00010000:00080000:1.2F:1787825716.488550:0:0:0:(ldlm_lib.c:3056:target_recovery_expired()) lustre-OST0000: recovery timed out; 0 clients are still in recovery after 70 seconds (2 clients connected) 00000100:00100000:3.0:1787826215.466310:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563548544 00000100:00100000:3.0:1787826215.466319:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563548544 00000100:00100000:3.0:1787826215.466387:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 896 00000100:00100000:3.0:1787826215.466397:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:44314:x1874670563548544:12345-192.168.203.39@tcp:35:lfs.0 00000040:00080000:3.0:1787826215.466699:0:14257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].16, 344 off50120 00000040:00080000:3.0:1787826215.466746:0:14257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x2:0x0].14, 424 off51504 00000004:00080000:3.0:1787826215.466753:0:14257:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff90ce057f6c00 with version 30 00000100:00100000:3.0:1787826215.475423:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:44314:x1874670563548544:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 9017us (9283us total) trans 4294967533 rc 0/0 00000100:00100000:3.0:1787826215.476094:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 896 00000100:00100000:3.0:1787826215.526027:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563549184 00000100:00100000:3.0:1787826215.526036:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563549184 00000100:00100000:3.0:1787826215.526092:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 325 00000100:00100000:3.0:1787826215.526100:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9af840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:2403:x1874670563549184:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826215.526114:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826215.526136:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46b800/0x22153cd396b7e307 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafc0f expref: 31 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826215.526153:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3:0x0].0x0 (ffff90cf06894600) 00010000:00010000:3.0:1787826215.526158:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826215.526711:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9af840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:2403:x1874670563549184:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 610us (2692us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826215.526720:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 325 00000100:00100000:3.0:1787826215.537612:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563549568 00000100:00100000:3.0:1787826215.537622:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563549568 00000100:00100000:3.0:1787826215.537672:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3055 00000100:00100000:3.0:1787826215.537681:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03739a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:44317:x1874670563549568:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826215.537704:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826215.537723:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b7e315 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aafc16 expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826215.537815:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b7e31c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826215.537829:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b7e31c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826215.537841:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b7e31c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826215.537852:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b7e323 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0xd6c8d217 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826215.537860:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b7e323 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826215.537868:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b7e323 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826215.537907:0:32404:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b7e31c lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826215.537914:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b7e31c lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826215.537920:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b7e31c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826215.537926:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b7e31c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826215.537932:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826215.537936:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b7e31c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826215.537943:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b7e31c lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826215.537954:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90cf36843500) 00010000:00010000:3.0:1787826215.537957:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826215.537962:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b7e31c lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826215.537968:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b7e31c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826215.537982:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b7e323 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826215.537988:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b7e323 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826215.537994:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b7e323 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826215.537998:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826215.538001:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b7e323 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826215.538006:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b7e323 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826215.538017:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0xd6c8d217 (ffff90cf1859ac00) 00010000:00010000:3.0:1787826215.538019:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826215.538022:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b7e323 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826215.538028:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b7e323 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826215.538062:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b7e315 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafc16 expref: 12 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826215.538073:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90cf36843500) 00010000:00010000:3.0:1787826215.538075:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826215.538079:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b7e315 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafc16 expref: 12 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826215.538088:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401a00, rc 0) 00000100:00100000:3.0:1787826215.538137:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03739a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:44317:x1874670563549568:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 456us (843us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826215.538145:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3055 00000100:00100000:3.0:1787826215.581643:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563550208 00000100:00100000:3.0:1787826215.581653:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563550208 00010000:00010000:3.0:1787826215.581693:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067200/0x22153cd396b7e33f lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafc1d expref: 15 pid: 8247 timeout: 1261 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826215.581734:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 844 00000100:00100000:3.0:1787826215.581748:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a18000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2404:x1874670563550208:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826215.581777:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826215.581784:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067200/0x22153cd396b7e33f lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafc1d expref: 15 pid: 8247 timeout: 1261 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826215.581797:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067200/0x22153cd396b7e33f lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafc1d expref: 15 pid: 8247 timeout: 1261 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826215.581819:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2:0x0].0x0 (ffff90cf1859a100) 00010000:00010000:3.0:1787826215.581826:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066c00/0x22153cd396b7e354 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826215.581835:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066c00/0x22153cd396b7e354 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826215.581843:0:10340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066c00/0x22153cd396b7e354 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826215.581863:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826215.581915:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a18000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2404:x1874670563550208:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 173us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826215.581922:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 844 00000100:00100000:3.0:1787826216.196537:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787826216.196559:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03aec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585063168:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826216.196697:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826216.197426:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03aec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585063168:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787826216.259724:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826217.220827:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585063936 00000100:00100000:3.0:1787826217.220832:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585063936 00000100:00100000:3.0:1787826217.222752:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 739 00000100:00100000:3.0:1787826217.222782:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049b83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874670585063936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826217.222866:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049b83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874670585063936:12345-0@lo:400:kworker.0 Request processed in 92us (2448us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826217.222873:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 739 00000100:00100000:3.0:1787826217.222912:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f8052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585063936:0@lo:400:kworker.0 00000100:00100000:3.0:1787826217.223271:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585064960 00000100:00100000:3.0:1787826217.223278:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585064960 00000100:00100000:3.0:1787826217.223320:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1194 00000100:00100000:3.0:1787826217.223326:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874670585064960:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787826217.223354:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446207488 avail 1299968000 00000100:00100000:3.0:1787826217.223387:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874670585064960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 61us (2092us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826217.223393:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1194 00010000:00010000:3.0:1787826218.308028:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787826218.760246:0:8544:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1164771773516ns, next at 1165771771044ns, rc = 0 00000100:00100000:3.0:1787826218.760744:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585065472 00000100:00100000:3.0:1787826218.760750:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585065472 00000100:00100000:3.0:1787826218.760785:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 637 00000100:00100000:3.0:1787826218.760793:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049bad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874670585065472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787826218.760808:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3920334848 avail 3688812544 00000100:00100000:3.0:1787826218.760848:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049bad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874670585065472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826218.760854:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 637 00000100:00100000:3.0:1787826219.159188:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563552000 00000100:00100000:3.0:1787826219.159196:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563552000 00000100:00100000:3.0:1787826219.159271:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 740 00000100:00100000:3.0:1787826219.159284:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049bbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2401:x1874670563552000:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1787826219.162242:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049bbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2401:x1874670563552000:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 2953us (3149us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826219.162253:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 740 00010000:00010000:3.0:1787826219.333069:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826220.358095:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826220.696335:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826220.696387:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826220.702559:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2404:x1874670563552256:12345-192.168.203.39@tcp:16:kworker.0 Request processed in 5901us (6165us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826220.702571:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1556 00000100:00100000:3.0:1787826220.807275:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f82c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585065728:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787826220.807369:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826220.807434:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787826220.807448:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f82f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585065856:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787826220.807529:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826220.807588:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585065728 00000100:00100000:3.0:1787826220.807596:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585065728 00000100:00100000:3.0:1787826220.807645:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585065984 00000100:00100000:3.0:1787826220.807649:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585065984 00000100:00100000:3.0:1787826220.807666:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585065856 00000100:00100000:3.0:1787826220.807669:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585065856 00000100:00100000:3.0:1787826220.807688:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1557 00000100:00100000:3.0:1787826220.807696:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3644:x1874670585065728:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787826220.809961:0:8435:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:200 count 1 00002000:00010000:3.0:1787826220.809992:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826220.809999:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e843828/0x22153cd396b7e3b6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.810011:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc8:0x0].0x0 since=1166s v=(0 0) 00010000:00010000:3.0:1787826220.810015:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826220.810020:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e843828/0x22153cd396b7e3b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.810032:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e843828/0x22153cd396b7e3b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.810041:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e843828/0x22153cd396b7e3b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.810050:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e843828/0x22153cd396b7e3b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.810066:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:3.0:1787826220.810164:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:3644:x1874670585065728:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2468us (2803us total) trans 21474836849 rc 0/0 00000100:00100000:3.0:1787826220.810172:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1557 00000100:00080000:3.0:1787826220.810204:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787826220.810208:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787826220.810215:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787826220.810222:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b1940442/0x22153cd396b7e3a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.810231:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0a067c00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826220.810235:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1940442/0x22153cd396b7e3a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.810245:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1940442/0x22153cd396b7e3a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.810260:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b1940442/0x22153cd396b7e3a1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.810267:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1940442/0x22153cd396b7e3a1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.810301:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787826220.810305:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a4b5afc1/0x22153cd396b7e3a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.810313:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46b000 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826220.810317:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4b5afc1/0x22153cd396b7e3a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.810325:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4b5afc1/0x22153cd396b7e3a8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.810335:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a4b5afc1/0x22153cd396b7e3a8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.810343:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4b5afc1/0x22153cd396b7e3a8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.810363:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826220.810367:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e843828/0x22153cd396b7e3b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.810374:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401a00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826220.810377:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e843828/0x22153cd396b7e3b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.810385:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e843828/0x22153cd396b7e3b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.810395:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e843828/0x22153cd396b7e3b6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.810402:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e843828/0x22153cd396b7e3b6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.810413:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826220.810415:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826220.810416:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826220.810446:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826220.810467:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3fb970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585066368:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787826220.810524:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826220.810562:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787826220.810568:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585066240:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787826220.810591:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826220.810615:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585066368 00000100:00100000:3.0:1787826220.810620:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585066368 00000100:00100000:3.0:1787826220.810641:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585066240 00000100:00100000:3.0:1787826220.810643:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585066240 00000100:00100000:3.0:1787826220.810658:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1562 00000100:00100000:3.0:1787826220.810665:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3645:x1874670585066368:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787826220.810686:0:8436:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:214 count 1 00002000:00010000:3.0:1787826220.810706:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826220.810711:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000482bb568/0x22153cd396b7e3bd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.810732:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd6:0x0].0x0 since=1166s v=(0 0) 00010000:00010000:3.0:1787826220.810735:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826220.810740:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000482bb568/0x22153cd396b7e3bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.810750:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000482bb568/0x22153cd396b7e3bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.810756:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000482bb568/0x22153cd396b7e3bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.810763:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000482bb568/0x22153cd396b7e3bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.810776:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787826220.810871:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3645:x1874670585066368:12345-0@lo:6:osp-syn-1-0.0 Request processed in 206us (344us total) trans 17179869533 rc 0/0 00000100:00100000:3.0:1787826220.810878:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1562 00000100:00100000:3.0:1787826220.810892:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1563 00000100:00100000:3.0:1787826220.810898:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3645:x1874670585066240:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787826220.810909:0:8436:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:213 count 1 00002000:00010000:3.0:1787826220.810924:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826220.810929:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc2068bb/0x22153cd396b7e3c4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.810936:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd5:0x0].0x0 since=1166s v=(0 0) 00010000:00010000:3.0:1787826220.810940:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826220.810943:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc2068bb/0x22153cd396b7e3c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.810951:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc2068bb/0x22153cd396b7e3c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.810959:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc2068bb/0x22153cd396b7e3c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.810965:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc2068bb/0x22153cd396b7e3c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.810977:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1787826220.811037:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3645:x1874670585066240:12345-0@lo:6:osp-syn-1-0.0 Request processed in 138us (444us total) trans 17179869534 rc 0/0 00000100:00100000:3.0:1787826220.811046:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1563 00010000:00010000:3.0:1787826220.811065:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787826220.811070:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000482bb568/0x22153cd396b7e3bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.811077:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400200 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826220.811080:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000482bb568/0x22153cd396b7e3bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.811089:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000482bb568/0x22153cd396b7e3bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.811101:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000482bb568/0x22153cd396b7e3bd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.811109:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000482bb568/0x22153cd396b7e3bd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.811124:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826220.811127:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc2068bb/0x22153cd396b7e3c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.811132:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400800 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826220.811135:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc2068bb/0x22153cd396b7e3c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.811147:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc2068bb/0x22153cd396b7e3c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.811156:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc2068bb/0x22153cd396b7e3c4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.811163:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc2068bb/0x22153cd396b7e3c4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.811176:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826220.811178:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826220.811179:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826220.811184:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787826220.811212:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce01fdf480/2, rc 0, transno 17179869534 00000100:00100000:3.0:1787826220.811218:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585066240:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1787826220.811227:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3fb970c0/2, rc 0, transno 17179869533 00000100:00100000:3.0:1787826220.811230:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3fb970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585066368:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1787826220.811251:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3f82f480/2, rc 0, transno 21474836848 00000100:00100000:3.0:1787826220.811256:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f82f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585065856:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1787826220.811264:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3f82c000/2, rc 0, transno 21474836849 00000100:00100000:3.0:1787826220.811267:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f82c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585065728:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1787826220.811294:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826220.815130:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826220.815144:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000951304c9/0x22153cd396b7e3cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.815158:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46b400 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826220.815163:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000951304c9/0x22153cd396b7e3cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.815174:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000951304c9/0x22153cd396b7e3cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.815196:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000951304c9/0x22153cd396b7e3cb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.815205:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000951304c9/0x22153cd396b7e3cb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.815232:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826220.815234:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826220.815236:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826220.827528:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3abc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585067008:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1787826220.827606:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826220.827645:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787826220.827652:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3abc0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585066880:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1787826220.827672:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826220.827704:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585067008 00000100:00100000:3.0:1787826220.827710:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585067008 00000100:00100000:3.0:1787826220.827863:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585066880 00000100:00100000:3.0:1787826220.827867:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585066880 00000100:00100000:3.0:1787826220.827888:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1564 00000100:00100000:3.0:1787826220.827897:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+6:3645:x1874670585067008:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1787826220.827923:0:30694:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:25 count 1 00002000:00010000:3.0:1787826220.828409:0:30694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826220.828418:0:30694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d612c5b/0x22153cd396b7e3d2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.828434:0:30694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=1166s v=(0 0) 00010000:00010000:3.0:1787826220.828439:0:30694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826220.828445:0:30694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d612c5b/0x22153cd396b7e3d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.828458:0:30694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d612c5b/0x22153cd396b7e3d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.828467:0:30694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d612c5b/0x22153cd396b7e3d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.828494:0:30694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d612c5b/0x22153cd396b7e3d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.828512:0:30694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787826220.828652:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+7:3645:x1874670585067008:12345-0@lo:6:osp-syn-0-1.0 Request processed in 755us (1045us total) trans 21474836850 rc 0/0 00000100:00100000:3.0:1787826220.828661:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1564 00000100:00100000:3.0:1787826220.828681:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1565 00000100:00100000:3.0:1787826220.828689:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+6:3645:x1874670585066880:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1787826220.828706:0:30694:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:24 count 1 00002000:00010000:3.0:1787826220.835788:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826220.835798:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd505040/0x22153cd396b7e3e0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.835814:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=1166s v=(0 0) 00010000:00010000:3.0:1787826220.835818:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826220.835824:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd505040/0x22153cd396b7e3e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.835836:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd505040/0x22153cd396b7e3e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.835845:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd505040/0x22153cd396b7e3e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.835852:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd505040/0x22153cd396b7e3e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.835879:0:14864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787826220.836042:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce058bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+9:3646:x1874670585066752:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6617us (7064us total) trans 21474836851 rc 0/0 00000100:00100000:3.0:1787826220.836052:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1567 00002000:00010000:3.0:1787826220.837462:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826220.837487:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008343e43a/0x22153cd396b7e3e7 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.837505:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x19:0x0].0x0 since=1166s v=(0 0) 00010000:00010000:3.0:1787826220.837510:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826220.837516:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008343e43a/0x22153cd396b7e3e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.837526:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008343e43a/0x22153cd396b7e3e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.837545:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008343e43a/0x22153cd396b7e3e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.837553:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008343e43a/0x22153cd396b7e3e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.837568:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1787826220.837684:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8043c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+8:3645:x1874670585067520:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6551us (6640us total) trans 17179869536 rc 0/0 00000100:00100000:3.0:1787826220.837692:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1568 00010000:00010000:3.0:1787826220.837716:0:7460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787826220.837722:0:7460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd505040/0x22153cd396b7e3e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.837730:0:7460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401800 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826220.837734:0:7460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd505040/0x22153cd396b7e3e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.837747:0:7460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd505040/0x22153cd396b7e3e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.837763:0:7460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd505040/0x22153cd396b7e3e0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.837772:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd505040/0x22153cd396b7e3e0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.837793:0:7460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826220.837796:0:7460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008343e43a/0x22153cd396b7e3e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.837802:0:7460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401000 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826220.837805:0:7460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008343e43a/0x22153cd396b7e3e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.837813:0:7460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008343e43a/0x22153cd396b7e3e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.837824:0:7460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008343e43a/0x22153cd396b7e3e7 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.837831:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008343e43a/0x22153cd396b7e3e7 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826220.837848:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826220.837850:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826220.837852:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787826220.837876:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3f806580/2, rc 0, transno 17179869536 00000100:00100000:3.0:1787826220.837881:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f806580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585067520:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1787826220.841400:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787826220.841425:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3abc0780/2, rc 0, transno 21474836852 00000100:00100000:3.0:1787826220.841431:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3abc0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585066880:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1787826221.316510:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce058bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585067648:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826221.316594:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787826221.382728:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826222.342248:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585068288 00000100:00100000:3.0:1787826222.342252:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585068288 00000100:00100000:3.0:1787826222.342281:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1197 00000100:00100000:3.0:1787826222.342287:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce058bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874670585068288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826222.342324:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce058bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874670585068288:12345-0@lo:400:kworker.0 Request processed in 37us (1225us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826222.342330:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1197 00000100:00100000:3.0:1787826222.342610:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f88c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585068288:0@lo:400:kworker.0 00000100:00100000:3.0:1787826222.342620:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787826222.342630:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3abc1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585069440:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787826222.342657:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787826222.403837:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826223.876422:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f806940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585069568:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826223.876577:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826223.887050:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787826223.887067:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3abc3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585069952:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787826223.887125:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826223.889520:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3abc3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585069952:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787826223.897447:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf136ce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585069824:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787826223.898371:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f806940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585069568:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826224.271449:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826224.271799:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826224.271845:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826224.271907:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826224.271961:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826224.272006:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563552896 00000100:00100000:3.0:1787826224.272016:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563552896 00000100:00100000:3.0:1787826224.272083:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1328 00000100:00100000:3.0:1787826224.272100:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2401:x1874670563552896:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1787826224.277631:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2401:x1874670563552896:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 5526us (5742us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826224.277645:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1328 00010000:00010000:3.0:1787826225.475781:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826226.436122:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf136cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585070080:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826226.436224:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826226.436964:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf136cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585070080:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787826226.499814:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787826226.950453:0:26205:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836854 is committed 00000001:00080000:3.0:1787826226.950507:0:26205:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836853 is committed 00000020:00080000:3.0:1787826226.957151:0:7472:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 19 00000004:00080000:3.0:1787826226.957239:0:7472:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff90cf3f7d86c0 with version 31 00000020:00080000:3.0:1787826226.957261:0:7472:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 19 cancel update log [0x200000401:0x2:0x0].14: rc = 0 00000020:00080000:3.0:1787826226.957366:0:7472:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 19 cancel update log [0x240000400:0x2:0x0].16: rc = 0 00000020:00080000:3.0:1787826226.957377:0:7472:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 19 00000100:00100000:3.0:1787826227.465137:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a8afc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585070592:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787826227.465288:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826227.477162:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787826227.477200:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f806940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874670585070720:0@lo:400:kworker.0 00000100:00100000:3.0:1787826227.478874:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826227.489763:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585071232 00000100:00100000:3.0:1787826227.489777:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585071232 00000100:00100000:3.0:1787826227.489882:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585071104 00000100:00100000:3.0:1787826227.489886:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585071104 00000100:00100000:3.0:1787826227.489913:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585071360 00000100:00100000:3.0:1787826227.489917:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585071360 00000100:00100000:3.0:1787826227.489939:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585071488 00000100:00100000:3.0:1787826227.489943:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585071488 00000100:00100000:3.0:1787826227.489969:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 748 00000100:00100000:3.0:1787826227.489980:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136d7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3647:x1874670585071232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826227.490088:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136d7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3647:x1874670585071232:12345-0@lo:400:kworker.0 Request processed in 110us (5784us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826227.490096:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 748 00000100:00100000:3.0:1787826227.490115:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 749 00000100:00100000:3.0:1787826227.490122:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f070c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3647:x1874670585071104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826227.490151:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f070c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3647:x1874670585071104:12345-0@lo:400:kworker.0 Request processed in 30us (5717us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826227.490158:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 749 00000100:00100000:3.0:1787826227.490169:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 750 00000100:00100000:3.0:1787826227.490175:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3644:x1874670585071360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826227.490211:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3644:x1874670585071360:12345-0@lo:400:kworker.0 Request processed in 37us (5565us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826227.490217:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 750 00000100:00100000:3.0:1787826227.490230:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 751 00000100:00100000:3.0:1787826227.490236:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f88e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3645:x1874670585071488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826227.490270:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f88e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3645:x1874670585071488:12345-0@lo:400:kworker.0 Request processed in 35us (4354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826227.490276:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 751 00000100:00100000:3.0:1787826227.490304:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585071872 00000100:00100000:3.0:1787826227.490560:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585071872 00000100:00100000:3.0:1787826227.490603:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585072000 00000100:00100000:3.0:1787826227.490606:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585072000 00000100:00100000:3.0:1787826227.490634:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1333 00000100:00100000:3.0:1787826227.490639:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f88cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874670585071872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826227.490677:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f88cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874670585071872:12345-0@lo:400:kworker.0 Request processed in 38us (4822us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826227.490683:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1333 00000100:00100000:3.0:1787826227.490695:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1334 00000100:00100000:3.0:1787826227.490701:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f88e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874670585072000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826227.490730:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f88e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874670585072000:12345-0@lo:400:kworker.0 Request processed in 29us (2052us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826227.490736:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1334 00000100:00080000:3.0:1787826227.490778:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787826227.490841:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787826227.490844:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787826227.490846:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826227.490885:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869535 gen 2 00000004:00080000:3.0:1787826227.490892:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3fb970c0, transno 17179869533 00000004:00080000:3.0:1787826227.490904:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce01fdf480, transno 17179869534 00000004:00080000:3.0:1787826227.490908:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce01fdcb40, transno 17179869535 00000100:00100000:3.0:1787826227.490917:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0373e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585071488:0@lo:400:kworker.0 00000100:00100000:3.0:1787826227.490937:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf136d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874670585072000:0@lo:400:kworker.0 00000004:00080000:3.0:1787826227.491105:0:9969:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 3 done 00000100:00100000:3.0:1787826227.491162:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 21474836853 gen 2 00000004:00080000:3.0:1787826227.491167:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3abc0000, transno 21474836850 00000004:00080000:3.0:1787826227.491178:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3abc30c0, transno 21474836851 00000004:00080000:3.0:1787826227.491180:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3abc0780, transno 21474836852 00000004:00080000:3.0:1787826227.491183:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3abc12c0, transno 21474836853 00000100:00100000:3.0:1787826227.491188:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a9af0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585071104:0@lo:400:kworker.0 00000004:00080000:3.0:1787826227.491264:0:8538:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0001: 0 changes, 0 in progress, 0 in flight, 4 done 00000100:00100000:3.0:1787826227.491286:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836854 gen 2 00000004:00080000:3.0:1787826227.491290:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3f82e940, transno 21474836847 00000004:00080000:3.0:1787826227.491300:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3f82f480, transno 21474836848 00000004:00080000:3.0:1787826227.491302:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3f82c000, transno 21474836849 00000004:00080000:3.0:1787826227.491305:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3f82fc00, transno 21474836854 00000100:00100000:3.0:1787826227.491310:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a9af840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585071232:0@lo:400:kworker.0 00000004:00080000:3.0:1787826227.492876:0:8543:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 4 done 00000004:00080000:3.0:1787826227.492975:0:9964:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 0 changes, 0 in progress, 0 in flight, 3 done 00000100:00100000:3.0:1787826228.996002:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787826228.996036:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a8fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585072128:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787826228.996133:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826228.997792:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585072256 00000100:00100000:3.0:1787826228.997799:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585072256 00000100:00100000:3.0:1787826228.997847:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 643 00000100:00100000:3.0:1787826228.997856:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03986d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874670585072256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787826228.997881:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3922436096 avail 3690913792 00000100:00100000:3.0:1787826228.997925:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03986d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874670585072256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826228.997932:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 643 00000100:00100000:3.0:1787826228.999087:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f88f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585072512:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787826228.999123:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826229.001870:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f88f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585072512:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1787826229.572059:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826231.556675:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787826231.556697:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f88c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585072640:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826231.556764:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826231.559419:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f88c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585072640:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826232.582443:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585074432 00000100:00100000:3.0:1787826232.582448:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585074432 00000100:00100000:3.0:1787826232.582508:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1206 00000100:00100000:3.0:1787826232.582515:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03984780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874670585074432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787826232.582538:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446207488 avail 1299968000 00000100:00100000:3.0:1787826232.582571:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03984780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874670585074432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 57us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826232.582580:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1206 00010000:00010000:3.0:1787826233.669622:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826234.116291:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787826234.116308:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a8fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585074688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787826234.122915:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826234.123017:0:25628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585074688 00000100:00100000:3.0:1787826234.123025:0:25628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585074688 00000100:00100000:3.0:1787826234.123097:0:25628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 646 00000100:00100000:3.0:1787826234.123108:0:25628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874670585074688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787826234.124643:0:25628:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3922436096 avail 3690913792 00000100:00100000:3.0:1787826234.124729:0:25628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874670585074688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1622us (1812us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826234.124738:0:25628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 646 00000100:00100000:3.0:1787826234.124811:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a8fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585074688:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1787826234.124868:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826234.518963:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563554560 00000100:00100000:3.0:1787826234.518978:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563554560 00000100:00100000:3.0:1787826234.519063:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1343 00000100:00100000:3.0:1787826234.519073:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f827840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2403:x1874670563554560:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1787826234.524712:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f827840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2403:x1874670563554560:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 5628us (10572us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826234.524727:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1343 00000100:00100000:3.0:1787826236.676566:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585075072 00000100:00100000:3.0:1787826236.676576:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585075072 00000100:00100000:3.0:1787826236.676641:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1207 00000100:00100000:3.0:1787826236.676653:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03986940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1874670585075072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787826236.676700:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445924864 avail 1299685376 00000100:00100000:3.0:1787826236.676761:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03986940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1874670585075072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826236.676769:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1207 00010000:00010000:3.0:1787826236.741907:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826237.699969:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787826237.699990:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f82c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585075200:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787826237.700067:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826237.700130:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585075200 00000100:00100000:3.0:1787826237.700148:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585075200 00000100:00100000:3.0:1787826237.700195:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1208 00000100:00100000:3.0:1787826237.700204:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874670585075200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787826237.700240:0:7796:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446207488 avail 1299968000 00000100:00100000:3.0:1787826237.700284:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874670585075200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826237.700292:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1208 00000100:00100000:3.0:1787826237.700364:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f82c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585075200:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787826237.770843:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826239.235906:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03b90780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585076864:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787826239.235978:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826239.236243:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585076864 00000100:00100000:3.0:1787826239.236250:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585076864 00000100:00100000:3.0:1787826239.236312:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585076992 00000100:00100000:3.0:1787826239.236315:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585076992 00000100:00100000:3.0:1787826239.236337:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 650 00000100:00100000:3.0:1787826239.236347:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874670585076864:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787826239.236377:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3920334848 avail 3688812544 00000100:00100000:3.0:1787826239.236432:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874670585076864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826239.236438:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 650 00000100:00100000:3.0:1787826239.236456:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 651 00000100:00100000:3.0:1787826239.236462:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9883c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874670585076992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787826239.236498:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3922436096 avail 3690913792 00000100:00100000:3.0:1787826239.236527:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9883c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874670585076992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826239.236534:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 651 00000100:00100000:3.0:1787826239.236575:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03b90780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585076864:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787826239.238512:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787826239.238525:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f82f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585077248:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787826239.238552:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826239.246502:0:12021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 652 00000100:00100000:3.0:1787826239.246516:0:12021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8261c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874670585077120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787826239.246541:0:12021:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3922436096 avail 3690913792 00000100:00100000:3.0:1787826239.246631:0:12021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8261c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874670585077120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 119us (8135us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826239.246638:0:12021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 652 00000100:00100000:3.0:1787826239.246693:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a988000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585077120:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1787826240.836007:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787826241.695304:0:33254:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 46: Verify setstripe --copy option ==== 06:24:01 (1787826241) 00000100:00100000:3.0:1787826241.790188:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563555584 00000100:00100000:3.0:1787826241.790202:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563555584 00000100:00100000:3.0:1787826241.790305:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3063 00000100:00100000:3.0:1787826241.790318:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:46302:x1874670563555584:12345-192.168.203.39@tcp:41:stat.0 00000004:00000024:3.0:1787826241.790403:0:8247:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 7842770944 avail 7379726336 00000100:00100000:3.0:1787826241.790514:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:46302:x1874670563555584:12345-192.168.203.39@tcp:41:stat.0 Request processed in 198us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826241.790523:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3063 00000100:00100000:3.0:1787826241.835097:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826241.855437:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585077632 00000100:00100000:3.0:1787826241.855447:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585077632 00000100:00100000:3.0:1787826241.855560:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1211 00000100:00100000:3.0:1787826241.855573:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7793:x1874670585077632:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826241.856246:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7793:x1874670585077632:12345-0@lo:1000:osp_up1-0.0 Request processed in 673us (947us total) trans 4294967539 rc 0/0 00000100:00100000:3.0:1787826241.856257:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1211 00010000:00010000:3.0:1787826241.857021:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b7e450 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826241.857042:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b7e450 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826241.857056:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b7e450 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826241.857079:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b7e457 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826241.857087:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b7e457 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826241.857104:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b7e457 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826241.857148:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf2f400800/0x22153cd396b7e45e lrc: 3/0,1 mode: --/PW res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826241.857156:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf2f400800/0x22153cd396b7e45e lrc: 3/0,1 mode: --/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826241.857167:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf2f400800/0x22153cd396b7e45e lrc: 3/0,1 mode: --/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826241.857185:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f82c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6519:1874670585077760:0@lo:101:mdt00_001.0 00000100:00100000:3.0:1787826241.857229:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826241.857273:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce024a3780 going to sleep for 11 seconds 00000100:00100000:3.0:1787826241.857777:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f82c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6519:1874670585077760:0@lo:101:mdt00_001.0 00010000:00010000:3.0:1787826241.857792:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf2f400800/0x22153cd396b7e45e lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x22153cd396b7e465 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826241.857802:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf2f400800/0x22153cd396b7e45e lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x22153cd396b7e465 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826241.857825:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a3b2d045 reply state 00000000c2a310bb transno 4294969179 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b7e457 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826241.857837:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b7e457 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826241.857844:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0x0 (ffff90cf421ecb00) 00010000:00010000:3.0:1787826241.857847:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826241.857850:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787826241.857856:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf2f400800/0x22153cd396b7e45e lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x22153cd396b7e465 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826241.857864:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf2f400800/0x22153cd396b7e45e lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x22153cd396b7e465 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787826241.857876:0:6519:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x8:0x0] 00000004:00010000:3.0:1787826241.857885:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a3b2d045 reply state 00000000c2a310bb transno 4294969179 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b7e450 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826241.857892:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b7e450 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826241.857898:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3:0x0].0x0 (ffff90cf421ec200) 00010000:00010000:3.0:1787826241.857900:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826241.857902:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:3.0:1787826241.857908:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1787826241.857919:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026aea00/0x22153cd396b7e442 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826241.857927:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026aea00/0x22153cd396b7e442 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826241.857932:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026aea00/0x22153cd396b7e442 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826241.857939:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026aea00/0x22153cd396b7e442 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826241.857946:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce026aea00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826241.857951:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026aea00/0x22153cd396b7e442 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826241.857960:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026aea00/0x22153cd396b7e442 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826241.857971:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cf39656000) 00010000:00010000:3.0:1787826241.857973:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826241.857978:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026aea00/0x22153cd396b7e442 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826241.857983:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026aea00/0x22153cd396b7e442 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826241.857997:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a3b2d045 reply state 00000000c2a310bb transno 4294969179 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026afc00/0x22153cd396b7e449 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x237edbbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826241.858006:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026afc00/0x22153cd396b7e449 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x237edbbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826241.858011:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x237edbbc (ffff90cf39e67900) 00010000:00010000:3.0:1787826241.858013:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826241.858015:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:3.0:1787826241.858107:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03987480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:46308:x1874670563555968:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 12132us (12510us total) trans 4294969179 rc 0/0 00000100:00100000:3.0:1787826241.858114:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3065 00010000:00010000:3.0:1787826241.860046:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826241.922139:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563556352 00000100:00100000:3.0:1787826241.922151:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563556352 00000100:00100000:3.0:1787826241.922222:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3068 00000100:00100000:3.0:1787826241.922234:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03afc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:46312:x1874670563556352:12345-192.168.203.39@tcp:101:rm.0 00010000:00010000:3.0:1787826241.922258:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826241.922771:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b7e496 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aafc55 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826241.922898:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b7e49d lrc: 3/1,0 mode: --/PR res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826241.922915:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b7e49d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826241.922929:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b7e49d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826241.922989:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0x8:0x0]: returning size 4096 00000004:00200000:3.0:1787826241.922995:0:16564:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1787826241.923034:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b7e496 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafc55 expref: 13 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826241.923056:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b7e49d lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafc55 expref: 12 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826241.923066:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0x0 (ffff90cf421ecb00) 00010000:00010000:3.0:1787826241.923069:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787826241.923073:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401a00, rc 0) 00000100:00100000:3.0:1787826241.923331:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03afc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:46312:x1874670563556352:12345-192.168.203.39@tcp:101:rm.0 Request processed in 1098us (1316us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826241.923340:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3068 00000100:00100000:3.0:1787826241.936537:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826241.943856:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563556480 00000100:00100000:3.0:1787826241.943887:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563556480 00000100:00100000:3.0:1787826241.943986:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3069 00000100:00100000:3.0:1787826241.944000:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:46312:x1874670563556480:12345-192.168.203.39@tcp:101:rm.0 00010000:00010000:3.0:1787826241.944028:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826241.944058:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400200/0x22153cd396b7e4a4 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aafc5c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826241.944165:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400000/0x22153cd396b7e4ab lrc: 3/1,0 mode: --/PR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826241.944184:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce026af000/0x22153cd396b7e465 lrc: 2/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x22153cd396b7e45e expref: 6 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826241.944196:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400000/0x22153cd396b7e4ab lrc: 4/1,0 mode: --/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826241.944245:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff90ce026af000/0x22153cd396b7e465 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x22153cd396b7e45e expref: 6 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826241.944264:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f82cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6519:1874670585077888:0@lo:104: 00000100:00100000:3.0:1787826241.944353:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826241.944426:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce024a3780 going to sleep for 11 seconds 00000100:00080000:3.0:1787826241.944447:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787826241.944460:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585077888 00000100:00100000:3.0:1787826241.944464:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585077888 00000100:00100000:3.0:1787826241.944520:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787826241.944527:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6519:x1874670585077888:12345-0@lo:104: 00010000:00010000:3.0:1787826241.944543:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf2f400800/0x22153cd396b7e45e lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x22153cd396b7e465 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826241.944600:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787826241.944607:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6519:x1874670585077888:12345-0@lo:104: Request processed in 81us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826241.944615:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00010000:3.0:1787826241.944649:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826241.944656:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf2f400800/0x22153cd396b7e45e lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x22153cd396b7e465 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826241.944665:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400800 already unused, calling callback (ffffffffc18ffee0) 00010000:00010000:3.0:1787826241.944672:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf2f400800/0x22153cd396b7e45e lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x22153cd396b7e465 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826241.944681:0:6506:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf2f400800/0x22153cd396b7e45e lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x22153cd396b7e465 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826241.944716:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf2f400800/0x22153cd396b7e45e lrc: 2/0,0 mode: --/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x22153cd396b7e465 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826241.944722:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787826241.944748:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf2f400800/0x22153cd396b7e45e lrc: 1/0,0 mode: --/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x22153cd396b7e465 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826241.944756:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf2f400800/0x22153cd396b7e45e lrc: 0/0,0 mode: --/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x22153cd396b7e465 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826241.944777:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826241.944779:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826241.944781:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826241.944794:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03b90780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585078016:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787826241.944828:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826241.944870:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585078016 00000100:00100000:3.0:1787826241.944874:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585078016 00010000:00010000:3.0:1787826241.944893:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce026af000/0x22153cd396b7e465 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x22153cd396b7e45e expref: 7 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826241.944918:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 847 00000100:00100000:3.0:1787826241.944926:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8fa580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+7:3644:x1874670585078016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787826241.944939:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826241.962999:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce026af000/0x22153cd396b7e465 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x22153cd396b7e45e expref: 6 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826241.963022:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff90cf39e67700) 00010000:00010000:3.0:1787826241.963028:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400000/0x22153cd396b7e4ab lrc: 3/1,0 mode: --/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826241.963039:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400000/0x22153cd396b7e4ab lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826241.963048:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400000/0x22153cd396b7e4ab lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826241.963096:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826241.964772:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8fa580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874670585078016:12345-0@lo:103:ldlm_bl.0 Request processed in 19836us (19930us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826241.964789:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 847 00000100:00100000:3.0:1787826241.969935:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563556608 00000100:00100000:3.0:1787826241.969951:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563556608 00000100:00100000:3.0:1787826241.970027:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3070 00000100:00100000:3.0:1787826241.970037:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:46312:x1874670563556608:12345-192.168.203.39@tcp:101:rm.0 00010000:00010000:3.0:1787826241.970057:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826241.970080:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400800/0x22153cd396b7e4b2 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aafc63 expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826241.970148:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b7e4b9 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826241.970161:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b7e4b9 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826241.970172:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b7e4b9 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826241.971626:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401c00/0x22153cd396b7e4c0 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826241.971648:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401c00/0x22153cd396b7e4c0 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826241.971660:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401c00/0x22153cd396b7e4c0 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826241.971725:0:8247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b7e4b9 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826241.971734:0:8247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b7e4b9 lrc: 2/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826241.971740:0:8247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b7e4b9 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826241.971747:0:8247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401e00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826241.971752:0:8247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b7e4b9 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826241.971765:0:8247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b7e4b9 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826241.971778:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff90cf39e67700) 00010000:00010000:3.0:1787826241.971782:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826241.971786:0:8247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b7e4b9 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826241.971792:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b7e4b9 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826241.971807:0:8247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401c00/0x22153cd396b7e4c0 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826241.971812:0:8247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401c00/0x22153cd396b7e4c0 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826241.971818:0:8247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401c00/0x22153cd396b7e4c0 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826241.971822:0:8247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826241.971825:0:8247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401c00/0x22153cd396b7e4c0 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826241.971830:0:8247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401c00/0x22153cd396b7e4c0 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826241.971836:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0xeb4e88c0 (ffff90cf13641900) 00010000:00010000:3.0:1787826241.971839:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826241.971841:0:8247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401c00/0x22153cd396b7e4c0 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826241.971850:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401c00/0x22153cd396b7e4c0 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826241.971892:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400800/0x22153cd396b7e4b2 lrc: 1/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafc63 expref: 16 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826241.971903:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff90cf39e67700) 00010000:00010000:3.0:1787826241.971905:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826241.971908:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400800/0x22153cd396b7e4b2 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafc63 expref: 16 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826241.971919:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400800, rc 0) 00000100:00100000:3.0:1787826241.971995:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:46312:x1874670563556608:12345-192.168.203.39@tcp:101:rm.0 Request processed in 1958us (3668us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826241.972003:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3070 00000100:00100000:3.0:1787826242.015417:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563557120 00000100:00100000:3.0:1787826242.015430:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563557120 00000100:00100000:3.0:1787826242.021512:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563557248 00000100:00100000:3.0:1787826242.021522:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563557248 00010000:00010000:3.0:1787826242.021557:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46bc00/0x22153cd396b7e4dc lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafc6a expref: 19 pid: 32404 timeout: 1288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826242.021604:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 848 00000100:00100000:3.0:1787826242.021615:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b432580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:2403:x1874670563557248:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826242.021631:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826242.021639:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46bc00/0x22153cd396b7e4dc lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafc6a expref: 19 pid: 32404 timeout: 1288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.021657:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46bc00/0x22153cd396b7e4dc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafc6a expref: 19 pid: 32404 timeout: 1288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.021679:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46bc00/0x22153cd396b7e4dc lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafc6a expref: 19 pid: 32404 timeout: 1288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.021696:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff90cf39656800) 00010000:00010000:3.0:1787826242.021702:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff90ce0a067200/0x22153cd396b7e4f1 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.021712:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce0a067200/0x22153cd396b7e4f1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.021721:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce0a067200/0x22153cd396b7e4f1 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.021755:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826242.021819:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b432580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+18:2403:x1874670563557248:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 205us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826242.021827:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 848 00000100:00100000:3.0:1787826242.044467:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563557888 00000100:00100000:3.0:1787826242.044969:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563557888 00000100:00100000:3.0:1787826242.067431:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563558144 00000100:00100000:3.0:1787826242.067445:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563558144 00000100:00100000:3.0:1787826242.067600:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3074 00000100:00100000:3.0:1787826242.067613:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce038903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:46315:x1874670563558144:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826242.067644:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826242.067696:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401c00/0x22153cd396b7e514 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aafc7f expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.067798:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b7e51b lrc: 3/1,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.067816:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b7e51b lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.067829:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b7e51b lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.067843:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400600/0x22153cd396b7e522 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.067851:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400600/0x22153cd396b7e522 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.067859:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400600/0x22153cd396b7e522 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.068016:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400400/0x22153cd396b7e529 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.068025:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400400/0x22153cd396b7e529 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.068032:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400400/0x22153cd396b7e529 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826242.068042:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0x5:0x0]: returning size 0 00010000:00010000:3.0:1787826242.068138:0:8247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b7e51b lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.068147:0:8247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b7e51b lrc: 2/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.068155:0:8247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b7e51b lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.068162:0:8247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401e00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826242.068167:0:8247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b7e51b lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.068176:0:8247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b7e51b lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.068190:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff90cf13641900) 00010000:00010000:3.0:1787826242.068194:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826242.068199:0:8247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b7e51b lrc: 2/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.068207:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b7e51b lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.068222:0:8247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400600/0x22153cd396b7e522 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.068228:0:8247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400600/0x22153cd396b7e522 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.068234:0:8247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400600/0x22153cd396b7e522 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.068240:0:8247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826242.068242:0:8247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400600/0x22153cd396b7e522 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.068253:0:8247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400600/0x22153cd396b7e522 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.068261:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0xeb4e88c0 (ffff90cf39656300) 00010000:00010000:3.0:1787826242.068263:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826242.068279:0:8247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400600/0x22153cd396b7e522 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.068285:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400600/0x22153cd396b7e522 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.068329:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401c00/0x22153cd396b7e514 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafc7f expref: 22 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.068351:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400400/0x22153cd396b7e529 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafc7f expref: 21 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.068359:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff90cf13641400) 00010000:00010000:3.0:1787826242.068362:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826242.068364:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400400, rc 0) 00000100:00100000:3.0:1787826242.068460:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce038903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:46315:x1874670563558144:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 849us (1244us total) trans 4294967544 rc 0/0 00000100:00100000:3.0:1787826242.068524:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3074 00000100:00100000:3.0:1787826242.084185:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00080000:3.0:1787826242.084753:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826242.116269:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826242.132153:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563559168 00000100:00100000:3.0:1787826242.132162:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563559168 00010000:00010000:3.0:1787826242.132216:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b7e553 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafc8d expref: 16 pid: 32404 timeout: 1288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826242.132311:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 849 00000100:00100000:3.0:1787826242.132323:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03893840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2401:x1874670563559168:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826242.132342:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826242.132351:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b7e553 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafc8d expref: 16 pid: 32404 timeout: 1288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.132364:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b7e553 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafc8d expref: 16 pid: 32404 timeout: 1288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.132559:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b7e553 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafc8d expref: 16 pid: 32404 timeout: 1288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.132577:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x4:0x0].0x0 (ffff90cf39656500) 00010000:00010000:3.0:1787826242.132582:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b800/0x22153cd396b7e568 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.132594:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b800/0x22153cd396b7e568 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.132602:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b800/0x22153cd396b7e568 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.132705:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826242.132858:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03893840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2401:x1874670563559168:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 535us (1516us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826242.132868:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 849 00000100:00100000:3.0:1787826242.229493:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563560064 00000100:00100000:3.0:1787826242.229506:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563560064 00000100:00100000:3.0:1787826242.229584:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3078 00000100:00100000:3.0:1787826242.229596:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f80a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:46318:x1874670563560064:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:3.0:1787826242.229708:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400800/0x22153cd396b7e584 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.229729:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400800/0x22153cd396b7e584 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.229743:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400800/0x22153cd396b7e584 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.229757:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401c00/0x22153cd396b7e58b lrc: 3/1,0 mode: --/PR res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.229765:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401c00/0x22153cd396b7e58b lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.229771:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401c00/0x22153cd396b7e58b lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.229872:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400600/0x22153cd396b7e592 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.229881:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400600/0x22153cd396b7e592 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.229888:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400600/0x22153cd396b7e592 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826242.230050:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0x5:0x0]: returning size 0 00000004:00200000:3.0:1787826242.230056:0:8247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826242.230071:0:8247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400600/0x22153cd396b7e592 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.230086:0:8247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400800/0x22153cd396b7e584 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.230092:0:8247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400800/0x22153cd396b7e584 lrc: 2/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.230097:0:8247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400800/0x22153cd396b7e584 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.230103:0:8247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826242.230107:0:8247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400800/0x22153cd396b7e584 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.230114:0:8247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400800/0x22153cd396b7e584 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.230129:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff90cf13641900) 00010000:00010000:3.0:1787826242.230131:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826242.230137:0:8247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400800/0x22153cd396b7e584 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.230142:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400800/0x22153cd396b7e584 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.230161:0:8247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401c00/0x22153cd396b7e58b lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.230166:0:8247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401c00/0x22153cd396b7e58b lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.230176:0:8247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401c00/0x22153cd396b7e58b lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.230180:0:8247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826242.230183:0:8247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401c00/0x22153cd396b7e58b lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.230188:0:8247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401c00/0x22153cd396b7e58b lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.230195:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0xeb4e88c0 (ffff90cf39656300) 00010000:00010000:3.0:1787826242.230198:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826242.230201:0:8247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401c00/0x22153cd396b7e58b lrc: 2/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.230206:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401c00/0x22153cd396b7e58b lrc: 0/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.230215:0:8247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400600/0x22153cd396b7e592 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.230222:0:8247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400600/0x22153cd396b7e592 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.230228:0:8247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400600/0x22153cd396b7e592 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.230233:0:8247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826242.230235:0:8247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400600/0x22153cd396b7e592 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.230245:0:8247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400600/0x22153cd396b7e592 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.230252:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff90cf13641400) 00010000:00010000:3.0:1787826242.230254:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826242.230257:0:8247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400600/0x22153cd396b7e592 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826242.230262:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400600/0x22153cd396b7e592 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826242.230467:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f80a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:46318:x1874670563560064:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 871us (1202us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826242.230537:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3078 00000100:00080000:3.0:1787826242.821348:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787826242.821356:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787826242.821371:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585078912 00000100:00100000:3.0:1787826242.821376:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585078912 00000100:00100000:3.0:1787826242.821427:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585080064 00000100:00100000:3.0:1787826242.821434:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585080064 00000100:00100000:3.0:1787826242.821458:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585078656 00000100:00100000:3.0:1787826242.821463:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585078656 00000100:00100000:3.0:1787826242.821501:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585079680 00000100:00100000:3.0:1787826242.821504:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585079680 00000100:00100000:3.0:1787826242.821519:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585079936 00000100:00100000:3.0:1787826242.821521:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585079936 00000100:00100000:3.0:1787826242.821537:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1353 00000100:00100000:3.0:1787826242.821545:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874670585078912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826242.821617:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874670585078912:12345-0@lo:400:kworker.0 Request processed in 71us (948us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826242.821629:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1353 00000100:00100000:3.0:1787826242.821651:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1354 00000100:00100000:3.0:1787826242.821662:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049b9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874670585080064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826242.822002:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049b9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874670585080064:12345-0@lo:400:kworker.0 Request processed in 341us (1208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826242.822014:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1354 00000100:00100000:3.0:1787826242.822036:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1355 00000100:00100000:3.0:1787826242.822047:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049bbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874670585078656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826242.822095:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049bbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874670585078656:12345-0@lo:400:kworker.0 Request processed in 50us (1244us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826242.822108:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1355 00000100:00100000:3.0:1787826242.822127:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1356 00000100:00100000:3.0:1787826242.822139:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1366a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874670585079680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826242.822181:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1366a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874670585079680:12345-0@lo:400:kworker.0 Request processed in 46us (1174us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826242.822189:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1356 00000100:00100000:3.0:1787826242.822207:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1357 00000100:00100000:3.0:1787826242.822217:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874670585079936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826242.822250:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874670585079936:12345-0@lo:400:kworker.0 Request processed in 36us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826242.822259:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1357 00000100:00080000:3.0:1787826242.822281:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787826242.822287:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787826242.822290:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787826242.822293:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826242.822337:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03bdda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874670585078656:0@lo:400:kworker.0 00000100:00100000:3.0:1787826242.822353:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03bdd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585079168:0@lo:400:kworker.0 00000100:00100000:3.0:1787826242.822368:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f8c3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874670585079680:0@lo:400:kworker.0 00000100:00100000:3.0:1787826242.822396:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f8c03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585079552:0@lo:400:kworker.0 00000100:00100000:3.0:1787826242.822414:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce044d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1874670585080064:0@lo:400:kworker.0 00000100:00100000:3.0:1787826242.822507:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1215 00000100:00100000:3.0:1787826242.822515:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03aec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874670585079040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826242.827236:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03aec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874670585079040:12345-0@lo:400:kworker.0 Request processed in 4709us (6526us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826242.828948:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1215 00010000:00010000:3.0:1787826243.907870:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826244.357547:0:25628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585080320 00000100:00100000:3.0:1787826244.357554:0:25628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585080320 00000100:00100000:3.0:1787826244.357615:0:25628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 655 00000100:00100000:3.0:1787826244.357625:0:25628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa85a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874670585080320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787826244.357656:0:25628:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3920334848 avail 3688812544 00000100:00100000:3.0:1787826244.357717:0:25628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa85a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874670585080320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826244.357728:0:25628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 655 00000100:00100000:3.0:1787826244.357891:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787826244.357904:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a988000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585080448:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826244.357937:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826244.361396:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce058bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585080576:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787826244.367037:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a988000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585080448:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826244.759212:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1360 00000100:00100000:3.0:1787826244.759224:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf07966580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+18:2404:x1874670563560576:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1787826244.759285:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf07966580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+18:2404:x1874670563560576:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 64us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826244.759293:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1360 00010000:00010000:3.0:1787826244.932706:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826245.956529:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826247.468801:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826247.479064:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826247.487613:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000020:00080000:3.0:1787826247.489649:0:6550:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 46 committed batchid 45 00000020:00080000:3.0:1787826247.489715:0:6550:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 45 00000100:00100000:3.0:1787826247.498960:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826247.941535:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585081344 00000100:00100000:3.0:1787826247.941539:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585081344 00000100:00100000:3.0:1787826247.941563:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585081088 00000100:00100000:3.0:1787826247.941565:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585081088 00000100:00100000:3.0:1787826247.941576:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1217 00000100:00100000:3.0:1787826247.941582:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f7f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874670585081344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826247.941620:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f7f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874670585081344:12345-0@lo:400:kworker.0 Request processed in 38us (1438us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826247.941625:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1217 00000100:00100000:3.0:1787826247.941636:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1218 00000100:00100000:3.0:1787826247.941642:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f7f6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3646:x1874670585081088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826247.941673:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f7f6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3646:x1874670585081088:12345-0@lo:400:kworker.0 Request processed in 32us (1044us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826247.941683:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1218 00000100:00100000:3.0:1787826247.941719:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf136ced00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585081088:0@lo:400:kworker.0 00000100:00100000:3.0:1787826247.943132:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585082496 00000100:00100000:3.0:1787826247.943225:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585082496 00000100:00100000:3.0:1787826247.943306:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1219 00000100:00100000:3.0:1787826247.943314:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa85e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874670585082496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787826247.943342:0:7796:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446203392 avail 1299963904 00000100:00100000:3.0:1787826247.943399:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa85e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874670585082496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (1638us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826247.943406:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1219 00000100:00100000:3.0:1787826247.943445:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce044d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585082496:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787826247.943504:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f88c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585081728:0@lo:400:kworker.0 00000100:00100000:3.0:1787826247.943528:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f88f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585081600:0@lo:400:kworker.0 00010000:00010000:3.0:1787826247.943766:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46a400/0x22153cd396b7e4d5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.943776:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46a400/0x22153cd396b7e4d5 lrc: 2/0,0 mode: TXN/TXN res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.943783:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46a400/0x22153cd396b7e4d5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.943790:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46a400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826247.943794:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46a400/0x22153cd396b7e4d5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.943807:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46a400/0x22153cd396b7e4d5 lrc: 4/0,0 mode: TXN/TXN res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.943825:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0xeb4e88c0 (ffff90cf39656300) 00010000:00010000:3.0:1787826247.943828:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826247.943833:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46a400/0x22153cd396b7e4d5 lrc: 2/0,0 mode: --/TXN res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826247.943838:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46a400/0x22153cd396b7e4d5 lrc: 0/0,0 mode: --/TXN res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826248.005750:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826249.029126:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826249.480516:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585083008 00000100:00100000:3.0:1787826249.480526:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585083008 00000100:00100000:3.0:1787826249.480602:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 661 00000100:00100000:3.0:1787826249.480610:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f7f61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874670585083008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787826249.480633:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3922436096 avail 3690913792 00000100:00100000:3.0:1787826249.480717:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f7f61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874670585083008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (2493us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826249.480723:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 661 00000100:00100000:3.0:1787826249.480790:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f7f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585083008:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826249.879945:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826249.880000:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826249.880034:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826249.880064:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826249.880090:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00080000:3.0:1787826249.881042:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787826249.881047:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787826249.881050:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787826249.881053:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826251.311611:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00080000:3.0:1787826251.312012:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787826251.356103:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826251.420708:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00080000:3.0:1787826251.421218:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787826251.427631:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00080000:3.0:1787826251.428210:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826251.430695:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00010000:00010000:3.0:1787826251.437734:0:7460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826251.437753:0:7460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b7e664 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826251.437772:0:7460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46b000 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826251.437777:0:7460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b7e664 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826251.437787:0:7460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b7e664 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826251.437808:0:7460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x4:0x0].0x0 (ffff90cf39656f00) 00010000:00010000:3.0:1787826251.437811:0:7460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787826251.437815:0:7460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b7e664 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826251.437820:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b7e664 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826251.437851:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826251.437853:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826251.437855:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826251.490654:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563565312 00000100:00100000:3.0:1787826251.490665:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563565312 00000100:00100000:3.0:1787826251.490725:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 910 00000100:00100000:3.0:1787826251.490735:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab90b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:47043:x1874670563565312:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:3.0:1787826251.490944:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab90b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:47043:x1874670563565312:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 210us (966us total) trans 4294967552 rc 0/0 00000100:00100000:3.0:1787826251.490953:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 910 00000100:00100000:3.0:1787826251.930337:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826252.036929:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585083392 00000100:00100000:3.0:1787826252.036940:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585083392 00000100:00100000:3.0:1787826252.037001:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1220 00000100:00100000:3.0:1787826252.037011:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f7f4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3647:x1874670585083392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787826252.037056:0:7796:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445912576 avail 1299673088 00000100:00100000:3.0:1787826252.038894:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f7f4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3647:x1874670585083392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1873us (2103us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826252.038912:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1220 00000100:00100000:3.0:1787826252.394571:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563568512 00000100:00100000:3.0:1787826252.394580:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563568512 00000100:00100000:3.0:1787826252.394827:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3098 00000100:00100000:3.0:1787826252.394839:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03892580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:47113:x1874670563568512:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826252.394864:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826252.394885:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400800/0x22153cd396b7e760 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aafd12 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.394954:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401c00/0x22153cd396b7e767 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.394969:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401c00/0x22153cd396b7e767 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.394980:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401c00/0x22153cd396b7e767 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.395121:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400600/0x22153cd396b7e76e lrc: 3/1,0 mode: --/PR res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.395129:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400600/0x22153cd396b7e76e lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.395135:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400600/0x22153cd396b7e76e lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.395175:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401c00/0x22153cd396b7e767 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.395183:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401c00/0x22153cd396b7e767 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.395191:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401c00/0x22153cd396b7e767 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.395197:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401c00/0x22153cd396b7e767 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.395202:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826252.395206:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401c00/0x22153cd396b7e767 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.395213:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401c00/0x22153cd396b7e767 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.395226:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff90cf13641a00) 00010000:00010000:3.0:1787826252.395229:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826252.395233:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401c00/0x22153cd396b7e767 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.395239:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401c00/0x22153cd396b7e767 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.395250:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400600/0x22153cd396b7e76e lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.395257:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400600/0x22153cd396b7e76e lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.395263:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400600/0x22153cd396b7e76e lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.395269:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826252.395271:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400600/0x22153cd396b7e76e lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.395278:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400600/0x22153cd396b7e76e lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.395286:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0xeb4e88c0 (ffff90cf39656800) 00010000:00010000:3.0:1787826252.395288:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826252.395292:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400600/0x22153cd396b7e76e lrc: 2/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.395297:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400600/0x22153cd396b7e76e lrc: 0/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.395346:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400800/0x22153cd396b7e760 lrc: 1/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafd12 expref: 26 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.395357:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff90cf13641a00) 00010000:00010000:3.0:1787826252.395360:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826252.395364:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400800/0x22153cd396b7e760 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafd12 expref: 26 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.395378:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400800, rc 0) 00000100:00100000:3.0:1787826252.395650:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03892580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:47113:x1874670563568512:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 812us (1365us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826252.395658:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3098 00000100:00100000:3.0:1787826252.414668:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563568640 00000100:00100000:3.0:1787826252.414681:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563568640 00000100:00100000:3.0:1787826252.414749:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3099 00000100:00100000:3.0:1787826252.414775:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f876d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:47113:x1874670563568640:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826252.414797:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826252.414821:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b7e775 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aafd19 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.414893:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400c00/0x22153cd396b7e77c lrc: 3/1,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.414909:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400c00/0x22153cd396b7e77c lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.414922:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400c00/0x22153cd396b7e77c lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.414938:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400e00/0x22153cd396b7e783 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.414946:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400e00/0x22153cd396b7e783 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.414953:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400e00/0x22153cd396b7e783 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.414989:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400c00/0x22153cd396b7e77c lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.414996:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400c00/0x22153cd396b7e77c lrc: 2/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.415004:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400c00/0x22153cd396b7e77c lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.415011:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826252.415015:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400c00/0x22153cd396b7e77c lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.415023:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400c00/0x22153cd396b7e77c lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.415036:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff90cf13641200) 00010000:00010000:3.0:1787826252.415039:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826252.415045:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400c00/0x22153cd396b7e77c lrc: 2/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.415051:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400c00/0x22153cd396b7e77c lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.415067:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400e00/0x22153cd396b7e783 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.415074:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400e00/0x22153cd396b7e783 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.415080:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400e00/0x22153cd396b7e783 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.415086:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400e00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826252.415089:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400e00/0x22153cd396b7e783 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.415096:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400e00/0x22153cd396b7e783 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.415104:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0xeb4e88c0 (ffff90cf39656800) 00010000:00010000:3.0:1787826252.415107:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826252.415111:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400e00/0x22153cd396b7e783 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.415117:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400e00/0x22153cd396b7e783 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.415151:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b7e775 lrc: 1/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafd19 expref: 26 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.415164:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff90cf13641200) 00010000:00010000:3.0:1787826252.415167:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826252.415173:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b7e775 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafd19 expref: 26 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.415196:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401e00, rc 0) 00000100:00100000:3.0:1787826252.415275:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f876d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:47113:x1874670563568640:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 516us (6051us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826252.415284:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3099 00000100:00100000:3.0:1787826252.428748:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826252.453160:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563569024 00000100:00100000:3.0:1787826252.453169:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563569024 00000100:00100000:3.0:1787826252.453228:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3102 00000100:00100000:3.0:1787826252.453238:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f877480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:47113:x1874670563569024:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826252.453258:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826252.453280:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b7e7a6 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aafd2e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.453348:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400e00/0x22153cd396b7e7ad lrc: 3/1,0 mode: --/PR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.453361:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400e00/0x22153cd396b7e7ad lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.453372:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400e00/0x22153cd396b7e7ad lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826252.453415:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000401:0x8:0x0]: returning size 4096 00000004:00200000:3.0:1787826252.453420:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1787826252.453454:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b7e7a6 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafd2e expref: 27 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.453566:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400e00/0x22153cd396b7e7ad lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafd2e expref: 26 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.453575:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff90cf13641800) 00010000:00010000:3.0:1787826252.453578:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787826252.453581:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400e00, rc 0) 00000100:00100000:3.0:1787826252.453637:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f877480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:47113:x1874670563569024:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 400us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826252.453644:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3102 00000100:00100000:3.0:1787826252.467619:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563569152 00000100:00100000:3.0:1787826252.467631:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563569152 00000100:00100000:3.0:1787826252.467691:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3103 00000100:00100000:3.0:1787826252.467703:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f874780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:47113:x1874670563569152:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826252.467723:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826252.467742:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400c00/0x22153cd396b7e7b4 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aafd35 expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826252.479110:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563569408 00000100:00100000:3.0:1787826252.479120:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563569408 00000100:00100000:3.0:1787826252.479175:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3104 00000100:00100000:3.0:1787826252.479186:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03890b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:47113:x1874670563569408:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826252.479205:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826252.479208:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787826252.479233:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400e00/0x22153cd396b7e7ad lrc: 0/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafd2e expref: 26 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.479256:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff90cf13641800) 00010000:00010000:3.0:1787826252.479267:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826252.479279:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401400/0x22153cd396b7e7c9 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aafd3c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.479394:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b7e7d0 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.479407:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b7e7d0 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.479416:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b7e7d0 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.479426:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400800/0x22153cd396b7e7d7 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.479435:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400800/0x22153cd396b7e7d7 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.479442:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400800/0x22153cd396b7e7d7 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.479833:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400600/0x22153cd396b7e7de lrc: 3/1,0 mode: --/PR res: [0x240000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.479844:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400600/0x22153cd396b7e7de lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.479852:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400600/0x22153cd396b7e7de lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826252.479862:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787826252.479887:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b7e7d0 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.479895:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b7e7d0 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.479902:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b7e7d0 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.479908:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b7e7d0 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.479914:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401e00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826252.479919:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b7e7d0 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.479926:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b7e7d0 lrc: 5/0,0 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.479936:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff90cf13641b00) 00010000:00010000:3.0:1787826252.479939:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826252.479942:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b7e7d0 lrc: 3/0,0 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.479947:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b7e7d0 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826252.479958:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d31ada05 reply state 00000000daa28283 transno 4294967554 ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400800/0x22153cd396b7e7d7 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.479972:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400800/0x22153cd396b7e7d7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.479977:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0xeb4e88c0 (ffff90cf39656800) 00010000:00010000:3.0:1787826252.479979:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826252.479981:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787826252.480007:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401400/0x22153cd396b7e7c9 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafd3c expref: 28 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.480023:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400600/0x22153cd396b7e7de lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafd3c expref: 27 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.480030:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x7:0x0].0x0 (ffff90cf13641600) 00010000:00010000:3.0:1787826252.480032:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826252.480034:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400600, rc 0) 00000100:00100000:3.0:1787826252.480098:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03890b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+28:47113:x1874670563569408:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 913us (1062us total) trans 4294967554 rc 0/0 00000100:00100000:3.0:1787826252.480105:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3104 00000100:00100000:3.0:1787826252.494347:0:16564:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f7f4000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:16564:1874670585083520:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826252.494381:0:16564:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff90ce026af000/0x22153cd396b7e7f3 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826252.494717:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563569792 00000100:00100000:3.0:1787826252.494724:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563569792 00010000:00010000:3.0:1787826252.495037:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400600/0x22153cd396b7e7de lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafd3c expref: 30 pid: 6520 timeout: 1298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826252.495094:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 852 00000100:00100000:3.0:1787826252.495106:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f7f4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:2404:x1874670563569792:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826252.495120:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826252.495127:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400600/0x22153cd396b7e7de lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafd3c expref: 30 pid: 6520 timeout: 1298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.495137:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400600/0x22153cd396b7e7de lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafd3c expref: 30 pid: 6520 timeout: 1298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.495161:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400600/0x22153cd396b7e7de lrc: 0/0,0 mode: --/PR res: [0x240000404:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafd3c expref: 30 pid: 6520 timeout: 1298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.495176:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x7:0x0].0x0 (ffff90cf13641600) 00010000:00010000:3.0:1787826252.495181:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff90ce026af000/0x22153cd396b7e7f3 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.495190:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce026af000/0x22153cd396b7e7f3 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.495198:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce026af000/0x22153cd396b7e7f3 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.495223:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826252.495273:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f7f4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+29:2404:x1874670563569792:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 169us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826252.495280:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 852 00010000:00010000:3.0:1787826252.495307:0:16564:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff90ce026af000/0x22153cd396b7e7f3 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.495324:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce026af000/0x22153cd396b7e7f3 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826252.495351:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0x7:0x0]: returning size 0 00000004:00080000:3.0:1787826252.495995:0:16564:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x20:0x0], index 0: 0 00000004:00080000:3.0:1787826252.496004:0:16564:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x1f:0x0], index 1: 0 00010000:00010000:3.0:1787826252.496348:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce026af000/0x22153cd396b7e7f3 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.496358:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce026af000/0x22153cd396b7e7f3 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.496365:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90ce026af000/0x22153cd396b7e7f3 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.496370:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce026af000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826252.496374:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce026af000/0x22153cd396b7e7f3 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.496381:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce026af000/0x22153cd396b7e7f3 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.496392:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x7:0x0].0x0 (ffff90cf13641600) 00010000:00010000:3.0:1787826252.496395:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826252.496399:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90ce026af000/0x22153cd396b7e7f3 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.496405:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce026af000/0x22153cd396b7e7f3 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.496457:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce026af600/0x22153cd396b7e7ec lrc: 1/0,0 mode: --/CR res: [0x240000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafd43 expref: 29 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.496467:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x7:0x0].0x0 (ffff90cf13641600) 00010000:00010000:3.0:1787826252.497872:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787826252.497884:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce026af600/0x22153cd396b7e7ec lrc: 0/0,0 mode: --/CR res: [0x240000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafd43 expref: 29 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.497904:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce026af600, rc 0) 00000100:00100000:3.0:1787826252.497982:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f877c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+28:47113:x1874670563569664:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 12622us (12995us total) trans 4294967555 rc 301/301 00000100:00100000:3.0:1787826252.497992:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3105 00000100:00100000:3.0:1787826252.505356:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826252.505391:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563570048 00000100:00100000:3.0:1787826252.505400:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563570048 00000100:00100000:3.0:1787826252.505450:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 915 00000100:00100000:3.0:1787826252.505460:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eea3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+28:47113:x1874670563570048:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:3.0:1787826252.505771:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eea3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+29:47113:x1874670563570048:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 312us (422us total) trans 4294967556 rc 0/0 00000100:00100000:3.0:1787826252.505781:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 915 00000100:00100000:3.0:1787826252.512513:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826252.512550:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563570304 00000100:00100000:3.0:1787826252.512559:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563570304 00000100:00100000:3.0:1787826252.512604:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 916 00000100:00100000:3.0:1787826252.512615:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03bdd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+29:47113:x1874670563570304:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:3.0:1787826252.512810:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03bdd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:47113:x1874670563570304:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 197us (340us total) trans 4294967557 rc 0/0 00000100:00100000:3.0:1787826252.512823:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 916 00000100:00100000:3.0:1787826252.527307:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563570432 00000100:00100000:3.0:1787826252.527326:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563570432 00000100:00100000:3.0:1787826252.527372:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3106 00000100:00100000:3.0:1787826252.527382:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+23:47114:x1874670563570432:12345-192.168.203.39@tcp:101:rm.0 00010000:00010000:3.0:1787826252.527404:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826252.527423:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b7e801 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aafd4a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.527657:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b7e808 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.527673:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b7e808 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.527685:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b7e808 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.527697:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b7e80f lrc: 3/1,0 mode: --/PR res: [0x200000400:0x8:0x0].0xba281655 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.527704:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b7e80f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.527711:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b7e80f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.527789:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400e00/0x22153cd396b7e816 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.527803:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400e00/0x22153cd396b7e816 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.527809:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400e00/0x22153cd396b7e816 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826252.527849:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x5:0x0]: returning size 0 00000004:00200000:3.0:1787826252.527853:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826252.527871:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400e00/0x22153cd396b7e816 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.527883:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400e00/0x22153cd396b7e816 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.527891:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b7e808 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.527897:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b7e808 lrc: 2/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.527904:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b7e808 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.527910:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826252.527915:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b7e808 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.527923:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b7e808 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.528018:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0x0 (ffff90cf1817c600) 00010000:00010000:3.0:1787826252.528022:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826252.528028:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b7e808 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.528035:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b7e808 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.528048:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b7e80f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.528054:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b7e80f lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.528059:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b7e80f lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.528064:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401e00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826252.528067:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b7e80f lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.528073:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b7e80f lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.528081:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0xba281655 (ffff90cf39656b00) 00010000:00010000:3.0:1787826252.528083:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826252.528086:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b7e80f lrc: 2/0,0 mode: --/PR res: [0x200000400:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.528091:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b7e80f lrc: 0/0,0 mode: --/PR res: [0x200000400:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.528118:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b7e801 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafd4a expref: 25 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.528138:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400e00/0x22153cd396b7e816 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafd4a expref: 24 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.528145:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x5:0x0].0x0 (ffff90cf13641600) 00010000:00010000:3.0:1787826252.528148:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826252.528150:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400e00, rc 0) 00000100:00100000:3.0:1787826252.528212:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:47114:x1874670563570432:12345-192.168.203.39@tcp:101:rm.0 Request processed in 830us (1504us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826252.528221:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3106 00000100:00100000:3.0:1787826252.533425:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826252.533467:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000040:00080000:3.0:1787826252.538773:0:9966:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].242, 64 off28376 00000004:00080000:3.0:1787826252.538784:0:9966:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1198550311747ns, next at 1199550309483ns, rc = 0 00000040:00080000:3.0:1787826252.538816:0:9966:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].249, 64 off28904 00000004:00080000:3.0:1787826252.538823:0:9966:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1198550351305ns, next at 1199550350265ns, rc = 0 00010000:00010000:3.0:1787826252.538886:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b7e840 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.538898:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b7e840 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.538908:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b7e840 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.538918:0:9966:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b7e840 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.538925:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b7e840 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.538934:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b7e840 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.538959:0:9966:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787826252.538976:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067200/0x22153cd396b7e839 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.538983:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067200/0x22153cd396b7e839 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.538991:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067200/0x22153cd396b7e839 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.538998:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0a067200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826252.539003:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067200/0x22153cd396b7e839 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.539011:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067200/0x22153cd396b7e839 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.539022:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x5:0x0].0x0 (ffff90cf1817cd00) 00010000:00010000:3.0:1787826252.539025:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787826252.539029:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067200/0x22153cd396b7e839 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.539035:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067200/0x22153cd396b7e839 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.539054:0:9966:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066800/0x22153cd396b7e82b lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.539060:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066800/0x22153cd396b7e82b lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.539067:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066800/0x22153cd396b7e82b lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.539072:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066800/0x22153cd396b7e82b lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.539077:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0a066800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826252.539081:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066800/0x22153cd396b7e82b lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.539087:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066800/0x22153cd396b7e82b lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.539095:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0x0 (ffff90cf1817cf00) 00010000:00010000:3.0:1787826252.539098:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826252.539101:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066800/0x22153cd396b7e82b lrc: 3/0,0 mode: --/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.539107:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066800/0x22153cd396b7e82b lrc: 0/0,0 mode: --/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826252.539120:0:9966:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003c2c073f reply state 00000000f88eefb2 transno 4294969197 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b7e832 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.539132:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b7e832 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.539139:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0xba281655 (ffff90cf39656b00) 00010000:00010000:3.0:1787826252.539142:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826252.539145:0:9966:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826252.539231:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03bdcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:47114:x1874670563570944:12345-192.168.203.39@tcp:36:rm.0 Request processed in 1066us (1219us total) trans 4294969197 rc 0/0 00000100:00100000:3.0:1787826252.539241:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3107 00000100:00100000:3.0:1787826252.544077:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585084032 00000100:00100000:3.0:1787826252.544082:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585084032 00000100:00100000:3.0:1787826252.544130:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1579 00000100:00100000:3.0:1787826252.544139:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f875a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3645:x1874670585084032:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787826252.544153:0:30695:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:207 count 1 00010000:00010000:3.0:1787826252.544170:0:30695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b7e855 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.544187:0:30695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000751cf8a3/0x22153cd396b7e824 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafd58 expref: 8 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.544195:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826252.544198:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826252.544202:0:30695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b7e855 lrc: 4/0,1 mode: --/PW res: [0x280000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.544221:0:30695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000751cf8a3/0x22153cd396b7e824 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafd58 expref: 8 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.544232:0:30695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000751cf8a3/0x22153cd396b7e824 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafd58 expref: 8 pid: 8435 timeout: 1298 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826252.544244:0:30695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3abc3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:30695:1874670585084288:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826252.544300:0:30695:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce024a3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826252.547832:0:14864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f8752c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14864:1874670585084160:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826252.547861:0:14864:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002fc1e6d3/0x22153cd396b7e84e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xdb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.550602:0:7460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826252.550611:0:7460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8b52bb3/0x22153cd396b7e847 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.550620:0:7460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0a067800 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826252.550624:0:7460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8b52bb3/0x22153cd396b7e847 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.550641:0:7460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8b52bb3/0x22153cd396b7e847 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.550654:0:7460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8b52bb3/0x22153cd396b7e847 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.550662:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8b52bb3/0x22153cd396b7e847 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.550681:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826252.550683:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826252.550685:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787826252.550841:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3f874f00/2, rc 0, transno 17179869539 00000100:00100000:3.0:1787826252.550847:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f874f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585083648:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1787826252.554223:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826252.554229:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002fc1e6d3/0x22153cd396b7e84e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826252.554237:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0a067e00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:1.0:1787826252.554241:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002fc1e6d3/0x22153cd396b7e84e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826252.554250:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002fc1e6d3/0x22153cd396b7e84e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xdb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826252.554263:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002fc1e6d3/0x22153cd396b7e84e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xdb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826252.554270:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002fc1e6d3/0x22153cd396b7e84e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xdb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826252.554285:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826252.554287:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826252.554289:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787826252.554430:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3f874000/2, rc 0, transno 17179869540 00000100:00100000:3.0:1787826252.554438:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f874000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585083776:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787826252.556754:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826252.556868:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563571584 00000100:00100000:1.0:1787826252.556874:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563571584 00010000:00010000:1.0:1787826252.556910:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000751cf8a3/0x22153cd396b7e824 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafd58 expref: 9 pid: 8435 timeout: 1298 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826252.556943:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 855 00000100:00100000:1.0:1787826252.556952:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563571584:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826252.556963:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826252.556973:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000751cf8a3/0x22153cd396b7e824 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafd58 expref: 9 pid: 8435 timeout: 1298 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826252.556985:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000751cf8a3/0x22153cd396b7e824 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafd58 expref: 9 pid: 8435 timeout: 1298 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826252.557003:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000751cf8a3/0x22153cd396b7e824 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafd58 expref: 9 pid: 8435 timeout: 1298 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826252.557016:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826252.557020:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826252.557026:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b7e855 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826252.557036:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b7e855 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826252.557074:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826252.557115:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2404:x1874670563571584:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 164us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826252.557122:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 855 00010000:00010000:3.0:1787826252.557310:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826252.557329:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b7e855 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.557339:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401e00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826252.557344:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b7e855 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.557352:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b7e855 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.557376:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b7e855 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.557384:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b7e855 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.557445:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826252.557449:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826252.557452:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826252.560519:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563571712 00000100:00100000:3.0:1787826252.560528:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563571712 00000100:00100000:3.0:1787826252.560575:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1580 00000100:00100000:3.0:1787826252.560584:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f937c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2404:x1874670563571712:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826252.560600:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826252.560630:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a816990/0x22153cd396b7e87f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aafd66 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826252.561055:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826252.561075:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=1198s v=(0 0) 00010000:00010000:3.0:1787826252.561080:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826252.561091:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a816990/0x22153cd396b7e87f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafd66 expref: 9 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.561110:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003a816990/0x22153cd396b7e87f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafd66 expref: 9 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.561125:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401400, rc 0) 00000100:00100000:3.0:1787826252.561227:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f937c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563571712:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 643us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826252.561236:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1580 00000100:00100000:3.0:1787826252.563343:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563571968 00000100:00100000:3.0:1787826252.563360:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563571968 00000100:00100000:3.0:1787826252.563424:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 917 00000100:00100000:3.0:1787826252.563434:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f934f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+32:47115:x1874670563571968:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:3.0:1787826252.563766:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f934f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:47115:x1874670563571968:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 332us (510us total) trans 4294967560 rc 0/0 00000100:00100000:3.0:1787826252.563775:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 917 00000100:00100000:3.0:1787826252.565603:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563572096 00000100:00100000:3.0:1787826252.565610:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563572096 00000100:00100000:3.0:1787826252.565692:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3109 00000100:00100000:3.0:1787826252.565701:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f934000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:47115:x1874670563572096:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826252.565723:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826252.565744:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b7e886 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aafd6d expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.565822:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401c00/0x22153cd396b7e88d lrc: 3/1,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.565837:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401c00/0x22153cd396b7e88d lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.565849:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401c00/0x22153cd396b7e88d lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.565861:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b7e894 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x8:0x0].0xba281655 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.565869:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b7e894 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.565876:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b7e894 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.565913:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401c00/0x22153cd396b7e88d lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.565920:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401c00/0x22153cd396b7e88d lrc: 2/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.565926:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401c00/0x22153cd396b7e88d lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.565933:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826252.565937:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401c00/0x22153cd396b7e88d lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.565945:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401c00/0x22153cd396b7e88d lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.565957:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0x0 (ffff90cf13641700) 00010000:00010000:3.0:1787826252.565960:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826252.565965:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401c00/0x22153cd396b7e88d lrc: 2/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.565972:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401c00/0x22153cd396b7e88d lrc: 0/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.565983:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b7e894 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.565990:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b7e894 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.565996:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b7e894 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.566001:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826252.566004:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b7e894 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.566010:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b7e894 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.566016:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0xba281655 (ffff90cf13641000) 00010000:00010000:3.0:1787826252.566018:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826252.566022:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b7e894 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.566028:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b7e894 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.566064:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b7e886 lrc: 1/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafd6d expref: 11 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.566076:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0x0 (ffff90cf13641700) 00010000:00010000:3.0:1787826252.566078:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826252.566083:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b7e886 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafd6d expref: 11 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.566095:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400c00, rc 0) 00000100:00100000:3.0:1787826252.566150:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f934000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:47115:x1874670563572096:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 450us (807us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826252.566158:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3109 00000100:00100000:1.0:1787826252.568199:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826252.568265:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563572352 00000100:00100000:3.0:1787826252.568273:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563572352 00000100:00100000:3.0:1787826252.568330:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3110 00000100:00100000:3.0:1787826252.568341:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f88f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:47115:x1874670563572352:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826252.568359:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826252.568379:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b7e89b lrc: 2/0,0 mode: --/CW res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aafd74 expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826252.575387:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563572608 00000100:00100000:3.0:1787826252.575397:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563572608 00000100:00100000:3.0:1787826252.575727:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3111 00000100:00100000:3.0:1787826252.575739:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8fa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:47115:x1874670563572608:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826252.575762:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826252.575782:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b7e8be lrc: 2/0,0 mode: --/CR res: [0x200000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aafd7b expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.575910:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b7e8c5 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.575928:0:9966:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421f3200/0x22153cd396b7e8b0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafd74 expref: 14 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.575936:0:9966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b7e8c5 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.575970:0:9966:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421f3200/0x22153cd396b7e8b0 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafd74 expref: 14 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.575984:0:9966:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421f3200/0x22153cd396b7e8b0 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafd74 expref: 14 pid: 8247 timeout: 1298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826252.575998:0:9966:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3abc1680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9966:1874670585084672:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826252.576095:0:9966:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce024a3b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826252.579126:0:9966:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3abc1680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9966:1874670585084672:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826252.579128:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00010000:00010000:1.0:1787826252.579161:0:9966:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b7e8c5 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826252.579785:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 856 00000100:00100000:1.0:1787826252.579800:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2403:x1874670563572736:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826252.579815:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826252.579823:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421f3200/0x22153cd396b7e8b0 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafd74 expref: 15 pid: 8247 timeout: 1298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826252.579837:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421f3200/0x22153cd396b7e8b0 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafd74 expref: 15 pid: 8247 timeout: 1298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826252.579859:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421f3200/0x22153cd396b7e8b0 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafd74 expref: 15 pid: 8247 timeout: 1298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826252.579875:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x6:0x0].0x0 (ffff90cf1817ca00) 00010000:00010000:1.0:1787826252.579880:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b7e8c5 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826252.579888:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b7e8c5 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826252.579896:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b7e8c5 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826252.579916:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826252.579956:0:9966:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b7e8c5 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826252.579965:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b7e8c5 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826252.579975:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2403:x1874670563572736:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 178us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826252.579987:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 856 00000004:00200000:3.0:1787826252.579999:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x6:0x0]: returning size 0 00000100:00100000:3.0:1787826252.586347:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563572992 00000100:00100000:3.0:1787826252.586358:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563572992 00000100:00100000:1.0:1787826252.589307:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826252.627372:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826253.060132:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787826253.060177:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3abc0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585084800:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787826253.060278:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826253.060447:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585084800 00000100:00100000:3.0:1787826253.060457:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585084800 00000100:00100000:3.0:1787826253.061231:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1222 00000100:00100000:3.0:1787826253.061249:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f88e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1874670585084800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787826253.061302:0:7796:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446203392 avail 1299963904 00000100:00100000:3.0:1787826253.061400:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f88e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1874670585084800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 157us (1121us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826253.061407:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1222 00000100:00100000:1.0:1787826253.076706:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585085184 00000100:00100000:1.0:1787826253.076730:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585085184 00000100:00100000:1.0:1787826253.076846:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1223 00000100:00100000:1.0:1787826253.076859:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f935680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1874670585085184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826253.077012:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f935680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1874670585085184:12345-0@lo:400:kworker.0 Request processed in 156us (11008us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826253.077021:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1223 00010000:00010000:1.0:1787826253.130071:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826254.148390:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826254.596038:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787826254.596071:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f88fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585086592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826254.596181:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826254.596237:0:12021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585086592 00000100:00100000:1.0:1787826254.596247:0:12021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585086592 00000100:00100000:1.0:1787826254.596341:0:12021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 662 00000100:00100000:1.0:1787826254.596354:0:12021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1874670585086592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787826254.596392:0:12021:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3922436096 avail 3690913792 00000100:00100000:1.0:1787826254.596441:0:12021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1874670585086592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826254.596450:0:12021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 662 00000100:00100000:1.0:1787826254.596555:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f88fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585086592:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787826254.596592:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826254.597707:0:25628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585086464 00000100:00100000:3.0:1787826254.597711:0:25628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585086464 00000100:00100000:3.0:1787826254.597765:0:25628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 663 00000100:00100000:3.0:1787826254.597774:0:25628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf2f45c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874670585086464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787826254.597800:0:25628:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3920334848 avail 3688812544 00000100:00100000:3.0:1787826254.598018:0:25628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf2f45c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874670585086464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 245us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826254.598025:0:25628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 663 00000004:00080000:1.0:1787826254.598505:0:9965:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1200610032696ns, next at 1201610029598ns, rc = 0 00000100:00100000:3.0:1787826254.599033:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585086848 00000100:00100000:3.0:1787826254.599040:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585086848 00000100:00100000:3.0:1787826254.599084:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 665 00000100:00100000:3.0:1787826254.599092:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf2f45c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874670585086848:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787826254.599106:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3922436096 avail 3690913792 00000100:00100000:3.0:1787826254.599156:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf2f45c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874670585086848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826254.599163:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 665 00000100:00100000:3.0:1787826254.993115:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826254.993155:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826254.993181:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826254.993411:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563574016 00000100:00100000:1.0:1787826254.993422:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563574016 00000100:00100000:1.0:1787826254.993533:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1375 00000100:00100000:1.0:1787826254.993544:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:2404:x1874670563574016:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1787826254.993626:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:2404:x1874670563574016:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 80us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826254.993636:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1375 00000100:00080000:3.0:1787826254.993860:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787826254.993865:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826255.000703:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826255.001703:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00080000:3.0:1787826255.003310:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787826255.003974:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563574144 00000100:00100000:1.0:1787826255.003985:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563574144 00000100:00100000:1.0:1787826255.004064:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 783 00000100:00100000:1.0:1787826255.004075:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563574144:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1787826255.004140:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563574144:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 68us (2441us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826255.004147:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 783 00000100:00080000:3.0:1787826255.004500:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787826255.172893:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826257.167512:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585086976 00000100:00100000:1.0:1787826257.167522:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585086976 00000100:00100000:1.0:1787826257.167574:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1224 00000100:00100000:1.0:1787826257.167583:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f935a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3646:x1874670585086976:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787826257.167619:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445912576 avail 1299673088 00000100:00100000:1.0:1787826257.167687:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f935a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3646:x1874670585086976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826257.167693:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1224 00010000:00010000:3.0:1787826257.169203:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46a400/0x22153cd396b7e5d8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826257.169213:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46a400/0x22153cd396b7e5d8 lrc: 2/0,0 mode: TXN/TXN res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826257.169221:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46a400/0x22153cd396b7e5d8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826257.169229:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46a400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826257.169234:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46a400/0x22153cd396b7e5d8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826257.169242:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46a400/0x22153cd396b7e5d8 lrc: 4/0,0 mode: TXN/TXN res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826257.169260:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0xeb4e88c0 (ffff90cf39656800) 00010000:00010000:3.0:1787826257.169264:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826257.169268:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46a400/0x22153cd396b7e5d8 lrc: 2/0,0 mode: --/TXN res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826257.169276:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46a400/0x22153cd396b7e5d8 lrc: 0/0,0 mode: --/TXN res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826257.169305:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce026ae400/0x22153cd396b7e5fb lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826257.169312:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce026ae400/0x22153cd396b7e5fb lrc: 2/0,0 mode: TXN/TXN res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826257.169319:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90ce026ae400/0x22153cd396b7e5fb lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826257.169324:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce026ae400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826257.169326:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce026ae400/0x22153cd396b7e5fb lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826257.169332:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce026ae400/0x22153cd396b7e5fb lrc: 4/0,0 mode: TXN/TXN res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826257.169340:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0xeb4e88c0 (ffff90cf39656800) 00010000:00010000:3.0:1787826257.169342:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826257.169345:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90ce026ae400/0x22153cd396b7e5fb lrc: 2/0,0 mode: --/TXN res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826257.169351:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce026ae400/0x22153cd396b7e5fb lrc: 0/0,0 mode: --/TXN res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826257.169361:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce0a067a00/0x22153cd396b7e74b lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826257.169367:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce0a067a00/0x22153cd396b7e74b lrc: 2/0,0 mode: TXN/TXN res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826257.169373:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90ce0a067a00/0x22153cd396b7e74b lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826257.169378:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0a067a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826257.169381:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce0a067a00/0x22153cd396b7e74b lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826257.169387:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce0a067a00/0x22153cd396b7e74b lrc: 4/0,0 mode: TXN/TXN res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826257.169395:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0xeb4e88c0 (ffff90cf39656800) 00010000:00010000:3.0:1787826257.169398:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826257.169400:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90ce0a067a00/0x22153cd396b7e74b lrc: 2/0,0 mode: --/TXN res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826257.169406:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce0a067a00/0x22153cd396b7e74b lrc: 0/0,0 mode: --/TXN res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826257.169415:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400800/0x22153cd396b7e7d7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826257.169422:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400800/0x22153cd396b7e7d7 lrc: 2/0,0 mode: TXN/TXN res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826257.169428:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400800/0x22153cd396b7e7d7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826257.169433:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826257.169436:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400800/0x22153cd396b7e7d7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826257.169446:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400800/0x22153cd396b7e7d7 lrc: 4/0,0 mode: TXN/TXN res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826257.169454:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0xeb4e88c0 (ffff90cf39656800) 00010000:00010000:3.0:1787826257.169456:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826257.169459:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400800/0x22153cd396b7e7d7 lrc: 2/0,0 mode: --/TXN res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826257.169524:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400800/0x22153cd396b7e7d7 lrc: 0/0,0 mode: --/TXN res: [0x240000401:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787826257.169551:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787826257.169556:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826257.174844:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826257.174872:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826257.174894:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826257.174922:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563574400 00000100:00100000:3.0:1787826257.174930:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563574400 00010000:00010000:3.0:1787826257.174978:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f0ef7729/0x22153cd396b7e68e lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafcda expref: 8 pid: 30694 timeout: 1303 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826257.175009:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563574656 00000100:00100000:3.0:1787826257.175012:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563574656 00010000:00010000:3.0:1787826257.175029:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000251fe879/0x22153cd396b7e537 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafc86 expref: 9 pid: 30695 timeout: 1303 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826257.175048:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563574528 00000100:00100000:3.0:1787826257.175051:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563574528 00010000:00010000:3.0:1787826257.175062:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000040c14e12/0x22153cd396b7e695 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafce1 expref: 10 pid: 8436 timeout: 1303 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826257.175078:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 857 00000100:00100000:3.0:1787826257.175086:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb97c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2403:x1874670563574400:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826257.175102:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826257.175108:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f0ef7729/0x22153cd396b7e68e lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafcda expref: 8 pid: 30694 timeout: 1303 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826257.175122:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f0ef7729/0x22153cd396b7e68e lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafcda expref: 8 pid: 30694 timeout: 1303 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826257.175148:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826257.175153:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826257.175158:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001a5fe178/0x22153cd396b7e8fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826257.175167:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a5fe178/0x22153cd396b7e8fd lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826257.175186:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826257.175230:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb97c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2403:x1874670563574400:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 145us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826257.175238:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 857 00000100:00100000:3.0:1787826257.175256:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 858 00000100:00100000:3.0:1787826257.175262:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb96580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670563574656:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826257.175273:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826257.175277:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000251fe879/0x22153cd396b7e537 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafc86 expref: 10 pid: 30695 timeout: 1303 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826257.175301:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000251fe879/0x22153cd396b7e537 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafc86 expref: 10 pid: 30695 timeout: 1303 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826257.175316:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826257.175319:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826257.175324:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003eb46645/0x22153cd396b7e90b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826257.175332:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003eb46645/0x22153cd396b7e90b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826257.175344:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826257.175364:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb96580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670563574656:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 101us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826257.175371:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 858 00000100:00100000:3.0:1787826257.175384:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 859 00000100:00100000:3.0:1787826257.175391:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb970c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670563574528:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826257.175399:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826257.175404:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000040c14e12/0x22153cd396b7e695 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafce1 expref: 9 pid: 8436 timeout: 1303 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826257.175414:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000040c14e12/0x22153cd396b7e695 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafce1 expref: 9 pid: 8436 timeout: 1303 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826257.175426:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826257.175429:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826257.175434:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000421aa0a2/0x22153cd396b7e904 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826257.175442:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000421aa0a2/0x22153cd396b7e904 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826257.175453:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826257.175501:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb970c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670563574528:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 110us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826257.175507:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 859 00000100:00080000:3.0:1787826257.175532:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787826257.175537:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787826257.175635:0:30398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040c14e12/0x22153cd396b7e695 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafce1 expref: 8 pid: 8436 timeout: 1303 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826257.175648:0:30398:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf2f45ed00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:30398:1874670585087616:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826257.175667:0:30398:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000421aa0a2/0x22153cd396b7e904 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826257.175676:0:30398:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000421aa0a2/0x22153cd396b7e904 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826257.175683:0:30398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000421aa0a2/0x22153cd396b7e904 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826257.175693:0:30398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000421aa0a2/0x22153cd396b7e904 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826257.175700:0:30398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000421aa0a2/0x22153cd396b7e904 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826257.175724:0:30398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787826257.175879:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf2f45f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+7:3647:x1874670585087360:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7222us (7668us total) trans 21474836856 rc 0/0 00000100:00100000:1.0:1787826257.175887:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1582 00010000:00010000:3.0:1787826257.176642:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787826257.176648:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000421aa0a2/0x22153cd396b7e904 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826257.176657:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46bc00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826257.176660:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000421aa0a2/0x22153cd396b7e904 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826257.176669:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000421aa0a2/0x22153cd396b7e904 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826257.176682:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000421aa0a2/0x22153cd396b7e904 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826257.176690:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000421aa0a2/0x22153cd396b7e904 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826257.176707:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787826257.176711:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003eb46645/0x22153cd396b7e90b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826257.176717:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46ba00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826257.176720:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003eb46645/0x22153cd396b7e90b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826257.176727:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003eb46645/0x22153cd396b7e90b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826257.176736:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003eb46645/0x22153cd396b7e90b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826257.176743:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003eb46645/0x22153cd396b7e90b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826257.176755:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826257.176758:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a5fe178/0x22153cd396b7e8fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826257.176764:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46a600 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826257.176768:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a5fe178/0x22153cd396b7e8fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826257.176775:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a5fe178/0x22153cd396b7e8fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826257.176784:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a5fe178/0x22153cd396b7e8fd lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826257.176791:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a5fe178/0x22153cd396b7e8fd lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826257.176803:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826257.176804:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826257.176806:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826257.176851:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826258.093094:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00080000:3.0:1787826258.094501:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787826258.181019:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f936580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874670585088000:0@lo:400:kworker.0 00000100:00100000:3.0:1787826258.181052:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826258.181072:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f934780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585088512:0@lo:400:kworker.0 00000100:00100000:3.0:1787826258.181104:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826258.181125:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aaf03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874670585089024:0@lo:400:kworker.0 00000100:00100000:3.0:1787826258.181145:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826258.181159:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585089536:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787826258.181177:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826258.181199:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787826258.181205:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f936d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585088128:0@lo:400:kworker.0 00000100:00100000:3.0:1787826258.181224:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826258.181237:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f9343c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585088640:0@lo:400:kworker.0 00000100:00100000:3.0:1787826258.181256:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826258.181284:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aaf2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874670585089152:0@lo:400:kworker.0 00000100:00100000:3.0:1787826258.181305:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826258.181336:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585088512 00000100:00100000:3.0:1787826258.181343:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585088512 00000100:00100000:3.0:1787826258.181381:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585088640 00000100:00100000:3.0:1787826258.181384:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585088640 00000100:00100000:3.0:1787826258.181414:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 784 00000100:00100000:3.0:1787826258.181422:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f89e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+7:3644:x1874670585088512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826258.181492:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f89e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+7:3644:x1874670585088512:12345-0@lo:400:kworker.0 Request processed in 49us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826258.181500:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 784 00000100:00100000:3.0:1787826258.181518:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 785 00000100:00100000:3.0:1787826258.181525:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f89e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1874670585088640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826258.181566:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f89e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1874670585088640:12345-0@lo:400:kworker.0 Request processed in 42us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826258.185482:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 785 00000100:00080000:3.0:1787826258.185532:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787826258.185536:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787826258.185539:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826258.185558:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f936d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585088128:0@lo:400:kworker.0 00000100:00100000:3.0:1787826258.185570:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f9343c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585088640:0@lo:400:kworker.0 00000100:00100000:3.0:1787826258.186253:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aaf2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874670585089152:0@lo:400:kworker.0 00000100:00100000:3.0:1787826258.186270:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f936580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874670585088000:0@lo:400:kworker.0 00000100:00100000:3.0:1787826258.186294:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f934780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585088512:0@lo:400:kworker.0 00000100:00100000:3.0:1787826258.186305:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aaf03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874670585089024:0@lo:400:kworker.0 00000100:00100000:3.0:1787826258.186320:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585089536:0@lo:41:osp-pre-1-0.0 00000001:00080000:3.0:1787826258.188388:0:26205:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836857 is committed 00000001:00080000:3.0:1787826258.188405:0:26205:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836855 is committed 00010000:00010000:1.0:1787826258.192618:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421f2600/0x22153cd396b7e8a9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826258.192633:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421f2600/0x22153cd396b7e8a9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826258.192640:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421f2600/0x22153cd396b7e8a9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826258.192646:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf421f2600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826258.192651:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421f2600/0x22153cd396b7e8a9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826258.192662:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421f2600/0x22153cd396b7e8a9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826258.192678:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0xba281655 (ffff90cf1817c600) 00010000:00010000:1.0:1787826258.192681:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826258.192686:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421f2600/0x22153cd396b7e8a9 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826258.192692:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421f2600/0x22153cd396b7e8a9 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826258.245180:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826259.267846:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826259.716136:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce04f06d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585089792:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826259.719232:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f89de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585090048:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826259.740280:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826259.742278:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179869541 gen 2 00000004:00080000:1.0:1787826259.742288:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf2f45e940, transno 17179869541 00000100:00100000:1.0:1787826259.742323:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce04f06d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585089792:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826259.744459:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826259.747541:0:25628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585090048 00000100:00100000:1.0:1787826259.747557:0:25628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585090048 00000100:00100000:1.0:1787826259.747623:0:25628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 669 00000100:00100000:1.0:1787826259.747647:0:25628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f89f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874670585090048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787826259.747672:0:25628:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3920334848 avail 3688812544 00000100:00100000:1.0:1787826259.748148:0:25628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f89f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874670585090048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 515us (3694us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826259.748156:0:25628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 669 00000100:00100000:3.0:1787826259.748436:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836855 gen 2 00000004:00080000:3.0:1787826259.748443:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3abc1a40, transno 21474836855 00000100:00100000:3.0:1787826259.748496:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f89de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585090048:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826260.114042:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563575168 00000100:00100000:1.0:1787826260.114047:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563575168 00000100:00100000:1.0:1787826260.114086:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 852 00000100:00100000:1.0:1787826260.114095:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf185cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:307626ff-a376-4faf-93e0-9f55b723d964+10:2402:x1874670563575168:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1787826260.114139:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf185cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:307626ff-a376-4faf-93e0-9f55b723d964+10:2402:x1874670563575168:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 45us (1117us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826260.114146:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 852 00000100:00100000:3.0:1787826262.278914:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f89de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585090176:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787826262.339964:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826262.508809:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563575808 00000100:00100000:3.0:1787826262.508823:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563575808 00000100:00100000:3.0:1787826262.508984:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3116 00000100:00100000:3.0:1787826262.508996:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b4303c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:47880:x1874670563575808:12345-192.168.203.39@tcp:41:stat.0 00000004:00000024:3.0:1787826262.509046:0:8247:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 7842770944 avail 7379726336 00000100:00100000:3.0:1787826262.509133:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b4303c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:47880:x1874670563575808:12345-192.168.203.39@tcp:41:stat.0 Request processed in 139us (4301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826262.509140:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3116 00000100:00100000:1.0:1787826262.561218:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563575936 00000100:00100000:1.0:1787826262.561231:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563575936 00000100:00100000:1.0:1787826262.561347:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3117 00000100:00100000:1.0:1787826262.561359:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b432580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:47884:x1874670563575936:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826262.561384:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826262.561414:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce026af200/0x22153cd396b7e93c lrc: 2/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aafd90 expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.561551:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce026aea00/0x22153cd396b7e943 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.561568:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce026aea00/0x22153cd396b7e943 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.561581:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce026aea00/0x22153cd396b7e943 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.561709:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce026ae600/0x22153cd396b7e94a lrc: 3/1,0 mode: --/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.561717:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce026ae600/0x22153cd396b7e94a lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.561724:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce026ae600/0x22153cd396b7e94a lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.561942:0:9966:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce026aea00/0x22153cd396b7e943 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.561981:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce026aea00/0x22153cd396b7e943 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.561988:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce026aea00/0x22153cd396b7e943 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.561995:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90ce026aea00/0x22153cd396b7e943 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.562001:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce026aea00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826262.562006:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce026aea00/0x22153cd396b7e943 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.562015:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce026aea00/0x22153cd396b7e943 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.562029:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff90cf06871300) 00010000:00010000:1.0:1787826262.562032:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826262.562038:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90ce026aea00/0x22153cd396b7e943 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.562044:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce026aea00/0x22153cd396b7e943 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.562061:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce026ae600/0x22153cd396b7e94a lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.562068:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce026ae600/0x22153cd396b7e94a lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.562074:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90ce026ae600/0x22153cd396b7e94a lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.562079:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce026ae600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826262.562081:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce026ae600/0x22153cd396b7e94a lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.562087:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce026ae600/0x22153cd396b7e94a lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.562094:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x46a4c46c (ffff90cf06871600) 00010000:00010000:1.0:1787826262.562096:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826262.562099:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90ce026ae600/0x22153cd396b7e94a lrc: 2/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.562104:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce026ae600/0x22153cd396b7e94a lrc: 0/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.562148:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce026af200/0x22153cd396b7e93c lrc: 1/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafd90 expref: 16 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.562160:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff90cf06871300) 00010000:00010000:1.0:1787826262.562162:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826262.562166:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce026af200/0x22153cd396b7e93c lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafd90 expref: 16 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.562178:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce026af200, rc 0) 00000100:00100000:1.0:1787826262.562270:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b432580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:47884:x1874670563575936:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 913us (1198us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826262.562281:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3117 00000100:00100000:3.0:1787826262.575186:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563576192 00000100:00100000:3.0:1787826262.575199:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563576192 00000100:00100000:3.0:1787826262.575329:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3119 00000100:00100000:3.0:1787826262.575341:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f806940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:47884:x1874670563576192:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826262.575370:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826262.575399:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b7e966 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aafd9e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826262.575555:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b7e96d lrc: 3/1,0 mode: --/PR res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826262.575573:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b7e96d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826262.575586:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b7e96d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826262.575651:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0x8:0x0]: returning size 4096 00000004:00200000:3.0:1787826262.575658:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1787826262.575704:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b7e966 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafd9e expref: 13 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826262.575726:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b7e96d lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafd9e expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826262.575736:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0x0 (ffff90cf1176a800) 00010000:00010000:3.0:1787826262.575739:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787826262.575743:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400c00, rc 0) 00000100:00100000:3.0:1787826262.575832:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f806940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:47884:x1874670563576192:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 492us (1432us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826262.575844:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3119 00000100:00100000:1.0:1787826262.579310:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826262.587254:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826262.587959:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585090304 00000100:00100000:3.0:1787826262.587963:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585090304 00000100:00100000:3.0:1787826262.587998:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1229 00000100:00100000:3.0:1787826262.588005:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab15e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6519:x1874670585090304:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787826262.588078:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab15e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6519:x1874670585090304:12345-0@lo:1000:mdt00_001.0 Request processed in 74us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826262.588086:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1229 00000100:00100000:3.0:1787826262.590364:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585090432 00000100:00100000:3.0:1787826262.590382:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585090432 00000100:00100000:3.0:1787826262.590824:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1230 00000100:00100000:3.0:1787826262.590837:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6519:x1874670585090432:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787826262.591012:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6519:x1874670585090432:12345-0@lo:1000:mdt00_001.0 Request processed in 178us (2675us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826262.591021:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1230 00000100:00100000:1.0:1787826262.591720:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585090560 00000100:00100000:1.0:1787826262.591727:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585090560 00000100:00100000:1.0:1787826262.592014:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1231 00000100:00100000:1.0:1787826262.592024:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab14780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6519:x1874670585090560:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787826262.592134:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab14780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6519:x1874670585090560:12345-0@lo:1000:mdt00_001.0 Request processed in 111us (854us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787826262.592141:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1231 00000100:00100000:1.0:1787826262.609520:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826262.609770:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563576704 00000100:00100000:3.0:1787826262.609781:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563576704 00010000:00010000:3.0:1787826262.609830:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf421f3c00/0x22153cd396b7e97b lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafda5 expref: 16 pid: 16564 timeout: 1308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826262.609865:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 860 00000100:00100000:3.0:1787826262.609877:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf181fc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2403:x1874670563576704:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826262.609895:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826262.609902:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff90cf421f3c00/0x22153cd396b7e97b lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafda5 expref: 16 pid: 16564 timeout: 1308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826262.609922:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff90cf421f3c00/0x22153cd396b7e97b lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafda5 expref: 16 pid: 16564 timeout: 1308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826262.609951:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf421f3c00/0x22153cd396b7e97b lrc: 0/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafda5 expref: 16 pid: 16564 timeout: 1308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826262.609968:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff90cf1817ca00) 00010000:00010000:3.0:1787826262.609974:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff90cf421f3e00/0x22153cd396b7e989 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x22153cd396b7e982 expref: 5 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826262.609983:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf421f3e00/0x22153cd396b7e989 lrc: 2/0,0 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x22153cd396b7e982 expref: 5 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826262.609994:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf421f3e00/0x22153cd396b7e989 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x22153cd396b7e982 expref: 5 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826262.610031:0:6504:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff90cf421f3e00/0x22153cd396b7e989 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x22153cd396b7e982 expref: 5 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826262.610047:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f89c780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001_UUID:6504:1874670585090944:0@lo:105: 00000100:00100000:3.0:1787826262.610090:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826262.610230:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab16d00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6519:1874670585090688:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1787826262.610260:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf2f46b800/0x22153cd396b7e982 lrc: 4/0,1 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x22153cd396b7e989 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.610273:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf2f46b800/0x22153cd396b7e982 lrc: 4/0,1 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x22153cd396b7e989 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826262.611947:0:6504:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce024a3300 going to sleep for 11 seconds 00000100:00100000:1.0:1787826262.623378:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585091072 00000100:00100000:1.0:1787826262.623397:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585091072 00000100:00100000:1.0:1787826262.623519:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1233 00000100:00100000:1.0:1787826262.623531:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab14f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6519:x1874670585091072:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1787826262.623556:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826262.623594:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce026af200/0x22153cd396b7e997 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x22153cd396b7e990 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.623629:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce026af200/0x22153cd396b7e997 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x22153cd396b7e990 expref: 7 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.624034:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce026af200/0x22153cd396b7e997 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x22153cd396b7e990 expref: 7 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.624046:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x46a4c46c (ffff90cf06871300) 00010000:00010000:1.0:1787826262.624050:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826262.624054:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce026af200, rc 0) 00000100:00100000:1.0:1787826262.624173:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab14f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6519:x1874670585091072:12345-0@lo:101:mdt00_001.0 Request processed in 636us (3290us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826262.624181:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1233 00000100:00100000:3.0:1787826262.624692:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f89c780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001_UUID:6504:1874670585090944:0@lo:105: 00010000:00010000:3.0:1787826262.624711:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826262.624785:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf181fc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2403:x1874670563576704:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 14908us (15277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826262.624799:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 860 00000100:00100000:1.0:1787826262.628458:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585091200 00000100:00100000:1.0:1787826262.628508:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585091200 00000100:00100000:1.0:1787826262.628595:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1234 00000100:00100000:1.0:1787826262.628607:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6519:x1874670585091200:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787826262.628985:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6519:x1874670585091200:12345-0@lo:1000:mdt00_001.0 Request processed in 379us (4418us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826262.628994:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1234 00000100:00100000:1.0:1787826262.630979:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585091328 00000100:00100000:1.0:1787826262.630989:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585091328 00000100:00100000:1.0:1787826262.631049:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1235 00000100:00100000:1.0:1787826262.631058:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aaf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6519:x1874670585091328:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787826262.631217:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aaf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6519:x1874670585091328:12345-0@lo:1000:mdt00_001.0 Request processed in 159us (1175us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787826262.631225:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1235 00000100:00100000:1.0:1787826262.634321:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585091712 00000100:00100000:1.0:1787826262.634335:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585091712 00000100:00100000:1.0:1787826262.634402:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1238 00000100:00100000:1.0:1787826262.634413:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6519:x1874670585091712:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787826262.634594:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6519:x1874670585091712:12345-0@lo:1000:mdt00_001.0 Request processed in 182us (1473us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826262.634602:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1238 00000100:00100000:1.0:1787826262.636290:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585091840 00000100:00100000:1.0:1787826262.636299:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585091840 00000100:00100000:1.0:1787826262.636358:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1239 00000100:00100000:1.0:1787826262.636368:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6519:x1874670585091840:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787826262.637779:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6519:x1874670585091840:12345-0@lo:1000:mdt00_001.0 Request processed in 1404us (2301us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826262.637793:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1239 00000004:00080000:1.0:1787826262.650760:0:7793:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff90cf39defc00 version 26 rpc_version 26 00000020:00100000:1.0:1787826262.650818:0:7793:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826262.650830:0:7793:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff90cf3abc3c00 x1874670585092224/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826262.650862:0:7793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3abc3c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7793:1874670585092224:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826262.650958:0:7793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826262.651009:0:7793:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce01ef9480 going to sleep for 11 seconds 00000100:00100000:1.0:1787826262.655442:0:7793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3abc3c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7793:1874670585092224:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826262.656167:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585092352 00000100:00100000:3.0:1787826262.656176:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585092352 00000100:00100000:3.0:1787826262.656237:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1242 00000100:00100000:3.0:1787826262.656257:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab15a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6519:x1874670585092352:12345-0@lo:101:mdt00_001.0 00010000:00010000:3.0:1787826262.656287:0:7796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826262.656309:0:7796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400800/0x22153cd396b7e9b3 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x22153cd396b7e9ac expref: -99 pid: 7796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826262.656332:0:7796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400800/0x22153cd396b7e9b3 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x22153cd396b7e9ac expref: 9 pid: 7796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826262.656344:0:7796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400800/0x22153cd396b7e9b3 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x22153cd396b7e9ac expref: 9 pid: 7796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826262.656354:0:7796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x9:0x0].0x0 (ffff90cf1176a100) 00010000:00010000:3.0:1787826262.656356:0:7796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826262.656360:0:7796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400800, rc 0) 00000100:00100000:3.0:1787826262.656419:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab15a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:6519:x1874670585092352:12345-0@lo:101:mdt00_001.0 Request processed in 174us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826262.656426:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1242 00010000:00010000:1.0:1787826262.657113:0:7460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826262.657122:0:7460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf2f46b800/0x22153cd396b7e982 lrc: 2/0,0 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x22153cd396b7e989 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.657131:0:7460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46b800 already unused, calling callback (ffffffffc18ffee0) 00010000:00010000:1.0:1787826262.657137:0:7460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf2f46b800/0x22153cd396b7e982 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x22153cd396b7e989 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826262.657150:0:7460:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf2f46b800/0x22153cd396b7e982 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x22153cd396b7e989 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.657186:0:7460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf2f46b800/0x22153cd396b7e982 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x22153cd396b7e989 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.657192:0:7460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787826262.657222:0:7460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf2f46b800/0x22153cd396b7e982 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x22153cd396b7e989 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.657229:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf2f46b800/0x22153cd396b7e982 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x22153cd396b7e989 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.657260:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826262.657262:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826262.657264:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826262.658634:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585092480 00000100:00100000:3.0:1787826262.658643:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585092480 00000100:00100000:3.0:1787826262.658713:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1787826262.658723:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aaf0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+9:3647:x1874670585092480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787826262.658738:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826262.658764:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf421f3e00/0x22153cd396b7e989 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x22153cd396b7e982 expref: 9 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826262.658882:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff90cf1817ca00) 00010000:00010000:3.0:1787826262.658895:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826262.658949:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aaf0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+8:3647:x1874670585092480:12345-0@lo:103:ldlm_bl.0 Request processed in 227us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826262.658956:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1787826262.695306:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826262.697115:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585092608 00000100:00100000:1.0:1787826262.697121:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585092608 00000100:00100000:1.0:1787826262.697162:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787826262.697171:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aaf0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6518:x1874670585092608:12345-0@lo:104: 00010000:00010000:1.0:1787826262.697187:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf2f46a400/0x22153cd396b7e990 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x22153cd396b7e997 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.697274:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787826262.697281:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aaf0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6518:x1874670585092608:12345-0@lo:104: Request processed in 111us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826262.697288:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00010000:1.0:1787826262.697311:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826262.697318:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf2f46a400/0x22153cd396b7e990 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x22153cd396b7e997 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.697326:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46a400 already unused, calling callback (ffffffffc18ffee0) 00010000:00010000:1.0:1787826262.697332:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf2f46a400/0x22153cd396b7e990 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x22153cd396b7e997 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826262.697342:0:6506:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf2f46a400/0x22153cd396b7e990 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x22153cd396b7e997 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.697372:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf2f46a400/0x22153cd396b7e990 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x22153cd396b7e997 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.697380:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787826262.697404:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf2f46a400/0x22153cd396b7e990 lrc: 1/0,0 mode: --/PW res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x22153cd396b7e997 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.697412:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf2f46a400/0x22153cd396b7e990 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x22153cd396b7e997 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.697451:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826262.697453:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826262.697454:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826262.697467:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03a18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585092736:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826262.697544:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826262.697693:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585092736 00000100:00100000:3.0:1787826262.697698:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585092736 00010000:00010000:3.0:1787826262.697722:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce026af200/0x22153cd396b7e997 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x22153cd396b7e990 expref: 8 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826262.697755:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 861 00000100:00100000:3.0:1787826262.697763:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136ced00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+8:3647:x1874670585092736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787826262.697773:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787826262.698305:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aaf3c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6518:1874670585092608:0@lo:104: 00010000:00010000:3.0:1787826262.698329:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff90cf421f3c00/0x22153cd396b7e9c8 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787826262.700034:0:7449:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967561 is committed 00000100:00100000:1.0:1787826262.700603:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03a18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585092736:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787826262.700753:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff90cf421f3c00/0x22153cd396b7e9c8 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826262.700763:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf421f3c00/0x22153cd396b7e9c8 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826262.700939:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f89c780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6518:1874670585092864:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787826262.700997:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826262.701035:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce024a3780 going to sleep for 11 seconds 00000100:00100000:3.0:1787826262.711628:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563576960 00000100:00100000:3.0:1787826262.711642:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563576960 00000100:00100000:3.0:1787826262.711731:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3123 00000100:00100000:3.0:1787826262.711742:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aaf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:47885:x1874670563576960:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826262.711783:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826262.711808:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b7e9d6 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aafdb3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826262.711910:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401c00/0x22153cd396b7e9dd lrc: 3/1,0 mode: --/PR res: [0x200000405:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826262.711926:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401c00/0x22153cd396b7e9dd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826262.711938:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401c00/0x22153cd396b7e9dd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826262.712052:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x7:0x0]: returning size 4096 00000004:00200000:3.0:1787826262.712057:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1787826262.712099:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b7e9d6 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafdb3 expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826262.712120:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401c00/0x22153cd396b7e9dd lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafdb3 expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826262.712130:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x7:0x0].0x0 (ffff90ce01f45100) 00010000:00010000:3.0:1787826262.712133:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787826262.712137:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401c00, rc 0) 00000100:00100000:3.0:1787826262.712210:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aaf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:47885:x1874670563576960:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 470us (1508us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826262.712219:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3123 00000100:00100000:3.0:1787826262.717772:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826262.718558:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563577088 00000100:00100000:1.0:1787826262.718574:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563577088 00000100:00100000:1.0:1787826262.718653:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3124 00000100:00100000:1.0:1787826262.718667:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f89c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:47885:x1874670563577088:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826262.718694:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826262.718722:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026ae600/0x22153cd396b7e9e4 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aafdba expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.718836:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026aea00/0x22153cd396b7e9eb lrc: 3/1,0 mode: --/PR res: [0x200000400:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.718852:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026aea00/0x22153cd396b7e9eb lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.718865:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026aea00/0x22153cd396b7e9eb lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826262.718933:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0x9:0x0]: returning size 4096 00000004:00200000:1.0:1787826262.718939:0:32404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1787826262.718982:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026ae600/0x22153cd396b7e9e4 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafdba expref: 17 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.719003:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026aea00/0x22153cd396b7e9eb lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafdba expref: 16 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.719012:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x9:0x0].0x0 (ffff90ce01f45200) 00010000:00010000:1.0:1787826262.719015:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787826262.719020:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce026aea00, rc 0) 00000100:00100000:1.0:1787826262.719100:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f89c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:47885:x1874670563577088:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 437us (1343us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826262.719112:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3124 00000100:00100000:1.0:1787826262.725418:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787826262.725434:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585092992 00000100:00100000:1.0:1787826262.725438:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585092992 00000100:00100000:1.0:1787826262.725496:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787826262.725505:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05194450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6519:x1874670585092992:12345-0@lo:104: 00010000:00010000:1.0:1787826262.725519:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf2f46b000/0x22153cd396b7e9ac lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x22153cd396b7e9b3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.725582:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787826262.725589:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05194450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6519:x1874670585092992:12345-0@lo:104: Request processed in 86us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826262.725597:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00010000:1.0:1787826262.725666:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826262.725675:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf2f46b000/0x22153cd396b7e9ac lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x22153cd396b7e9b3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.725685:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46b000 already unused, calling callback (ffffffffc18ffee0) 00010000:00010000:1.0:1787826262.725692:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf2f46b000/0x22153cd396b7e9ac lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x9:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x22153cd396b7e9b3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826262.725701:0:6507:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf2f46b000/0x22153cd396b7e9ac lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x9:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x22153cd396b7e9b3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.725734:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf2f46b000/0x22153cd396b7e9ac lrc: 2/0,0 mode: --/PW res: [0x240000401:0x9:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x22153cd396b7e9b3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.725741:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787826262.725766:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf2f46b000/0x22153cd396b7e9ac lrc: 1/0,0 mode: --/PW res: [0x240000401:0x9:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x22153cd396b7e9b3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.725774:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf2f46b000/0x22153cd396b7e9ac lrc: 0/0,0 mode: --/PW res: [0x240000401:0x9:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x22153cd396b7e9b3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.725798:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826262.725800:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826262.725801:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826262.725810:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787826262.725822:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf136ce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585093120:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826262.725855:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826262.725892:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585093120 00000100:00100000:1.0:1787826262.725896:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585093120 00010000:00010000:1.0:1787826262.725917:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400800/0x22153cd396b7e9b3 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x22153cd396b7e9ac expref: 6 pid: 7796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826262.725942:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 862 00000100:00100000:1.0:1787826262.725949:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce039770c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1874670585093120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787826262.725960:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826262.729621:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400800/0x22153cd396b7e9b3 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x22153cd396b7e9ac expref: 6 pid: 7796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.729644:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x9:0x0].0x0 (ffff90cf1176a100) 00010000:00010000:1.0:1787826262.729651:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff90cf421f2600/0x22153cd396b7e9f9 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.729661:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf421f2600/0x22153cd396b7e9f9 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.729674:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf421f2600/0x22153cd396b7e9f9 lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.729718:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826262.729838:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce039770c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874670585093120:12345-0@lo:103:ldlm_bl.0 Request processed in 3888us (3980us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826262.729849:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 862 00000100:00100000:3.0:1787826262.730195:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf136ce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585093120:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787826262.754058:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000004:00080000:3.0:1787826262.755111:0:7793:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff90cf39defc00 version 27 rpc_version 27 00000020:00100000:3.0:1787826262.755149:0:7793:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787826262.755160:0:7793:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff90cf3f89d680 x1874670585093376/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1520/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826262.755188:0:7793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f89d680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7793:1874670585093376:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826262.755270:0:7793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826262.755311:0:7793:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce024a3540 going to sleep for 11 seconds 00000100:00100000:1.0:1787826262.755873:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585093376 00000100:00100000:1.0:1787826262.755883:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585093376 00000100:00100000:1.0:1787826262.755948:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1244 00000100:00100000:1.0:1787826262.755958:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f89cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7793:x1874670585093376:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826262.756217:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f89cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7793:x1874670585093376:12345-0@lo:1000:osp_up1-0.0 Request processed in 260us (946us total) trans 4294967562 rc 0/0 00000100:00100000:1.0:1787826262.756227:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1244 00000100:00100000:3.0:1787826262.757686:0:7793:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967561 gen 2 00000004:00080000:3.0:1787826262.757699:0:7793:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967561 committed transno 4294967561 00000100:00100000:3.0:1787826262.757740:0:7793:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff90cf3f89d680 x1874670585093376/t4294967562(4294967562) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1520/4320 e 0 to 0 dl 1787826278 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826262.757781:0:7793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f89d680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7793:1874670585093376:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826262.760017:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826262.760091:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563577984 00000100:00100000:3.0:1787826262.760101:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563577984 00000100:00100000:3.0:1787826262.760162:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 920 00000100:00100000:3.0:1787826262.760172:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03739680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+18:47885:x1874670563577984:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:3.0:1787826262.760606:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03739680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:47885:x1874670563577984:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 434us (603us total) trans 4294969206 rc 0/0 00000100:00100000:3.0:1787826262.760615:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 920 00000100:00100000:1.0:1787826262.909331:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563578112 00000100:00100000:1.0:1787826262.909345:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563578112 00000100:00100000:1.0:1787826262.909435:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3128 00000100:00100000:1.0:1787826262.909448:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf39609050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:47894:x1874670563578112:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826262.909514:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826262.909543:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026af000/0x22153cd396b7ea15 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aafdcf expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.909662:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026aee00/0x22153cd396b7ea1c lrc: 3/1,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.909681:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026aee00/0x22153cd396b7ea1c lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.909695:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026aee00/0x22153cd396b7ea1c lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.909711:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026ae200/0x22153cd396b7ea23 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x8:0x0].0x892874e3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.909718:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026ae200/0x22153cd396b7ea23 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.909725:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026ae200/0x22153cd396b7ea23 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.909794:0:32404:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026aee00/0x22153cd396b7ea1c lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.909802:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026aee00/0x22153cd396b7ea1c lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.909809:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026aee00/0x22153cd396b7ea1c lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.909816:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026aee00/0x22153cd396b7ea1c lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.909822:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce026aee00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826262.909827:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026aee00/0x22153cd396b7ea1c lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.909836:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026aee00/0x22153cd396b7ea1c lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.909849:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0x0 (ffff90cf1176a800) 00010000:00010000:1.0:1787826262.909853:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826262.909857:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026aee00/0x22153cd396b7ea1c lrc: 3/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.909864:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026aee00/0x22153cd396b7ea1c lrc: 0/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.909880:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026ae200/0x22153cd396b7ea23 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.909885:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026ae200/0x22153cd396b7ea23 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.909891:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026ae200/0x22153cd396b7ea23 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.909895:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce026ae200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826262.909897:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026ae200/0x22153cd396b7ea23 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.909903:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026ae200/0x22153cd396b7ea23 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.909910:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0x892874e3 (ffff90cf06871600) 00010000:00010000:1.0:1787826262.909912:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826262.909915:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026ae200/0x22153cd396b7ea23 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.909920:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026ae200/0x22153cd396b7ea23 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.909961:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026af000/0x22153cd396b7ea15 lrc: 1/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafdcf expref: 20 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.909974:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0x0 (ffff90cf1176a800) 00010000:00010000:1.0:1787826262.909976:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826262.909980:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026af000/0x22153cd396b7ea15 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafdcf expref: 20 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.909991:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce026af000, rc 0) 00000100:00100000:1.0:1787826262.910083:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf39609050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:47894:x1874670563578112:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 637us (899us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826262.910092:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3128 00000100:00100000:1.0:1787826262.922608:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826262.935931:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563578496 00000100:00100000:3.0:1787826262.935944:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563578496 00000100:00100000:3.0:1787826262.936633:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3130 00000100:00100000:3.0:1787826262.936649:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aaf1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:47894:x1874670563578496:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:3.0:1787826262.936727:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826262.937000:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b7e96d lrc: 0/0,0 mode: --/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafd9e expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826262.937024:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0x0 (ffff90cf1176a800) 00010000:00010000:3.0:1787826262.937039:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826262.937124:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b7ea38 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826262.937139:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b7ea38 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826262.937151:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b7ea38 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826262.937165:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b7ea3f lrc: 3/0,1 mode: --/PW res: [0x200000400:0x8:0x0].0x892874e3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826262.937173:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b7ea3f lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826262.937179:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b7ea3f lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787826262.938625:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x2:0x0].26, 2152 off56144 00000040:00080000:3.0:1787826262.938723:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].14, 2352 off54024 00000004:00080000:3.0:1787826262.938730:0:6520:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff90ce024a3480 with version 28 00000100:00100000:3.0:1787826262.939194:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585093632 00000100:00100000:3.0:1787826262.939203:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585093632 00000100:00100000:3.0:1787826262.939310:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1245 00000100:00100000:3.0:1787826262.939321:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aaf12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7793:x1874670585093632:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826262.940138:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aaf12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:7793:x1874670585093632:12345-0@lo:1000:osp_up1-0.0 Request processed in 816us (1069us total) trans 4294967563 rc 0/0 00000100:00100000:3.0:1787826262.940149:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1245 00000100:00100000:1.0:1787826262.941086:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585093760 00000100:00100000:1.0:1787826262.941093:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585093760 00000100:00100000:1.0:1787826262.941179:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1246 00000100:00100000:1.0:1787826262.941189:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf0c40ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6520:x1874670585093760:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1787826262.941209:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826262.941229:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce026ae200/0x22153cd396b7ea5b lrc: 2/0,0 mode: --/PW res: [0x240000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x22153cd396b7ea54 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.941263:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce026ae200/0x22153cd396b7ea5b lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x22153cd396b7ea54 expref: 8 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.941277:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce026ae200/0x22153cd396b7ea5b lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x22153cd396b7ea54 expref: 8 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.941287:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xa:0x0].0x0 (ffff90cf06871600) 00010000:00010000:1.0:1787826262.941290:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826262.941295:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce026ae200, rc 0) 00000100:00100000:1.0:1787826262.941344:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf0c40ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6520:x1874670585093760:12345-0@lo:101:mdt00_002.0 Request processed in 157us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826262.941350:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1246 00000100:00100000:3.0:1787826262.941724:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aaf2d00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6520:1874670585093760:0@lo:101:mdt00_002.0 00010000:00010000:3.0:1787826262.941743:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf421f2e00/0x22153cd396b7ea54 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x22153cd396b7ea5b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826262.941756:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf421f2e00/0x22153cd396b7ea54 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x22153cd396b7ea5b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826262.941782:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fa52ecce reply state 0000000048c2be0c transno 4294969207 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421f3c00/0x22153cd396b7ea4d lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826262.941796:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421f3c00/0x22153cd396b7ea4d lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826262.941802:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xa:0x0].0x0 (ffff90cf1817cc00) 00010000:00010000:3.0:1787826262.941804:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826262.941807:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787826262.941814:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf421f2e00/0x22153cd396b7ea54 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x22153cd396b7ea5b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826262.941821:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf421f2e00/0x22153cd396b7ea54 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x22153cd396b7ea5b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787826262.941832:0:6520:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0xa:0x0] 00000004:00010000:3.0:1787826262.941839:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fa52ecce reply state 0000000048c2be0c transno 4294969207 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421f2a00/0x22153cd396b7ea46 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826262.941846:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421f2a00/0x22153cd396b7ea46 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826262.941851:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x8:0x0].0x0 (ffff90cf1817c700) 00010000:00010000:3.0:1787826262.941853:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826262.941855:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:3.0:1787826262.941861:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x8:0x0]: returning size 4096 00010000:00010000:3.0:1787826262.941871:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b7ea38 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826262.941876:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b7ea38 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826262.941882:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b7ea38 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826262.941887:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b7ea38 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826262.941892:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826262.941897:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b7ea38 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826262.941904:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b7ea38 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826262.941915:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0x0 (ffff90cf08af9000) 00010000:00010000:3.0:1787826262.941917:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826262.941921:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b7ea38 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826262.941932:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b7ea38 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826262.941952:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fa52ecce reply state 0000000048c2be0c transno 4294969207 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b7ea3f lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826262.941960:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b7ea3f lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826262.941966:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0x892874e3 (ffff90cf08af9c00) 00010000:00010000:3.0:1787826262.941968:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826262.941970:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:3.0:1787826262.942054:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aaf1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:47894:x1874670563578496:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 5407us (6384us total) trans 4294969207 rc 0/0 00000100:00100000:3.0:1787826262.942062:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3130 00000100:00100000:1.0:1787826262.958999:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826262.963810:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826262.971393:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563579008 00000100:00100000:1.0:1787826262.971427:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563579008 00000100:00100000:1.0:1787826262.971541:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3132 00000100:00100000:1.0:1787826262.971554:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f89d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:47895:x1874670563579008:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826262.971589:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826262.971619:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026aee00/0x22153cd396b7ea7e lrc: 2/0,0 mode: --/CR res: [0x200000405:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aafde4 expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826262.971891:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x7:0x0]: returning size 4096 00010000:00010000:1.0:1787826262.972022:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026aee00/0x22153cd396b7ea7e lrc: 1/0,0 mode: --/CR res: [0x200000405:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafde4 expref: 22 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.972054:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x7:0x0].0x0 (ffff90ce01f45100) 00010000:00010000:1.0:1787826262.972057:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787826262.972064:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026aee00/0x22153cd396b7ea7e lrc: 0/0,0 mode: --/CR res: [0x200000405:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafde4 expref: 22 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826262.972080:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce026aee00, rc 0) 00000100:00100000:1.0:1787826262.972158:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f89d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:47895:x1874670563579008:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 607us (8361us total) trans 4294969208 rc 301/301 00000100:00100000:1.0:1787826262.972166:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3132 00000100:00100000:1.0:1787826262.978527:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826262.978712:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563579392 00000100:00100000:3.0:1787826262.978726:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563579392 00000100:00100000:3.0:1787826262.978808:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 921 00000100:00100000:3.0:1787826262.978820:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eea0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:47895:x1874670563579392:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:3.0:1787826262.979126:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eea0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:47895:x1874670563579392:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 308us (660us total) trans 4294969209 rc 0/0 00000100:00100000:3.0:1787826262.979136:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 921 00000100:00100000:1.0:1787826262.983839:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826262.995194:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826263.000909:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563579904 00000100:00100000:3.0:1787826263.000923:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563579904 00000100:00100000:3.0:1787826263.001102:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3134 00000100:00100000:3.0:1787826263.001115:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aaf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:47895:x1874670563579904:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826263.001143:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826263.001172:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b7eaa1 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aafdf2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826263.001300:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b7eaa8 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826263.001318:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b7eaa8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826263.001334:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b7eaa8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826263.001526:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x7:0x0]: returning size 4096 00000004:00200000:3.0:1787826263.001533:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1787826263.001560:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b7eaa8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826263.001591:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b7eaa1 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafdf2 expref: 26 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826263.001615:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b7eaa8 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafdf2 expref: 25 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826263.001625:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x7:0x0].0x0 (ffff90ce01f45100) 00010000:00010000:3.0:1787826263.001628:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787826263.001632:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400c00, rc 0) 00000100:00100000:3.0:1787826263.001720:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aaf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:47895:x1874670563579904:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 608us (1372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826263.001728:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3134 00000100:00100000:1.0:1787826263.007126:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826263.007229:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563580032 00000100:00100000:3.0:1787826263.007252:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563580032 00000100:00100000:3.0:1787826263.007374:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3135 00000100:00100000:3.0:1787826263.007388:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03738000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:47895:x1874670563580032:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826263.007426:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826263.007459:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b7eaaf lrc: 2/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aafdf9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826263.007634:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b7eab6 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826263.007653:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b7eab6 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826263.007666:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b7eab6 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826263.007681:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401c00/0x22153cd396b7eabd lrc: 3/1,0 mode: --/PR res: [0x200000400:0x8:0x0].0x892874e3 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826263.007688:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401c00/0x22153cd396b7eabd lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826263.007694:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401c00/0x22153cd396b7eabd lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826263.007808:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b7eac4 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826263.007816:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b7eac4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826263.007827:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b7eac4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826263.007929:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x8:0x0]: returning size 4096 00000004:00200000:3.0:1787826263.007934:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1787826263.007958:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b7eac4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826263.007971:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b7eab6 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826263.007979:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b7eab6 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826263.007986:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b7eab6 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826263.007992:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b7eab6 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826263.007998:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826263.008002:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b7eab6 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826263.008011:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b7eab6 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826263.008025:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0x0 (ffff90cf08af9600) 00010000:00010000:3.0:1787826263.008029:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826263.008034:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b7eab6 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826263.008044:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b7eab6 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826263.008061:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401c00/0x22153cd396b7eabd lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826263.008067:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401c00/0x22153cd396b7eabd lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826263.008072:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401c00/0x22153cd396b7eabd lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826263.008077:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826263.008080:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401c00/0x22153cd396b7eabd lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826263.008085:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401c00/0x22153cd396b7eabd lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826263.008092:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0x892874e3 (ffff90cf08af9c00) 00010000:00010000:3.0:1787826263.008094:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826263.008097:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401c00/0x22153cd396b7eabd lrc: 2/0,0 mode: --/PR res: [0x200000400:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826263.008103:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401c00/0x22153cd396b7eabd lrc: 0/0,0 mode: --/PR res: [0x200000400:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826263.008132:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b7eaaf lrc: 0/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafdf9 expref: 27 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826263.008151:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b7eac4 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafdf9 expref: 26 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826263.008159:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x8:0x0].0x0 (ffff90cf1817c700) 00010000:00010000:3.0:1787826263.008161:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787826263.008164:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400800, rc 0) 00000100:00100000:3.0:1787826263.008258:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03738000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:47895:x1874670563580032:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 873us (1145us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826263.008266:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3135 00000100:00100000:1.0:1787826263.011939:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563580160 00000100:00100000:1.0:1787826263.011952:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563580160 00000100:00100000:1.0:1787826263.012030:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3136 00000100:00100000:1.0:1787826263.012041:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:47895:x1874670563580160:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826263.012067:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826263.012093:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026afc00/0x22153cd396b7eacb lrc: 2/0,0 mode: --/CR res: [0x200000400:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aafe00 expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826263.012197:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026aee00/0x22153cd396b7ead2 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826263.012213:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026aee00/0x22153cd396b7ead2 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826263.012226:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026aee00/0x22153cd396b7ead2 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826263.012301:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1787826263.012307:0:8247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1787826263.012352:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026afc00/0x22153cd396b7eacb lrc: 0/0,0 mode: --/CR res: [0x200000400:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafe00 expref: 28 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826263.012373:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026aee00/0x22153cd396b7ead2 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafe00 expref: 27 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826263.012383:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xa:0x0].0x0 (ffff90cf1817cc00) 00010000:00010000:1.0:1787826263.012387:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787826263.012391:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce026aee00, rc 0) 00000100:00100000:1.0:1787826263.012629:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:47895:x1874670563580160:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 470us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826263.012639:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3136 00000100:00100000:1.0:1787826263.016364:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826263.017366:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585093888 00000100:00100000:3.0:1787826263.017371:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585093888 00000100:00100000:3.0:1787826263.017650:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787826263.017660:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aaf0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:16564:x1874670585093888:12345-0@lo:104: 00010000:00010000:3.0:1787826263.017675:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf421f2e00/0x22153cd396b7ea54 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x22153cd396b7ea5b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826263.017745:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787826263.017751:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aaf0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:16564:x1874670585093888:12345-0@lo:104: Request processed in 93us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826263.017759:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787826263.018633:0:16564:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aaf21c0 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:16564:1874670585093888:0@lo:104: 00010000:00010000:1.0:1787826263.018660:0:16564:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff90ce0a067000/0x22153cd396b7eae0 lrc: 3/1,0 mode: --/PR res: [0x240000401:0xa:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826263.021878:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce026ae200/0x22153cd396b7ea5b lrc: 0/0,0 mode: --/PW res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x22153cd396b7ea54 expref: 6 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826263.021900:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xa:0x0].0x0 (ffff90cf06871600) 00010000:00010000:1.0:1787826263.021907:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff90ce0a067000/0x22153cd396b7eae0 lrc: 3/1,0 mode: --/PR res: [0x240000401:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826263.021918:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce0a067000/0x22153cd396b7eae0 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826263.021926:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce0a067000/0x22153cd396b7eae0 lrc: 4/1,0 mode: PR/PR res: [0x240000401:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826263.021996:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826263.022098:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab15e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874670585094016:12345-0@lo:103:ldlm_bl.0 Request processed in 3979us (4088us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826263.022110:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 863 00000100:00100000:3.0:1787826263.026921:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563580544 00000100:00100000:3.0:1787826263.026935:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563580544 00000100:00100000:3.0:1787826263.027016:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3138 00000100:00100000:3.0:1787826263.027026:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aaf3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:47895:x1874670563580544:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826263.027054:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826263.027081:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b7eae7 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aafe0e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826263.027314:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x8:0x0]: returning size 4096 00010000:00010000:3.0:1787826263.027441:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b7eae7 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafe0e expref: 29 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826263.027458:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x8:0x0].0x0 (ffff90cf1817c700) 00010000:00010000:3.0:1787826263.027461:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787826263.027467:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b7eae7 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafe0e expref: 29 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826263.027704:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400000, rc 0) 00000100:00100000:3.0:1787826263.027785:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aaf3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+28:47895:x1874670563580544:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 759us (1051us total) trans 4294969211 rc 301/301 00000100:00100000:3.0:1787826263.027794:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3138 00000100:00100000:3.0:1787826263.032935:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563580800 00000100:00100000:3.0:1787826263.032948:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563580800 00000100:00100000:3.0:1787826263.033062:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3139 00000100:00100000:3.0:1787826263.033075:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab16580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+28:47895:x1874670563580800:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:3.0:1787826263.033150:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826263.033187:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b7eac4 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafdf9 expref: 28 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826263.033211:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x8:0x0].0x0 (ffff90cf1817c700) 00010000:00010000:3.0:1787826263.033217:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826263.033253:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401c00/0x22153cd396b7eaf5 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826263.033270:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401c00/0x22153cd396b7eaf5 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826263.033280:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401c00/0x22153cd396b7eaf5 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787826263.033780:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x2:0x0].27, 456 off56600 00000040:00080000:3.0:1787826263.033840:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].15, 536 off54560 00000004:00080000:3.0:1787826263.033848:0:6519:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff90ce024a3b40 with version 29 00000100:00100000:3.0:1787826263.034431:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585094272 00000100:00100000:3.0:1787826263.034438:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585094272 00000100:00100000:1.0:1787826263.039039:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826263.039168:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563581056 00000100:00100000:3.0:1787826263.039180:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563581056 00000100:00100000:3.0:1787826263.039281:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 923 00000100:00100000:3.0:1787826263.039293:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03739a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+29:47895:x1874670563581056:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:3.0:1787826263.039704:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03739a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:47895:x1874670563581056:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 412us (678us total) trans 4294969213 rc 0/0 00000100:00100000:3.0:1787826263.039714:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 923 00000100:00100000:1.0:1787826263.085369:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826263.085710:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563581184 00000100:00100000:3.0:1787826263.085724:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563581184 00000100:00100000:3.0:1787826263.085811:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 924 00000100:00100000:3.0:1787826263.085824:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03739680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:47898:x1874670563581184:12345-192.168.203.39@tcp:33:lfs.0 00000004:00200000:3.0:1787826263.085987:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x7:0x0]: returning size 4096 00000004:00200000:3.0:1787826263.085994:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:3.0:1787826263.086095:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03739680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:47898:x1874670563581184:12345-192.168.203.39@tcp:33:lfs.0 Request processed in 274us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826263.086104:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 924 00000100:00100000:3.0:1787826263.303182:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585094400 00000100:00100000:3.0:1787826263.303200:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585094400 00000100:00100000:3.0:1787826263.303298:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1248 00000100:00100000:3.0:1787826263.303309:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1874670585094400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787826263.303366:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446178816 avail 1299939328 00000100:00100000:3.0:1787826263.303497:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1874670585094400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 190us (2096us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826263.303505:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1248 00000100:00100000:3.0:1787826263.305892:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1387 00000100:00100000:3.0:1787826263.305904:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab14780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874670585094656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826263.305954:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab14780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874670585094656:12345-0@lo:400:kworker.0 Request processed in 54us (1025us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826263.305960:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1387 00000100:00100000:3.0:1787826263.305988:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03aef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874670585094656:0@lo:400:kworker.0 00000100:00100000:3.0:1787826263.306010:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1388 00000100:00100000:3.0:1787826263.306016:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab14f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874670585095680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826263.306047:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab14f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874670585095680:12345-0@lo:400:kworker.0 Request processed in 31us (1036us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826263.306052:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1388 00000100:00100000:3.0:1787826263.306073:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a8ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874670585095680:0@lo:400:kworker.0 00000100:00100000:3.0:1787826263.306089:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1389 00000100:00100000:3.0:1787826263.306096:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874670585095808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826263.306126:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874670585095808:12345-0@lo:400:kworker.0 Request processed in 32us (995us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826263.306132:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1389 00000100:00100000:3.0:1787826263.306152:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03b90f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1874670585095808:0@lo:400:kworker.0 00000100:00100000:3.0:1787826263.306187:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585094784 00000100:00100000:3.0:1787826263.306192:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585094784 00000100:00100000:3.0:1787826263.306222:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1249 00000100:00100000:3.0:1787826263.306227:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3644:x1874670585094784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826263.306275:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3644:x1874670585094784:12345-0@lo:400:kworker.0 Request processed in 47us (1215us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826263.306281:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1249 00000100:00100000:3.0:1787826263.306303:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03aec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585094784:0@lo:400:kworker.0 00000100:00100000:3.0:1787826263.306360:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a8ae1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585095424:0@lo:400:kworker.0 00000100:00100000:3.0:1787826263.306370:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03b93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1874670585095936:0@lo:400:kworker.0 00000100:00100000:3.0:1787826263.306402:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826263.306429:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03aec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585095040:0@lo:400:kworker.0 00000100:00100000:3.0:1787826263.306452:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585095936 00000100:00100000:3.0:1787826263.306455:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585095936 00000100:00100000:3.0:1787826263.306503:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1390 00000100:00100000:3.0:1787826263.306509:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f89f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874670585095936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826263.306544:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f89f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874670585095936:12345-0@lo:400:kworker.0 Request processed in 35us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826263.306550:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1390 00000100:00100000:3.0:1787826263.306572:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03b93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1874670585095936:0@lo:400:kworker.0 00000100:00100000:3.0:1787826263.309810:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03aef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874670585094912:0@lo:400:kworker.0 00000100:00100000:3.0:1787826263.309830:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a8acb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874670585095552:0@lo:400:kworker.0 00000100:00100000:1.0:1787826263.310228:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585094528 00000100:00100000:1.0:1787826263.310246:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585094528 00000100:00100000:1.0:1787826263.310305:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 853 00000100:00100000:1.0:1787826263.310315:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf185c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3c550b8-2c3c-46c3-ad36-671c284167ea+24:3647:x1874670585094528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826263.310379:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf185c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3c550b8-2c3c-46c3-ad36-671c284167ea+24:3647:x1874670585094528:12345-0@lo:400:kworker.0 Request processed in 66us (6369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826263.310386:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 853 00000100:00100000:3.0:1787826263.310866:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce04f40b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e3c550b8-2c3c-46c3-ad36-671c284167ea:3647:1874670585094528:0@lo:400:kworker.0 00010000:00010000:1.0:1787826263.364192:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826264.389111:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826264.835860:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aaf2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585096064:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787826264.835967:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826264.836225:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aaf30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585096192:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787826264.836267:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826264.836760:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aaf30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585096192:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787826264.836794:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aaf2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585096064:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826264.837193:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787826264.837204:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aaf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585096320:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826264.837248:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826264.837451:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787826264.837460:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f89cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585096448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787826264.837511:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826264.837534:0:12021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585096320 00000100:00100000:3.0:1787826264.837540:0:12021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585096320 00000100:00100000:3.0:1787826264.837571:0:12021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585096448 00000100:00100000:3.0:1787826264.837574:0:12021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585096448 00000100:00100000:3.0:1787826264.837593:0:12021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 672 00000100:00100000:3.0:1787826264.837599:0:12021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03b930c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874670585096320:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787826264.837621:0:12021:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3922436096 avail 3690913792 00000100:00100000:3.0:1787826264.837661:0:12021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03b930c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874670585096320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826264.837667:0:12021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 672 00000100:00100000:3.0:1787826264.837681:0:12021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 673 00000100:00100000:3.0:1787826264.837687:0:12021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f89da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874670585096448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787826264.837697:0:12021:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3922436096 avail 3690913792 00000100:00100000:3.0:1787826264.837719:0:12021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f89da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874670585096448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 33us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826264.837725:0:12021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 673 00000100:00100000:3.0:1787826264.837762:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f89cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585096448:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826264.837852:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aaf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585096320:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826265.036384:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563581440 00000100:00100000:3.0:1787826265.036399:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563581440 00000100:00100000:3.0:1787826265.036558:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3140 00000100:00100000:3.0:1787826265.036571:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:48091:x1874670563581440:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826265.036597:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826265.036844:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b7eafc lrc: 2/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aafe15 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.036987:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b7eb03 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.037004:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b7eb03 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.037021:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b7eb03 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.037035:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b7eb0a lrc: 3/1,0 mode: --/PR res: [0x200000400:0x8:0x0].0x892874e3 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.037043:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b7eb0a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.037050:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b7eb0a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826265.037248:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x8:0x0]: returning size 4096 00010000:00010000:3.0:1787826265.037423:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b7eb03 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.037432:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b7eb03 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.037440:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b7eb03 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.037448:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b7eb03 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.037456:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826265.037461:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b7eb03 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.037495:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b7eb03 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.037812:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0x0 (ffff90cf08af9000) 00010000:00010000:3.0:1787826265.037816:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826265.037823:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b7eb03 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.037831:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b7eb03 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.037848:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b7eb0a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.037854:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b7eb0a lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.037860:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b7eb0a lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.037864:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826265.037867:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b7eb0a lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.037878:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b7eb0a lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.037886:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0x892874e3 (ffff90cf08af9c00) 00010000:00010000:3.0:1787826265.037889:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826265.037892:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b7eb0a lrc: 2/0,0 mode: --/PR res: [0x200000400:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.037897:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b7eb0a lrc: 0/0,0 mode: --/PR res: [0x200000400:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.037939:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b7eafc lrc: 1/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafe15 expref: 32 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.037951:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0x0 (ffff90cf08af9000) 00010000:00010000:3.0:1787826265.037954:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787826265.037958:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b7eafc lrc: 0/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafe15 expref: 32 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.037973:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400800, rc 0) 00000100:00100000:3.0:1787826265.038069:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:48091:x1874670563581440:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1501us (2065us total) trans 4294969214 rc 301/301 00000100:00100000:3.0:1787826265.038079:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3140 00000100:00100000:1.0:1787826265.043315:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00010000:00010000:3.0:1787826265.058123:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b7e99e lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.058136:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b7e99e lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.058150:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b7e99e lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.058157:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46ba00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826265.058163:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b7e99e lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.058173:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b7e99e lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.058194:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x7:0x0].0x0 (ffff90ce01f45100) 00010000:00010000:3.0:1787826265.058198:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826265.058204:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b7e99e lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.058211:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b7e99e lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.058236:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b7e9a5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.058243:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b7e9a5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.058249:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b7e9a5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.058254:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46bc00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826265.058257:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b7e9a5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.058267:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b7e9a5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.058276:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x9:0x0].0x0 (ffff90ce01f45200) 00010000:00010000:3.0:1787826265.058278:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826265.058281:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b7e9a5 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.058286:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b7e9a5 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.058318:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421f2400/0x22153cd396b7ea0e lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.058453:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421f2400/0x22153cd396b7ea0e lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.058460:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421f2400/0x22153cd396b7ea0e lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.058465:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf421f2400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826265.058468:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421f2400/0x22153cd396b7ea0e lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.058495:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421f2400/0x22153cd396b7ea0e lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.058505:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x7:0x0].0x0 (ffff90ce01f45100) 00010000:00010000:3.0:1787826265.058508:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787826265.058510:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421f2400/0x22153cd396b7ea0e lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.058520:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421f2400/0x22153cd396b7ea0e lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.058538:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b7ea3f lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.058545:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b7ea3f lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.058551:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b7ea3f lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.058556:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826265.058559:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b7ea3f lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.058565:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b7ea3f lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.058573:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0x892874e3 (ffff90cf08af9c00) 00010000:00010000:3.0:1787826265.058576:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826265.058579:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b7ea3f lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.058584:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b7ea3f lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.058602:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421f2a00/0x22153cd396b7ea46 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.058609:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421f2a00/0x22153cd396b7ea46 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.058615:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421f2a00/0x22153cd396b7ea46 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.058621:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf421f2a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826265.058623:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421f2a00/0x22153cd396b7ea46 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.058629:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421f2a00/0x22153cd396b7ea46 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.059043:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x8:0x0].0x0 (ffff90cf1817c700) 00010000:00010000:3.0:1787826265.059047:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826265.059052:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421f2a00/0x22153cd396b7ea46 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.059058:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421f2a00/0x22153cd396b7ea46 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.059070:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421f3c00/0x22153cd396b7ea4d lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.059711:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421f3c00/0x22153cd396b7ea4d lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.059724:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421f3c00/0x22153cd396b7ea4d lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.059734:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf421f3c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826265.059738:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421f3c00/0x22153cd396b7ea4d lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.060369:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421f3c00/0x22153cd396b7ea4d lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.060391:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xa:0x0].0x0 (ffff90cf1817cc00) 00010000:00010000:3.0:1787826265.060394:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826265.060399:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421f3c00/0x22153cd396b7ea4d lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.060406:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421f3c00/0x22153cd396b7ea4d lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.060436:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401c00/0x22153cd396b7eaf5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x8:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.060443:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401c00/0x22153cd396b7eaf5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x8:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.060449:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401c00/0x22153cd396b7eaf5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x8:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.060455:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826265.060459:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401c00/0x22153cd396b7eaf5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x8:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.060465:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401c00/0x22153cd396b7eaf5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x8:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.060793:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x8:0x0].0x0 (ffff90cf1817c700) 00010000:00010000:3.0:1787826265.060798:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787826265.060803:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401c00/0x22153cd396b7eaf5 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x8:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826265.060814:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401c00/0x22153cd396b7eaf5 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x8:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826265.061771:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563581952 00000100:00100000:3.0:1787826265.061784:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563581952 00000100:00100000:3.0:1787826265.062007:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 925 00000100:00100000:3.0:1787826265.062022:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:48091:x1874670563581952:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:3.0:1787826265.062349:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+17:48091:x1874670563581952:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 330us (638us total) trans 4294969216 rc 0/0 00000100:00100000:3.0:1787826265.062358:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 925 00000100:00100000:3.0:1787826265.086409:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563582336 00000100:00100000:3.0:1787826265.086422:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563582336 00000100:00100000:3.0:1787826265.086542:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 927 00000100:00100000:3.0:1787826265.086554:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aaf12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+17:48091:x1874670563582336:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:3.0:1787826265.086843:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aaf12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+18:48091:x1874670563582336:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 291us (556us total) trans 4294969217 rc 0/0 00000100:00100000:3.0:1787826265.086851:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 927 00000100:00100000:1.0:1787826265.241318:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563582720 00000100:00100000:1.0:1787826265.241331:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563582720 00000100:00100000:1.0:1787826265.241432:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 794 00000100:00100000:1.0:1787826265.241446:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab15a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2403:x1874670563582720:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1787826265.241581:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab15a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2403:x1874670563582720:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 137us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826265.241590:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 794 00000100:00100000:3.0:1787826265.248609:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00010000:00010000:1.0:1787826265.412100:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826267.142127:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563583104 00000100:00100000:1.0:1787826267.142140:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563583104 00000100:00100000:1.0:1787826267.142336:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3142 00000100:00100000:1.0:1787826267.142352:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+18:48283:x1874670563583104:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:1.0:1787826267.142433:0:32404:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826267.142524:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b7eaa8 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafdf2 expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826267.142556:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x7:0x0].0x0 (ffff90ce01f45100) 00010000:00010000:1.0:1787826267.142563:0:32404:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826267.142592:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026af600/0x22153cd396b7eb34 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826267.142607:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026af600/0x22153cd396b7eb34 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826267.142619:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026af600/0x22153cd396b7eb34 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787826267.143228:0:32404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x2:0x0].28, 216 off56816 00000040:00080000:1.0:1787826267.143297:0:32404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].16, 296 off54856 00000004:00080000:1.0:1787826267.143307:0:32404:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff90ce01ef9f00 with version 30 00000100:00100000:1.0:1787826267.149089:0:7793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab16d00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7793:1874670585096704:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826267.180717:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826267.182794:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563583360 00000100:00100000:3.0:1787826267.182813:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563583360 00000100:00100000:3.0:1787826267.182932:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3143 00000100:00100000:3.0:1787826267.182947:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03b91680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:48284:x1874670563583360:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826267.182975:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826267.183003:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401c00/0x22153cd396b7eb3b lrc: 2/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aafe23 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826267.183104:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b7eb42 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826267.183124:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b7eb42 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826267.183141:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b7eb42 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826267.183160:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400400/0x22153cd396b7eb49 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826267.183167:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400400/0x22153cd396b7eb49 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826267.183185:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400400/0x22153cd396b7eb49 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826267.183281:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400800/0x22153cd396b7eb50 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826267.183291:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400800/0x22153cd396b7eb50 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826267.183298:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400800/0x22153cd396b7eb50 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826267.183315:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b7eb42 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826267.183324:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b7eb42 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826267.183331:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b7eb42 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826267.183338:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b7eb42 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826267.183345:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826267.183349:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b7eb42 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826267.183357:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b7eb42 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826267.183370:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff90cf1817ce00) 00010000:00010000:3.0:1787826267.183374:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826267.183380:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b7eb42 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826267.183615:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b7eb42 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826267.183632:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400400/0x22153cd396b7eb49 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826267.183638:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400400/0x22153cd396b7eb49 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826267.183644:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400400/0x22153cd396b7eb49 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826267.183648:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826267.183651:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400400/0x22153cd396b7eb49 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826267.183836:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400400/0x22153cd396b7eb49 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826267.183849:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x46a4c46c (ffff90cf08af9c00) 00010000:00010000:3.0:1787826267.183852:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826267.183855:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400400/0x22153cd396b7eb49 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826267.183861:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400400/0x22153cd396b7eb49 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826267.183913:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401c00/0x22153cd396b7eb3b lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafe23 expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826267.183929:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400800/0x22153cd396b7eb50 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafe23 expref: 20 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826267.183937:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x7:0x0].0x0 (ffff90ce01f45d00) 00010000:00010000:3.0:1787826267.183940:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787826267.183943:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400800, rc 0) 00000100:00100000:3.0:1787826267.190528:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563583488 00000100:00100000:3.0:1787826267.190542:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563583488 00000100:00100000:3.0:1787826267.190621:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 328 00000100:00100000:3.0:1787826267.190633:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aaf3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:2402:x1874670563583488:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826267.190654:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826267.190688:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400800/0x22153cd396b7eb50 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafe23 expref: 20 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826267.190711:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x7:0x0].0x0 (ffff90ce01f45d00) 00010000:00010000:3.0:1787826267.190718:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826267.190907:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aaf3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:2402:x1874670563583488:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 154us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826267.190917:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 328 00000100:00100000:3.0:1787826267.197989:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826267.201262:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826267.201354:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563584128 00000100:00100000:3.0:1787826267.201365:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563584128 00000100:00100000:3.0:1787826267.201442:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 929 00000100:00100000:3.0:1787826267.201454:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03b93c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:48284:x1874670563584128:12345-192.168.203.39@tcp:33:lfs.0 00000004:00200000:3.0:1787826267.201925:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x7:0x0]: returning size 4096 00000004:00200000:3.0:1787826267.201932:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:3.0:1787826267.202030:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03b93c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:48284:x1874670563584128:12345-192.168.203.39@tcp:33:lfs.0 Request processed in 577us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826267.202039:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 929 00000100:00100000:1.0:1787826267.204180:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826267.204670:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3145 00000100:00100000:3.0:1787826267.204685:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03b92d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:48284:x1874670563584256:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826267.204710:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826267.204751:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b7eb65 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aafe31 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826267.205027:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401c00/0x22153cd396b7eb6c lrc: 3/1,0 mode: --/PR res: [0x200000405:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826267.205052:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401c00/0x22153cd396b7eb6c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826267.205073:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401c00/0x22153cd396b7eb6c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826267.205201:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x7:0x0]: returning size 4096 00000004:00200000:3.0:1787826267.205207:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1787826267.205242:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401c00/0x22153cd396b7eb6c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826267.205273:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b7eb65 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafe31 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826267.205299:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401c00/0x22153cd396b7eb6c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafe31 expref: 22 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826267.205309:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x7:0x0].0x0 (ffff90ce01f45100) 00010000:00010000:3.0:1787826267.205313:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787826267.205317:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401c00, rc 0) 00000100:00100000:3.0:1787826267.206023:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03b92d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:48284:x1874670563584256:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1338us (1851us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826267.206034:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3145 00000100:00100000:1.0:1787826267.226624:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563584640 00000100:00100000:1.0:1787826267.226649:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563584640 00000100:00100000:3.0:1787826267.238590:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563584896 00000100:00100000:3.0:1787826267.238602:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563584896 00000100:00100000:3.0:1787826267.238679:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3148 00000100:00100000:3.0:1787826267.238691:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:48284:x1874670563584896:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:3.0:1787826267.238994:0:16564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826267.239034:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067a00/0x22153cd396b7eb88 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafe38 expref: 24 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826267.239063:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x8:0x0].0x0 (ffff90cf3a84a600) 00010000:00010000:3.0:1787826267.239076:0:16564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826267.239106:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b7eb9d lrc: 3/0,1 mode: --/PW res: [0x200000405:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826267.239121:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b7eb9d lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x8:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826267.239132:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b7eb9d lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x8:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787826267.240283:0:16564:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x2:0x0].29, 216 off57032 00000040:00080000:3.0:1787826267.240365:0:16564:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].17, 296 off55152 00000004:00080000:3.0:1787826267.240371:0:16564:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff90ce04d24a80 with version 31 00000004:00080000:1.0:1787826267.240457:0:7793:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff90cf39defc00 version 31 rpc_version 31 00000020:00100000:1.0:1787826267.240525:0:7793:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826267.240538:0:7793:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff90ce03b93480 x1874670585096960/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1040/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826267.240570:0:7793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03b93480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7793:1874670585096960:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826267.240661:0:7793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826267.240726:0:7793:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce01ef9180 going to sleep for 11 seconds 00000100:00100000:1.0:1787826267.241163:0:7793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03b93480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7793:1874670585096960:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826267.246256:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826267.246385:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563585152 00000100:00100000:1.0:1787826267.246399:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563585152 00000100:00100000:1.0:1787826267.246576:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 930 00000100:00100000:1.0:1787826267.246590:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f89de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:48284:x1874670563585152:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:1.0:1787826267.246893:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f89de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:48284:x1874670563585152:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 305us (650us total) trans 4294969223 rc 0/0 00000100:00100000:1.0:1787826267.246902:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 930 00000100:00100000:1.0:1787826267.296642:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826267.396272:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787826267.396307:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f89c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585097088:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826267.396423:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826267.397255:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585097088 00000100:00100000:3.0:1787826267.397269:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585097088 00000100:00100000:3.0:1787826267.397335:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1252 00000100:00100000:3.0:1787826267.397345:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03b93c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1874670585097088:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787826267.398119:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445888000 avail 1299648512 00000100:00100000:3.0:1787826267.401798:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03b93c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1874670585097088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 4428us (5349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826267.401817:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1252 00000100:00100000:1.0:1787826267.402219:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f89c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585097088:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826267.406221:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563585536 00000100:00100000:3.0:1787826267.406232:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563585536 00000100:00100000:3.0:1787826267.406307:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3149 00000100:00100000:3.0:1787826267.406319:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:48295:x1874670563585536:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826267.406349:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826267.406379:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b7eba4 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aafe46 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826267.429726:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563585792 00000100:00100000:3.0:1787826267.429749:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563585792 00000100:00100000:1.0:1787826267.448328:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826267.448545:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563586048 00000100:00100000:3.0:1787826267.448558:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563586048 00000100:00100000:3.0:1787826267.448633:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 932 00000100:00100000:3.0:1787826267.448645:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab92940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+28:48295:x1874670563586048:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:3.0:1787826267.449069:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab92940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+29:48295:x1874670563586048:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 425us (755us total) trans 4294969226 rc 0/0 00000100:00100000:3.0:1787826267.449079:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 932 00010000:00010000:1.0:1787826267.459978:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826267.470030:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563586560 00000100:00100000:3.0:1787826267.470050:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563586560 00000100:00100000:3.0:1787826267.470134:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 934 00000100:00100000:3.0:1787826267.470146:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03977c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:48295:x1874670563586560:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:3.0:1787826267.470937:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03977c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:48295:x1874670563586560:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 787us (2146us total) trans 4294969227 rc 0/0 00000100:00100000:3.0:1787826267.470948:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 934 00000040:00080000:3.0:1787826267.580319:0:16564:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x2:0x0].30, 616 off57648 00000040:00080000:3.0:1787826267.580391:0:16564:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].18, 696 off55848 00000004:00080000:3.0:1787826267.580399:0:16564:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff90cf2069d6c0 with version 32 00000004:00080000:1.0:1787826267.580707:0:7793:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff90cf39defc00 version 32 rpc_version 32 00000020:00100000:1.0:1787826267.580757:0:7793:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826267.580771:0:7793:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff90cf3ab92580 x1874670585097344/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1840/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826267.580804:0:7793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab92580 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7793:1874670585097344:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826267.580896:0:7793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826267.581038:0:7793:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf19bfe000 going to sleep for 11 seconds 00000100:00100000:3.0:1787826267.583021:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585097344 00000100:00100000:3.0:1787826267.583040:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585097344 00000100:00100000:3.0:1787826267.583192:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1253 00000100:00100000:3.0:1787826267.583206:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab91680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:7793:x1874670585097344:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826267.583609:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab91680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:7793:x1874670585097344:12345-0@lo:1000:osp_up1-0.0 Request processed in 404us (2711us total) trans 4294967567 rc 0/0 00000100:00100000:3.0:1787826267.583619:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1253 00000100:00100000:1.0:1787826267.583782:0:7793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab92580 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7793:1874670585097344:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826267.621051:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563587456 00000100:00100000:3.0:1787826267.621061:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563587456 00000100:00100000:3.0:1787826267.621125:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3154 00000100:00100000:3.0:1787826267.621134:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03974780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+32:48302:x1874670563587456:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826267.621159:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826267.621182:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b7ec1b lrc: 2/0,0 mode: --/CR res: [0x200000405:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aafe62 expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826267.630222:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x7:0x0]: returning size 4096 00010000:00010000:1.0:1787826267.631033:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b7ec1b lrc: 1/0,0 mode: --/CR res: [0x200000405:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafe62 expref: 34 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826267.631059:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x7:0x0].0x0 (ffff90ce01f45100) 00010000:00010000:1.0:1787826267.631063:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787826267.631069:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b7ec1b lrc: 0/0,0 mode: --/CR res: [0x200000405:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafe62 expref: 34 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826267.631089:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401800, rc 0) 00000100:00100000:1.0:1787826267.631186:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03974780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:48302:x1874670563587456:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 10052us (11282us total) trans 4294969229 rc 301/301 00000100:00100000:1.0:1787826267.631196:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3154 00000100:00100000:3.0:1787826267.663234:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563587840 00000100:00100000:3.0:1787826267.663247:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563587840 00000100:00100000:3.0:1787826267.663329:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 936 00000100:00100000:3.0:1787826267.663341:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eea3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:48302:x1874670563587840:12345-192.168.203.39@tcp:33:lfs.0 00000004:00200000:3.0:1787826267.663976:0:14257:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x7:0x0]: returning size 4096 00000004:00200000:3.0:1787826267.663984:0:14257:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:3.0:1787826267.664082:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eea3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:48302:x1874670563587840:12345-192.168.203.39@tcp:33:lfs.0 Request processed in 742us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826267.664091:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 936 00000100:00100000:3.0:1787826267.690021:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563588224 00000100:00100000:3.0:1787826267.690037:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563588224 00000100:00100000:3.0:1787826267.690124:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3156 00000100:00100000:3.0:1787826267.690136:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce039743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:48302:x1874670563588224:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826267.690163:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826267.690191:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b7ec37 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aafe70 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826267.690441:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b7ec3e lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826267.690460:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b7ec3e lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826267.690537:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b7ec3e lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826267.690781:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x8:0x0]: returning size 4096 00010000:00010000:3.0:1787826267.690929:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b7ec37 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafe70 expref: 38 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826267.690952:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b7ec3e lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafe70 expref: 37 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826267.690963:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x8:0x0].0x0 (ffff90cf08af9c00) 00010000:00010000:3.0:1787826267.690967:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787826267.690970:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400000, rc 0) 00000100:00100000:3.0:1787826267.691061:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce039743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:48302:x1874670563588224:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 926us (1803us total) trans 4294969231 rc 0/0 00000100:00100000:3.0:1787826267.691070:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3156 00000004:00080000:1.0:1787826267.704689:0:7793:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff90cf39defc00 version 33 rpc_version 33 00000020:00100000:1.0:1787826267.704731:0:7793:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826267.704743:0:7793:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff90cf3ab93840 x1874670585097600/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1840/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826267.704772:0:7793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab93840 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7793:1874670585097600:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826267.704855:0:7793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826267.704934:0:7793:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf19bfe840 going to sleep for 11 seconds 00000100:00100000:3.0:1787826267.705006:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585097600 00000100:00100000:3.0:1787826267.705013:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585097600 00000100:00100000:3.0:1787826267.705067:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1254 00000100:00100000:3.0:1787826267.705076:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab90780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:7793:x1874670585097600:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826267.705296:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab90780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+10:7793:x1874670585097600:12345-0@lo:1000:osp_up1-0.0 Request processed in 220us (439us total) trans 4294967568 rc 0/0 00000100:00100000:3.0:1787826267.705306:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1254 00000100:00100000:1.0:1787826267.705575:0:7793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab93840 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7793:1874670585097600:0@lo:1000:osp_up1-0.0 00000004:00010000:3.0:1787826267.705805:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000089ef6171 reply state 000000001d080664 transno 4294969232 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067e00/0x22153cd396b7ec4c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826267.705829:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067e00/0x22153cd396b7ec4c lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826267.705840:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x8:0x0].0x0 (ffff90cf08af9c00) 00010000:00010000:3.0:1787826267.705843:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:3.0:1787826267.705848:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787826267.705863:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x8:0x0]: returning size 4096 00000100:00100000:3.0:1787826267.705950:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce039770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:48302:x1874670563588480:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 2186us (2792us total) trans 4294969232 rc 0/0 00000100:00100000:3.0:1787826267.705959:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3157 00000100:00100000:1.0:1787826267.756901:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826268.424130:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aaf0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e3c550b8-2c3c-46c3-ad36-671c284167ea:3644:1874670585097728:0@lo:400:kworker.0 00000100:00100000:3.0:1787826268.424214:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826268.424271:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab15e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585098240:0@lo:400:kworker.0 00000100:00100000:3.0:1787826268.424299:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826268.424324:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f9361c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585098752:0@lo:400:kworker.0 00000100:00100000:3.0:1787826268.424347:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826268.424364:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f9352c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874670585099264:0@lo:400:kworker.0 00000100:00100000:3.0:1787826268.424385:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826268.424451:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585098752 00000100:00100000:3.0:1787826268.424457:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585098752 00000100:00100000:3.0:1787826268.424524:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585098368 00000100:00100000:3.0:1787826268.424527:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585098368 00000100:00100000:3.0:1787826268.424550:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 796 00000100:00100000:3.0:1787826268.424558:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f89fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1874670585098752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826268.424617:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f89fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1874670585098752:12345-0@lo:400:kworker.0 Request processed in 47us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826268.424622:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 796 00000100:00100000:3.0:1787826268.424658:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f9361c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585098752:0@lo:400:kworker.0 00000100:00100000:3.0:1787826268.424680:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585098240 00000100:00100000:3.0:1787826268.424682:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585098240 00000100:00100000:3.0:1787826268.424705:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585099392 00000100:00100000:3.0:1787826268.424708:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585099392 00000100:00100000:3.0:1787826268.424719:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1255 00000100:00100000:3.0:1787826268.424724:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f89e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+11:3644:x1874670585098240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826268.424762:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f89e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+11:3644:x1874670585098240:12345-0@lo:400:kworker.0 Request processed in 37us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826268.424768:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1255 00000100:00100000:3.0:1787826268.424780:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1256 00000100:00100000:3.0:1787826268.424785:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+10:3645:x1874670585099392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787826268.424807:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446178816 avail 1299939328 00000100:00100000:3.0:1787826268.425015:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+10:3645:x1874670585099392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 229us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826268.425021:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1256 00000100:00100000:3.0:1787826268.425044:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1394 00000100:00100000:3.0:1787826268.425052:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874670585098880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826268.425126:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aaf12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585097984:0@lo:400:kworker.0 00000100:00100000:3.0:1787826268.433718:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874670585098880:12345-0@lo:400:kworker.0 Request processed in 8659us (9197us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826268.433734:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1394 00000100:00100000:1.0:1787826268.436857:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826268.436914:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03739680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585098496:0@lo:400:kworker.0 00000100:00100000:1.0:1787826268.436948:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826268.436980:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f935a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874670585099008:0@lo:400:kworker.0 00000100:00100000:1.0:1787826268.437009:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787826268.437360:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787826268.437365:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826268.437393:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03739680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585098496:0@lo:400:kworker.0 00000100:00100000:1.0:1787826268.437419:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f935a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874670585099008:0@lo:400:kworker.0 00000100:00100000:3.0:1787826268.437592:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585097984 00000100:00100000:3.0:1787826268.437598:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585097984 00000100:00100000:3.0:1787826268.437644:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1257 00000100:00100000:3.0:1787826268.437652:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab92d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1874670585097984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826268.437697:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab92d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1874670585097984:12345-0@lo:400:kworker.0 Request processed in 46us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826268.437703:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1257 00000100:00100000:1.0:1787826268.438008:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aaf12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585097984:0@lo:400:kworker.0 00010000:00010000:3.0:1787826268.484987:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787826268.935182:0:7449:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967568 is committed 00010000:00010000:1.0:1787826269.507734:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826269.956496:0:25628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585099648 00000100:00100000:1.0:1787826269.956503:0:25628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585099648 00000100:00100000:1.0:1787826269.956556:0:25628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585099520 00000100:00100000:1.0:1787826269.956559:0:25628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585099520 00000100:00100000:1.0:1787826269.956572:0:25628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585099776 00000100:00100000:1.0:1787826269.956574:0:25628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585099776 00000100:00100000:1.0:1787826269.956604:0:25628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 674 00000100:00100000:1.0:1787826269.956613:0:25628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874670585099648:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787826269.956642:0:25628:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3920334848 avail 3688812544 00000100:00100000:1.0:1787826269.956686:0:25628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874670585099648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826269.956693:0:25628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 674 00000100:00100000:1.0:1787826269.956709:0:25628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 675 00000100:00100000:1.0:1787826269.956714:0:25628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03739680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874670585099520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787826269.956730:0:25628:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3922436096 avail 3690913792 00000100:00100000:1.0:1787826269.956758:0:25628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03739680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874670585099520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826269.956764:0:25628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 675 00000100:00100000:1.0:1787826269.956775:0:25628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 676 00000100:00100000:1.0:1787826269.956781:0:25628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03739a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874670585099776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787826269.956791:0:25628:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3920334848 avail 3688812544 00000100:00100000:1.0:1787826269.956817:0:25628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03739a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874670585099776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 36us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826269.956822:0:25628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 676 00000100:00100000:1.0:1787826269.958266:0:25628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585099904 00000100:00100000:1.0:1787826269.958272:0:25628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585099904 00000100:00100000:1.0:1787826269.958315:0:25628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 677 00000100:00100000:1.0:1787826269.958323:0:25628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f9352c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874670585099904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787826269.958339:0:25628:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3922436096 avail 3690913792 00000100:00100000:1.0:1787826269.958381:0:25628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f9352c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874670585099904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826269.958388:0:25628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 677 00000100:00100000:3.0:1787826270.353638:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826270.353692:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826270.354009:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826270.354038:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826270.354066:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826270.354101:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563589248 00000100:00100000:3.0:1787826270.354110:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563589248 00000100:00100000:3.0:1787826270.354186:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 800 00000100:00100000:3.0:1787826270.354213:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f89ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2401:x1874670563589248:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1787826270.354328:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f89ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2401:x1874670563589248:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 118us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826270.354340:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 800 00000100:00100000:1.0:1787826270.354708:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563588736 00000100:00100000:1.0:1787826270.354716:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563588736 00000100:00100000:1.0:1787826270.354774:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 856 00000100:00100000:1.0:1787826270.354783:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf185c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:307626ff-a376-4faf-93e0-9f55b723d964+10:2401:x1874670563588736:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1787826270.354824:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf185c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:307626ff-a376-4faf-93e0-9f55b723d964+10:2401:x1874670563588736:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 42us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826270.354831:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 856 00000100:00080000:1.0:1787826270.354884:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787826270.354889:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826270.356913:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1399 00000100:00100000:3.0:1787826270.356939:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f89d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:2401:x1874670563588992:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1787826270.357017:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f89d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:2401:x1874670563588992:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 88us (2975us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826270.357027:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1399 00000100:00080000:1.0:1787826270.357155:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787826270.357161:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787826270.842018:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826270.849803:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563589760 00000100:00100000:3.0:1787826270.849820:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563589760 00000100:00100000:3.0:1787826270.849900:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 938 00000100:00100000:3.0:1787826270.849925:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+39:48608:x1874670563589760:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:3.0:1787826270.850247:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:48608:x1874670563589760:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 326us (537us total) trans 4294969234 rc 0/0 00000100:00100000:3.0:1787826270.850256:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 938 00000001:00080000:1.0:1787826270.853847:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969233 is committed 00000020:00080000:1.0:1787826270.853906:0:6497:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 49 batchid updated 00000004:00080000:3.0:1787826270.854253:0:7793:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff90cf39defc00 version 34 rpc_version 34 00000020:00100000:3.0:1787826270.854314:0:7793:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787826270.854328:0:7793:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff90cf3a8ae580 x1874670585100160/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826270.854360:0:7793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a8ae580 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7793:1874670585100160:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826270.855038:0:7793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826270.855136:0:7793:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf396cf780 going to sleep for 11 seconds 00000100:00100000:3.0:1787826270.859446:0:7793:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967568 gen 2 00000004:00080000:3.0:1787826270.859462:0:7793:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967564 committed transno 4294967568 00000020:00080000:3.0:1787826270.859504:0:7793:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90cf10aba900 refcount 2 committed 0 result 0 batchid 50 00000020:00080000:3.0:1787826270.859520:0:7793:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90ce04e9b000 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90ce024a3b40 00000020:00080000:3.0:1787826270.859523:0:7793:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].15 00000020:00080000:3.0:1787826270.859526:0:7793:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90ce04e9b600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90cf3f5b7000 00000020:00080000:3.0:1787826270.859529:0:7793:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000400:0x2:0x0].27 00000004:00080000:3.0:1787826270.859576:0:7793:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967565 committed transno 4294967568 00000020:00080000:3.0:1787826270.859581:0:7793:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90ce01ef96c0 refcount 2 committed 0 result 0 batchid 51 00000020:00080000:3.0:1787826270.859583:0:7793:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cf3a8c7f00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90ce01ef9f00 00000020:00080000:3.0:1787826270.859586:0:7793:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].16 00000020:00080000:3.0:1787826270.859588:0:7793:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cf3a8c7a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90cf37306200 00000020:00080000:3.0:1787826270.859591:0:7793:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000400:0x2:0x0].28 00000004:00080000:3.0:1787826270.859607:0:7793:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967566 committed transno 4294967568 00000020:00080000:3.0:1787826270.859611:0:7793:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90ce04d24780 refcount 2 committed 0 result 0 batchid 52 00000020:00080000:3.0:1787826270.859615:0:7793:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90ce04e9b900 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90ce04d24a80 00000020:00080000:3.0:1787826270.859618:0:7793:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].17 00000020:00080000:3.0:1787826270.859621:0:7793:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90ce04e9bb00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90ce031aaa00 00000020:00080000:3.0:1787826270.859624:0:7793:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000400:0x2:0x0].29 00000004:00080000:3.0:1787826270.859636:0:7793:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967567 committed transno 4294967568 00000020:00080000:3.0:1787826270.859639:0:7793:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90cf076a8000 refcount 2 committed 0 result 0 batchid 53 00000020:00080000:3.0:1787826270.859642:0:7793:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cf2f580800 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90cf2069d6c0 00000020:00080000:3.0:1787826270.859644:0:7793:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].18 00000020:00080000:3.0:1787826270.859646:0:7793:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cf2f580000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90cf0bfd3c00 00000020:00080000:3.0:1787826270.859649:0:7793:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000400:0x2:0x0].30 00000004:00080000:3.0:1787826270.859661:0:7793:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967568 committed transno 4294967568 00000020:00080000:3.0:1787826270.859665:0:7793:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90ce046baa80 refcount 2 committed 0 result 0 batchid 54 00000020:00080000:3.0:1787826270.859668:0:7793:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cf2f4cc800 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90ce046ba0c0 00000020:00080000:3.0:1787826270.859671:0:7793:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].19 00000020:00080000:3.0:1787826270.859672:0:7793:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cf2f580b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90ce03716000 00000020:00080000:3.0:1787826270.859675:0:7793:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000400:0x2:0x0].31 00000100:00100000:3.0:1787826270.859693:0:7793:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff90cf3a8ae580 x1874670585100160/t4294967569(4294967569) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1787826286 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826270.859735:0:7793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a8ae580 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7793:1874670585100160:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1787826270.859753:0:7793:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff90cf39defc00 version 35 rpc_version 35 00000020:00100000:3.0:1787826270.859796:0:7793:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787826270.859802:0:7793:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff90cf3ab93840 x1874670585100416/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826270.859833:0:7793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab93840 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7793:1874670585100416:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826270.859911:0:7793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826270.860117:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826270.860183:0:7793:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf396cf780 going to sleep for 11 seconds 00000100:00100000:1.0:1787826270.860209:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563590016 00000100:00100000:1.0:1787826270.860218:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563590016 00000100:00100000:1.0:1787826270.860355:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3159 00000100:00100000:1.0:1787826270.860366:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03bde940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+17:48608:x1874670563590016:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826270.860394:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826270.860426:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026ae400/0x22153cd396b7ec6f lrc: 2/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aafe7e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826270.861271:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026aec00/0x22153cd396b7ec76 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826270.861291:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026aec00/0x22153cd396b7ec76 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826270.861306:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026aec00/0x22153cd396b7ec76 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826270.861322:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026ae000/0x22153cd396b7ec7d lrc: 3/1,0 mode: --/PR res: [0x200000400:0x8:0x0].0x892874e3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826270.861330:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026ae000/0x22153cd396b7ec7d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826270.861338:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026ae000/0x22153cd396b7ec7d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826270.861559:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x8:0x0]: returning size 4096 00010000:00010000:1.0:1787826270.861782:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026aec00/0x22153cd396b7ec76 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826270.861792:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026aec00/0x22153cd396b7ec76 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826270.861801:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026aec00/0x22153cd396b7ec76 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826270.861808:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026aec00/0x22153cd396b7ec76 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826270.861815:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce026aec00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826270.861820:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026aec00/0x22153cd396b7ec76 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826270.861828:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026aec00/0x22153cd396b7ec76 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826270.861844:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0x0 (ffff90cf06894200) 00010000:00010000:1.0:1787826270.861847:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826270.861853:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026aec00/0x22153cd396b7ec76 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826270.861859:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026aec00/0x22153cd396b7ec76 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826270.861874:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026ae000/0x22153cd396b7ec7d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826270.861880:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026ae000/0x22153cd396b7ec7d lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826270.861885:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026ae000/0x22153cd396b7ec7d lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826270.861890:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce026ae000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826270.861894:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026ae000/0x22153cd396b7ec7d lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826270.861900:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026ae000/0x22153cd396b7ec7d lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826270.861906:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0x892874e3 (ffff90cf06894a00) 00010000:00010000:1.0:1787826270.861909:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826270.861911:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026ae000/0x22153cd396b7ec7d lrc: 2/0,0 mode: --/PR res: [0x200000400:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826270.861918:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026ae000/0x22153cd396b7ec7d lrc: 0/0,0 mode: --/PR res: [0x200000400:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826270.861968:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026ae400/0x22153cd396b7ec6f lrc: 1/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafe7e expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826270.861979:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0x0 (ffff90cf06894200) 00010000:00010000:1.0:1787826270.861982:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787826270.861985:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026ae400/0x22153cd396b7ec6f lrc: 0/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafe7e expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826270.861997:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce026ae400, rc 0) 00000100:00100000:1.0:1787826270.862147:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03bde940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+18:48608:x1874670563590016:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1781us (2030us total) trans 4294969235 rc 301/301 00000100:00100000:1.0:1787826270.862157:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3159 00000100:00100000:1.0:1787826270.866440:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563590272 00000100:00100000:1.0:1787826270.866463:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563590272 00000100:00100000:1.0:1787826270.866781:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 939 00000100:00100000:1.0:1787826270.866794:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8fbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+18:48608:x1874670563590272:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:1.0:1787826270.867075:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8fbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:48608:x1874670563590272:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 283us (718us total) trans 4294969236 rc 0/0 00000100:00100000:1.0:1787826270.867084:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 939 00000100:00100000:1.0:1787826270.872527:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563590400 00000100:00100000:1.0:1787826270.872536:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563590400 00000100:00100000:1.0:1787826270.872575:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 940 00000100:00100000:1.0:1787826270.872587:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:48608:x1874670563590400:12345-192.168.203.39@tcp:33:lfs.0 00000100:00100000:3.0:1787826270.872895:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1259 00000100:00100000:3.0:1787826270.873144:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7793:x1874670585100416:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826270.874971:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:7793:x1874670585100416:12345-0@lo:1000:osp_up1-0.0 Request processed in 2060us (15052us total) trans 4294967570 rc 0/0 00000100:00100000:3.0:1787826270.874984:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1259 00010000:00010000:3.0:1787826271.556675:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826272.580663:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826273.541727:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f9343c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874670585101312:0@lo:400:kworker.0 00000100:00100000:1.0:1787826273.541764:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826273.541803:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f935a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585101824:0@lo:400:kworker.0 00000100:00100000:1.0:1787826273.541827:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826273.541859:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab16d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874670585102336:0@lo:400:kworker.0 00000100:00100000:1.0:1787826273.541882:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826273.541907:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1787826273.541914:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f935e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e3c550b8-2c3c-46c3-ad36-671c284167ea:3646:1874670585100928:0@lo:400:kworker.0 00000100:00100000:1.0:1787826273.541942:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826273.541964:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f936d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585101440:0@lo:400:kworker.0 00000100:00100000:1.0:1787826273.541987:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826273.542001:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f934000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585101952:0@lo:400:kworker.0 00000100:00100000:1.0:1787826273.542020:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826273.542034:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab17840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1874670585102464:0@lo:400:kworker.0 00000100:00100000:1.0:1787826273.542054:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826273.542089:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585101184 00000100:00100000:1.0:1787826273.542098:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585101184 00000100:00100000:1.0:1787826273.542148:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585101440 00000100:00100000:1.0:1787826273.542151:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585101440 00000100:00100000:1.0:1787826273.542183:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1262 00000100:00100000:1.0:1787826273.542195:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab15e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1874670585101184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826273.542256:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab15e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1874670585101184:12345-0@lo:400:kworker.0 Request processed in 63us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826273.542264:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1262 00000100:00100000:1.0:1787826273.542283:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1263 00000100:00100000:1.0:1787826273.542289:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03bdda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:3646:x1874670585101440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826273.542325:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03bdda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:3646:x1874670585101440:12345-0@lo:400:kworker.0 Request processed in 36us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826273.542331:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1263 00000100:00100000:1.0:1787826273.542350:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585100928 00000100:00100000:1.0:1787826273.542354:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585100928 00000100:00100000:1.0:1787826273.542393:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 857 00000100:00100000:1.0:1787826273.542400:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf185ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3c550b8-2c3c-46c3-ad36-671c284167ea+24:3646:x1874670585100928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826273.542645:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585101312 00000100:00100000:3.0:1787826273.542650:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585101312 00000100:00100000:3.0:1787826273.542686:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585102336 00000100:00100000:3.0:1787826273.542689:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585102336 00000100:00100000:3.0:1787826273.542715:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585102464 00000100:00100000:3.0:1787826273.542718:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585102464 00000100:00100000:3.0:1787826273.542737:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1400 00000100:00100000:3.0:1787826273.542744:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03bdd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874670585101312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826273.542782:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03bdd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874670585101312:12345-0@lo:400:kworker.0 Request processed in 39us (1017us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826273.542788:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1400 00000100:00100000:3.0:1787826273.542800:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1401 00000100:00100000:3.0:1787826273.542806:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03bdc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874670585102336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826273.542842:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03bdc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874670585102336:12345-0@lo:400:kworker.0 Request processed in 36us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826273.542849:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1401 00000100:00100000:3.0:1787826273.542862:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1402 00000100:00100000:3.0:1787826273.542868:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03bde1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874670585102464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826273.542894:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03bde1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874670585102464:12345-0@lo:400:kworker.0 Request processed in 27us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826273.542900:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1402 00000100:00100000:3.0:1787826273.542918:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585101824 00000100:00100000:3.0:1787826273.542922:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585101824 00000100:00100000:3.0:1787826273.542944:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585101952 00000100:00100000:3.0:1787826273.542947:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585101952 00000100:00100000:3.0:1787826273.542963:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 802 00000100:00100000:3.0:1787826273.542970:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03bdf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3646:x1874670585101824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826273.543001:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03bdf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3646:x1874670585101824:12345-0@lo:400:kworker.0 Request processed in 32us (1173us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826273.543006:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 802 00000100:00100000:3.0:1787826273.543016:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 803 00000100:00100000:3.0:1787826273.543021:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03bdcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3646:x1874670585101952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826273.543048:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03bdcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3646:x1874670585101952:12345-0@lo:400:kworker.0 Request processed in 26us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826273.543053:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 803 00000100:00100000:3.0:1787826273.543130:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f935e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e3c550b8-2c3c-46c3-ad36-671c284167ea:3646:1874670585100928:0@lo:400:kworker.0 00000100:00100000:3.0:1787826273.543148:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f936d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585101440:0@lo:400:kworker.0 00000100:00100000:3.0:1787826273.543160:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f934000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585101952:0@lo:400:kworker.0 00000100:00100000:3.0:1787826273.543183:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab17840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1874670585102464:0@lo:400:kworker.0 00000100:00100000:3.0:1787826273.543196:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f9343c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874670585101312:0@lo:400:kworker.0 00000100:00100000:3.0:1787826273.543209:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f935a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585101824:0@lo:400:kworker.0 00000100:00100000:3.0:1787826273.543221:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab16d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874670585102336:0@lo:400:kworker.0 00000100:00100000:1.0:1787826273.543408:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf185ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3c550b8-2c3c-46c3-ad36-671c284167ea+24:3646:x1874670585100928:12345-0@lo:400:kworker.0 Request processed in 32us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826273.543417:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 857 00000100:00080000:1.0:1787826273.543463:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787826273.543468:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787826273.543483:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787826273.546049:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787826273.546058:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787826273.546063:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787826273.603805:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787826275.082037:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826275.475433:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826275.475512:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826275.475548:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826275.475571:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826275.475598:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826275.475631:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563590656 00000100:00100000:3.0:1787826275.475643:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563590656 00000100:00100000:3.0:1787826275.475721:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563590784 00000100:00100000:3.0:1787826275.475725:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563590784 00000100:00100000:3.0:1787826275.475754:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1406 00000100:00100000:3.0:1787826275.475767:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03b92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:2402:x1874670563590656:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1787826275.478798:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03b92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:2402:x1874670563590656:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 3015us (3360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826275.478818:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1406 00000100:00100000:3.0:1787826275.480012:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1407 00000100:00100000:3.0:1787826275.480034:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03b90780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:2402:x1874670563590784:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1787826275.480124:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03b90780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:2402:x1874670563590784:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 99us (4552us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826275.480132:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1407 00000100:00100000:3.0:1787826275.480177:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563590528 00000100:00100000:3.0:1787826275.480187:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563590528 00000100:00100000:3.0:1787826275.480245:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 858 00000100:00100000:3.0:1787826275.480253:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf185c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:307626ff-a376-4faf-93e0-9f55b723d964+10:2402:x1874670563590528:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1787826275.480281:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf185c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:307626ff-a376-4faf-93e0-9f55b723d964+10:2402:x1874670563590528:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 30us (4733us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826275.480288:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 858 00000100:00100000:3.0:1787826275.480328:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563590912 00000100:00100000:3.0:1787826275.480332:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563590912 00000100:00100000:3.0:1787826275.480364:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563591040 00000100:00100000:3.0:1787826275.480367:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563591040 00000100:00100000:3.0:1787826275.480393:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 806 00000100:00100000:3.0:1787826275.480400:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03b93840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2402:x1874670563590912:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1787826275.480428:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03b93840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2402:x1874670563590912:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 29us (4916us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826275.480435:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 806 00000100:00100000:3.0:1787826275.480447:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 807 00000100:00100000:3.0:1787826275.480453:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03b93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2402:x1874670563591040:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1787826275.480498:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03b93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2402:x1874670563591040:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 45us (4899us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826275.480505:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 807 00000100:00080000:3.0:1787826275.480523:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787826275.480527:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787826275.480530:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787826275.480534:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787826275.652073:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826276.675901:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787826277.135553:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969236 is committed 00000020:00080000:3.0:1787826277.135577:0:6497:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 54 batchid updated 00000020:00080000:3.0:1787826277.135606:0:6550:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 54 00000004:00080000:3.0:1787826277.135674:0:6550:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff90cf08193900 with version 37 00000020:00080000:3.0:1787826277.135688:0:6550:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 50 cancel update log [0x240000401:0x3:0x0].15: rc = 0 00000020:00080000:3.0:1787826277.135763:0:6550:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 50 cancel update log [0x200000400:0x2:0x0].27: rc = 0 00000004:00080000:3.0:1787826277.135788:0:6550:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff90cf10aba900 with version 38 00000020:00080000:3.0:1787826277.135790:0:6550:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 51 cancel update log [0x240000401:0x3:0x0].16: rc = 0 00000020:00080000:3.0:1787826277.135808:0:6550:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 51 cancel update log [0x200000400:0x2:0x0].28: rc = 0 00000004:00080000:3.0:1787826277.135829:0:6550:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff90cf396cf780 with version 39 00000020:00080000:3.0:1787826277.135832:0:6550:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 52 cancel update log [0x240000401:0x3:0x0].17: rc = 0 00000020:00080000:3.0:1787826277.135850:0:6550:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 52 cancel update log [0x200000400:0x2:0x0].29: rc = 0 00000004:00080000:3.0:1787826277.135870:0:6550:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff90cf011ca540 with version 40 00000020:00080000:3.0:1787826277.135873:0:6550:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 53 cancel update log [0x240000401:0x3:0x0].18: rc = 0 00000020:00080000:3.0:1787826277.135891:0:6550:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 53 cancel update log [0x200000400:0x2:0x0].30: rc = 0 00000004:00080000:3.0:1787826277.135908:0:6550:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff90cf076a8000 with version 41 00000020:00080000:3.0:1787826277.135911:0:6550:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 54 cancel update log [0x240000401:0x3:0x0].19: rc = 0 00000020:00080000:3.0:1787826277.135928:0:6550:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 54 cancel update log [0x200000400:0x2:0x0].31: rc = 0 00000020:00080000:3.0:1787826277.135934:0:6550:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 54 00000004:00080000:3.0:1787826277.135944:0:7793:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff90cf39defc00 version 37 rpc_version 37 00000020:00100000:3.0:1787826277.135978:0:7793:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787826277.135989:0:7793:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff90ce03b90000 x1874670585103360/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826277.136013:0:7793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03b90000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7793:1874670585103360:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826277.136079:0:7793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826277.136134:0:7793:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce04d24a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787826277.136168:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585103360 00000100:00100000:3.0:1787826277.136174:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585103360 00000100:00100000:3.0:1787826277.136218:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1265 00000100:00100000:3.0:1787826277.136227:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f9361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7793:x1874670585103360:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826277.136360:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f9361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7793:x1874670585103360:12345-0@lo:1000:osp_up1-0.0 Request processed in 133us (281us total) trans 4294967572 rc 0/0 00000100:00100000:3.0:1787826277.136368:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1265 00000100:00100000:3.0:1787826277.138065:0:7793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce038912c0 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7793:1874670585103616:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1787826277.138077:0:7793:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff90cf39defc00 version 39 rpc_version 39 00000020:00100000:3.0:1787826277.138094:0:7793:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787826277.138100:0:7793:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff90cf3f9370c0 x1874670585103872/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826277.138117:0:7793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f9370c0 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7793:1874670585103872:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826277.138166:0:7793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826277.138197:0:7793:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf184023c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826277.138217:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585103872 00000100:00100000:3.0:1787826277.138223:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585103872 00000100:00100000:3.0:1787826277.138342:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1267 00000100:00100000:3.0:1787826277.138352:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f934f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:7793:x1874670585103872:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826277.138510:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f934f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:7793:x1874670585103872:12345-0@lo:1000:osp_up1-0.0 Request processed in 159us (343us total) trans 4294967574 rc 0/0 00000100:00100000:3.0:1787826277.138518:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1267 00000100:00100000:3.0:1787826277.141140:0:7793:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce05f8e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826277.141863:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585104128 00000100:00100000:1.0:1787826277.141875:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585104128 00000100:00100000:1.0:1787826277.141974:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1268 00000100:00100000:1.0:1787826277.141983:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8ae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:7793:x1874670585104128:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826277.142179:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8ae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:7793:x1874670585104128:12345-0@lo:1000:osp_up1-0.0 Request processed in 197us (1308us total) trans 4294967575 rc 0/0 00000100:00100000:1.0:1787826277.142187:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1268 00000100:00100000:3.0:1787826277.142567:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585104384 00000100:00100000:3.0:1787826277.142575:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585104384 00000100:00100000:3.0:1787826277.142635:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1269 00000100:00100000:3.0:1787826277.142645:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab17c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:7793:x1874670585104384:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826277.142828:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab17c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:7793:x1874670585104384:12345-0@lo:1000:osp_up1-0.0 Request processed in 185us (423us total) trans 4294967576 rc 0/0 00000100:00100000:3.0:1787826277.142836:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1269 00000100:00100000:1.0:1787826277.142908:0:7793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a8afc00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7793:1874670585104384:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826277.647083:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03890b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585104512:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826277.647208:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826277.648113:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03890b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585104512:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787826277.701912:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826278.664696:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03891680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585104896:0@lo:400:kworker.0 00000100:00100000:3.0:1787826278.664743:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826278.664802:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf2f45f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585105408:0@lo:400:kworker.0 00000100:00100000:3.0:1787826278.664827:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826278.664851:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf2f45fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874670585105920:0@lo:400:kworker.0 00000100:00100000:3.0:1787826278.664873:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826278.664897:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787826278.664903:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03891a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874670585105024:0@lo:400:kworker.0 00000100:00100000:3.0:1787826278.664922:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826278.664936:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf2f45f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585105536:0@lo:400:kworker.0 00000100:00100000:3.0:1787826278.664951:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826278.664964:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf2f45c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1874670585106048:0@lo:400:kworker.0 00000100:00100000:3.0:1787826278.664981:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826278.665009:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585105408 00000100:00100000:3.0:1787826278.665016:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585105408 00000100:00100000:3.0:1787826278.665062:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585105536 00000100:00100000:3.0:1787826278.665066:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585105536 00000100:00100000:3.0:1787826278.665087:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 808 00000100:00100000:3.0:1787826278.665096:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f937c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874670585105408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826278.665152:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f937c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874670585105408:12345-0@lo:400:kworker.0 Request processed in 57us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826278.665159:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 808 00000100:00100000:3.0:1787826278.665173:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 809 00000100:00100000:3.0:1787826278.665179:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f935a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874670585105536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826278.665205:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f935a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874670585105536:12345-0@lo:400:kworker.0 Request processed in 26us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826278.665210:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 809 00000100:00100000:3.0:1787826278.665227:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585105920 00000100:00100000:3.0:1787826278.665230:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585105920 00000100:00100000:3.0:1787826278.665252:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585105024 00000100:00100000:3.0:1787826278.665255:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585105024 00000100:00100000:3.0:1787826278.665269:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585106048 00000100:00100000:3.0:1787826278.665271:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585106048 00000100:00100000:3.0:1787826278.665300:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1408 00000100:00100000:1.0:1787826278.666512:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585104896 00000100:00100000:1.0:1787826278.666517:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585104896 00000100:00100000:1.0:1787826278.666539:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585106304 00000100:00100000:1.0:1787826278.666541:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585106304 00000100:00100000:1.0:1787826278.666549:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585105152 00000100:00100000:1.0:1787826278.666551:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585105152 00000100:00100000:1.0:1787826278.666561:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1271 00000100:00100000:1.0:1787826278.666566:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f934780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3644:x1874670585104896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826278.667433:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f934780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3644:x1874670585104896:12345-0@lo:400:kworker.0 Request processed in 865us (2689us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826278.667439:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1271 00000100:00100000:3.0:1787826278.667506:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f934b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874670585105920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826278.667975:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf2f45fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874670585105920:0@lo:400:kworker.0 00010000:00010000:3.0:1787826278.724232:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826279.748397:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826280.195987:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab15a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585106432:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787826280.196061:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826280.196607:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f936d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585106816:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826280.196645:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826280.196692:0:25628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585106560 00000100:00100000:1.0:1787826280.196697:0:25628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585106560 00000100:00100000:1.0:1787826280.196749:0:25628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 683 00000100:00100000:1.0:1787826280.196762:0:25628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f88c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874670585106688:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787826280.196785:0:25628:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3922436096 avail 3690913792 00000100:00100000:1.0:1787826280.213439:0:25628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f88c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874670585106688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 16666us (16899us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826280.213455:0:25628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 683 00000100:00100000:3.0:1787826280.595522:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826280.595555:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826280.595582:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826280.595601:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826280.595623:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826280.595649:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563591552 00000100:00100000:3.0:1787826280.595658:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563591552 00000100:00100000:3.0:1787826280.595707:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563591680 00000100:00100000:3.0:1787826280.595710:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563591680 00000100:00100000:3.0:1787826280.595733:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 812 00000100:00100000:3.0:1787826280.595742:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f937480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2404:x1874670563591552:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1787826280.595808:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f937480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2404:x1874670563591552:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 67us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826280.595815:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 812 00000100:00100000:3.0:1787826280.595832:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 813 00000100:00100000:3.0:1787826280.595838:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f935680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2404:x1874670563591680:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1787826280.595864:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f935680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2404:x1874670563591680:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 27us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826280.595871:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 813 00000100:00100000:3.0:1787826280.595888:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563591168 00000100:00100000:3.0:1787826280.595891:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563591168 00000100:00100000:3.0:1787826280.595913:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 860 00000100:00100000:3.0:1787826280.595919:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf185cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:307626ff-a376-4faf-93e0-9f55b723d964+10:2403:x1874670563591168:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1787826280.595942:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf185cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:307626ff-a376-4faf-93e0-9f55b723d964+10:2403:x1874670563591168:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 23us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826280.595949:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 860 00000100:00080000:3.0:1787826280.595975:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787826280.595979:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787826280.596800:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787826280.596803:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787826280.773506:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787826280.851424:0:33473:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 47: Verify mirror obj alloc =========== 06:24:40 (1787826280) 00010000:00010000:3.0:1787826281.798167:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826282.756682:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787826282.756705:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f88cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585106944:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826282.756771:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787826282.826053:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826283.782737:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787826283.782760:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0b432940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585107072:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787826283.782841:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826283.783151:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0b430000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874670585107328:0@lo:400:kworker.0 00000100:00100000:1.0:1787826283.783176:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826283.783199:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f8043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585107840:0@lo:400:kworker.0 00000100:00100000:1.0:1787826283.783223:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826283.783240:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f806d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874670585108352:0@lo:400:kworker.0 00000100:00100000:1.0:1787826283.783260:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826283.783289:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585107328 00000100:00100000:1.0:1787826283.783292:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585107328 00000100:00100000:1.0:1787826283.783318:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585108352 00000100:00100000:1.0:1787826283.783321:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585108352 00000100:00100000:1.0:1787826283.783344:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1416 00000100:00100000:1.0:1787826283.783350:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f805a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874670585107328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826283.783389:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f805a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874670585107328:12345-0@lo:400:kworker.0 Request processed in 39us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826283.783395:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1416 00000100:00100000:1.0:1787826283.783408:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1417 00000100:00100000:1.0:1787826283.783415:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f806940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874670585108352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826283.783442:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f806940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874670585108352:12345-0@lo:400:kworker.0 Request processed in 28us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826283.783448:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1417 00000100:00100000:1.0:1787826283.783503:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0b432580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874670585107584:0@lo:400:kworker.0 00000100:00100000:1.0:1787826283.783531:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826283.783553:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f8070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585108096:0@lo:400:kworker.0 00000100:00100000:1.0:1787826283.784183:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826283.784210:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f804000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874670585108608:0@lo:400:kworker.0 00000100:00100000:1.0:1787826283.784239:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826283.784292:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0b432580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874670585107584:0@lo:400:kworker.0 00000100:00100000:1.0:1787826283.784309:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787826283.784316:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0b4303c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585107456:0@lo:400:kworker.0 00000100:00100000:1.0:1787826283.784341:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826283.784359:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f806580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585107968:0@lo:400:kworker.0 00000100:00100000:1.0:1787826283.784382:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826283.784396:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f804780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1874670585108480:0@lo:400:kworker.0 00000100:00100000:1.0:1787826283.784422:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826283.784449:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826283.784526:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0b433c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e3c550b8-2c3c-46c3-ad36-671c284167ea:3646:1874670585107200:0@lo:400:kworker.0 00000100:00100000:1.0:1787826283.784540:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0b433840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585107712:0@lo:400:kworker.0 00000100:00100000:3.0:1787826283.784863:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585108480 00000100:00100000:3.0:1787826283.784868:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585108480 00000100:00100000:3.0:1787826283.784907:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585108224 00000100:00100000:3.0:1787826283.784910:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585108224 00000100:00100000:3.0:1787826283.784929:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1419 00000100:00100000:3.0:1787826283.784936:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874670585108480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826283.784975:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874670585108480:12345-0@lo:400:kworker.0 Request processed in 40us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826283.784980:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1419 00000100:00100000:3.0:1787826283.785010:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1420 00000100:00100000:3.0:1787826283.785017:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f06580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874670585108224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826283.785050:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f06580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874670585108224:12345-0@lo:400:kworker.0 Request processed in 35us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826283.785056:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1420 00000100:00100000:1.0:1787826283.785333:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585108608 00000100:00100000:1.0:1787826283.785338:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585108608 00000100:00100000:1.0:1787826283.785390:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1421 00000100:00100000:1.0:1787826283.785398:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f04780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874670585108608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826283.785433:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f04780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874670585108608:12345-0@lo:400:kworker.0 Request processed in 37us (1195us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826283.785440:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1421 00000100:00100000:1.0:1787826283.785501:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0b430000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874670585107328:0@lo:400:kworker.0 00000100:00100000:1.0:1787826283.785515:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f8043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585107840:0@lo:400:kworker.0 00000100:00100000:1.0:1787826283.785525:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f806d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874670585108352:0@lo:400:kworker.0 00000100:00100000:3.0:1787826283.785527:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967576 gen 2 00000004:00080000:3.0:1787826283.785531:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967572 committed transno 4294967576 00000004:00080000:3.0:1787826283.785545:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967573 committed transno 4294967576 00000100:00100000:1.0:1787826283.785552:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f807840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874670585108224:0@lo:400:kworker.0 00000004:00080000:3.0:1787826283.785557:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967574 committed transno 4294967576 00000004:00080000:3.0:1787826283.785564:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967575 committed transno 4294967576 00000004:00080000:3.0:1787826283.785578:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967576 committed transno 4294967576 00000100:00100000:3.0:1787826283.785595:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0b432940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585107072:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787826283.785658:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0b4303c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585107456:0@lo:400:kworker.0 00000100:00100000:1.0:1787826283.785672:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f806580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585107968:0@lo:400:kworker.0 00000100:00100000:1.0:1787826283.785682:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f804780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1874670585108480:0@lo:400:kworker.0 00000100:00100000:1.0:1787826283.785691:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f8070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585108096:0@lo:400:kworker.0 00000100:00100000:1.0:1787826283.785700:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f804000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874670585108608:0@lo:400:kworker.0 00010000:00010000:3.0:1787826283.843937:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826284.128525:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826284.128564:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563591808 00000100:00100000:3.0:1787826284.128572:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563591808 00000100:00100000:3.0:1787826284.128629:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3160 00000100:00100000:3.0:1787826284.128637:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03aef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:49784:x1874670563591808:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826284.128655:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826284.128675:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b7ec8b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aafe85 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.128752:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b7ec92 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.128778:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b7ec92 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.128792:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b7ec92 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.128808:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b7ec99 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.128824:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b7ec99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.128832:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b7ec99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.128874:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b7ec92 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.128881:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b7ec92 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.128887:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b7ec92 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.128892:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826284.128896:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b7ec92 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.128907:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b7ec92 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.128917:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cf39656000) 00010000:00010000:3.0:1787826284.128920:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826284.128925:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b7ec92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.128931:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b7ec92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.128944:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b7ec99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.128949:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b7ec99 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.128955:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b7ec99 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.128961:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826284.128963:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b7ec99 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.128970:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b7ec99 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.128977:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x995b1268 (ffff90cf08af9300) 00010000:00010000:3.0:1787826284.128979:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826284.128982:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b7ec99 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.128990:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b7ec99 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.129023:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b7ec8b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafe85 expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.129033:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cf39656000) 00010000:00010000:3.0:1787826284.129035:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826284.129039:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b7ec8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafe85 expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.129048:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401e00, rc 0) 00000100:00100000:3.0:1787826284.129114:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03aef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:49784:x1874670563591808:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 477us (596us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826284.129122:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3160 00000100:00080000:3.0:1787826284.129146:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787826284.140671:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563592064 00000100:00100000:1.0:1787826284.140681:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563592064 00000100:00100000:1.0:1787826284.140776:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3161 00000100:00100000:1.0:1787826284.140787:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f88ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:49784:x1874670563592064:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826284.140809:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826284.140821:0:16564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787826284.140846:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026afa00/0x22153cd396b7e473 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafc47 expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.140862:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cf39656000) 00010000:00010000:1.0:1787826284.140867:0:16564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826284.140881:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026af800/0x22153cd396b7eca0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aafe8c expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.141001:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026ae800/0x22153cd396b7eca7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.141015:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026ae800/0x22153cd396b7eca7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.141023:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026ae800/0x22153cd396b7eca7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.141036:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026af600/0x22153cd396b7ecae lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x995b1268 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.141043:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026af600/0x22153cd396b7ecae lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.141048:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026af600/0x22153cd396b7ecae lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.141455:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026ae400/0x22153cd396b7ecb5 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.141466:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026ae400/0x22153cd396b7ecb5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.141513:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026ae400/0x22153cd396b7ecb5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826284.141523:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x9:0x0]: returning size 0 00010000:00010000:1.0:1787826284.141551:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026ae800/0x22153cd396b7eca7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.141561:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026ae800/0x22153cd396b7eca7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.141569:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026ae800/0x22153cd396b7eca7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.141575:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce026ae800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826284.141580:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026ae800/0x22153cd396b7eca7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.141587:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026ae800/0x22153cd396b7eca7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.141597:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cf39656000) 00010000:00010000:1.0:1787826284.141600:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826284.141604:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026ae800/0x22153cd396b7eca7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.141612:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026ae800/0x22153cd396b7eca7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826284.141626:0:16564:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bfb1193a reply state 000000008ad3a879 transno 4294969237 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026af600/0x22153cd396b7ecae lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.141637:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026af600/0x22153cd396b7ecae lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.141644:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x995b1268 (ffff90cf06894d00) 00010000:00010000:1.0:1787826284.141646:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826284.141649:0:16564:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787826284.141675:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026af800/0x22153cd396b7eca0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafe8c expref: 18 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.141692:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026ae400/0x22153cd396b7ecb5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafe8c expref: 17 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.141700:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff90cf06894400) 00010000:00010000:1.0:1787826284.141703:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826284.141706:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce026ae400, rc 0) 00000100:00100000:1.0:1787826284.141769:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f88ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+18:49784:x1874670563592064:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 984us (1232us total) trans 4294969237 rc 0/0 00000100:00100000:1.0:1787826284.141778:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3161 00000100:00100000:1.0:1787826284.163888:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826284.171515:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563592448 00000100:00100000:1.0:1787826284.171524:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563592448 00010000:00010000:1.0:1787826284.171561:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026ae400/0x22153cd396b7ecb5 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafe8c expref: 20 pid: 16564 timeout: 1330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826284.171601:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 864 00000100:00100000:1.0:1787826284.171612:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f88f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:2403:x1874670563592448:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826284.171626:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826284.171634:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026ae400/0x22153cd396b7ecb5 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafe8c expref: 20 pid: 16564 timeout: 1330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.171647:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026ae400/0x22153cd396b7ecb5 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafe8c expref: 20 pid: 16564 timeout: 1330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.171669:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff90cf06894400) 00010000:00010000:1.0:1787826284.171675:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b7ecca lrc: 3/0,1 mode: --/EX res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.171684:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b7ecca lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.171691:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b7ecca lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.171710:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826284.171759:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f88f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:2403:x1874670563592448:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 149us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826284.171767:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 864 00000100:00100000:3.0:1787826284.188403:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826284.207958:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826284.208025:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563593088 00000100:00100000:3.0:1787826284.208035:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563593088 00000100:00100000:3.0:1787826284.208103:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3163 00000100:00100000:3.0:1787826284.208113:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f06d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:49788:x1874670563593088:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:3.0:1787826284.208135:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826284.208157:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b7ecd8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aafe9a expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.208242:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b7ecdf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.208260:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b7ecdf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.208371:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b7ecdf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826284.208417:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787826284.208422:0:8247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826284.208439:0:8247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b7ecdf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.208461:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b7ecd8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafe9a expref: 22 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.208794:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b7ecdf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafe9a expref: 21 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.208804:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cf39656000) 00010000:00010000:3.0:1787826284.208807:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787826284.208810:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401a00, rc 0) 00000100:00100000:3.0:1787826284.208928:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f06d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:49788:x1874670563593088:12345-192.168.203.39@tcp:101:dd.0 Request processed in 816us (980us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826284.208935:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3163 00000100:00100000:1.0:1787826284.218977:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563593344 00000100:00100000:1.0:1787826284.218987:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563593344 00000100:00100000:1.0:1787826284.219049:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3164 00000100:00100000:1.0:1787826284.219060:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab15a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:49788:x1874670563593344:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:1.0:1787826284.219080:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826284.219083:0:9966:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787826284.219121:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b7ecdf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafe9a expref: 21 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.219139:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cf39656000) 00010000:00010000:1.0:1787826284.219143:0:9966:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826284.219156:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026af200/0x22153cd396b7ece6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aafea1 expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.219312:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026ae600/0x22153cd396b7eced lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.219325:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026ae600/0x22153cd396b7eced lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.219335:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026ae600/0x22153cd396b7eced lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.219347:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026af000/0x22153cd396b7ecf4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.219355:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026af000/0x22153cd396b7ecf4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.219363:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026af000/0x22153cd396b7ecf4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.219424:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026afe00/0x22153cd396b7ecfb lrc: 3/1,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.219432:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026afe00/0x22153cd396b7ecfb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.219440:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026afe00/0x22153cd396b7ecfb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826284.219449:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x9:0x0]: returning size 0 00010000:00010000:1.0:1787826284.219566:0:9966:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026ae600/0x22153cd396b7eced lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.219574:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026ae600/0x22153cd396b7eced lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.219579:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026ae600/0x22153cd396b7eced lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.219586:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026ae600/0x22153cd396b7eced lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.219591:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce026ae600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826284.219595:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026ae600/0x22153cd396b7eced lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.219602:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026ae600/0x22153cd396b7eced lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.219611:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cf39656000) 00010000:00010000:1.0:1787826284.219614:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826284.219618:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026ae600/0x22153cd396b7eced lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.219625:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026ae600/0x22153cd396b7eced lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.219637:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026af000/0x22153cd396b7ecf4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.219644:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026af000/0x22153cd396b7ecf4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.219649:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026af000/0x22153cd396b7ecf4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.219655:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce026af000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826284.219657:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026af000/0x22153cd396b7ecf4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.219667:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026af000/0x22153cd396b7ecf4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.219675:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x995b1268 (ffff90cf06894d00) 00010000:00010000:1.0:1787826284.219677:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826284.219680:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026af000/0x22153cd396b7ecf4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.219685:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026af000/0x22153cd396b7ecf4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.219718:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026af200/0x22153cd396b7ece6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafea1 expref: 23 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.219730:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026afe00/0x22153cd396b7ecfb lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafea1 expref: 22 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.219737:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff90cf06894500) 00010000:00010000:1.0:1787826284.219739:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826284.219741:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce026afe00, rc 0) 00000100:00100000:1.0:1787826284.219796:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab15a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:49788:x1874670563593344:12345-192.168.203.39@tcp:101:dd.0 Request processed in 738us (904us total) trans 4294969241 rc 0/0 00000100:00100000:1.0:1787826284.219803:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3164 00000100:00100000:1.0:1787826284.223328:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826284.223400:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563593472 00000100:00100000:3.0:1787826284.223409:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563593472 00000100:00100000:3.0:1787826284.223466:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3165 00000100:00100000:3.0:1787826284.223510:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:49788:x1874670563593472:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:3.0:1787826284.223533:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826284.223553:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b7ed09 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aafea8 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.223585:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b7ed10 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.223598:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b7ed10 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.223610:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b7ed10 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.223726:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b7ed09 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafea8 expref: 24 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.223742:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b7ed10 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafea8 expref: 23 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.223750:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff90cf06894500) 00010000:00010000:3.0:1787826284.223752:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787826284.223755:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401000, rc 0) 00000100:00100000:3.0:1787826284.223815:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+23:49788:x1874670563593472:12345-192.168.203.39@tcp:101:dd.0 Request processed in 306us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826284.223822:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3165 00000100:00100000:1.0:1787826284.226550:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826284.226678:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563593728 00000100:00100000:3.0:1787826284.226688:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563593728 00000100:00100000:3.0:1787826284.226744:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3166 00000100:00100000:3.0:1787826284.226755:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+23:49788:x1874670563593728:12345-192.168.203.39@tcp:36:dd.0 00010000:00010000:3.0:1787826284.226806:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826284.226835:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026afe00/0x22153cd396b7ecfb lrc: 0/0,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafea1 expref: 23 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.226855:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff90cf06894500) 00010000:00010000:3.0:1787826284.226860:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826284.227002:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b7ed17 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.227015:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b7ed17 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.227025:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b7ed17 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787826284.227065:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294969242 00000004:00010000:3.0:1787826284.227087:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dad21996 reply state 00000000c35c7680 transno 4294969243 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b7ed17 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.227111:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b7ed17 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.227117:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff90cf06894500) 00010000:00010000:3.0:1787826284.227121:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826284.227124:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826284.227209:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:49788:x1874670563593728:12345-192.168.203.39@tcp:36:dd.0 Request processed in 455us (666us total) trans 4294969243 rc 0/0 00000100:00100000:3.0:1787826284.227216:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3166 00000020:00080000:3.0:1787826284.227221:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787826284.232741:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563593856 00000100:00100000:3.0:1787826284.232751:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563593856 00000100:00100000:3.0:1787826284.232801:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3167 00000100:00100000:3.0:1787826284.232811:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f88f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:49788:x1874670563593856:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:3.0:1787826284.232834:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826284.232853:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b7ed1e lrc: 2/0,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aafeaf expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.232907:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b7ed1e lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafeaf expref: 26 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.232920:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b7ed1e lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafeaf expref: 26 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.232939:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff90cf06894500) 00010000:00010000:3.0:1787826284.232943:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826284.232947:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400200, rc 0) 00000100:00100000:3.0:1787826284.233018:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f88f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:49788:x1874670563593856:12345-192.168.203.39@tcp:101:dd.0 Request processed in 199us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826284.233026:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3167 00000100:00100000:1.0:1787826284.237310:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000001:00080000:3.0:1787826284.244690:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969244 is committed 00000004:00080000:3.0:1787826284.244704:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 227 committed 00000004:00080000:3.0:1787826284.244719:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 235 committed 00000100:00100000:1.0:1787826284.244952:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787826284.244971:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab15680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585108864:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787826284.245046:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826284.245107:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585108864 00000100:00100000:1.0:1787826284.245115:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585108864 00000100:00100000:1.0:1787826284.245164:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1584 00000100:00100000:1.0:1787826284.245172:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f806580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874670585108864:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787826284.245340:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f806580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1874670585108864:12345-0@lo:2:osp-syn-1-0.0 Request processed in 167us (293us total) trans 17179869542 rc 0/0 00000100:00100000:1.0:1787826284.245348:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1584 00000100:00100000:1.0:1787826284.245389:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f807840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585108992:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787826284.245428:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1787826284.245463:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3ab15680/2, rc 0, transno 17179869542 00000100:00100000:1.0:1787826284.245696:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab15680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585108864:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787826284.248286:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585108992 00000100:00100000:1.0:1787826284.248295:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585108992 00000100:00100000:1.0:1787826284.248348:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563594240 00000100:00100000:1.0:1787826284.248352:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563594240 00000004:00080000:1.0:1787826284.249213:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3f807840/2, rc 0, transno 21474836858 00000100:00100000:1.0:1787826284.249219:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f807840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585108992:0@lo:2:osp-syn-0-0.0 00000100:00080000:3.0:1787826284.249392:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826284.251079:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826284.320389:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826284.320719:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563594624 00000100:00100000:3.0:1787826284.320733:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563594624 00000100:00100000:3.0:1787826284.322242:0:8544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a8afc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8544:1874670585109120:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787826284.322302:0:8544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826284.322340:0:8544:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce04aa5cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826284.322397:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585109120 00000100:00100000:1.0:1787826284.322404:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585109120 00000100:00100000:1.0:1787826284.322450:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1587 00000100:00100000:1.0:1787826284.322459:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03b90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:8544:x1874670585109120:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1787826284.322522:0:30695:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 226 00000100:00100000:1.0:1787826284.324056:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03b90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:8544:x1874670585109120:12345-0@lo:5:osp-pre-0-0.0 Request processed in 1594us (1749us total) trans 21474836860 rc 0/0 00000100:00100000:1.0:1787826284.324066:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1587 00000100:00100000:3.0:1787826284.324269:0:8544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a8afc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8544:1874670585109120:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787826284.324283:0:8544:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0xd2:0x0]-[0x280000401:0x101:0x0] 00000001:00080000:3.0:1787826284.335428:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969245 is committed 00000004:00080000:3.0:1787826284.335441:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 228 committed 00000004:00080000:3.0:1787826284.335463:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 237 committed 00000004:00080000:3.0:1787826284.335524:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 236 committed 00000100:00100000:1.0:1787826284.335658:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0b432940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585109504:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787826284.335741:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0b4303c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585109248:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787826284.336891:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826284.336977:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585109504 00000100:00100000:1.0:1787826284.336984:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585109504 00000100:00100000:1.0:1787826284.337032:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1588 00000100:00100000:1.0:1787826284.337042:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b430000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3646:x1874670585109504:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787826284.337207:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b430000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3646:x1874670585109504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 166us (319us total) trans 21474836861 rc 0/0 00000100:00100000:1.0:1787826284.337214:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1588 00000004:00080000:1.0:1787826284.337258:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce0b432940/2, rc 0, transno 21474836861 00000100:00100000:1.0:1787826284.337263:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0b432940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585109504:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787826284.339485:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826284.339658:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585109248 00000100:00100000:1.0:1787826284.339667:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585109248 00000100:00100000:1.0:1787826284.339717:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1589 00000100:00100000:1.0:1787826284.339727:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f9370c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3644:x1874670585109248:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787826284.339860:0:8437:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xd1:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787826284.339864:0:8437:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xd1:0x0] updating lvb mtime from disk: 1787826284 -> 1787826284 00002000:00010000:1.0:1787826284.339867:0:8437:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xd1:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787826284.339869:0:8437:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xd1:0x0] updating lvb ctime from disk: 1787826284 -> 1787826284 00002000:00010000:1.0:1787826284.339871:0:8437:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xd1:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1787826284.339974:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f9370c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3644:x1874670585109248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 248us (507us total) trans 21474836862 rc 0/0 00000100:00100000:1.0:1787826284.339983:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1589 00000100:00100000:1.0:1787826284.346823:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585109376 00000100:00100000:1.0:1787826284.346833:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585109376 00000100:00100000:1.0:1787826284.346889:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1590 00000100:00100000:1.0:1787826284.347000:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf2f45fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3645:x1874670585109376:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787826284.347619:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf2f45fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:3645:x1874670585109376:12345-0@lo:2:osp-syn-1-0.0 Request processed in 620us (962us total) trans 17179869543 rc 0/0 00000100:00100000:1.0:1787826284.347629:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1590 00000100:00100000:1.0:1787826284.348792:0:25423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563594752 00000100:00100000:1.0:1787826284.348801:0:25423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563594752 00002000:00100000:1.0:1787826284.348853:0:25423:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xd1:0x0] (0->2097151) req@ffff90cf3f88f0c0 x1874670563594752/t0(0) o4->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:640/0 lens 488/0 e 0 to 0 dl 1787826295 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826284.348863:0:25423:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf3f88f0c0 with x1874670563594752 ext(0->2097151) 00002000:00010000:1.0:1787826284.348869:0:25423:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf3f88f0c0 00000100:00100000:1.0:1787826284.348898:0:25423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 609 00000100:00100000:1.0:1787826284.348907:0:25423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f88f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563594752:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:1.0:1787826284.377329:0:25423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f88f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2404:x1874670563594752:12345-192.168.203.39@tcp:4:dd.0 Request processed in 28410us (29175us total) trans 21474836863 rc 0/0 00000100:00100000:1.0:1787826284.377345:0:25423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 609 00002000:00100000:1.0:1787826284.377357:0:25423:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xd1:0x0] (0->2097151) req@ffff90cf3f88f0c0 x1874670563594752/t21474836863(0) o4->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:640/0 lens 488/448 e 0 to 0 dl 1787826295 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826284.377368:0:25423:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf3f88f0c0 with x1874670563594752 ext(0->2097151) 00002000:00010000:1.0:1787826284.377375:0:25423:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf3f88f0c0 00000100:00100000:3.0:1787826284.439237:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563595136 00000100:00100000:3.0:1787826284.439246:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563595136 00000100:00100000:3.0:1787826284.439305:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 943 00000100:00100000:3.0:1787826284.439315:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f88fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+17:49788:x1874670563595136:12345-192.168.203.39@tcp:35:dd.0 00000100:00100000:3.0:1787826284.440245:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f88fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+18:49788:x1874670563595136:12345-192.168.203.39@tcp:35:dd.0 Request processed in 927us (1127us total) trans 4294969246 rc 0/0 00000100:00100000:3.0:1787826284.440256:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 943 00000100:00100000:3.0:1787826284.490383:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826284.497637:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826284.501204:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563595520 00000100:00100000:3.0:1787826284.501226:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563595520 00000100:00100000:1.0:1787826284.535450:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826284.538032:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3173 00000100:00100000:3.0:1787826284.571205:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00002000:00100000:1.0:1787826284.607617:0:30188:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_017: refresh rw locks for [0x280000401:0xd1:0x0] (32768->2097151) req@ffff90cf2f45cb40 x1874670563596160/t0(0) o3->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:640/0 lens 488/0 e 0 to 0 dl 1787826295 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826284.607639:0:30188:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf2f45cb40 with x1874670563596160 ext(32768->2097151) 00002000:00010000:1.0:1787826284.607645:0:30188:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf2f45cb40 00000100:00100000:1.0:1787826284.607694:0:30188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 611 00000100:00100000:1.0:1787826284.607705:0:30188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf2f45cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2402:x1874670563596160:12345-192.168.203.39@tcp:3:md5sum.0 00000100:00100000:1.0:1787826284.647842:0:30188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf2f45cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2402:x1874670563596160:12345-192.168.203.39@tcp:3:md5sum.0 Request processed in 40128us (42045us total) trans 0 rc 2064384/2064384 00000100:00100000:1.0:1787826284.647855:0:30188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 611 00002000:00100000:1.0:1787826284.647870:0:30188:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_017: refresh rw locks for [0x280000401:0xd1:0x0] (32768->2097151) req@ffff90cf2f45cb40 x1874670563596160/t0(0) o3->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:640/0 lens 488/440 e 0 to 0 dl 1787826295 ref 1 fl Complete:/600/0 rc 2064384/2064384 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826284.647880:0:30188:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf2f45cb40 with x1874670563596160 ext(32768->2097151) 00002000:00010000:1.0:1787826284.647887:0:30188:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf2f45cb40 00000100:00100000:3.0:1787826284.679219:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826284.727665:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563596672 00000100:00100000:3.0:1787826284.727678:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563596672 00000100:00100000:3.0:1787826284.727751:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3174 00000100:00100000:3.0:1787826284.727769:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf2f45d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:49794:x1874670563596672:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826284.727793:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826284.727813:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b7edaa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aafee7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.727947:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b7edb1 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.727961:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839600/0x22153cd396b7ed9c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafee0 expref: 23 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.727971:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b7edb1 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.728004:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839600/0x22153cd396b7ed9c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafee0 expref: 23 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.728016:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839600/0x22153cd396b7ed9c lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafee0 expref: 23 pid: 8247 timeout: 1330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826284.728029:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3abc3480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1874670585109632:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826284.728125:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce04aa5f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787826284.732822:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3abc3480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1874670585109632:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826284.732851:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b7edb1 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.734742:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b7edb1 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.734750:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b7edb1 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826284.734781:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x9:0x0]: returning size 3145729 00010000:00010000:3.0:1787826284.734912:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b7edaa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafee7 expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.734927:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b7edb1 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafee7 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.734935:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff90cf06894500) 00010000:00010000:3.0:1787826284.734938:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787826284.734941:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401e00, rc 0) 00000100:00100000:3.0:1787826284.734979:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf2f45d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+23:49794:x1874670563596672:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 7220us (7810us total) trans 4294969249 rc 0/0 00000100:00100000:3.0:1787826284.734987:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3174 00000100:00100000:3.0:1787826284.741346:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563596928 00000100:00100000:3.0:1787826284.741356:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563596928 00000100:00100000:3.0:1787826284.741416:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3175 00000100:00100000:3.0:1787826284.741426:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf2f45e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+23:49794:x1874670563596928:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826284.741448:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826284.741469:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b7edbf lrc: 2/0,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aafeee expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.741630:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b7edc6 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.741647:0:32404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b7edb1 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafee7 expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.741656:0:32404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b7edc6 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.741691:0:32404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b7edb1 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafee7 expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.741705:0:32404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b7edb1 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafee7 expref: 24 pid: 6520 timeout: 1330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826284.741718:0:32404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3abc3480 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:32404:1874670585109760:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826284.741794:0:32404:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce04aa5300 going to sleep for 11 seconds 00000100:00100000:1.0:1787826284.747400:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563597056 00000100:00100000:1.0:1787826284.747409:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563597056 00010000:00010000:1.0:1787826284.747448:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b7edb1 lrc: 5/0,0 mode: CW/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafee7 expref: 25 pid: 6520 timeout: 1330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826284.747538:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 866 00000100:00100000:1.0:1787826284.747548:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f88d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:2404:x1874670563597056:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826284.747561:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826284.747568:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b7edb1 lrc: 5/0,0 mode: CW/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafee7 expref: 25 pid: 6520 timeout: 1330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.747581:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b7edb1 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafee7 expref: 25 pid: 6520 timeout: 1330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.747607:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff90cf06894500) 00010000:00010000:1.0:1787826284.747612:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b7edc6 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.747621:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b7edc6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.747630:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b7edc6 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.747649:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826284.747699:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f88d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:2404:x1874670563597056:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 152us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826284.747706:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 866 00010000:00010000:3.0:1787826284.751707:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b7edb1 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafee7 expref: 24 pid: 6520 timeout: 1330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826284.751732:0:32404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3abc3480 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:32404:1874670585109760:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826284.751769:0:32404:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b7edc6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.751781:0:32404:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b7edc6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.751786:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b7edc6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826284.751843:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x9:0x0]: returning size 3145729 00000004:00200000:3.0:1787826284.751848:0:32404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826284.751870:0:32404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b7edc6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.751910:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b7edbf lrc: 0/0,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafeee expref: 24 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.751931:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b7edc6 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafeee expref: 23 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.751940:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff90cf06894500) 00010000:00010000:3.0:1787826284.751943:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826284.751946:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401a00, rc 0) 00000100:00100000:3.0:1787826284.752028:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf2f45e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+23:49794:x1874670563596928:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 10603us (10780us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826284.752037:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3175 00000100:00100000:1.0:1787826284.767203:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563597440 00000100:00100000:1.0:1787826284.767214:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563597440 00000100:00100000:1.0:1787826284.768264:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563597568 00000100:00100000:1.0:1787826284.768272:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563597568 00000100:00100000:1.0:1787826284.768376:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1592 00000100:00100000:1.0:1787826284.768387:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f88d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2404:x1874670563597440:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:1.0:1787826284.768433:0:30695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cdfbbc94/0x22153cd396b7ede2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.768453:0:30695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004bbb43ea/0x22153cd396b7ed33 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000080000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafebd expref: 13 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.768461:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0xd1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826284.768466:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd1:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826284.768493:0:30695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cdfbbc94/0x22153cd396b7ede2 lrc: 4/0,1 mode: --/PW res: [0x280000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.768532:0:30695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004bbb43ea/0x22153cd396b7ed33 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000080000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafebd expref: 13 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.768546:0:30695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004bbb43ea/0x22153cd396b7ed33 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x70000480000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafebd expref: 13 pid: 8545 timeout: 1330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826284.768560:0:30695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0b432580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:30695:1874670585109888:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826284.768625:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1593 00000100:00100000:3.0:1787826284.768635:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aaf03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2404:x1874670563597568:12345-192.168.203.39@tcp:1:lfs.0 00000100:00100000:1.0:1787826284.768647:0:30695:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068bd240 going to sleep for 11 seconds 00010000:00010000:3.0:1787826284.768653:0:30696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000482bb568/0x22153cd396b7ede9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.768664:0:30696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bc49efab/0x22153cd396b7ed48 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafecb expref: 13 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.768670:0:30696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0xd2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826284.768673:0:30696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826284.768676:0:30696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000482bb568/0x22153cd396b7ede9 lrc: 4/0,1 mode: --/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.768695:0:30696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bc49efab/0x22153cd396b7ed48 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafecb expref: 13 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.768710:0:30696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bc49efab/0x22153cd396b7ed48 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafecb expref: 13 pid: 8436 timeout: 1330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826284.768719:0:30696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3abc3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:30696:1874670585110016:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826284.768745:0:30696:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce04aa5300 going to sleep for 11 seconds 00000100:00100000:1.0:1787826284.775685:0:30695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0b432580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:30695:1874670585109888:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826284.775715:0:30695:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cdfbbc94/0x22153cd396b7ede2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826284.776572:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563597696 00000100:00100000:1.0:1787826284.776580:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563597696 00010000:00010000:1.0:1787826284.776618:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004bbb43ea/0x22153cd396b7ed33 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000480000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafebd expref: 14 pid: 8545 timeout: 1330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826284.776659:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 867 00000100:00100000:1.0:1787826284.776668:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aaf2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2403:x1874670563597696:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826284.776682:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787826284.776701:0:6504:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xd1:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:1.0:1787826284.776705:0:6504:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xd1:0x0] updating lvb blocks from disk: 0 -> 4096 00010000:00010000:1.0:1787826284.776711:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004bbb43ea/0x22153cd396b7ed33 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000480000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafebd expref: 14 pid: 8545 timeout: 1330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.776725:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004bbb43ea/0x22153cd396b7ed33 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000480000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafebd expref: 14 pid: 8545 timeout: 1330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.776747:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004bbb43ea/0x22153cd396b7ed33 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801480000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafebd expref: 14 pid: 8545 timeout: 1330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.776765:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd1:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826284.776769:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd1:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826284.776775:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cdfbbc94/0x22153cd396b7ede2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.776785:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cdfbbc94/0x22153cd396b7ede2 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.776817:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826284.776868:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aaf2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2403:x1874670563597696:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 199us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826284.776883:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 867 00000100:00100000:3.0:1787826284.778902:0:30696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3abc3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:30696:1874670585110016:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826284.778928:0:30696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000482bb568/0x22153cd396b7ede9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826284.811578:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826284.811660:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563597952 00000100:00100000:1.0:1787826284.811670:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563597952 00010000:00010000:1.0:1787826284.811713:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bc49efab/0x22153cd396b7ed48 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafecb expref: 14 pid: 8436 timeout: 1330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826284.811851:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 868 00000100:00100000:1.0:1787826284.811864:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2402:x1874670563597952:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826284.811880:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787826284.811898:0:6503:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xd2:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:1.0:1787826284.811902:0:6503:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xd2:0x0] updating lvb mtime from disk: 0 -> 1787826285 00002000:00010000:1.0:1787826284.811904:0:6503:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xd2:0x0] updating lvb atime from disk: 0 -> 1787826285 00002000:00010000:1.0:1787826284.811906:0:6503:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xd2:0x0] updating lvb ctime from disk: 0 -> 1787826285 00002000:00010000:1.0:1787826284.811909:0:6503:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xd2:0x0] updating lvb blocks from disk: 0 -> 2048 00010000:00010000:1.0:1787826284.811915:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bc49efab/0x22153cd396b7ed48 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafecb expref: 14 pid: 8436 timeout: 1330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.811931:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bc49efab/0x22153cd396b7ed48 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafecb expref: 14 pid: 8436 timeout: 1330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.811955:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc49efab/0x22153cd396b7ed48 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafecb expref: 14 pid: 8436 timeout: 1330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.811973:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826284.811978:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826284.811983:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000482bb568/0x22153cd396b7ede9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.811993:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000482bb568/0x22153cd396b7ede9 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826284.812027:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826284.812056:0:30696:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000482bb568/0x22153cd396b7ede9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.812067:0:30696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000482bb568/0x22153cd396b7ede9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.812087:0:30696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000482bb568/0x22153cd396b7ede9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826284.812100:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2402:x1874670563597952:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 227us (518us total) trans 0 rc 0/0 00010000:00010000:3.0:1787826284.812106:0:30696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000482bb568/0x22153cd396b7ede9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826284.812114:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 868 00010000:00010000:3.0:1787826284.812122:0:30696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000482bb568/0x22153cd396b7ede9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.812136:0:30696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400200 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826284.812140:0:30696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000482bb568/0x22153cd396b7ede9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.812316:0:30696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000482bb568/0x22153cd396b7ede9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.812331:0:30696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000482bb568/0x22153cd396b7ede9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.812338:0:30696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000482bb568/0x22153cd396b7ede9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826284.812544:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aaf03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563597568:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 43910us (45314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826284.812552:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1593 00000100:00100000:3.0:1787826284.816967:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000001:00080000:1.0:1787826284.824163:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969251 is committed 00000004:00080000:1.0:1787826284.824380:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 230 committed 00000004:00080000:1.0:1787826284.824585:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 229 committed 00000100:00100000:3.0:1787826284.824689:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787826284.824707:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3abc2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585110144:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787826284.824783:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826284.824841:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826284.824896:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1594 00000100:00100000:3.0:1787826284.824907:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+8:3646:x1874670585110144:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787826284.825126:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+9:3646:x1874670585110144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 219us (342us total) trans 17179869544 rc 0/0 00000004:00080000:1.0:1787826284.825523:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 239 committed 00000004:00080000:1.0:1787826284.825533:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 238 committed 00000004:00080000:1.0:1787826284.825842:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3abc0000/2, rc 0, transno 17179869545 00000100:00100000:1.0:1787826284.825850:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3abc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585110272:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787826284.825864:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf2f45f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585110400:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787826284.825900:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826284.826795:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1594 00000100:00100000:1.0:1787826284.830770:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826284.831016:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563598336 00000100:00100000:3.0:1787826284.831025:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563598336 00000100:00100000:3.0:1787826284.831083:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3178 00000100:00100000:3.0:1787826284.831104:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+18:49794:x1874670563598336:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826284.831125:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826284.831145:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b7edf7 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aafefc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.831212:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b7edf7 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafefc expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.831226:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b7edf7 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafefc expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.831244:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff90cf06894500) 00010000:00010000:3.0:1787826284.831247:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826284.831251:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400200, rc 0) 00000100:00100000:3.0:1787826284.831313:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:49794:x1874670563598336:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 222us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826284.831320:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3178 00000100:00100000:1.0:1787826284.840817:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826284.841425:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563598464 00000100:00100000:3.0:1787826284.841436:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563598464 00000100:00100000:3.0:1787826284.841519:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3179 00000100:00100000:3.0:1787826284.841529:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:49794:x1874670563598464:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826284.841550:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826284.841574:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b7edfe lrc: 2/0,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aaff03 expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.841700:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b7ee05 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.841716:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b7ee05 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.841728:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b7ee05 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826284.841756:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x9:0x0]: returning size 3145729 00000004:00200000:3.0:1787826284.841760:0:32404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826284.841779:0:32404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b7ee05 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.841806:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b7edfe lrc: 0/0,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff03 expref: 21 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.841824:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b7ee05 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff03 expref: 20 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826284.841832:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff90cf06894500) 00010000:00010000:3.0:1787826284.841834:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826284.841838:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401e00, rc 0) 00000100:00100000:3.0:1787826284.841914:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:49794:x1874670563598464:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 387us (1969us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826284.841922:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3179 00000100:00100000:1.0:1787826284.848080:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00010000:00010000:1.0:1787826284.868330:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826284.940865:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826284.940908:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826284.944425:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826284.945009:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563599104 00000100:00100000:3.0:1787826284.945025:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563599104 00000100:00100000:3.0:1787826284.945118:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1602 00000100:00100000:3.0:1787826284.945131:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563599104:12345-192.168.203.39@tcp:23:lfs.0 00000100:00100000:3.0:1787826284.945300:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563599104:12345-192.168.203.39@tcp:23:lfs.0 Request processed in 171us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826284.945309:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1602 00000100:00100000:1.0:1787826284.945771:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826284.947703:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563599232 00000100:00100000:3.0:1787826284.947721:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563599232 00000100:00100000:3.0:1787826284.947814:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1603 00000100:00100000:3.0:1787826284.947826:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563599232:12345-192.168.203.39@tcp:23:lfs.0 00000100:00100000:3.0:1787826284.947969:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563599232:12345-192.168.203.39@tcp:23:lfs.0 Request processed in 145us (2200us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826284.947977:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1603 00000100:00100000:3.0:1787826284.964122:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826285.005295:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00080000:3.0:1787826285.007294:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826285.055722:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000001:00080000:1.0:1787826285.077585:0:27651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179869547 is committed 00000100:00100000:1.0:1787826285.129299:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563600128 00000100:00100000:1.0:1787826285.129309:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563600128 00000100:00100000:1.0:1787826285.129368:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1604 00000100:00100000:1.0:1787826285.129378:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03893840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:49794:x1874670563600128:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826285.129395:0:30398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826285.129417:0:30398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b410ed4/0x22153cd396b7ee3d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xdd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aaff18 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826285.129440:0:30398:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xdd:0x0] initial LVB size: 1048576, mtime: 0x6a90106d, atime: 0x0, ctime: 0x6a90106d, blocks: 0x800 00010000:00010000:1.0:1787826285.129461:0:30398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdd:0x0].0x0 since=1231s v=(0 0) 00010000:00010000:1.0:1787826285.129466:0:30398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826285.129509:0:30398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b410ed4/0x22153cd396b7ee3d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff18 expref: 8 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826285.129537:0:30398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003b410ed4/0x22153cd396b7ee3d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff18 expref: 8 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826285.129551:0:30398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce026ae400, rc 0) 00000100:00100000:1.0:1787826285.129618:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03893840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:49794:x1874670563600128:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 242us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826285.129625:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1604 00000100:00100000:1.0:1787826285.139777:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826285.151006:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826285.178207:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563600768 00000100:00100000:1.0:1787826285.178220:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563600768 00000100:00100000:1.0:1787826285.178284:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563600896 00000100:00100000:1.0:1787826285.178288:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563600896 00000100:00100000:1.0:1787826285.178326:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1606 00000100:00100000:1.0:1787826285.178336:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03891a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2403:x1874670563600768:12345-192.168.203.39@tcp:2:lfs.0 00002000:00010000:1.0:1787826285.178517:0:28853:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xd1:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1787826285.178521:0:28853:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xd1:0x0] updating lvb mtime from disk: 1787826284 -> 1787826285 00002000:00010000:1.0:1787826285.178524:0:28853:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xd1:0x0] updating lvb atime from disk: 0 -> 1787826285 00002000:00010000:1.0:1787826285.178526:0:28853:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xd1:0x0] updating lvb ctime from disk: 1787826284 -> 1787826285 00002000:00010000:1.0:1787826285.178528:0:28853:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xd1:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:1.0:1787826285.178602:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03891a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2403:x1874670563600768:12345-192.168.203.39@tcp:2:lfs.0 Request processed in 266us (1652us total) trans 21474836867 rc 0/0 00000100:00100000:1.0:1787826285.178611:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1606 00000100:00100000:1.0:1787826285.178630:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1607 00000100:00100000:1.0:1787826285.178637:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2403:x1874670563600896:12345-192.168.203.39@tcp:2:lfs.0 00002000:00010000:1.0:1787826285.178691:0:28853:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xd2:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:1.0:1787826285.178694:0:28853:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xd2:0x0] updating lvb mtime from disk: 1787826285 -> 1787826285 00002000:00010000:1.0:1787826285.178696:0:28853:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xd2:0x0] updating lvb atime from disk: 1787826285 -> 1787826285 00002000:00010000:1.0:1787826285.178698:0:28853:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xd2:0x0] updating lvb ctime from disk: 1787826285 -> 1787826285 00002000:00010000:1.0:1787826285.178700:0:28853:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xd2:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:1.0:1787826285.178722:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2403:x1874670563600896:12345-192.168.203.39@tcp:2:lfs.0 Request processed in 86us (1716us total) trans 21474836868 rc 0/0 00000100:00100000:1.0:1787826285.178727:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1607 00000100:00100000:3.0:1787826285.182165:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563601152 00000100:00100000:3.0:1787826285.182175:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563601152 00000100:00100000:3.0:1787826285.182235:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 945 00000100:00100000:3.0:1787826285.182245:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:49794:x1874670563601152:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:3.0:1787826285.182306:0:14257:0:(mdt_open.c:2504:mdt_close_resync_done()) ### [0x200000405:0x9:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427a00/0x22153cd396b7edd4 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x9:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafef5 expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.182353:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a07800/0x22153cd396b7ee52 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.182370:0:14257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b7edf7 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafefc expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.182378:0:14257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a07800/0x22153cd396b7ee52 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.182409:0:14257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b7edf7 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafefc expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.182423:0:14257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b7edf7 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafefc expref: 24 pid: 6520 timeout: 1331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826285.182436:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3abc3c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585110656:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826285.182931:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce04aa5300 going to sleep for 11 seconds 00000100:00100000:3.0:1787826285.191158:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3abc3c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585110656:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826285.191181:0:14257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a07800/0x22153cd396b7ee52 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.191534:0:14257:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a07800/0x22153cd396b7ee52 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.191543:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a07800/0x22153cd396b7ee52 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787826285.191755:0:14257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].255, 88 off29432 00000004:00080000:3.0:1787826285.191776:0:14257:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1231203303462ns, next at 1199550350265ns, rc = 0 00000040:00080000:3.0:1787826285.191799:0:14257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].256, 88 off29520 00000004:00080000:3.0:1787826285.191811:0:14257:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1231203339407ns, next at 1199550350265ns, rc = 0 00000040:00080000:3.0:1787826285.191832:0:14257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].247, 88 off28816 00000004:00080000:3.0:1787826285.191840:0:14257:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1231203368047ns, next at 1199550309483ns, rc = 0 00000040:00080000:3.0:1787826285.191857:0:14257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].248, 88 off28904 00000004:00080000:3.0:1787826285.191860:0:14257:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1231203388402ns, next at 1199550309483ns, rc = 0 00000100:00100000:3.0:1787826285.195019:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf136ced00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585110912:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787826285.195101:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826285.195155:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585110912 00000100:00100000:3.0:1787826285.195162:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585110912 00000100:00100000:3.0:1787826285.195209:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1608 00000100:00100000:3.0:1787826285.195217:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3644:x1874670585110912:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1787826285.195361:0:30696:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xde:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:3.0:1787826285.195366:0:30696:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xde:0x0] updating lvb mtime from disk: 1787826285 -> 1787826285 00002000:00010000:3.0:1787826285.195368:0:30696:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xde:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787826285.195370:0:30696:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xde:0x0] updating lvb ctime from disk: 1787826285 -> 1787826285 00002000:00010000:3.0:1787826285.195373:0:30696:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xde:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:3.0:1787826285.195410:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3644:x1874670585110912:12345-0@lo:2:osp-syn-1-0.0 Request processed in 194us (310us total) trans 17179869549 rc 0/0 00000100:00100000:3.0:1787826285.195418:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1608 00000100:00080000:3.0:1787826285.195438:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826285.195462:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869545 gen 2 00000004:00080000:3.0:1787826285.195467:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3ab15680, transno 17179869542 00000004:00080000:3.0:1787826285.195499:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3a8fa1c0, transno 17179869543 00000004:00080000:3.0:1787826285.195503:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3abc2940, transno 17179869544 00000004:00080000:3.0:1787826285.195505:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3abc0000, transno 17179869545 00000100:00100000:3.0:1787826285.195511:0:3644:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff90cf136ced00 x1874670585110912/t17179869549(17179869549) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1787826301 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1787826285.195528:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf136ced00/2, rc 0, transno 17179869549 00000100:00100000:3.0:1787826285.195532:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf136ced00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585110912:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787826285.195546:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787826285.195553:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3abc3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585110784:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787826285.195592:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1787826285.195692:0:9969:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 2 in progress, 1 in flight, 4 done 00000100:00100000:3.0:1787826285.195705:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585110784 00000100:00100000:3.0:1787826285.195709:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585110784 00000100:00100000:3.0:1787826285.195735:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1609 00000100:00100000:3.0:1787826285.195742:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136cc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3646:x1874670585110784:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1787826285.195795:0:30398:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xdd:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1787826285.195799:0:30398:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xdd:0x0] updating lvb mtime from disk: 1787826285 -> 1787826285 00002000:00010000:3.0:1787826285.195801:0:30398:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xdd:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787826285.195803:0:30398:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xdd:0x0] updating lvb ctime from disk: 1787826285 -> 1787826285 00002000:00010000:3.0:1787826285.195942:0:30398:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xdd:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:3.0:1787826285.195975:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136cc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:3646:x1874670585110784:12345-0@lo:2:osp-syn-1-0.0 Request processed in 233us (382us total) trans 17179869550 rc 0/0 00000100:00100000:3.0:1787826285.195982:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1609 00000004:00080000:3.0:1787826285.196008:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3abc3c00/2, rc 0, transno 17179869550 00000100:00100000:3.0:1787826285.196013:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3abc3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585110784:0@lo:2:osp-syn-1-0.0 00000004:00010000:3.0:1787826285.196051:0:14257:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000085b2d0d0 reply state 000000006c89f6df transno 4294969255 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a07800/0x22153cd396b7ee52 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.196070:0:14257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a07800/0x22153cd396b7ee52 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.196084:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff90cf06894500) 00010000:00010000:3.0:1787826285.196099:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1787826285.196103:0:14257:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787826285.196108:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff90cf06894500) 00010000:00010000:3.0:1787826285.196111:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787826285.196117:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427a00/0x22153cd396b7edd4 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x9:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafef5 expref: 20 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1787826285.196202:0:14257:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1787826285.196213:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:49794:x1874670563601152:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 13969us (14156us total) trans 4294969255 rc 0/0 00000100:00100000:3.0:1787826285.196221:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 945 00000100:00100000:1.0:1787826285.196512:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787826285.196522:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03a1ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585111040:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787826285.196550:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826285.196589:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03a1a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585111168:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787826285.196612:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826285.196753:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585111040 00000100:00100000:1.0:1787826285.196758:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585111040 00000100:00100000:1.0:1787826285.196791:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585111168 00000100:00100000:1.0:1787826285.196794:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585111168 00000100:00100000:1.0:1787826285.196962:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1610 00000100:00100000:1.0:1787826285.196971:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a183c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3644:x1874670585111040:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787826285.197064:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xd1:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1787826285.197067:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xd1:0x0] updating lvb mtime from disk: 1787826285 -> 1787826285 00002000:00010000:1.0:1787826285.197070:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xd1:0x0] updating lvb atime from disk: 1787826285 -> 1787826285 00002000:00010000:1.0:1787826285.197072:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xd1:0x0] updating lvb ctime from disk: 1787826285 -> 1787826285 00002000:00010000:1.0:1787826285.197075:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xd1:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:1.0:1787826285.197122:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a183c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3644:x1874670585111040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 153us (570us total) trans 21474836869 rc 0/0 00000100:00100000:1.0:1787826285.197129:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1610 00000100:00100000:1.0:1787826285.197144:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1611 00000100:00100000:1.0:1787826285.197151:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3646:x1874670585111168:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787826285.197202:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xd2:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:1.0:1787826285.197205:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xd2:0x0] updating lvb mtime from disk: 1787826285 -> 1787826285 00002000:00010000:1.0:1787826285.197207:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xd2:0x0] updating lvb atime from disk: 1787826285 -> 1787826285 00002000:00010000:1.0:1787826285.197209:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xd2:0x0] updating lvb ctime from disk: 1787826285 -> 1787826285 00002000:00010000:1.0:1787826285.197212:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xd2:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:1.0:1787826285.197242:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3646:x1874670585111168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 93us (629us total) trans 21474836870 rc 0/0 00000100:00100000:1.0:1787826285.197249:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1611 00000100:00080000:1.0:1787826285.197266:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1787826285.197658:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce03a1ad00/2, rc 0, transno 21474836869 00000100:00100000:1.0:1787826285.197663:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03a1ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585111040:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1787826285.197682:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce03a1a940/2, rc 0, transno 21474836870 00000100:00100000:1.0:1787826285.197685:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03a1a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585111168:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787826285.200673:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563601408 00000100:00100000:3.0:1787826285.200682:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563601408 00000100:00100000:3.0:1787826285.200738:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3182 00000100:00100000:3.0:1787826285.200747:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+17:49794:x1874670563601408:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826285.200779:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826285.200801:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a07e00/0x22153cd396b7ee59 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aaff26 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.201011:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a07e00/0x22153cd396b7ee59 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff26 expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.201026:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a07e00/0x22153cd396b7ee59 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff26 expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.201042:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff90cf06894500) 00010000:00010000:3.0:1787826285.201046:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826285.201049:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf10a07e00, rc 0) 00000100:00100000:3.0:1787826285.201114:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+18:49794:x1874670563601408:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 368us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826285.201122:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3182 00000100:00100000:1.0:1787826285.206452:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826285.237124:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563601920 00000100:00100000:1.0:1787826285.237133:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563601920 00000100:00100000:1.0:1787826285.237184:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3183 00000100:00100000:1.0:1787826285.237192:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab93840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:49795:x1874670563601920:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826285.237213:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826285.237234:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026af200/0x22153cd396b7ee60 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aaff2d expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826285.237338:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026af000/0x22153cd396b7ee67 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826285.237352:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026af000/0x22153cd396b7ee67 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826285.237363:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026af000/0x22153cd396b7ee67 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826285.237376:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026af600/0x22153cd396b7ee6e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826285.237383:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026af600/0x22153cd396b7ee6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826285.237389:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026af600/0x22153cd396b7ee6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826285.237682:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026ae600/0x22153cd396b7ee75 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826285.237692:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026ae600/0x22153cd396b7ee75 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826285.237699:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026ae600/0x22153cd396b7ee75 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826285.237707:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x9:0x0]: returning size 3145728 00010000:00010000:1.0:1787826285.237783:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026af000/0x22153cd396b7ee67 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826285.237790:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026af000/0x22153cd396b7ee67 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826285.237796:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026af000/0x22153cd396b7ee67 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826285.237802:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce026af000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826285.237807:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026af000/0x22153cd396b7ee67 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826285.237814:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026af000/0x22153cd396b7ee67 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826285.237825:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cf39656000) 00010000:00010000:1.0:1787826285.237828:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826285.237833:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026af000/0x22153cd396b7ee67 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826285.237838:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026af000/0x22153cd396b7ee67 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826285.237852:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026af600/0x22153cd396b7ee6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826285.237859:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026af600/0x22153cd396b7ee6e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826285.237865:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026af600/0x22153cd396b7ee6e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826285.237874:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce026af600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826285.237877:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026af600/0x22153cd396b7ee6e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826285.237883:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026af600/0x22153cd396b7ee6e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826285.237890:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x995b1268 (ffff90cf06871400) 00010000:00010000:1.0:1787826285.237893:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826285.237895:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026af600/0x22153cd396b7ee6e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826285.237901:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026af600/0x22153cd396b7ee6e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826285.237940:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026af200/0x22153cd396b7ee60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff2d expref: 22 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826285.237952:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026ae600/0x22153cd396b7ee75 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff2d expref: 21 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826285.237958:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff90cf06894500) 00010000:00010000:1.0:1787826285.237960:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826285.237962:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce026ae600, rc 0) 00000100:00100000:1.0:1787826285.238067:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab93840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:49795:x1874670563601920:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 874us (1037us total) trans 4294969257 rc 0/0 00000100:00100000:1.0:1787826285.238074:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3183 00000100:00100000:1.0:1787826285.242786:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563602048 00000100:00100000:1.0:1787826285.242798:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563602048 00000100:00100000:1.0:1787826285.243005:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563602176 00000100:00100000:1.0:1787826285.243010:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563602176 00000100:00100000:3.0:1787826285.246162:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1613 00000100:00100000:3.0:1787826285.246181:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa86940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+17:2403:x1874670563602176:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:3.0:1787826285.246219:0:30696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000103f0cf4/0x22153cd396b7ee8a lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.246237:0:30696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e29b3e48/0x22153cd396b7ee13 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff11 expref: 17 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.246247:0:30696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787826285.246251:0:30696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826285.246256:0:30696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000103f0cf4/0x22153cd396b7ee8a lrc: 4/0,1 mode: --/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.246287:0:30696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e29b3e48/0x22153cd396b7ee13 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff11 expref: 17 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.246298:0:30696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e29b3e48/0x22153cd396b7ee13 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff11 expref: 17 pid: 8545 timeout: 1331 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826285.246310:0:30696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf136ccf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:30696:1874670585111424:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826285.246636:0:30696:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce04aa5480 going to sleep for 11 seconds 00000100:00100000:3.0:1787826285.250135:0:30694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab90b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:30694:1874670585111296:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826285.250165:0:30694:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c9fab3a2/0x22153cd396b7ee83 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826285.250197:0:30696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf136ccf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:30696:1874670585111424:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826285.250217:0:30696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000103f0cf4/0x22153cd396b7ee8a lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826285.252391:0:30696:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000103f0cf4/0x22153cd396b7ee8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826285.252405:0:30696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000103f0cf4/0x22153cd396b7ee8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826285.252429:0:30696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000103f0cf4/0x22153cd396b7ee8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826285.252438:0:30696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000103f0cf4/0x22153cd396b7ee8a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826285.252447:0:30696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000103f0cf4/0x22153cd396b7ee8a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826285.252454:0:30696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf10a07400 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:1.0:1787826285.252458:0:30696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000103f0cf4/0x22153cd396b7ee8a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826285.252467:0:30696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000103f0cf4/0x22153cd396b7ee8a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826285.252501:0:30696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000103f0cf4/0x22153cd396b7ee8a lrc: 2/0,0 mode: --/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826285.252510:0:30696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000103f0cf4/0x22153cd396b7ee8a lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826285.253070:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa86940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2403:x1874670563602176:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 6893us (10323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826285.253080:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1613 00000100:00100000:3.0:1787826285.261794:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826285.261829:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826285.262003:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563602816 00000100:00100000:1.0:1787826285.262011:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563602816 00010000:00010000:1.0:1787826285.262051:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a07e00/0x22153cd396b7ee59 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff26 expref: 21 pid: 6520 timeout: 1331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826285.262106:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563602944 00000100:00100000:1.0:1787826285.262110:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563602944 00010000:00010000:1.0:1787826285.262126:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026ae600/0x22153cd396b7ee75 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff2d expref: 22 pid: 16564 timeout: 1331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.262538:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05355800/0x22153cd396b7ee91 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.262547:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05355800/0x22153cd396b7ee91 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826285.262735:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ddce725e reply state 00000000f0cd61d0 transno 4294969258 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05355800/0x22153cd396b7ee91 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.262747:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05355800/0x22153cd396b7ee91 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.262753:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff90cf06894500) 00010000:00010000:3.0:1787826285.262756:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2a 00000100:00100000:3.0:1787826285.262759:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826285.262812:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:49795:x1874670563602688:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 5240us (5466us total) trans 4294969258 rc 0/0 00000100:00100000:3.0:1787826285.262820:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3184 00000100:00100000:3.0:1787826285.266742:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826285.290308:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826285.290505:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563603584 00000100:00100000:3.0:1787826285.290516:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563603584 00000100:00100000:3.0:1787826285.290565:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3186 00000100:00100000:3.0:1787826285.290574:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a19680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:49797:x1874670563603584:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:3.0:1787826285.290598:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826285.290618:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a07c00/0x22153cd396b7eebb lrc: 2/0,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aaff3b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.290650:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a07000/0x22153cd396b7eec2 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.290663:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a07000/0x22153cd396b7eec2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.290675:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a07000/0x22153cd396b7eec2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.291007:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a07c00/0x22153cd396b7eebb lrc: 0/0,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff3b expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.291027:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a07000/0x22153cd396b7eec2 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff3b expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.291035:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff90cf06894500) 00010000:00010000:3.0:1787826285.291038:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787826285.291042:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf10a07000, rc 0) 00000100:00100000:3.0:1787826285.291136:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a19680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+23:49797:x1874670563603584:12345-192.168.203.39@tcp:101:dd.0 Request processed in 563us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826285.291144:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3186 00000100:00100000:1.0:1787826285.298836:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563603840 00000100:00100000:1.0:1787826285.298845:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563603840 00000100:00100000:1.0:1787826285.298905:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3187 00000100:00100000:1.0:1787826285.298915:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+23:49797:x1874670563603840:12345-192.168.203.39@tcp:36:dd.0 00010000:00010000:1.0:1787826285.298977:0:16564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826285.299006:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05354800/0x22153cd396b7eead lrc: 0/0,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff34 expref: 23 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826285.299025:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff90cf06894500) 00010000:00010000:1.0:1787826285.299029:0:16564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826285.299207:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026af000/0x22153cd396b7eec9 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826285.299222:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026af000/0x22153cd396b7eec9 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826285.299232:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026af000/0x22153cd396b7eec9 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787826285.299353:0:16564:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294969261 00000004:00010000:1.0:1787826285.299378:0:16564:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000325a2418 reply state 00000000caa3fa3b transno 4294969262 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026af000/0x22153cd396b7eec9 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826285.299390:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026af000/0x22153cd396b7eec9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826285.299396:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff90cf06894500) 00010000:00010000:1.0:1787826285.299399:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826285.299401:0:16564:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826285.299522:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:49797:x1874670563603840:12345-192.168.203.39@tcp:36:dd.0 Request processed in 608us (775us total) trans 4294969262 rc 0/0 00000100:00100000:1.0:1787826285.299529:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3187 00000020:00080000:1.0:1787826285.299533:0:16564:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787826285.303122:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563603968 00000100:00100000:3.0:1787826285.303132:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563603968 00000100:00100000:3.0:1787826285.303187:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3188 00000100:00100000:3.0:1787826285.303196:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa85e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:49797:x1874670563603968:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:3.0:1787826285.303218:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826285.303238:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a07c00/0x22153cd396b7eed0 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aaff42 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.303302:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a07c00/0x22153cd396b7eed0 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff42 expref: 26 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.303317:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a07c00/0x22153cd396b7eed0 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff42 expref: 26 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.303334:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff90cf06894500) 00010000:00010000:3.0:1787826285.303337:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826285.303340:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf10a07c00, rc 0) 00000100:00100000:3.0:1787826285.303401:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa85e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:49797:x1874670563603968:12345-192.168.203.39@tcp:101:dd.0 Request processed in 207us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826285.303409:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3188 00000100:00100000:1.0:1787826285.311238:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab92940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585111936:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787826285.311313:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826285.311384:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787826285.311391:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03a183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585112064:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787826285.311415:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826285.311452:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab90b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585111808:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1787826285.311791:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05355400/0x22153cd396b7eede lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff49 expref: 18 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.311801:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff90cf06894500) 00010000:00010000:3.0:1787826285.311804:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1787826285.311816:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05355000/0x22153cd396b7eed7 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff49 expref: 18 pid: 8247 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.311830:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05355400/0x22153cd396b7eede lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff49 expref: 17 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.311861:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff90cf06894500) 00010000:00010000:3.0:1787826285.311863:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1787826285.311865:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05355400, rc 0) 00000100:00100000:3.0:1787826285.311915:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136d7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+17:49797:x1874670563604224:12345-192.168.203.39@tcp:101:dd.0 Request processed in 4332us (4556us total) trans 4294969263 rc 0/0 00000100:00100000:3.0:1787826285.311923:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3189 00000100:00100000:1.0:1787826285.312560:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03a18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585112192:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787826285.312608:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1614 00000100:00100000:1.0:1787826285.312617:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3644:x1874670585111936:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1787826285.312735:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xde:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:1.0:1787826285.312739:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xde:0x0] updating lvb mtime from disk: 1787826285 -> 1787826285 00002000:00010000:1.0:1787826285.312741:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xde:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787826285.312743:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xde:0x0] updating lvb ctime from disk: 1787826285 -> 1787826285 00002000:00010000:1.0:1787826285.312746:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xde:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:1.0:1787826285.312769:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3644:x1874670585111936:12345-0@lo:2:osp-syn-1-0.0 Request processed in 153us (1456us total) trans 17179869551 rc 0/0 00000100:00100000:1.0:1787826285.312776:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1614 00000004:00080000:1.0:1787826285.312812:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce03a183c0/2, rc 0, transno 21474836871 00000100:00100000:1.0:1787826285.312817:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03a183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585112064:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1787826285.312828:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3ab92940/2, rc 0, transno 17179869551 00000100:00100000:1.0:1787826285.312833:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab92940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585111936:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787826285.313061:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826285.313581:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1617 00000100:00100000:1.0:1787826285.313590:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3646:x1874670585112192:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787826285.313693:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+15:3646:x1874670585112192:12345-0@lo:2:osp-syn-0-0.0 Request processed in 104us (631us total) trans 21474836872 rc 0/0 00000100:00100000:1.0:1787826285.313700:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1617 00000004:00080000:1.0:1787826285.313729:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce03a18000/2, rc 0, transno 21474836872 00000100:00100000:1.0:1787826285.313733:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03a18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585112192:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1787826285.314040:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3ab90b40/2, rc 0, transno 17179869552 00000100:00100000:1.0:1787826285.314045:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab90b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585111808:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787826285.316238:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787826285.316248:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf136cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585112448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787826285.316277:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826285.316305:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585112448 00000100:00100000:3.0:1787826285.316309:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585112448 00000100:00100000:3.0:1787826285.316335:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 687 00000100:00100000:3.0:1787826285.316342:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136cc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+15:3645:x1874670585112448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787826285.316358:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 3194880 free 3920334848 avail 3688812544 00000100:00100000:1.0:1787826285.316669:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf136d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585112704:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787826285.316747:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136cc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+15:3645:x1874670585112448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 405us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826285.316754:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 687 00000100:00100000:3.0:1787826285.316792:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf136cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585112448:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826285.316888:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826285.316942:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826285.316961:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563604352 00000100:00100000:1.0:1787826285.316964:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563604352 00000100:00100000:3.0:1787826285.317136:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826285.317158:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1618 00000100:00100000:1.0:1787826285.317165:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:49797:x1874670563604352:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:1.0:1787826285.317175:0:30696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826285.317194:0:30696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009370d440/0x22153cd396b7eee5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aaff50 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826285.317217:0:30696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd1:0x0] initial LVB size: 2097152, mtime: 0x6a90106d, atime: 0x6a90106d, ctime: 0x6a90106d, blocks: 0x1000 00010000:00010000:1.0:1787826285.317235:0:30696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd1:0x0].0x0 since=1231s v=(0 0) 00010000:00010000:1.0:1787826285.317240:0:30696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826285.317249:0:30696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009370d440/0x22153cd396b7eee5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000080000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff50 expref: 15 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826285.317266:0:30696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009370d440/0x22153cd396b7eee5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000080000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff50 expref: 15 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826285.317279:0:30696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce026ae600, rc 0) 00000100:00100000:1.0:1787826285.317425:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:49797:x1874670563604352:12345-192.168.203.39@tcp:101:dd.0 Request processed in 259us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826285.317435:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1618 00000100:00080000:3.0:1787826285.317500:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826285.317599:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf136d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585112704:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787826285.318340:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0300d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585112576:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826285.320685:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563604480 00000100:00100000:1.0:1787826285.320693:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563604480 00000100:00100000:1.0:1787826285.320750:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1619 00000100:00100000:1.0:1787826285.320760:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136d5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:49797:x1874670563604480:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:1.0:1787826285.320777:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826285.320799:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0ef7729/0x22153cd396b7eeec lrc: 2/0,0 mode: --/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aaff57 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826285.320825:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd2:0x0] initial LVB size: 3145728, mtime: 0x6a90106d, atime: 0x6a90106d, ctime: 0x6a90106d, blocks: 0x800 00010000:00010000:1.0:1787826285.320845:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd2:0x0].0x0 since=1231s v=(0 0) 00010000:00010000:1.0:1787826285.320850:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826285.320860:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0ef7729/0x22153cd396b7eeec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff57 expref: 16 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826285.320876:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f0ef7729/0x22153cd396b7eeec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff57 expref: 16 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826285.320893:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce026aec00, rc 0) 00000100:00100000:1.0:1787826285.320946:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136d5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:49797:x1874670563604480:12345-192.168.203.39@tcp:101:dd.0 Request processed in 188us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826285.320952:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1619 00000100:00100000:1.0:1787826285.324199:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826285.482173:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826285.482257:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563605120 00000100:00100000:3.0:1787826285.482279:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563605120 00000100:00100000:3.0:1787826285.482338:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3190 00000100:00100000:3.0:1787826285.482347:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:49798:x1874670563605120:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826285.482370:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826285.482389:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06400/0x22153cd396b7eef3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aaff5e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.482496:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a07a00/0x22153cd396b7eefa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.482510:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a07a00/0x22153cd396b7eefa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.482521:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a07a00/0x22153cd396b7eefa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826285.482566:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787826285.482569:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826285.482587:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a07a00/0x22153cd396b7eefa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.482608:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06400/0x22153cd396b7eef3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff5e expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.482623:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a07a00/0x22153cd396b7eefa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff5e expref: 20 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.482631:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cf39656000) 00010000:00010000:3.0:1787826285.482634:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787826285.482636:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf10a07a00, rc 0) 00000100:00100000:3.0:1787826285.482694:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:49798:x1874670563605120:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 349us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826285.482701:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3190 00000100:00100000:1.0:1787826285.484974:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826285.485038:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563605248 00000100:00100000:3.0:1787826285.485048:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563605248 00000100:00100000:3.0:1787826285.485167:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3191 00000100:00100000:3.0:1787826285.485177:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:49798:x1874670563605248:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826285.485195:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826285.485215:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06a00/0x22153cd396b7ef01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aaff65 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.485315:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06600/0x22153cd396b7ef08 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.485328:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06600/0x22153cd396b7ef08 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.485338:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06600/0x22153cd396b7ef08 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.485351:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06000/0x22153cd396b7ef0f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.485357:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06000/0x22153cd396b7ef0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.485363:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06000/0x22153cd396b7ef0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.485437:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a07200/0x22153cd396b7ef16 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.485446:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a07200/0x22153cd396b7ef16 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.485457:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a07200/0x22153cd396b7ef16 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826285.485536:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x9:0x0]: returning size 3145728 00000004:00200000:3.0:1787826285.485541:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826285.485559:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a07200/0x22153cd396b7ef16 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.485569:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a07200/0x22153cd396b7ef16 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.485577:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06600/0x22153cd396b7ef08 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.485583:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06600/0x22153cd396b7ef08 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.485589:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06600/0x22153cd396b7ef08 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.485594:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf10a06600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826285.485598:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06600/0x22153cd396b7ef08 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.485604:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06600/0x22153cd396b7ef08 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.486015:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cf39656000) 00010000:00010000:3.0:1787826285.486019:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826285.486024:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06600/0x22153cd396b7ef08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.486033:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06600/0x22153cd396b7ef08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.486047:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06000/0x22153cd396b7ef0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.486054:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06000/0x22153cd396b7ef0f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.486060:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06000/0x22153cd396b7ef0f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.486065:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf10a06000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826285.486068:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06000/0x22153cd396b7ef0f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.486073:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06000/0x22153cd396b7ef0f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.486080:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x995b1268 (ffff90cf13641700) 00010000:00010000:3.0:1787826285.486083:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826285.486095:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06000/0x22153cd396b7ef0f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.486101:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06000/0x22153cd396b7ef0f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.486134:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06a00/0x22153cd396b7ef01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff65 expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.486147:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a07200/0x22153cd396b7ef16 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff65 expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.486154:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff90cf06894500) 00010000:00010000:3.0:1787826285.486156:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826285.486159:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf10a07200, rc 0) 00000100:00100000:3.0:1787826285.493077:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563605504 00000100:00100000:3.0:1787826285.493098:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563605504 00000100:00100000:3.0:1787826285.493193:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3192 00000100:00100000:3.0:1787826285.493204:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f826580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:49798:x1874670563605504:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826285.493224:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826285.493244:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06400/0x22153cd396b7ef1d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aaff6c expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.493388:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a07600/0x22153cd396b7ef24 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.493402:0:32404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a07200/0x22153cd396b7ef16 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff65 expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.493411:0:32404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a07600/0x22153cd396b7ef24 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.493444:0:32404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a07200/0x22153cd396b7ef16 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff65 expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.493458:0:32404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a07200/0x22153cd396b7ef16 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff65 expref: 22 pid: 6518 timeout: 1331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826285.493499:0:32404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf136cf480 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:32404:1874670585112832:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826285.493582:0:32404:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce04aa5e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787826285.499158:0:32404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf136cf480 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:32404:1874670585112832:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826285.499187:0:32404:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a07600/0x22153cd396b7ef24 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826285.500465:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563605632 00000100:00100000:3.0:1787826285.500557:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563605632 00010000:00010000:3.0:1787826285.500602:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a07200/0x22153cd396b7ef16 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff65 expref: 23 pid: 6518 timeout: 1331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826285.500685:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 874 00000100:00100000:3.0:1787826285.500695:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8261c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+23:2404:x1874670563605632:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826285.500711:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826285.500718:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a07200/0x22153cd396b7ef16 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff65 expref: 23 pid: 6518 timeout: 1331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.500731:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a07200/0x22153cd396b7ef16 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff65 expref: 23 pid: 6518 timeout: 1331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.500754:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a07200/0x22153cd396b7ef16 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff65 expref: 23 pid: 6518 timeout: 1331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.500780:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff90cf06894500) 00010000:00010000:3.0:1787826285.500784:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a07600/0x22153cd396b7ef24 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.500794:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a07600/0x22153cd396b7ef24 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.500806:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a07600/0x22153cd396b7ef24 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.500829:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826285.500892:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8261c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:2404:x1874670563605632:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 198us (1452us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826285.500901:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 874 00000100:00100000:3.0:1787826285.504892:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563605760 00000100:00100000:3.0:1787826285.504903:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563605760 00000100:00100000:3.0:1787826285.505008:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3193 00000100:00100000:3.0:1787826285.505018:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f824780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:49798:x1874670563605760:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826285.505040:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826285.505060:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06a00/0x22153cd396b7ef32 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aaff73 expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.505194:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06000/0x22153cd396b7ef39 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.505221:0:8247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a07600/0x22153cd396b7ef24 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff6c expref: 23 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.505230:0:8247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06000/0x22153cd396b7ef39 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.505264:0:8247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a07600/0x22153cd396b7ef24 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff6c expref: 23 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.505286:0:8247:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a07600/0x22153cd396b7ef24 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff6c expref: 23 pid: 32404 timeout: 1331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826285.505300:0:8247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf136cf480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8247:1874670585112960:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826285.505588:0:8247:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce04aa5e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787826285.509109:0:8247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf136cf480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8247:1874670585112960:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826285.509137:0:8247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06000/0x22153cd396b7ef39 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826285.509210:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563605888 00000100:00100000:1.0:1787826285.509217:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563605888 00010000:00010000:1.0:1787826285.509253:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a07600/0x22153cd396b7ef24 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff6c expref: 24 pid: 32404 timeout: 1331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826285.509401:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 875 00000100:00100000:1.0:1787826285.509411:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03bdcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:2403:x1874670563605888:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826285.509426:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826285.509433:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a07600/0x22153cd396b7ef24 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff6c expref: 24 pid: 32404 timeout: 1331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826285.509445:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a07600/0x22153cd396b7ef24 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff6c expref: 24 pid: 32404 timeout: 1331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826285.509467:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a07600/0x22153cd396b7ef24 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff6c expref: 24 pid: 32404 timeout: 1331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826285.509533:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff90cf06894500) 00010000:00010000:1.0:1787826285.509538:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06000/0x22153cd396b7ef39 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826285.509548:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06000/0x22153cd396b7ef39 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826285.509555:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06000/0x22153cd396b7ef39 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826285.509583:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826285.509628:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03bdcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+23:2403:x1874670563605888:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 219us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826285.509636:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 875 00010000:00010000:3.0:1787826285.509689:0:8247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06000/0x22153cd396b7ef39 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.509696:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06000/0x22153cd396b7ef39 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826285.509745:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x9:0x0]: returning size 3145728 00000004:00200000:3.0:1787826285.509750:0:8247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826285.509770:0:8247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06000/0x22153cd396b7ef39 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.509801:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06a00/0x22153cd396b7ef32 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff73 expref: 23 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.512413:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06000/0x22153cd396b7ef39 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff73 expref: 22 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.512436:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff90cf06894500) 00010000:00010000:3.0:1787826285.512439:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826285.512443:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf10a06000, rc 0) 00000100:00100000:3.0:1787826285.512537:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f824780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:49798:x1874670563605760:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 7517us (7712us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826285.512547:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3193 00000100:00100000:3.0:1787826285.519968:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563606016 00000100:00100000:3.0:1787826285.519977:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563606016 00000100:00100000:3.0:1787826285.520042:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3194 00000100:00100000:3.0:1787826285.520053:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03bdf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:49798:x1874670563606016:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826285.520071:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826285.520098:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a07200/0x22153cd396b7ef40 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aaff7a expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.520182:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06600/0x22153cd396b7ef47 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.520196:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06600/0x22153cd396b7ef47 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.520205:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06600/0x22153cd396b7ef47 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.520219:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06200/0x22153cd396b7ef4e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.520226:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06200/0x22153cd396b7ef4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.520233:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06200/0x22153cd396b7ef4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.520316:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06800/0x22153cd396b7ef55 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.520330:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06800/0x22153cd396b7ef55 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.520337:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06800/0x22153cd396b7ef55 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826285.520374:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x9:0x0]: returning size 3145728 00000004:00200000:3.0:1787826285.520378:0:16564:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826285.520395:0:16564:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06800/0x22153cd396b7ef55 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.520405:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06800/0x22153cd396b7ef55 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.520413:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06600/0x22153cd396b7ef47 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.520420:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06600/0x22153cd396b7ef47 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.520427:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06600/0x22153cd396b7ef47 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.520432:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf10a06600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826285.520436:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06600/0x22153cd396b7ef47 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.520442:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06600/0x22153cd396b7ef47 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.520453:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cf39656000) 00010000:00010000:3.0:1787826285.520456:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826285.520461:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06600/0x22153cd396b7ef47 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.520467:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06600/0x22153cd396b7ef47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.520519:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06200/0x22153cd396b7ef4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.520525:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06200/0x22153cd396b7ef4e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.520531:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06200/0x22153cd396b7ef4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.520535:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf10a06200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826285.520538:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06200/0x22153cd396b7ef4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.520543:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06200/0x22153cd396b7ef4e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.520550:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x995b1268 (ffff90cf13641700) 00010000:00010000:3.0:1787826285.520552:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826285.520555:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06200/0x22153cd396b7ef4e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.520561:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06200/0x22153cd396b7ef4e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.520590:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a07200/0x22153cd396b7ef40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff7a expref: 24 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.520608:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06800/0x22153cd396b7ef55 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff7a expref: 23 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.520616:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff90cf06894500) 00010000:00010000:3.0:1787826285.520618:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826285.520621:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf10a06800, rc 0) 00000100:00100000:3.0:1787826285.520673:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03bdf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+23:49798:x1874670563606016:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 623us (833us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826285.520681:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3194 00000100:00100000:1.0:1787826285.534701:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826285.534868:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563606656 00000100:00100000:3.0:1787826285.534878:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563606656 00000100:00100000:3.0:1787826285.534966:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3196 00000100:00100000:3.0:1787826285.534977:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:49798:x1874670563606656:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826285.534998:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826285.535020:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06a00/0x22153cd396b7ef71 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aaff88 expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.535159:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a07600/0x22153cd396b7ef78 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.535174:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a07600/0x22153cd396b7ef78 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x9:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.535186:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a07600/0x22153cd396b7ef78 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x9:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826285.535199:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x9:0x0]: returning size 3145728 00010000:00010000:3.0:1787826285.535313:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06a00/0x22153cd396b7ef71 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff88 expref: 27 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.535333:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a07600/0x22153cd396b7ef78 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x9:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff88 expref: 26 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.535341:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff90cf06894500) 00010000:00010000:3.0:1787826285.535344:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787826285.535348:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf10a07600, rc 0) 00000100:00100000:3.0:1787826285.535405:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:49798:x1874670563606656:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 431us (713us total) trans 4294969268 rc 0/0 00000100:00100000:3.0:1787826285.535412:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3196 00000100:00100000:3.0:1787826285.544200:0:30174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563606784 00000100:00100000:3.0:1787826285.544210:0:30174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563606784 00002000:00100000:3.0:1787826285.544363:0:30174:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x280000401:0xd1:0x0] (0->2097151) req@ffff90cf3aa85a40 x1874670563606784/t0(0) o4->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:641/0 lens 488/0 e 0 to 0 dl 1787826296 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826285.544376:0:30174:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf3aa85a40 with x1874670563606784 ext(0->2097151) 00002000:00010000:3.0:1787826285.544382:0:30174:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf3aa85a40 00000100:00100000:1.0:1787826285.544667:0:30188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 619 00000100:00100000:1.0:1787826285.544682:0:30188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa85a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+18:2403:x1874670563606784:12345-192.168.203.39@tcp:4:lfs.0 00000100:00100000:1.0:1787826285.571931:0:30188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa85a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:2403:x1874670563606784:12345-192.168.203.39@tcp:4:lfs.0 Request processed in 27244us (27812us total) trans 21474836875 rc 0/0 00000100:00100000:1.0:1787826285.571944:0:30188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 619 00002000:00100000:1.0:1787826285.571957:0:30188:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_017: refresh rw locks for [0x280000401:0xd1:0x0] (0->2097151) req@ffff90cf3aa85a40 x1874670563606784/t21474836875(0) o4->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:641/0 lens 488/448 e 0 to 0 dl 1787826296 ref 1 fl Complete:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826285.571967:0:30188:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf3aa85a40 with x1874670563606784 ext(0->2097151) 00002000:00010000:1.0:1787826285.571973:0:30188:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf3aa85a40 00000100:00100000:1.0:1787826285.583142:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563606912 00000100:00100000:1.0:1787826285.583152:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563606912 00000100:00100000:1.0:1787826285.583224:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 620 00000100:00100000:1.0:1787826285.583233:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2401:x1874670563606912:12345-192.168.203.39@tcp:3:lfs.0 00010000:00010000:1.0:1787826285.583267:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000751cf8a3/0x22153cd396b7ef86 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xdd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826285.583285:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003b410ed4/0x22153cd396b7ee3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff18 expref: 10 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826285.583298:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0xdd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826285.583302:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826285.583306:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000751cf8a3/0x22153cd396b7ef86 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0xdd:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826285.583338:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003b410ed4/0x22153cd396b7ee3d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xdd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff18 expref: 10 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826285.583353:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003b410ed4/0x22153cd396b7ee3d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xdd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff18 expref: 10 pid: 30398 timeout: 1331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826285.583366:0:8441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0300f840 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:8441:1874670585113088:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826285.583451:0:8441:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068bd900 going to sleep for 11 seconds 00000100:00100000:3.0:1787826285.586637:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826285.586718:0:8441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0300f840 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:8441:1874670585113088:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826285.586746:0:8441:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000751cf8a3/0x22153cd396b7ef86 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xdd:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826285.592742:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826285.592968:0:30172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563607168 00000100:00100000:1.0:1787826285.592978:0:30172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563607168 00002000:00100000:1.0:1787826285.593025:0:30172:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0xd2:0x0] (2097152->3145727) req@ffff90cf136cf480 x1874670563607168/t0(0) o4->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:641/0 lens 488/0 e 0 to 0 dl 1787826296 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826285.593036:0:30172:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf136cf480 with x1874670563607168 ext(2097152->3145727) 00002000:00010000:1.0:1787826285.593042:0:30172:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf136cf480 00000100:00100000:1.0:1787826285.593079:0:30172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 621 00000100:00100000:1.0:1787826285.593098:0:30172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:2401:x1874670563607168:12345-192.168.203.39@tcp:4:lfs.0 00010000:00010000:3.0:1787826285.602315:0:8441:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000751cf8a3/0x22153cd396b7ef86 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xdd:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826285.602335:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000751cf8a3/0x22153cd396b7ef86 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xdd:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826285.629438:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563607424 00000100:00100000:1.0:1787826285.629446:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563607424 00010000:00010000:1.0:1787826285.629519:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003b62b7d0/0x22153cd396b7ee44 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xde:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff1f expref: 10 pid: 8436 timeout: 1331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826285.629567:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 877 00000100:00100000:1.0:1787826285.629579:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f825a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670563607424:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826285.629596:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826285.629619:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003b62b7d0/0x22153cd396b7ee44 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xde:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff1f expref: 10 pid: 8436 timeout: 1331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826285.629634:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003b62b7d0/0x22153cd396b7ee44 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xde:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff1f expref: 10 pid: 8436 timeout: 1331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826285.629658:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b62b7d0/0x22153cd396b7ee44 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xde:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff1f expref: 10 pid: 8436 timeout: 1331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826285.629675:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xde:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826285.629679:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xde:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826285.629685:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003d1518bb/0x22153cd396b7ef8d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xde:0x0].0x0 rrc: 3 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826285.629696:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d1518bb/0x22153cd396b7ef8d lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0xde:0x0].0x0 rrc: 3 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826285.629734:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826285.629780:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f825a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670563607424:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 202us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826285.629790:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 877 00000100:00100000:3.0:1787826285.699966:0:14865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563607680 00000100:00100000:3.0:1787826285.699980:0:14865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563607680 00000100:00100000:1.0:1787826285.724906:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826285.724949:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826285.726635:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563607936 00000100:00100000:3.0:1787826285.726650:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563607936 00000100:00100000:3.0:1787826285.726752:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1422 00000100:00100000:3.0:1787826285.726767:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:2404:x1874670563607936:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1787826285.726848:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:2404:x1874670563607936:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 83us (1951us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826285.726858:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1422 00000100:00100000:1.0:1787826285.769674:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826285.776742:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563608320 00000100:00100000:3.0:1787826285.776812:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563608320 00000100:00100000:3.0:1787826285.777152:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 949 00000100:00100000:3.0:1787826285.777163:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f827840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:49798:x1874670563608320:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:3.0:1787826285.777455:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f827840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:49798:x1874670563608320:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 293us (849us total) trans 4294969269 rc 0/0 00000100:00100000:3.0:1787826285.777463:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 949 00000100:00100000:1.0:1787826285.780893:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826285.819313:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826285.871300:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00010000:00010000:3.0:1787826285.892498:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826286.111814:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826286.111945:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826286.132988:0:30176:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aa84000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0000_UUID:30176:1874670585113472:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826286.133012:0:30176:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003d1518bb/0x22153cd396b7efd3 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.180958:0:30176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003d1518bb/0x22153cd396b7efd3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.180977:0:30176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d1518bb/0x22153cd396b7efd3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.180991:0:30176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d1518bb/0x22153cd396b7efd3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.180997:0:30176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05354000 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826286.181002:0:30176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d1518bb/0x22153cd396b7efd3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.181011:0:30176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d1518bb/0x22153cd396b7efd3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.181029:0:30176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d1518bb/0x22153cd396b7efd3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.181037:0:30176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d1518bb/0x22153cd396b7efd3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826286.181603:0:30176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03affc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:2404:x1874670563609088:12345-192.168.203.39@tcp:3:lfs.0 Request processed in 61661us (69651us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1787826286.181613:0:30176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 626 00010000:00010000:1.0:1787826286.197045:0:20692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007f79a91b/0x22153cd396b7efcc lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826286.197066:0:20692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f79a91b/0x22153cd396b7efcc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826286.197076:0:20692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f79a91b/0x22153cd396b7efcc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826286.197097:0:20692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05355e00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:1.0:1787826286.197102:0:20692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f79a91b/0x22153cd396b7efcc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826286.197112:0:20692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f79a91b/0x22153cd396b7efcc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826286.197139:0:20692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f79a91b/0x22153cd396b7efcc lrc: 2/0,0 mode: --/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826286.197148:0:20692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f79a91b/0x22153cd396b7efcc lrc: 0/0,0 mode: --/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826286.197273:0:20692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03afd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:2403:x1874670563608960:12345-192.168.203.39@tcp:3:lfs.0 Request processed in 78078us (85458us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1787826286.197284:0:20692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 625 00000100:00100000:3.0:1787826286.206566:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826286.206610:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826286.206766:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563609472 00000100:00100000:1.0:1787826286.206775:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563609472 00000100:00100000:1.0:1787826286.206823:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563609600 00000100:00100000:1.0:1787826286.206827:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563609600 00000100:00100000:1.0:1787826286.206854:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1620 00000100:00100000:1.0:1787826286.206865:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136ce940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:2401:x1874670563609472:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826286.206883:0:14864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826286.206905:0:14864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b7efda lrc: 2/0,0 mode: --/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aaff8f expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826286.206929:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd1:0x0] initial LVB size: 2097152, mtime: 0x6a90106e, atime: 0x6a90106d, ctime: 0x6a90106e, blocks: 0x1000 00010000:00010000:1.0:1787826286.206949:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd1:0x0].0x0 since=1232s v=(0 0) 00010000:00010000:1.0:1787826286.206954:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826286.206965:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b7efda lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff8f expref: 22 pid: 14864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826286.206982:0:14864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b7efda lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff8f expref: 22 pid: 14864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826286.206997:0:14864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400c00, rc 0) 00000100:00100000:1.0:1787826286.207064:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136ce940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:2401:x1874670563609472:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 200us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826286.207071:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1620 00000100:00100000:1.0:1787826286.207101:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1621 00000100:00100000:1.0:1787826286.207108:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:2401:x1874670563609600:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826286.207114:0:14864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826286.207124:0:14864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e843828/0x22153cd396b7efe1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aaff96 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826286.207136:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd2:0x0] initial LVB size: 3145728, mtime: 0x6a90106e, atime: 0x6a90106d, ctime: 0x6a90106e, blocks: 0x800 00010000:00010000:1.0:1787826286.207145:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd2:0x0].0x0 since=1232s v=(0 0) 00010000:00010000:1.0:1787826286.207148:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826286.207153:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e843828/0x22153cd396b7efe1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff96 expref: 22 pid: 14864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826286.207164:0:14864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009e843828/0x22153cd396b7efe1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff96 expref: 22 pid: 14864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826286.207172:0:14864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401a00, rc 0) 00000100:00100000:1.0:1787826286.207192:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:2401:x1874670563609600:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 85us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826286.207199:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1621 00000100:00100000:3.0:1787826286.408643:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563609856 00000100:00100000:3.0:1787826286.408669:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563609856 00000100:00100000:3.0:1787826286.408729:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563609984 00000100:00100000:3.0:1787826286.408735:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563609984 00000100:00100000:3.0:1787826286.408770:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1622 00000100:00100000:3.0:1787826286.408793:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03bdcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670563609856:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826286.408817:0:30695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826286.408840:0:30695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000008e1fd0/0x22153cd396b7efef lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xdd:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aaff9d expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.408873:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826286.408878:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826286.408890:0:30695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000008e1fd0/0x22153cd396b7efef lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xdd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff9d expref: 11 pid: 30695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.408910:0:30695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000008e1fd0/0x22153cd396b7efef lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xdd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff9d expref: 11 pid: 30695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.408925:0:30695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf10a06a00, rc 0) 00000100:00100000:3.0:1787826286.408998:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03bdcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563609856:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 210us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826286.409006:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1622 00000100:00100000:3.0:1787826286.409026:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1623 00000100:00100000:3.0:1787826286.409033:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f41e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2404:x1874670563609984:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826286.409041:0:30695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826286.409052:0:30695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0c18b21/0x22153cd396b7eff6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xde:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aaffa4 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826286.409075:0:30695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xde:0x0] initial LVB size: 3145728, mtime: 0x6a90106d, atime: 0x0, ctime: 0x6a90106d, blocks: 0x1000 00010000:00010000:3.0:1787826286.409098:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xde:0x0].0x0 since=1232s v=(0 0) 00010000:00010000:3.0:1787826286.409102:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xde:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826286.409109:0:30695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0c18b21/0x22153cd396b7eff6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaffa4 expref: 12 pid: 30695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.409121:0:30695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b0c18b21/0x22153cd396b7eff6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaffa4 expref: 12 pid: 30695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.409131:0:30695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf10a07200, rc 0) 00000100:00100000:3.0:1787826286.409150:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f41e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563609984:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 118us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826286.409157:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1623 00010000:00010000:3.0:1787826286.424072:0:25425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003c57be12/0x22153cd396b7efe8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xdd:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.424096:0:25425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c57be12/0x22153cd396b7efe8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xdd:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.424105:0:25425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c57be12/0x22153cd396b7efe8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xdd:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.424112:0:25425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0865ae00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826286.424120:0:25425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c57be12/0x22153cd396b7efe8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xdd:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.424129:0:25425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c57be12/0x22153cd396b7efe8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xdd:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.424156:0:25425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c57be12/0x22153cd396b7efe8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xdd:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.424164:0:25425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c57be12/0x22153cd396b7efe8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xdd:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826286.424243:0:25425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2404:x1874670563609728:12345-192.168.203.39@tcp:3:lfs.0 Request processed in 15553us (15789us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1787826286.424251:0:25425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 627 00000100:00100000:3.0:1787826286.619147:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826286.654455:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563610496 00000100:00100000:1.0:1787826286.654488:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563610496 00000100:00100000:1.0:1787826286.654665:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3200 00000100:00100000:1.0:1787826286.654678:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce037383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:49825:x1874670563610496:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826286.654706:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826286.654732:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b7f019 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aaffab expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826286.656552:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b7f020 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826286.656583:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b7f020 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x9:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826286.656599:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b7f020 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x9:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826286.656620:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x9:0x0]: returning size 3145728 00010000:00010000:1.0:1787826286.656812:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b7f019 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaffab expref: 30 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826286.656840:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b7f020 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x9:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaffab expref: 29 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826286.656852:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff90cf06894500) 00010000:00010000:1.0:1787826286.656856:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787826286.656982:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400200, rc 0) 00000100:00100000:1.0:1787826286.657095:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce037383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+29:49825:x1874670563610496:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 2418us (6453us total) trans 4294969271 rc 0/0 00000100:00100000:1.0:1787826286.657110:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3200 00000100:00100000:3.0:1787826286.663438:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826286.672529:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826286.679332:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826286.679440:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563611136 00000100:00100000:3.0:1787826286.679454:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563611136 00000100:00100000:3.0:1787826286.679554:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3201 00000100:00100000:3.0:1787826286.679567:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03afcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+29:49825:x1874670563611136:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826286.680517:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826286.680552:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6a00/0x22153cd396b7f02e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aaffb2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.681064:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7400/0x22153cd396b7f035 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.681099:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06000/0x22153cd396b7ef39 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff73 expref: 30 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.681115:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7400/0x22153cd396b7f035 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.681164:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06000/0x22153cd396b7ef39 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff73 expref: 30 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.681181:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06000/0x22153cd396b7ef39 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff73 expref: 30 pid: 8247 timeout: 1332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826286.681198:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a8f9e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1874670585113600:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826286.681318:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce04aa5a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787826286.689014:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826286.689130:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563611264 00000100:00100000:3.0:1787826286.689142:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563611264 00010000:00010000:3.0:1787826286.689197:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06000/0x22153cd396b7ef39 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff73 expref: 31 pid: 8247 timeout: 1332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826286.689321:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 880 00000100:00100000:3.0:1787826286.689333:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03afe580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:2404:x1874670563611264:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826286.689364:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826286.689373:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06000/0x22153cd396b7ef39 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff73 expref: 31 pid: 8247 timeout: 1332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.689388:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06000/0x22153cd396b7ef39 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff73 expref: 31 pid: 8247 timeout: 1332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.689416:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf10a06000/0x22153cd396b7ef39 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff73 expref: 31 pid: 8247 timeout: 1332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.689437:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff90cf06894500) 00010000:00010000:3.0:1787826286.689444:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7400/0x22153cd396b7f035 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.689457:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7400/0x22153cd396b7f035 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.689467:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7400/0x22153cd396b7f035 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.689569:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826286.689641:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03afe580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:2404:x1874670563611264:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 310us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826286.689650:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 880 00010000:00010000:1.0:1787826286.692642:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7400/0x22153cd396b7f035 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826286.692671:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7400/0x22153cd396b7f035 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826286.692709:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x9:0x0]: returning size 3145728 00010000:00010000:1.0:1787826286.692899:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6a00/0x22153cd396b7f02e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaffb2 expref: 31 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826286.692921:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7400/0x22153cd396b7f035 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaffb2 expref: 30 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826286.692931:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff90cf06894500) 00010000:00010000:1.0:1787826286.692934:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787826286.692937:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3abd7400, rc 0) 00000100:00100000:1.0:1787826286.693028:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03afcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:49825:x1874670563611136:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 13463us (13713us total) trans 4294969273 rc 0/0 00000100:00100000:1.0:1787826286.693038:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3201 00000100:00100000:1.0:1787826286.700839:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00010000:00010000:3.0:1787826286.712110:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7400/0x22153cd396b7f035 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaffb2 expref: 31 pid: 6519 timeout: 1332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826286.712141:0:9966:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f826940 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9966:1874670585113728:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826286.712168:0:9966:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0865b600/0x22153cd396b7f04a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.712188:0:9966:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0865b600/0x22153cd396b7f04a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.712195:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0865b600/0x22153cd396b7f04a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826286.712269:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x9:0x0]: returning size 3145728 00000004:00200000:3.0:1787826286.712274:0:9966:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826286.712299:0:9966:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0865b600/0x22153cd396b7f04a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.712338:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0865be00/0x22153cd396b7f043 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaffb9 expref: 31 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.712355:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0865b600/0x22153cd396b7f04a lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaffb9 expref: 30 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.712364:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff90cf06894500) 00010000:00010000:3.0:1787826286.712367:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826286.712370:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0865b600, rc 0) 00000100:00100000:3.0:1787826286.712437:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03aff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:49825:x1874670563611392:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 11170us (11607us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826286.712447:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3202 00000100:00100000:3.0:1787826286.714895:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563611776 00000100:00100000:3.0:1787826286.714910:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563611776 00000100:00100000:3.0:1787826286.714991:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 952 00000100:00100000:3.0:1787826286.715003:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf10475850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:49825:x1874670563611776:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:3.0:1787826286.715385:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf10475850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:49825:x1874670563611776:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 382us (568us total) trans 4294969274 rc 0/0 00000100:00100000:3.0:1787826286.715394:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 952 00000100:00100000:1.0:1787826286.724645:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826286.737790:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826286.737895:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826286.738144:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563612288 00000100:00100000:3.0:1787826286.738148:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563612288 00000100:00100000:3.0:1787826286.738190:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1624 00000100:00100000:3.0:1787826286.738201:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03afe580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+23:2403:x1874670563612160:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:3.0:1787826286.738367:0:8545:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006552234c/0x22153cd396b7f066 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.738394:0:8545:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b7efda lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff8f expref: 23 pid: 14864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.738404:0:8545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826286.738409:0:8545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826286.738415:0:8545:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006552234c/0x22153cd396b7f066 lrc: 4/0,1 mode: --/PW res: [0x280000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.738489:0:8545:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b7efda lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff8f expref: 23 pid: 14864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.738508:0:8545:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b7efda lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff8f expref: 23 pid: 14864 timeout: 1332 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826286.738525:0:8545:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a8f8780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8545:1874670585113856:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826286.738626:0:8545:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce04aa5480 going to sleep for 11 seconds 00000100:00100000:1.0:1787826286.738755:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1625 00000100:00100000:1.0:1787826286.738767:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f808b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+23:2403:x1874670563612288:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:1.0:1787826286.738791:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b7f06d lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826286.738804:0:14864:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009e843828/0x22153cd396b7efe1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff96 expref: 23 pid: 14864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826286.738812:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826286.738815:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826286.738819:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b7f06d lrc: 4/0,1 mode: --/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826286.738842:0:14864:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009e843828/0x22153cd396b7efe1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff96 expref: 23 pid: 14864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826286.738852:0:14864:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009e843828/0x22153cd396b7efe1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff96 expref: 23 pid: 14864 timeout: 1332 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826286.738864:0:14864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f80b0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14864:1874670585113984:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826286.738896:0:14864:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068bd240 going to sleep for 11 seconds 00000100:00100000:3.0:1787826286.745955:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826286.745997:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826286.746151:0:14864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f80b0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14864:1874670585113984:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826286.746189:0:14864:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b7f06d lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826286.748052:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 883 00000100:00100000:3.0:1787826286.748063:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8fbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:2403:x1874670563612544:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826286.748072:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826286.748094:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009e843828/0x22153cd396b7efe1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff96 expref: 25 pid: 14864 timeout: 1332 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.748107:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009e843828/0x22153cd396b7efe1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff96 expref: 25 pid: 14864 timeout: 1332 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.748125:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e843828/0x22153cd396b7efe1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff96 expref: 25 pid: 14864 timeout: 1332 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.748141:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826286.748144:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826286.748149:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b7f06d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.748158:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b7f06d lrc: 4/0,1 mode: PW/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.748179:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826286.748201:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8fbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:2403:x1874670563612544:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 141us (2204us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826286.748209:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 883 00010000:00010000:1.0:1787826286.748331:0:14864:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b7f06d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826286.748342:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b7f06d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826286.748365:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b7f06d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826286.748374:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b7f06d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826286.748383:0:14864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b7f06d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826286.748391:0:14864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401e00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:1.0:1787826286.748396:0:14864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b7f06d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826286.748410:0:14864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b7f06d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826286.748423:0:14864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b7f06d lrc: 2/0,0 mode: --/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826286.748431:0:14864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b7f06d lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826286.748520:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f808b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+23:2403:x1874670563612288:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 9756us (10625us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826286.748529:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1625 00010000:00010000:3.0:1787826286.748799:0:8545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b7efda lrc: 0/0,0 mode: --/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff8f expref: 22 pid: 14864 timeout: 1332 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826286.748813:0:8545:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a8f8780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8545:1874670585113856:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826286.748838:0:8545:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006552234c/0x22153cd396b7f066 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.748854:0:8545:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006552234c/0x22153cd396b7f066 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.748862:0:8545:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006552234c/0x22153cd396b7f066 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.748878:0:8545:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006552234c/0x22153cd396b7f066 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.748886:0:8545:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006552234c/0x22153cd396b7f066 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.748894:0:8545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006552234c/0x22153cd396b7f066 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.748900:0:8545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3abd7400 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826286.748903:0:8545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006552234c/0x22153cd396b7f066 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.748910:0:8545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006552234c/0x22153cd396b7f066 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.748920:0:8545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006552234c/0x22153cd396b7f066 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.748932:0:8545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006552234c/0x22153cd396b7f066 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826286.748969:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03afe580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:2403:x1874670563612160:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 10770us (11196us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826286.748977:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1624 00000100:00100000:1.0:1787826286.753217:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826286.753384:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563612800 00000100:00100000:3.0:1787826286.753396:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563612800 00000100:00100000:3.0:1787826286.753536:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3204 00000100:00100000:3.0:1787826286.753549:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f80b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+32:49825:x1874670563612800:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:3.0:1787826286.753630:0:16564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1787826286.753670:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05355400/0x22153cd396b7eede lrc: 0/0,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff49 expref: 32 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.753699:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0865b600/0x22153cd396b7f04a lrc: 0/0,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaffb9 expref: 31 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.753712:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff90cf06894500) 00010000:00010000:3.0:1787826286.753718:0:16564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826286.753891:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6e00/0x22153cd396b7f074 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.753909:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6e00/0x22153cd396b7f074 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.753920:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6e00/0x22153cd396b7f074 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787826286.754217:0:16564:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].259, 88 off29784 00000004:00080000:3.0:1787826286.754229:0:16564:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1232765756857ns, next at 1199550350265ns, rc = 0 00000040:00080000:3.0:1787826286.754408:0:16564:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].260, 88 off29872 00000004:00080000:3.0:1787826286.754415:0:16564:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1232765942876ns, next at 1199550350265ns, rc = 0 00000040:00080000:3.0:1787826286.754784:0:16564:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].251, 88 off29168 00000004:00080000:3.0:1787826286.754793:0:16564:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1232766321288ns, next at 1199550309483ns, rc = 0 00000040:00080000:3.0:1787826286.754809:0:16564:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].252, 88 off29256 00000004:00080000:3.0:1787826286.754814:0:16564:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1232766342223ns, next at 1199550309483ns, rc = 0 00000001:00080000:1.0:1787826286.757016:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969276 is committed 00000004:00080000:1.0:1787826286.757033:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 236 committed 00000004:00080000:1.0:1787826286.757102:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 235 committed 00000004:00010000:3.0:1787826286.757214:0:16564:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000a6b9ce0 reply state 00000000a53b9eb6 transno 4294969276 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6e00/0x22153cd396b7f074 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.757243:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6e00/0x22153cd396b7f074 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.757270:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff90cf06894500) 00010000:00010000:3.0:1787826286.757274:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1787826286.757279:0:16564:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1787826286.757427:0:16564:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1787826286.757453:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f80b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:49825:x1874670563612800:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 3900us (4244us total) trans 4294969276 rc 0/0 00000100:00100000:3.0:1787826286.757462:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3204 00010000:00010000:3.0:1787826286.758850:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6e00/0x22153cd396b7f074 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.758868:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6e00/0x22153cd396b7f074 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.758877:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6e00/0x22153cd396b7f074 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.758885:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3abd6e00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826286.758891:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6e00/0x22153cd396b7f074 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.758900:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6e00/0x22153cd396b7f074 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.758920:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff90cf06894500) 00010000:00010000:3.0:1787826286.758923:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826286.758929:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6e00/0x22153cd396b7f074 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.758935:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6e00/0x22153cd396b7f074 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826286.759880:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563612928 00000100:00100000:3.0:1787826286.759893:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563612928 00000100:00100000:3.0:1787826286.759967:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3205 00000100:00100000:3.0:1787826286.759979:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f827480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:49825:x1874670563612928:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826286.760010:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826286.760032:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6400/0x22153cd396b7f07b lrc: 2/0,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aaffc7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.760115:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6400/0x22153cd396b7f07b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaffc7 expref: 31 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.760134:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6400/0x22153cd396b7f07b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaffc7 expref: 31 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.760162:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff90cf06894500) 00010000:00010000:3.0:1787826286.760165:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826286.760169:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3abd6400, rc 0) 00000100:00100000:3.0:1787826286.760243:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f827480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:49825:x1874670563612928:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 267us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826286.760327:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3205 00000100:00100000:3.0:1787826286.763561:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03739680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585114112:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787826286.763597:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1787826286.764004:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 245 committed 00000004:00080000:1.0:1787826286.764015:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 244 committed 00000100:00100000:3.0:1787826286.765497:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787826286.765522:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585114368:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787826286.765592:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826286.765908:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f827840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585114496:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787826286.765940:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826286.766069:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585114496 00000100:00100000:3.0:1787826286.766084:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585114496 00000100:00100000:3.0:1787826286.766123:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1629 00000100:00100000:3.0:1787826286.766131:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f809680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3646:x1874670585114496:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787826286.766224:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f809680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+18:3646:x1874670585114496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 92us (281us total) trans 21474836878 rc 0/0 00000100:00100000:3.0:1787826286.766232:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1629 00000004:00080000:3.0:1787826286.766298:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3f827840/2, rc 0, transno 21474836878 00000100:00100000:3.0:1787826286.766304:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f827840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585114496:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1787826286.766323:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3f824000/2, rc 0, transno 21474836877 00000100:00100000:3.0:1787826286.766327:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585114368:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787826286.768467:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563613056 00000100:00100000:3.0:1787826286.768576:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563613056 00000100:00100000:3.0:1787826286.772337:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826286.772414:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826286.772449:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563613184 00000100:00100000:3.0:1787826286.772461:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563613184 00000100:00100000:3.0:1787826286.772554:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563613312 00000100:00100000:3.0:1787826286.772558:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563613312 00000100:00100000:3.0:1787826286.772583:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1630 00000100:00100000:3.0:1787826286.772593:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8f9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:2403:x1874670563613184:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826286.772615:0:8545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826286.772642:0:8545:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006552234c/0x22153cd396b7f090 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aaffd5 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826286.772675:0:8545:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd1:0x0] initial LVB size: 2097152, mtime: 0x6a90106e, atime: 0x6a90106d, ctime: 0x6a90106e, blocks: 0x1000 00010000:00010000:3.0:1787826286.772706:0:8545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd1:0x0].0x0 since=1232s v=(0 0) 00010000:00010000:3.0:1787826286.772711:0:8545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826286.772725:0:8545:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006552234c/0x22153cd396b7f090 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaffd5 expref: 22 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.772747:0:8545:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006552234c/0x22153cd396b7f090 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaffd5 expref: 22 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.772763:0:8545:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3abd7400, rc 0) 00000100:00100000:3.0:1787826286.772834:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8f9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:2403:x1874670563613184:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 242us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826286.772842:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1630 00000100:00100000:3.0:1787826286.772861:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1631 00000100:00100000:3.0:1787826286.772868:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab15680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:2403:x1874670563613312:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826286.772876:0:8545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826286.772885:0:8545:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061e22549/0x22153cd396b7f097 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aaffdc expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826286.772898:0:8545:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd2:0x0] initial LVB size: 3145728, mtime: 0x6a90106e, atime: 0x6a90106d, ctime: 0x6a90106e, blocks: 0x800 00010000:00010000:3.0:1787826286.772908:0:8545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd2:0x0].0x0 since=1232s v=(0 0) 00010000:00010000:3.0:1787826286.772911:0:8545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826286.772917:0:8545:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061e22549/0x22153cd396b7f097 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaffdc expref: 22 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.772928:0:8545:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000061e22549/0x22153cd396b7f097 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaffdc expref: 22 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.772937:0:8545:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3abd7e00, rc 0) 00000100:00100000:3.0:1787826286.772957:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab15680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:2403:x1874670563613312:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 90us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826286.772963:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1631 00000100:00100000:1.0:1787826286.807333:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826286.809706:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563613568 00000100:00100000:3.0:1787826286.809718:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563613568 00000100:00100000:3.0:1787826286.809793:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1633 00000100:00100000:3.0:1787826286.809804:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f825a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:2404:x1874670563613568:12345-192.168.203.39@tcp:23:lfs.0 00000100:00100000:3.0:1787826286.809951:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f825a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:2404:x1874670563613568:12345-192.168.203.39@tcp:23:lfs.0 Request processed in 148us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826286.809961:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1633 00000100:00100000:1.0:1787826286.812953:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826286.813045:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826286.814159:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1635 00000100:00100000:1.0:1787826286.814168:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f80a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:2402:x1874670563613696:12345-192.168.203.39@tcp:23:lfs.0 00000100:00100000:1.0:1787826286.814212:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f80a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:2402:x1874670563613696:12345-192.168.203.39@tcp:23:lfs.0 Request processed in 46us (1274us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826286.814219:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1635 00000100:00100000:1.0:1787826286.819857:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826286.852293:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826286.857878:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0300d680 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:8442:1874670585114624:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826286.857917:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563614336 00000100:00100000:1.0:1787826286.857926:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563614336 00010000:00010000:1.0:1787826286.857986:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000008e1fd0/0x22153cd396b7efef lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xdd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff9d expref: 11 pid: 30695 timeout: 1332 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826286.858044:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 884 00000100:00100000:1.0:1787826286.858055:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049bad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2403:x1874670563614336:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826286.858084:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826286.858113:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000008e1fd0/0x22153cd396b7efef lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xdd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff9d expref: 11 pid: 30695 timeout: 1332 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826286.858129:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000008e1fd0/0x22153cd396b7efef lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xdd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff9d expref: 11 pid: 30695 timeout: 1332 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826286.858160:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000008e1fd0/0x22153cd396b7efef lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xdd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaff9d expref: 11 pid: 30695 timeout: 1332 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826286.858178:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826286.858184:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826286.858191:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000055242d0c/0x22153cd396b7f0ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdd:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826286.858202:0:10340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055242d0c/0x22153cd396b7f0ac lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0xdd:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826286.858227:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826286.858293:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049bad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670563614336:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 239us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826286.858302:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 884 00010000:00010000:3.0:1787826286.858986:0:8442:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000055242d0c/0x22153cd396b7f0ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdd:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.859003:0:8442:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000055242d0c/0x22153cd396b7f0ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdd:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.859011:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000055242d0c/0x22153cd396b7f0ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdd:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826286.887605:0:8442:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xdd:0x0] updating lvb mtime from disk: 1787826285 -> 1787826287 00002000:00010000:3.0:1787826286.887611:0:8442:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xdd:0x0] updating lvb ctime from disk: 1787826285 -> 1787826287 00010000:00010000:3.0:1787826286.887630:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055242d0c/0x22153cd396b7f0ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdd:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.887644:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000055242d0c/0x22153cd396b7f0ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdd:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.887653:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000055242d0c/0x22153cd396b7f0ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xdd:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.887661:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce026ae200 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826286.887666:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000055242d0c/0x22153cd396b7f0ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xdd:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.887676:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000055242d0c/0x22153cd396b7f0ac lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xdd:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.887705:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000055242d0c/0x22153cd396b7f0ac lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xdd:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.887714:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055242d0c/0x22153cd396b7f0ac lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xdd:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826286.887834:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2403:x1874670563614208:12345-192.168.203.39@tcp:4:lfs.0 Request processed in 35298us (35546us total) trans 17179869555 rc 0/0 00000100:00100000:3.0:1787826286.887846:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 631 00000100:00100000:1.0:1787826286.893606:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826286.893706:0:25426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563614464 00000100:00100000:3.0:1787826286.893719:0:25426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563614464 00000100:00100000:3.0:1787826286.893886:0:25426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 632 00000100:00100000:3.0:1787826286.893926:0:25426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f808780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2404:x1874670563614464:12345-192.168.203.39@tcp:4:lfs.0 00010000:00010000:3.0:1787826286.893976:0:25426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb167c78/0x22153cd396b7f0b3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xde:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.893997:0:25426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b0c18b21/0x22153cd396b7eff6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xde:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaffa4 expref: 8 pid: 30695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.894004:0:25426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xde:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826286.894008:0:25426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xde:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826286.894012:0:25426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb167c78/0x22153cd396b7f0b3 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0xde:0x0].0x0 rrc: 3 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.894049:0:25426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b0c18b21/0x22153cd396b7eff6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xde:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaffa4 expref: 8 pid: 30695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.894063:0:25426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b0c18b21/0x22153cd396b7eff6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xde:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaffa4 expref: 8 pid: 30695 timeout: 1332 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826286.894091:0:25426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3abc0f00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0001_UUID:25426:1874670585114752:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826286.894201:0:25426:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce04aa5480 going to sleep for 11 seconds 00000100:00100000:3.0:1787826286.899164:0:25426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3abc0f00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0001_UUID:25426:1874670585114752:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826286.899202:0:25426:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000eb167c78/0x22153cd396b7f0b3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xde:0x0].0x0 rrc: 3 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826286.899441:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563614592 00000100:00100000:1.0:1787826286.899450:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563614592 00010000:00010000:1.0:1787826286.899545:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b0c18b21/0x22153cd396b7eff6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xde:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaffa4 expref: 9 pid: 30695 timeout: 1332 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826286.899598:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 885 00000100:00100000:1.0:1787826286.899609:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049b83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563614592:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826286.899632:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826286.899660:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b0c18b21/0x22153cd396b7eff6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xde:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaffa4 expref: 9 pid: 30695 timeout: 1332 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826286.899675:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b0c18b21/0x22153cd396b7eff6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xde:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaffa4 expref: 9 pid: 30695 timeout: 1332 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826286.899707:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0c18b21/0x22153cd396b7eff6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xde:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaffa4 expref: 9 pid: 30695 timeout: 1332 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826286.899727:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xde:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826286.899733:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xde:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826286.899739:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eb167c78/0x22153cd396b7f0b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xde:0x0].0x0 rrc: 4 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826286.899751:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb167c78/0x22153cd396b7f0b3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0xde:0x0].0x0 rrc: 4 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826286.899775:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826286.899844:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049b83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2404:x1874670563614592:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 235us (1118us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826286.899853:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 885 00010000:00010000:3.0:1787826286.899938:0:25426:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000eb167c78/0x22153cd396b7f0b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xde:0x0].0x0 rrc: 2 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.899945:0:25426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb167c78/0x22153cd396b7f0b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xde:0x0].0x0 rrc: 2 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.916902:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787826286.945692:0:25426:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xde:0x0] updating lvb mtime from disk: 1787826285 -> 1787826287 00002000:00010000:1.0:1787826286.945701:0:25426:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xde:0x0] updating lvb ctime from disk: 1787826285 -> 1787826287 00010000:00010000:1.0:1787826286.945720:0:25426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb167c78/0x22153cd396b7f0b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xde:0x0].0x0 rrc: 2 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826286.945736:0:25426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eb167c78/0x22153cd396b7f0b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xde:0x0].0x0 rrc: 2 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826286.945745:0:25426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eb167c78/0x22153cd396b7f0b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xde:0x0].0x0 rrc: 2 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826286.945753:0:25426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3abd7000 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:1.0:1787826286.945758:0:25426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb167c78/0x22153cd396b7f0b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xde:0x0].0x0 rrc: 2 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826286.945769:0:25426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb167c78/0x22153cd396b7f0b3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xde:0x0].0x0 rrc: 2 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826286.945793:0:25426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eb167c78/0x22153cd396b7f0b3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xde:0x0].0x0 rrc: 2 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826286.945800:0:25426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb167c78/0x22153cd396b7f0b3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xde:0x0].0x0 rrc: 2 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826286.945997:0:25426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f808780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2404:x1874670563614464:12345-192.168.203.39@tcp:4:lfs.0 Request processed in 52095us (52399us total) trans 17179869556 rc 0/0 00000100:00100000:1.0:1787826286.946010:0:25426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 632 00000100:00100000:3.0:1787826286.966107:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563614976 00000100:00100000:3.0:1787826286.966121:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563614976 00000100:00100000:3.0:1787826286.966189:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1636 00000100:00100000:3.0:1787826286.966200:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:49825:x1874670563614976:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826286.966223:0:28853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826286.966249:0:28853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c969551/0x22153cd396b7f0c1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xdd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aaffe3 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826286.966290:0:28853:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xdd:0x0] initial LVB size: 1048576, mtime: 0x6a90106f, atime: 0x0, ctime: 0x6a90106f, blocks: 0x800 00010000:00010000:3.0:1787826286.966319:0:28853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdd:0x0].0x0 since=1232s v=(0 0) 00010000:00010000:3.0:1787826286.966325:0:28853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826286.966338:0:28853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c969551/0x22153cd396b7f0c1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaffe3 expref: 8 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.966356:0:28853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006c969551/0x22153cd396b7f0c1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaffe3 expref: 8 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826286.966372:0:28853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3abd6e00, rc 0) 00000100:00100000:3.0:1787826286.966548:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:49825:x1874670563614976:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 348us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826286.966561:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1636 00000100:00100000:1.0:1787826286.969619:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826286.977112:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563615488 00000100:00100000:3.0:1787826286.977125:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563615488 00000100:00100000:3.0:1787826286.977409:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3208 00000100:00100000:3.0:1787826286.977423:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049b92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:49825:x1874670563615488:12345-192.168.203.39@tcp:36:lfs.0 00000100:00100000:1.0:1787826286.986359:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826286.989054:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563615616 00000100:00100000:3.0:1787826286.989086:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563615616 00000100:00100000:0.0:1787826286.994233:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f80bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+23:49825:x1874670563615616:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 5028us (7894us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826286.994263:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1638 00000100:00100000:1.0:1787826286.998534:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826286.998680:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563615744 00000100:00100000:0.0:1787826286.998693:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563615744 00010000:00010000:0.0:1787826286.998748:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006552234c/0x22153cd396b7f090 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaffd5 expref: 23 pid: 8545 timeout: 1333 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826286.998798:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 886 00000100:00100000:0.0:1787826286.998810:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f808f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+23:2403:x1874670563615744:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826286.998830:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826286.998858:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006552234c/0x22153cd396b7f090 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaffd5 expref: 23 pid: 8545 timeout: 1333 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826286.998882:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006552234c/0x22153cd396b7f090 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaffd5 expref: 23 pid: 8545 timeout: 1333 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826286.998917:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006552234c/0x22153cd396b7f090 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaffd5 expref: 23 pid: 8545 timeout: 1333 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826286.998939:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826286.998944:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826286.998955:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000117e0b37/0x22153cd396b7f0d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafff1 expref: 22 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826286.998967:0:10341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000117e0b37/0x22153cd396b7f0d6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafff1 expref: 22 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826286.999021:0:10341:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000117e0b37/0x22153cd396b7f0d6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafff1 expref: 22 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826286.999039:0:10341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce049ba580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10341:1874670585115008:192.168.203.39@tcp:105: 00000100:00100000:0.0:1787826286.999168:0:10341:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf117b0780 going to sleep for 11 seconds 00000100:00100000:1.0:1787826287.008367:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826287.012274:0:10341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce049ba580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10341:1874670585115008:192.168.203.39@tcp:105: 00010000:00010000:0.0:1787826287.012312:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826287.012405:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f808f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:2403:x1874670563615744:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 13597us (13882us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826287.012419:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 886 00000100:00100000:1.0:1787826287.022723:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826287.022831:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563616000 00000100:00100000:0.0:1787826287.022842:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563616000 00010000:00010000:0.0:1787826287.022896:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000061e22549/0x22153cd396b7f097 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaffdc expref: 24 pid: 8545 timeout: 1333 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826287.022978:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 887 00000100:00100000:0.0:1787826287.022989:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f80b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:2404:x1874670563616000:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826287.023007:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826287.023034:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000061e22549/0x22153cd396b7f097 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaffdc expref: 24 pid: 8545 timeout: 1333 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826287.023055:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000061e22549/0x22153cd396b7f097 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaffdc expref: 24 pid: 8545 timeout: 1333 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826287.023097:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061e22549/0x22153cd396b7f097 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaffdc expref: 24 pid: 8545 timeout: 1333 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826287.023115:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826287.023120:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826287.023130:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000055242d0c/0x22153cd396b7f0dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafff8 expref: 23 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826287.023143:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055242d0c/0x22153cd396b7f0dd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafff8 expref: 23 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826287.023183:0:6505:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000055242d0c/0x22153cd396b7f0dd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafff8 expref: 22 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826287.023199:0:6505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce049ba580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1874670585115264:192.168.203.39@tcp:105: 00000100:00100000:0.0:1787826287.023262:0:6505:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf117b0780 going to sleep for 11 seconds 00000100:00100000:3.0:1787826287.030168:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563616128 00000100:00100000:3.0:1787826287.030179:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563616128 00000100:00100000:3.0:1787826287.030892:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563616256 00000100:00100000:3.0:1787826287.030900:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563616256 00000100:00100000:3.0:1787826287.031008:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1640 00000100:00100000:3.0:1787826287.031020:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:2404:x1874670563616128:12345-192.168.203.39@tcp:2:lfs.0 00002000:00010000:3.0:1787826287.032541:0:14864:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xd1:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1787826287.032545:0:14864:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xd1:0x0] updating lvb mtime from disk: 1787826286 -> 1787826286 00002000:00010000:3.0:1787826287.032547:0:14864:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xd1:0x0] updating lvb atime from disk: 1787826285 -> 1787826287 00002000:00010000:3.0:1787826287.032549:0:14864:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xd1:0x0] updating lvb ctime from disk: 1787826286 -> 1787826287 00002000:00010000:3.0:1787826287.032551:0:14864:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xd1:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:3.0:1787826287.032576:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:2404:x1874670563616128:12345-192.168.203.39@tcp:2:lfs.0 Request processed in 1559us (2731us total) trans 21474836879 rc 0/0 00000100:00100000:3.0:1787826287.032584:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1640 00000100:00100000:0.0:1787826287.032975:0:6505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce049ba580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1874670585115264:192.168.203.39@tcp:105: 00010000:00010000:0.0:1787826287.033004:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826287.042134:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563616512 00000100:00100000:3.0:1787826287.042148:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563616512 00000100:00100000:3.0:1787826287.042289:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 953 00000100:00100000:3.0:1787826287.042302:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:49825:x1874670563616512:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:3.0:1787826287.042394:0:6522:0:(mdt_open.c:2504:mdt_close_resync_done()) ### [0x200000405:0x9:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0865a800/0x22153cd396b7f058 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x9:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaffc0 expref: 24 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826287.042466:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6800/0x22153cd396b7f0e4 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826287.042502:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6400/0x22153cd396b7f07b lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaffc7 expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826287.042513:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6800/0x22153cd396b7f0e4 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826287.042567:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6400/0x22153cd396b7f07b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaffc7 expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826287.042589:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6400/0x22153cd396b7f07b lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaffc7 expref: 24 pid: 6519 timeout: 1333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826287.042604:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3abc0f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585115392:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826287.042712:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce04aa5e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826287.047208:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00010000:00010000:3.0:1787826287.051673:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6400/0x22153cd396b7f07b lrc: 0/0,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaffc7 expref: 24 pid: 6519 timeout: 1333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826287.051707:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3abc0f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585115392:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826287.051739:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6800/0x22153cd396b7f0e4 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787826287.062347:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969280 is committed 00000004:00080000:1.0:1787826287.062368:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 238 committed 00000004:00080000:1.0:1787826287.062398:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 237 committed 00000004:00080000:1.0:1787826287.062402:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 247 committed 00000004:00080000:1.0:1787826287.062421:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 246 committed 00000100:00100000:3.0:1787826287.062602:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787826287.062633:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3abc0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585115520:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787826287.062740:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826287.063010:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce049bb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585115904:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787826287.063041:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826287.063096:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3abc30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585115648:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787826287.063124:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826287.063145:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787826287.063151:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce049ba580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585115776:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787826287.063170:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826287.063205:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585115520 00000100:00100000:3.0:1787826287.063213:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585115520 00000100:00100000:3.0:1787826287.063538:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585115904 00000100:00100000:3.0:1787826287.063544:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585115904 00000100:00100000:1.0:1787826287.065498:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585115648 00000100:00100000:1.0:1787826287.065523:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585115648 00000100:00100000:1.0:1787826287.065597:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585115776 00000100:00100000:1.0:1787826287.065601:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585115776 00000100:00100000:1.0:1787826287.065638:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1642 00000100:00100000:1.0:1787826287.065649:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3646:x1874670585115520:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1787826287.065972:0:8545:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xdd:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1787826287.065978:0:8545:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xdd:0x0] updating lvb mtime from disk: 1787826287 -> 1787826287 00002000:00010000:1.0:1787826287.065981:0:8545:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xdd:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787826287.065983:0:8545:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xdd:0x0] updating lvb ctime from disk: 1787826287 -> 1787826287 00002000:00010000:1.0:1787826287.065986:0:8545:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xdd:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:1.0:1787826287.066106:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3646:x1874670585115520:12345-0@lo:2:osp-syn-1-0.0 Request processed in 458us (3366us total) trans 17179869558 rc 0/0 00000100:00100000:1.0:1787826287.066116:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1642 00000100:00100000:1.0:1787826287.066141:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1643 00000100:00100000:1.0:1787826287.066150:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+18:3646:x1874670585115904:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787826287.066231:0:8545:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xd2:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:1.0:1787826287.066234:0:8545:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xd2:0x0] updating lvb mtime from disk: 1787826286 -> 1787826286 00002000:00010000:1.0:1787826287.066237:0:8545:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xd2:0x0] updating lvb atime from disk: 1787826287 -> 1787826287 00002000:00010000:1.0:1787826287.066239:0:8545:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xd2:0x0] updating lvb ctime from disk: 1787826287 -> 1787826287 00002000:00010000:1.0:1787826287.066241:0:8545:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xd2:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:1.0:1787826287.066446:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+19:3646:x1874670585115904:12345-0@lo:2:osp-syn-0-0.0 Request processed in 297us (3403us total) trans 21474836881 rc 0/0 00000100:00100000:1.0:1787826287.066454:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1643 00000100:00100000:1.0:1787826287.066468:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1644 00000100:00100000:1.0:1787826287.066501:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3644:x1874670585115648:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1787826287.066558:0:8545:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xde:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:1.0:1787826287.066561:0:8545:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xde:0x0] updating lvb mtime from disk: 1787826287 -> 1787826287 00002000:00010000:1.0:1787826287.066564:0:8545:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xde:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787826287.066566:0:8545:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xde:0x0] updating lvb ctime from disk: 1787826287 -> 1787826287 00002000:00010000:1.0:1787826287.066568:0:8545:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xde:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:1.0:1787826287.066604:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3644:x1874670585115648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 104us (3478us total) trans 17179869559 rc 0/0 00000100:00100000:1.0:1787826287.066611:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1644 00000100:00100000:1.0:1787826287.066626:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1645 00000100:00100000:1.0:1787826287.066634:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+18:3644:x1874670585115776:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787826287.066690:0:8545:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xd1:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1787826287.066695:0:8545:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xd1:0x0] updating lvb mtime from disk: 1787826286 -> 1787826286 00002000:00010000:1.0:1787826287.066697:0:8545:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xd1:0x0] updating lvb atime from disk: 1787826287 -> 1787826287 00002000:00010000:1.0:1787826287.066699:0:8545:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xd1:0x0] updating lvb ctime from disk: 1787826287 -> 1787826287 00002000:00010000:1.0:1787826287.066702:0:8545:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xd1:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:1.0:1787826287.066730:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+19:3644:x1874670585115776:12345-0@lo:2:osp-syn-0-0.0 Request processed in 97us (3557us total) trans 21474836882 rc 0/0 00000100:00100000:1.0:1787826287.066736:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1645 00000100:00080000:3.0:1787826287.067208:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787826287.067217:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1787826287.067396:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce049ba580/2, rc 0, transno 21474836882 00000100:00100000:3.0:1787826287.067407:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce049ba580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585115776:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787826287.067425:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869554 gen 2 00000004:00080000:3.0:1787826287.067431:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf136ced00, transno 17179869549 00000004:00080000:3.0:1787826287.067596:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3abc3c00, transno 17179869550 00000004:00080000:3.0:1787826287.067766:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3ab92940, transno 17179869551 00000004:00080000:3.0:1787826287.067846:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3ab90b40, transno 17179869552 00000004:00080000:3.0:1787826287.067850:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce03739a40, transno 17179869553 00000004:00080000:3.0:1787826287.067853:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce03739680, transno 17179869554 00000100:00100000:3.0:1787826287.067863:0:3644:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff90cf3abc30c0 x1874670585115648/t17179869559(17179869559) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1787826303 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1787826287.067950:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3abc30c0/2, rc 0, transno 17179869559 00000100:00100000:3.0:1787826287.067955:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3abc30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585115648:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1787826287.068056:0:9969:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 2 in progress, 1 in flight, 4 done 00000004:00080000:3.0:1787826287.068155:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce049bb0c0/2, rc 0, transno 21474836881 00000100:00100000:3.0:1787826287.068163:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce049bb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585115904:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1787826287.068179:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3abc0f00/2, rc 0, transno 17179869558 00000100:00100000:3.0:1787826287.068183:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3abc0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585115520:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1787826287.069983:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6800/0x22153cd396b7f0e4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826287.069993:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6800/0x22153cd396b7f0e4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826287.070001:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6800/0x22153cd396b7f0e4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826287.070012:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3abd6800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826287.070017:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6800/0x22153cd396b7f0e4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826287.070024:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6800/0x22153cd396b7f0e4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826287.070037:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff90cf06894500) 00010000:00010000:3.0:1787826287.070040:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826287.070044:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6800/0x22153cd396b7f0e4 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826287.070050:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6800/0x22153cd396b7f0e4 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826287.072354:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826287.073570:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563616768 00000100:00100000:0.0:1787826287.073835:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563616768 00000100:00100000:1.0:1787826287.073984:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3209 00000100:00100000:1.0:1787826287.073997:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f808000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+17:49825:x1874670563616768:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826287.074028:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826287.074060:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518600/0x22153cd396b7f0eb lrc: 2/0,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aaffff expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826287.074149:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518600/0x22153cd396b7f0eb lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaffff expref: 18 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826287.074165:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518600/0x22153cd396b7f0eb lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaffff expref: 18 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826287.074187:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff90cf06894500) 00010000:00010000:1.0:1787826287.074191:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826287.074195:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf01518600, rc 0) 00000100:00100000:1.0:1787826287.074274:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f808000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+18:49825:x1874670563616768:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 281us (1935us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826287.074281:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3209 00000100:00100000:1.0:1787826287.079106:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826287.079647:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563617024 00000100:00100000:0.0:1787826287.079661:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563617024 00000100:00100000:0.0:1787826287.079844:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 954 00000100:00100000:0.0:1787826287.079858:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f809a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+18:49825:x1874670563617024:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:0.0:1787826287.080197:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f809a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:49825:x1874670563617024:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 342us (1104us total) trans 4294969281 rc 0/0 00000100:00100000:0.0:1787826287.080207:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 954 00000100:00100000:0.0:1787826287.108320:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826287.118139:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826287.183649:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826287.193722:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826287.193917:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563617792 00000100:00100000:1.0:1787826287.193931:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563617792 00000100:00100000:1.0:1787826287.194136:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3213 00000100:00100000:1.0:1787826287.194149:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049bbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:49830:x1874670563617792:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:1.0:1787826287.194266:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518e00/0x22153cd396b7f131 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826287.194289:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518e00/0x22153cd396b7f131 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826287.194304:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518e00/0x22153cd396b7f131 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826287.194322:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519600/0x22153cd396b7f138 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826287.194329:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519600/0x22153cd396b7f138 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826287.194336:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519600/0x22153cd396b7f138 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826287.194441:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518200/0x22153cd396b7f13f lrc: 3/1,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826287.194451:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518200/0x22153cd396b7f13f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826287.194458:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518200/0x22153cd396b7f13f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826287.194549:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x9:0x0]: returning size 3145728 00000004:00200000:1.0:1787826287.194555:0:8247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826287.194572:0:8247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518200/0x22153cd396b7f13f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826287.194587:0:8247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518e00/0x22153cd396b7f131 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826287.194594:0:8247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518e00/0x22153cd396b7f131 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826287.194602:0:8247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518e00/0x22153cd396b7f131 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826287.194609:0:8247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf01518e00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826287.194613:0:8247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518e00/0x22153cd396b7f131 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826287.194621:0:8247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518e00/0x22153cd396b7f131 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826287.194636:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cf39656000) 00010000:00010000:1.0:1787826287.194639:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826287.194644:0:8247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518e00/0x22153cd396b7f131 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826287.194650:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518e00/0x22153cd396b7f131 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826287.194669:0:8247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519600/0x22153cd396b7f138 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826287.194680:0:8247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519600/0x22153cd396b7f138 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826287.194686:0:8247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519600/0x22153cd396b7f138 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826287.194692:0:8247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf01519600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826287.194695:0:8247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519600/0x22153cd396b7f138 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826287.194701:0:8247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519600/0x22153cd396b7f138 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826287.194709:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x995b1268 (ffff90cf39e67700) 00010000:00010000:1.0:1787826287.194712:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826287.194715:0:8247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519600/0x22153cd396b7f138 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826287.194721:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519600/0x22153cd396b7f138 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826287.194741:0:8247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518200/0x22153cd396b7f13f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826287.194747:0:8247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518200/0x22153cd396b7f13f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826287.194754:0:8247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518200/0x22153cd396b7f13f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826287.194759:0:8247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf01518200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826287.194763:0:8247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518200/0x22153cd396b7f13f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826287.194769:0:8247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518200/0x22153cd396b7f13f lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826287.195069:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff90cf06894500) 00010000:00010000:1.0:1787826287.195082:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826287.195086:0:8247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518200/0x22153cd396b7f13f lrc: 2/0,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826287.195093:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518200/0x22153cd396b7f13f lrc: 0/0,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826287.195202:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049bbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:49830:x1874670563617792:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 1052us (1491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826287.195211:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3213 00000100:00100000:1.0:1787826287.292349:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826287.349782:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826287.355635:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826287.355740:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826287.356101:0:30176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563618304 00000100:00100000:3.0:1787826287.356110:0:30176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563618304 00000100:00100000:3.0:1787826287.356210:0:30176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 635 00000100:00100000:3.0:1787826287.356221:0:30176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049bad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:2402:x1874670563618304:12345-192.168.203.39@tcp:3:lfs.0 00010000:00010000:3.0:1787826287.356273:0:30176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000009a032ff/0x22153cd396b7f170 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826287.356294:0:30176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000055242d0c/0x22153cd396b7f0dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafff8 expref: 25 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826287.356305:0:30176:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0xd2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826287.356310:0:30176:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826287.356316:0:30176:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009a032ff/0x22153cd396b7f170 lrc: 4/1,0 mode: --/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826287.356361:0:30176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000055242d0c/0x22153cd396b7f0dd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafff8 expref: 25 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826287.356382:0:30176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000055242d0c/0x22153cd396b7f0dd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafff8 expref: 25 pid: 8436 timeout: 1333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826287.356411:0:30176:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3abc0000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0000_UUID:30176:1874670585116160:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826287.356601:0:30176:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce04aa5e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826287.361578:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563618432 00000100:00100000:1.0:1787826287.361600:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563618432 00010000:00010000:1.0:1787826287.361672:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000117e0b37/0x22153cd396b7f0d6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafff1 expref: 26 pid: 30398 timeout: 1333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826287.361808:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 889 00000100:00100000:1.0:1787826287.361820:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049b83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:2404:x1874670563618432:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826287.361842:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826287.361872:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000117e0b37/0x22153cd396b7f0d6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafff1 expref: 26 pid: 30398 timeout: 1333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826287.361896:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000117e0b37/0x22153cd396b7f0d6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafff1 expref: 26 pid: 30398 timeout: 1333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826287.361927:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000117e0b37/0x22153cd396b7f0d6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafff1 expref: 26 pid: 30398 timeout: 1333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826287.361963:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd1:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826287.361970:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd1:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826287.361978:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006e7e9fde/0x22153cd396b7f169 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826287.361991:0:10341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e7e9fde/0x22153cd396b7f169 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826287.362041:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826287.362143:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049b83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:2404:x1874670563618432:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 325us (6402us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826287.362152:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 889 00010000:00010000:3.0:1787826287.362234:0:25423:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006e7e9fde/0x22153cd396b7f169 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826287.362257:0:25423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e7e9fde/0x22153cd396b7f169 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826287.384387:0:30176:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3abc0000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0000_UUID:30176:1874670585116160:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826287.384435:0:30176:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000009a032ff/0x22153cd396b7f170 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826287.386705:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563618560 00000100:00100000:1.0:1787826287.386718:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563618560 00010000:00010000:1.0:1787826287.386776:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000055242d0c/0x22153cd396b7f0dd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafff8 expref: 26 pid: 8436 timeout: 1333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826287.386834:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 890 00000100:00100000:1.0:1787826287.386846:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136ced00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:2404:x1874670563618560:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826287.386868:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826287.386897:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000055242d0c/0x22153cd396b7f0dd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafff8 expref: 26 pid: 8436 timeout: 1333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826287.386914:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000055242d0c/0x22153cd396b7f0dd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafff8 expref: 26 pid: 8436 timeout: 1333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826287.386945:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055242d0c/0x22153cd396b7f0dd lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafff8 expref: 26 pid: 8436 timeout: 1333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826287.386981:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826287.386987:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826287.386993:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000009a032ff/0x22153cd396b7f170 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 30176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826287.387006:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009a032ff/0x22153cd396b7f170 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 30176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826287.387044:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826287.387124:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136ced00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:2404:x1874670563618560:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 280us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826287.387133:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 890 00010000:00010000:1.0:1787826287.387166:0:30176:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000009a032ff/0x22153cd396b7f170 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826287.387176:0:30176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009a032ff/0x22153cd396b7f170 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826287.405040:0:30176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000009a032ff/0x22153cd396b7f170 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826287.405069:0:30176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000009a032ff/0x22153cd396b7f170 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826287.405092:0:30176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000009a032ff/0x22153cd396b7f170 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826287.405101:0:30176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3abd6800 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:1.0:1787826287.405107:0:30176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000009a032ff/0x22153cd396b7f170 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826287.405118:0:30176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000009a032ff/0x22153cd396b7f170 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826287.405144:0:30176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000009a032ff/0x22153cd396b7f170 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826287.405153:0:30176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009a032ff/0x22153cd396b7f170 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826287.405238:0:25423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006e7e9fde/0x22153cd396b7f169 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826287.405262:0:25423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e7e9fde/0x22153cd396b7f169 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826287.405284:0:25423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e7e9fde/0x22153cd396b7f169 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826287.405292:0:25423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce026afa00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826287.405297:0:25423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e7e9fde/0x22153cd396b7f169 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826287.405304:0:25423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e7e9fde/0x22153cd396b7f169 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826287.405317:0:25423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e7e9fde/0x22153cd396b7f169 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826287.405325:0:25423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e7e9fde/0x22153cd396b7f169 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826287.405337:0:30176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049bad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:2402:x1874670563618304:12345-192.168.203.39@tcp:3:lfs.0 Request processed in 49110us (49711us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1787826287.405351:0:30176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 635 00000100:00100000:3.0:1787826287.405370:0:25423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:2403:x1874670563618176:12345-192.168.203.39@tcp:3:lfs.0 Request processed in 55254us (55603us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1787826287.405380:0:25423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 634 00000100:00100000:0.0:1787826287.415737:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826287.415848:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826287.416783:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563618688 00000100:00100000:3.0:1787826287.416797:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563618688 00000100:00100000:3.0:1787826287.417093:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563618816 00000100:00100000:3.0:1787826287.417099:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563618816 00000100:00100000:0.0:1787826287.417215:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1646 00000100:00100000:0.0:1787826287.417230:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf13669e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+23:2401:x1874670563618688:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826287.417270:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826287.417303:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e0f9a77/0x22153cd396b7f177 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab001b expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826287.417338:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd1:0x0] initial LVB size: 2097152, mtime: 0x6a90106e, atime: 0x6a90106f, ctime: 0x6a90106f, blocks: 0x1000 00010000:00010000:0.0:1787826287.417366:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd1:0x0].0x0 since=1233s v=(0 0) 00010000:00010000:0.0:1787826287.417372:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826287.417386:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e0f9a77/0x22153cd396b7f177 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab001b expref: 24 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826287.417420:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004e0f9a77/0x22153cd396b7f177 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab001b expref: 24 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826287.417437:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0a70f400, rc 0) 00000100:00100000:0.0:1787826287.417557:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf13669e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:2401:x1874670563618688:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 331us (1834us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826287.417566:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1646 00000100:00100000:0.0:1787826287.417590:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1647 00000100:00100000:0.0:1787826287.417597:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1366a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+23:2401:x1874670563618816:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826287.417605:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826287.417616:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007dfa189d/0x22153cd396b7f17e lrc: 2/0,0 mode: --/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0022 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826287.417630:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd2:0x0] initial LVB size: 3145728, mtime: 0x6a90106e, atime: 0x6a90106f, ctime: 0x6a90106f, blocks: 0x800 00010000:00010000:0.0:1787826287.417640:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd2:0x0].0x0 since=1233s v=(0 0) 00010000:00010000:0.0:1787826287.417643:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826287.417652:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007dfa189d/0x22153cd396b7f17e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0022 expref: 24 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826287.417663:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007dfa189d/0x22153cd396b7f17e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0022 expref: 24 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826287.417672:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0a70ec00, rc 0) 00000100:00100000:0.0:1787826287.417693:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1366a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:2401:x1874670563618816:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 97us (1845us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826287.417699:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1647 00000100:00100000:0.0:1787826287.470572:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826287.513694:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826287.582213:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826287.582742:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826287.585269:0:30188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 636 00000100:00100000:0.0:1787826287.585287:0:30188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1366a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2404:x1874670563619456:12345-192.168.203.39@tcp:3:lfs.0 00010000:00010000:0.0:1787826287.585615:0:30188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000d8c8998/0x22153cd396b7f19a lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xdd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826287.585643:0:30188:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006c969551/0x22153cd396b7f0c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaffe3 expref: 11 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826287.585652:0:30188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0xdd:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787826287.585658:0:30188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826287.585663:0:30188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d8c8998/0x22153cd396b7f19a lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0xdd:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826287.585711:0:30188:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006c969551/0x22153cd396b7f0c1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xdd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaffe3 expref: 11 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826287.585727:0:30188:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006c969551/0x22153cd396b7f0c1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xdd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaffe3 expref: 11 pid: 28853 timeout: 1333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826287.585746:0:30188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf13668780 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_017:lustre-OST0001_UUID:30188:1874670585116288:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826287.585859:0:30188:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf117b0780 going to sleep for 11 seconds 00000100:00080000:3.0:1787826287.595859:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826287.596099:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826287.596311:0:30188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf13668780 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_017:lustre-OST0001_UUID:30188:1874670585116288:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826287.596349:0:30188:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000d8c8998/0x22153cd396b7f19a lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xdd:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826287.596406:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563619712 00000100:00100000:3.0:1787826287.596415:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563619712 00010000:00010000:3.0:1787826287.596501:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006c969551/0x22153cd396b7f0c1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xdd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaffe3 expref: 12 pid: 28853 timeout: 1333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826287.596545:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 891 00000100:00100000:3.0:1787826287.596556:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf13668b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563619712:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826287.596574:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826287.596602:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006c969551/0x22153cd396b7f0c1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xdd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaffe3 expref: 12 pid: 28853 timeout: 1333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826287.596616:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006c969551/0x22153cd396b7f0c1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xdd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaffe3 expref: 12 pid: 28853 timeout: 1333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826287.596648:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c969551/0x22153cd396b7f0c1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xdd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaffe3 expref: 12 pid: 28853 timeout: 1333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826287.596669:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826287.596674:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826287.596681:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000d8c8998/0x22153cd396b7f19a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xdd:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 30188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826287.596691:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d8c8998/0x22153cd396b7f19a lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0xdd:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 30188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826287.596716:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826287.596778:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf13668b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2403:x1874670563619712:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 224us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826287.596787:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 891 00010000:00010000:3.0:1787826287.596814:0:30188:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000d8c8998/0x22153cd396b7f19a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xdd:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826287.596823:0:30188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d8c8998/0x22153cd396b7f19a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xdd:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826287.625426:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563619840 00000100:00100000:1.0:1787826287.625438:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563619840 00010000:00010000:1.0:1787826287.625534:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000502c9f50/0x22153cd396b7f0c8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xde:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaffea expref: 12 pid: 30695 timeout: 1333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826287.625648:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 892 00000100:00100000:1.0:1787826287.625662:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8fbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563619840:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826287.625683:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826287.625716:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000502c9f50/0x22153cd396b7f0c8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xde:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaffea expref: 12 pid: 30695 timeout: 1333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826287.625732:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000502c9f50/0x22153cd396b7f0c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xde:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaffea expref: 12 pid: 30695 timeout: 1333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826287.625770:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000502c9f50/0x22153cd396b7f0c8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xde:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aaffea expref: 12 pid: 30695 timeout: 1333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826287.625791:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xde:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826287.625796:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xde:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826287.625803:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003b410ed4/0x22153cd396b7f1a1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xde:0x0].0x0 rrc: 3 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 30175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826287.625816:0:10341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b410ed4/0x22153cd396b7f1a1 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0xde:0x0].0x0 rrc: 3 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 30175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826287.625856:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826287.625932:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8fbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2403:x1874670563619840:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 273us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826287.625942:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 892 00010000:00010000:0.0:1787826287.626186:0:30175:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003b410ed4/0x22153cd396b7f1a1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xde:0x0].0x0 rrc: 2 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826287.626200:0:30175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b410ed4/0x22153cd396b7f1a1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xde:0x0].0x0 rrc: 2 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826287.632891:0:30188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000d8c8998/0x22153cd396b7f19a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xdd:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826287.632918:0:30188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d8c8998/0x22153cd396b7f19a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xdd:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826287.632929:0:30188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d8c8998/0x22153cd396b7f19a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xdd:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826287.632938:0:30188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0a70e400 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826287.632944:0:30188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d8c8998/0x22153cd396b7f19a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xdd:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826287.632954:0:30188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d8c8998/0x22153cd396b7f19a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xdd:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826287.632978:0:30188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d8c8998/0x22153cd396b7f19a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xdd:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826287.632987:0:30188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d8c8998/0x22153cd396b7f19a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xdd:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826287.633108:0:30188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1366a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563619456:12345-192.168.203.39@tcp:3:lfs.0 Request processed in 47818us (52988us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1787826287.633121:0:30188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 636 00010000:00010000:0.0:1787826287.665284:0:30175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003b410ed4/0x22153cd396b7f1a1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xde:0x0].0x0 rrc: 2 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826287.665313:0:30175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b410ed4/0x22153cd396b7f1a1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xde:0x0].0x0 rrc: 2 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826287.665324:0:30175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b410ed4/0x22153cd396b7f1a1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xde:0x0].0x0 rrc: 2 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826287.665332:0:30175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce026ae400 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826287.665337:0:30175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b410ed4/0x22153cd396b7f1a1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xde:0x0].0x0 rrc: 2 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826287.665349:0:30175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b410ed4/0x22153cd396b7f1a1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xde:0x0].0x0 rrc: 2 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826287.665387:0:30175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b410ed4/0x22153cd396b7f1a1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xde:0x0].0x0 rrc: 2 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826287.665396:0:30175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b410ed4/0x22153cd396b7f1a1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xde:0x0].0x0 rrc: 2 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826287.665627:0:30175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1366ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2404:x1874670563619584:12345-192.168.203.39@tcp:3:lfs.0 Request processed in 63459us (82878us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1787826287.665640:0:30175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 637 00000100:00100000:3.0:1787826287.677088:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826287.677150:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826287.677259:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563619968 00000100:00100000:1.0:1787826287.677270:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563619968 00000100:00100000:1.0:1787826287.677326:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563620096 00000100:00100000:1.0:1787826287.677329:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563620096 00000100:00100000:1.0:1787826287.677359:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1648 00000100:00100000:1.0:1787826287.677369:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670563619968:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826287.677387:0:14864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826287.677407:0:14864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021508201/0x22153cd396b7f1a8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xdd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0030 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826287.677433:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xdd:0x0] initial LVB size: 1048576, mtime: 0x6a90106f, atime: 0x0, ctime: 0x6a90106f, blocks: 0x800 00010000:00010000:1.0:1787826287.677453:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdd:0x0].0x0 since=1233s v=(0 0) 00010000:00010000:1.0:1787826287.677457:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826287.677467:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021508201/0x22153cd396b7f1a8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0030 expref: 10 pid: 14864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826287.677514:0:14864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000021508201/0x22153cd396b7f1a8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0030 expref: 10 pid: 14864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826287.677533:0:14864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf01518e00, rc 0) 00000100:00100000:1.0:1787826287.677578:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670563619968:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 211us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826287.677584:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1648 00000100:00100000:1.0:1787826287.677600:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1649 00000100:00100000:1.0:1787826287.677605:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8761c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670563620096:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826287.677611:0:14864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826287.677619:0:14864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000723be610/0x22153cd396b7f1af lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xde:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0037 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826287.677629:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xde:0x0] initial LVB size: 3145728, mtime: 0x6a90106f, atime: 0x0, ctime: 0x6a90106f, blocks: 0x1000 00010000:00010000:1.0:1787826287.677637:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xde:0x0].0x0 since=1233s v=(0 0) 00010000:00010000:1.0:1787826287.677640:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xde:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826287.677645:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000723be610/0x22153cd396b7f1af lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0037 expref: 10 pid: 14864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826287.677655:0:14864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000723be610/0x22153cd396b7f1af lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0037 expref: 10 pid: 14864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826287.677663:0:14864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf01519e00, rc 0) 00000100:00100000:1.0:1787826287.677689:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8761c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670563620096:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 84us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826287.677695:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1649 00000100:00100000:0.0:1787826287.785152:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563620224 00000100:00100000:0.0:1787826287.785166:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563620224 00000100:00100000:0.0:1787826287.786159:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3216 00000100:00100000:0.0:1787826287.786180:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8fa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:49850:x1874670563620224:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:0.0:1787826287.786410:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70ea00/0x22153cd396b7f1b6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826287.786654:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70ea00/0x22153cd396b7f1b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826287.786672:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70ea00/0x22153cd396b7f1b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826287.786693:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70e600/0x22153cd396b7f1bd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826287.786701:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70e600/0x22153cd396b7f1bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826287.786708:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70e600/0x22153cd396b7f1bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826287.786799:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70ee00/0x22153cd396b7f1c4 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826287.786808:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70ee00/0x22153cd396b7f1c4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826287.786815:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70ee00/0x22153cd396b7f1c4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826287.786864:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x9:0x0]: returning size 3145728 00000004:00200000:0.0:1787826287.786869:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826287.786885:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70ee00/0x22153cd396b7f1c4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826287.786898:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70ea00/0x22153cd396b7f1b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826287.786905:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70ea00/0x22153cd396b7f1b6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826287.786913:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70ea00/0x22153cd396b7f1b6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826287.786919:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0a70ea00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826287.786924:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70ea00/0x22153cd396b7f1b6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826287.786932:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70ea00/0x22153cd396b7f1b6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826287.786946:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cf39656000) 00010000:00010000:0.0:1787826287.786949:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826287.786954:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70ea00/0x22153cd396b7f1b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826287.786960:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70ea00/0x22153cd396b7f1b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826287.786975:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70e600/0x22153cd396b7f1bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826287.786981:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70e600/0x22153cd396b7f1bd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826287.786992:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70e600/0x22153cd396b7f1bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826287.786997:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0a70e600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826287.786999:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70e600/0x22153cd396b7f1bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826287.787005:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70e600/0x22153cd396b7f1bd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826287.787012:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x995b1268 (ffff90cf39656500) 00010000:00010000:0.0:1787826287.787014:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826287.787017:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70e600/0x22153cd396b7f1bd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826287.787022:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70e600/0x22153cd396b7f1bd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826287.787039:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70ee00/0x22153cd396b7f1c4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826287.787045:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70ee00/0x22153cd396b7f1c4 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826287.787052:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70ee00/0x22153cd396b7f1c4 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826287.787058:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0a70ee00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826287.787060:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70ee00/0x22153cd396b7f1c4 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826287.788705:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70ee00/0x22153cd396b7f1c4 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826287.788726:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff90cf06894500) 00010000:00010000:0.0:1787826287.788730:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826287.788735:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70ee00/0x22153cd396b7f1c4 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826287.788744:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70ee00/0x22153cd396b7f1c4 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826287.788879:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8fa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:49850:x1874670563620224:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 2701us (3876us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826287.788889:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3216 00000100:00100000:1.0:1787826287.877034:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f875680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585116544:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826287.877113:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826287.877429:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585116544 00000100:00100000:3.0:1787826287.877438:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585116544 00000100:00100000:3.0:1787826287.877904:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1277 00000100:00100000:3.0:1787826287.877915:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab90b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3647:x1874670585116544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787826287.877950:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445888000 avail 1299648512 00000100:00100000:3.0:1787826287.880175:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab90b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3647:x1874670585116544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2254us (3053us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826287.880196:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1277 00010000:00010000:3.0:1787826287.941188:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826288.899735:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787826288.899768:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03739680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585116672:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826288.899835:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826288.900080:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce04f070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e3c550b8-2c3c-46c3-ad36-671c284167ea:3645:1874670585116800:0@lo:400:kworker.0 00000100:00100000:3.0:1787826288.900099:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585116672 00000100:00100000:3.0:1787826288.900108:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585116672 00000100:00100000:0.0:1787826288.900122:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826288.900156:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1278 00000100:00100000:3.0:1787826288.900166:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1366a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874670585116672:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787826288.900168:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585116928 00000100:00100000:1.0:1787826288.900174:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585116928 00000004:00000024:3.0:1787826288.900200:0:7796:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446178816 avail 1299939328 00000100:00100000:1.0:1787826288.900213:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1423 00000100:00100000:1.0:1787826288.900222:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f04b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874670585116928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826288.905188:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585116800 00000100:00100000:3.0:1787826288.905190:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1366a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874670585116672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 5022us (5351us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826288.905196:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585116800 00000100:00100000:3.0:1787826288.905203:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1278 00000100:00100000:3.0:1787826288.905239:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585117056 00000100:00100000:0.0:1787826288.905247:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 863 00000100:00100000:0.0:1787826288.905259:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf185c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3c550b8-2c3c-46c3-ad36-671c284167ea+24:3645:x1874670585116800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826288.905353:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585117056 00000100:00100000:3.0:1787826288.905378:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1279 00000100:00100000:3.0:1787826288.905384:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3647:x1874670585117056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826288.912137:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf185c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3c550b8-2c3c-46c3-ad36-671c284167ea+24:3645:x1874670585116800:12345-0@lo:400:kworker.0 Request processed in 6878us (12010us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826288.912149:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 863 00000100:00100000:0.0:1787826288.912793:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce04f070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e3c550b8-2c3c-46c3-ad36-671c284167ea:3645:1874670585116800:0@lo:400:kworker.0 00000100:00100000:0.0:1787826288.912810:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1428 00000100:00100000:0.0:1787826288.912819:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce058bd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874670585117824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826288.912856:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce058bd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874670585117824:12345-0@lo:400:kworker.0 Request processed in 39us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826288.912863:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1428 00000100:00100000:0.0:1787826288.912885:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585117696 00000100:00100000:0.0:1787826288.912890:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585117696 00000100:00100000:0.0:1787826288.912921:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585117312 00000100:00100000:0.0:1787826288.912925:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585117312 00000100:00100000:1.0:1787826288.912930:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 820 00000100:00100000:1.0:1787826288.912942:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf07967840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3644:x1874670585117696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826288.912978:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf07967840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3644:x1874670585117696:12345-0@lo:400:kworker.0 Request processed in 41us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826288.913088:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 821 00000100:00100000:0.0:1787826288.913097:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874670585117312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826288.913129:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874670585117312:12345-0@lo:400:kworker.0 Request processed in 34us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826288.914872:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3647:x1874670585117056:12345-0@lo:400:kworker.0 Request processed in 9482us (11803us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826288.914883:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1279 00000100:00100000:3.0:1787826288.914933:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0373d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585117056:0@lo:400:kworker.0 00000100:00100000:1.0:1787826288.921160:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 820 00000100:00100000:1.0:1787826288.921283:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f04b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874670585116928:12345-0@lo:400:kworker.0 Request processed in 21059us (21249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826288.921294:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1423 00000100:00100000:1.0:1787826288.921345:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce04f05680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874670585116928:0@lo:400:kworker.0 00000100:00100000:1.0:1787826288.921510:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03739680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585116672:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826288.930083:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 821 00010000:00010000:1.0:1787826288.968156:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787826289.943373:0:26205:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836882 is committed 00000001:00080000:3.0:1787826289.943398:0:26205:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836880 is committed 00010000:00010000:1.0:1787826289.989700:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826290.435738:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787826290.435761:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce058bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585118336:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787826290.435863:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826290.436982:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585118592 00000100:00100000:0.0:1787826290.436988:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585118592 00000100:00100000:0.0:1787826290.437037:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 692 00000100:00100000:0.0:1787826290.437044:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce058bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874670585118592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787826290.437067:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 36077248 pending 0 free 3917189120 avail 3685666816 00000100:00100000:0.0:1787826290.437103:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce058bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874670585118592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826290.437108:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 692 00000100:00100000:0.0:1787826290.437135:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836882 gen 2 00000004:00080000:0.0:1787826290.437140:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3f807840, transno 21474836858 00000004:00080000:0.0:1787826290.437153:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce0b432940, transno 21474836861 00000004:00080000:0.0:1787826290.437156:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce0b4303c0, transno 21474836862 00000004:00080000:0.0:1787826290.437159:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf2f45f480, transno 21474836865 00000004:00080000:0.0:1787826290.437162:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf2f45c000, transno 21474836866 00000004:00080000:0.0:1787826290.437164:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce03a1ad00, transno 21474836869 00000004:00080000:0.0:1787826290.437167:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce03a1a940, transno 21474836870 00000004:00080000:0.0:1787826290.437169:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce03a183c0, transno 21474836871 00000004:00080000:0.0:1787826290.437171:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce03a18000, transno 21474836872 00000004:00080000:0.0:1787826290.437174:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3f824000, transno 21474836877 00000004:00080000:0.0:1787826290.437176:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3f827840, transno 21474836878 00000004:00080000:0.0:1787826290.437179:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce049bb0c0, transno 21474836881 00000004:00080000:0.0:1787826290.437181:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce049ba580, transno 21474836882 00000100:00100000:0.0:1787826290.437189:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf13668780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585118592:0@lo:13:osp-pre-0-0.0 00000004:00080000:0.0:1787826290.437354:0:8543:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 13 done 00000100:00100000:3.0:1787826290.438258:0:25628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585118720 00000100:00100000:3.0:1787826290.438264:0:25628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585118720 00000100:00100000:3.0:1787826290.438306:0:25628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 693 00000100:00100000:3.0:1787826290.438313:0:25628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce058bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3644:x1874670585118720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787826290.438328:0:25628:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52895424 pending 0 free 3919290368 avail 3687768064 00000100:00100000:3.0:1787826290.438365:0:25628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce058bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3644:x1874670585118720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826290.438371:0:25628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 693 00000100:00100000:0.0:1787826290.834993:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826290.835112:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00080000:3.0:1787826290.836380:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787826290.836537:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563620352 00000100:00100000:1.0:1787826290.836543:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563620352 00000100:00100000:1.0:1787826290.836585:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 864 00000100:00100000:1.0:1787826290.836593:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf185cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:307626ff-a376-4faf-93e0-9f55b723d964+10:2401:x1874670563620352:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1787826290.836632:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf185cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:307626ff-a376-4faf-93e0-9f55b723d964+10:2401:x1874670563620352:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 40us (1649us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826290.836638:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 864 00000100:00100000:0.0:1787826290.836986:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826290.837110:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826290.837178:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563620608 00000100:00100000:1.0:1787826290.837182:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563620608 00000100:00100000:1.0:1787826290.837228:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1430 00000100:00100000:1.0:1787826290.837235:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a1ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:2401:x1874670563620608:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1787826290.837273:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a1ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:2401:x1874670563620608:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 40us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826290.837280:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1430 00000100:00080000:0.0:1787826290.837354:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787826290.838015:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826290.841435:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00080000:0.0:1787826290.841953:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787826291.011890:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826292.002305:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826292.003049:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563621120 00000100:00100000:0.0:1787826292.003059:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563621120 00000100:00100000:0.0:1787826292.003210:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 956 00000100:00100000:0.0:1787826292.003221:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03739a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:50274:x1874670563621120:12345-192.168.203.39@tcp:35:rm.0 00000100:00100000:0.0:1787826292.003536:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03739a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:50274:x1874670563621120:12345-192.168.203.39@tcp:35:rm.0 Request processed in 316us (1239us total) trans 4294969285 rc 0/0 00000100:00100000:0.0:1787826292.003544:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 956 00000100:00080000:3.0:1787826292.007150:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787826292.018812:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00010000:00010000:3.0:1787826292.021641:0:7460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826292.021649:0:7460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426800/0x22153cd396b7f1e0 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826292.021657:0:7460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce02426800 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826292.021660:0:7460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426800/0x22153cd396b7f1e0 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826292.021667:0:7460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426800/0x22153cd396b7f1e0 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826292.021679:0:7460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff90cf1859a700) 00010000:00010000:3.0:1787826292.021681:0:7460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787826292.021684:0:7460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426800/0x22153cd396b7f1e0 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826292.021690:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426800/0x22153cd396b7f1e0 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826292.021706:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826292.021707:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826292.021709:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826292.035967:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787826292.745459:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969286 is committed 00000004:00080000:1.0:1787826292.745491:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 239 committed 00010000:00010000:3.0:1787826292.745605:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427c00/0x22153cd396b7f1d2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826292.745616:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427c00/0x22153cd396b7f1d2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826292.745624:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427c00/0x22153cd396b7f1d2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826292.745630:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce02427c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826292.745635:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427c00/0x22153cd396b7f1d2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826292.745642:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427c00/0x22153cd396b7f1d2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826292.745663:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x995b1268 (ffff90cf1859a300) 00010000:00010000:3.0:1787826292.745666:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826292.745670:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427c00/0x22153cd396b7f1d2 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826292.745676:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427c00/0x22153cd396b7f1d2 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826292.747680:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000004:00080000:1.0:1787826292.748300:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 248 committed 00000100:00100000:3.0:1787826292.748406:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce04f070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585118976:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787826292.748488:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826292.748554:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585118976 00000100:00100000:3.0:1787826292.748560:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585118976 00000100:00100000:3.0:1787826292.748608:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1650 00000100:00100000:3.0:1787826292.748618:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8743c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3646:x1874670585118976:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787826292.748642:0:30398:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:209 count 1 00010000:00010000:3.0:1787826292.748666:0:30398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009a032ff/0x22153cd396b7f1e7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826292.748686:0:30398:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004e0f9a77/0x22153cd396b7f177 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab001b expref: 8 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826292.748696:0:30398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd1:0x0].0x0 since=5s v=(0 0) 00000100:00080000:1.0:1787826292.748697:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787826292.748700:0:30398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826292.748705:0:30398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009a032ff/0x22153cd396b7f1e7 lrc: 4/0,1 mode: --/PW res: [0x280000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826292.748730:0:30398:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004e0f9a77/0x22153cd396b7f177 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000000010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab001b expref: 8 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826292.748744:0:30398:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004e0f9a77/0x22153cd396b7f177 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x70000400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab001b expref: 8 pid: 8435 timeout: 1338 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826292.748768:0:30398:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f876940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:30398:1874670585119104:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826292.748835:0:30398:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce04aa5300 going to sleep for 11 seconds 00000100:00100000:0.0:1787826292.750147:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf136d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585118848:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787826292.750202:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787826292.751567:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826292.754245:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00080000:1.0:1787826292.755863:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787826292.760911:0:30398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e0f9a77/0x22153cd396b7f177 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab001b expref: 8 pid: 8435 timeout: 1338 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826292.760936:0:30398:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f876940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:30398:1874670585119104:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826292.760961:0:30398:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000009a032ff/0x22153cd396b7f1e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826292.760973:0:30398:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000009a032ff/0x22153cd396b7f1e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826292.760981:0:30398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009a032ff/0x22153cd396b7f1e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826292.760993:0:30398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009a032ff/0x22153cd396b7f1e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826292.761005:0:30398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000009a032ff/0x22153cd396b7f1e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826292.761060:0:30398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826292.761104:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826292.761112:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000009a032ff/0x22153cd396b7f1e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826292.761119:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3abd6800 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826292.761123:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000009a032ff/0x22153cd396b7f1e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826292.761132:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000009a032ff/0x22153cd396b7f1e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826292.761155:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000009a032ff/0x22153cd396b7f1e7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826292.761163:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009a032ff/0x22153cd396b7f1e7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826292.761180:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826292.761182:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826292.761184:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826292.761410:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8743c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3646:x1874670585118976:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12792us (12920us total) trans 21474836883 rc 0/0 00000100:00100000:3.0:1787826292.761420:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1650 00000100:00100000:1.0:1787826292.774566:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826292.776253:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563621632 00000100:00100000:0.0:1787826292.776265:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563621632 00010000:00010000:0.0:1787826292.776401:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000021508201/0x22153cd396b7f1a8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xdd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0030 expref: 10 pid: 14864 timeout: 1338 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826292.776457:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 894 00000100:00100000:0.0:1787826292.776468:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563621632:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826292.776504:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826292.776511:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000021508201/0x22153cd396b7f1a8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xdd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0030 expref: 10 pid: 14864 timeout: 1338 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826292.776525:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000021508201/0x22153cd396b7f1a8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xdd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0030 expref: 10 pid: 14864 timeout: 1338 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826292.776549:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021508201/0x22153cd396b7f1a8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xdd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0030 expref: 10 pid: 14864 timeout: 1338 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826292.776568:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826292.776573:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826292.776579:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000882c280d/0x22153cd396b7f1ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826292.776588:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000882c280d/0x22153cd396b7f1ee lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0xdd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826292.776625:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826292.776689:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563621632:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 223us (2133us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826292.776697:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 894 00000100:00080000:1.0:1787826292.777307:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787826292.777396:0:30696:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000882c280d/0x22153cd396b7f1ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826292.777410:0:30696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000882c280d/0x22153cd396b7f1ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826292.777421:0:30696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000882c280d/0x22153cd396b7f1ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826292.777429:0:30696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000882c280d/0x22153cd396b7f1ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826292.777457:0:30696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787826292.777779:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a183c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3644:x1874670585118848:12345-0@lo:6:osp-syn-1-0.0 Request processed in 27327us (27573us total) trans 17179869560 rc 0/0 00000100:00100000:3.0:1787826292.777787:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1651 00010000:00010000:0.0:1787826292.778336:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826292.778344:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000882c280d/0x22153cd396b7f1ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826292.778360:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce02426200 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826292.778365:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000882c280d/0x22153cd396b7f1ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826292.778375:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000882c280d/0x22153cd396b7f1ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826292.778392:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000882c280d/0x22153cd396b7f1ee lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826292.778400:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000882c280d/0x22153cd396b7f1ee lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826292.778423:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826292.778425:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826292.778427:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787826292.784740:0:27651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179869560 is committed 00000001:00080000:0.0:1787826292.784775:0:27651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179869557 is committed 00000100:00100000:0.0:1787826292.996647:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787826292.996670:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f876940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585119360:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826292.996775:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826292.996948:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585119360 00000100:00100000:3.0:1787826292.996955:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585119360 00000100:00100000:3.0:1787826292.997005:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1280 00000100:00100000:3.0:1787826292.997015:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1874670585119360:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787826292.997058:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445888000 avail 1299648512 00000100:00100000:3.0:1787826292.997112:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1874670585119360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826292.997119:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1280 00000100:00100000:0.0:1787826293.006754:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f876940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585119360:0@lo:41:osp-pre-0-1.0 00000001:02000400:1.0:1787826293.675568:0:33764:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 49a: FIEMAP upon FLR file ============= 06:24:52 (1787826292) 00000100:00100000:0.0:1787826293.807642:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826293.807708:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563621760 00000100:00100000:1.0:1787826293.807719:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563621760 00000100:00100000:1.0:1787826293.807793:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3218 00000100:00100000:1.0:1787826293.807804:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a1a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:50426:x1874670563621760:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826293.807837:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826293.807857:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519600/0x22153cd396b7f1f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab003e expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.807939:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518600/0x22153cd396b7f1fc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.807955:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518600/0x22153cd396b7f1fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.807966:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518600/0x22153cd396b7f1fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826293.808010:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787826293.808014:0:8247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826293.808372:0:8247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518600/0x22153cd396b7f1fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.808398:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519600/0x22153cd396b7f1f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab003e expref: 17 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.808417:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518600/0x22153cd396b7f1fc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab003e expref: 16 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.808426:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cf39656000) 00010000:00010000:1.0:1787826293.808429:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787826293.808432:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf01518600, rc 0) 00000100:00100000:1.0:1787826293.808547:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a1a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:50426:x1874670563621760:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 744us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826293.808556:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3218 00000100:00100000:0.0:1787826293.817984:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826293.818572:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563621888 00000100:00100000:1.0:1787826293.818592:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563621888 00000100:00100000:1.0:1787826293.818650:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3219 00000100:00100000:1.0:1787826293.818662:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f825a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:50426:x1874670563621888:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826293.818683:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826293.818705:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519600/0x22153cd396b7f203 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0045 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.818797:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519c00/0x22153cd396b7f20a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.818812:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519c00/0x22153cd396b7f20a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.818832:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519c00/0x22153cd396b7f20a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.818897:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518200/0x22153cd396b7f211 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.818906:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518200/0x22153cd396b7f211 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.818913:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518200/0x22153cd396b7f211 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.818956:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519c00/0x22153cd396b7f20a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.818964:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519c00/0x22153cd396b7f20a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.818970:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519c00/0x22153cd396b7f20a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.818977:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf01519c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826293.818981:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519c00/0x22153cd396b7f20a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.818993:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519c00/0x22153cd396b7f20a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.819006:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cf39656000) 00010000:00010000:1.0:1787826293.819009:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826293.819014:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519c00/0x22153cd396b7f20a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.819021:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519c00/0x22153cd396b7f20a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.819043:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518200/0x22153cd396b7f211 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.819050:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518200/0x22153cd396b7f211 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.819055:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518200/0x22153cd396b7f211 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.819061:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf01518200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826293.819064:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518200/0x22153cd396b7f211 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.819070:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518200/0x22153cd396b7f211 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.819078:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xcdb08acc (ffff90cf06894d00) 00010000:00010000:1.0:1787826293.819081:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826293.819084:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518200/0x22153cd396b7f211 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.819093:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518200/0x22153cd396b7f211 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.819129:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519600/0x22153cd396b7f203 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0045 expref: 17 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.819139:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cf39656000) 00010000:00010000:1.0:1787826293.819141:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826293.819145:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519600/0x22153cd396b7f203 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0045 expref: 17 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.819154:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf01519600, rc 0) 00000100:00100000:1.0:1787826293.819217:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f825a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:50426:x1874670563621888:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 558us (1242us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826293.819225:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3219 00000100:00100000:1.0:1787826293.829110:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826293.829196:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563622144 00000100:00100000:3.0:1787826293.829206:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563622144 00000100:00100000:3.0:1787826293.829273:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3220 00000100:00100000:3.0:1787826293.829286:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:50426:x1874670563622144:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826293.829307:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826293.829311:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787826293.829341:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518600/0x22153cd396b7f1fc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab003e expref: 16 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826293.829359:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cf39656000) 00010000:00010000:3.0:1787826293.829366:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826293.829379:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6c00/0x22153cd396b7f218 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab004c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826293.829544:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7200/0x22153cd396b7f21f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826293.829556:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7200/0x22153cd396b7f21f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826293.829566:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7200/0x22153cd396b7f21f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826293.829661:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7600/0x22153cd396b7f226 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826293.829671:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7600/0x22153cd396b7f226 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826293.829679:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7600/0x22153cd396b7f226 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826293.830138:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6400/0x22153cd396b7f22d lrc: 3/1,0 mode: --/PR res: [0x200000405:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826293.830148:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6400/0x22153cd396b7f22d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826293.830156:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6400/0x22153cd396b7f22d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826293.830165:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0xc:0x0]: returning size 0 00010000:00010000:3.0:1787826293.830190:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7200/0x22153cd396b7f21f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826293.830197:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7200/0x22153cd396b7f21f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826293.830204:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7200/0x22153cd396b7f21f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826293.830211:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7200/0x22153cd396b7f21f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826293.830217:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3abd7200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826293.830221:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7200/0x22153cd396b7f21f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826293.830228:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7200/0x22153cd396b7f21f lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826293.830241:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cf39656000) 00010000:00010000:3.0:1787826293.830244:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826293.830247:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7200/0x22153cd396b7f21f lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826293.830253:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7200/0x22153cd396b7f21f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826293.830263:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000020f95fde reply state 00000000578ca728 transno 4294969287 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7600/0x22153cd396b7f226 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826293.830273:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7600/0x22153cd396b7f226 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826293.830278:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xcdb08acc (ffff90cf0bd50f00) 00010000:00010000:3.0:1787826293.830280:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826293.830283:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787826293.830310:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6c00/0x22153cd396b7f218 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab004c expref: 18 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826293.830322:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6400/0x22153cd396b7f22d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab004c expref: 17 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826293.830329:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xc:0x0].0x0 (ffff90cf0bd50500) 00010000:00010000:3.0:1787826293.830331:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826293.830333:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3abd6400, rc 0) 00000100:00100000:3.0:1787826293.830397:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+18:50426:x1874670563622144:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1115us (1298us total) trans 4294969287 rc 0/0 00000100:00100000:3.0:1787826293.830404:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3220 00000100:00100000:0.0:1787826293.833587:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826293.833662:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563622400 00000100:00100000:1.0:1787826293.833672:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563622400 00000100:00100000:1.0:1787826293.833729:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3221 00000100:00100000:1.0:1787826293.833740:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf39608c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+18:50426:x1874670563622400:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826293.833766:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826293.833787:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519600/0x22153cd396b7f23b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0053 expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.833906:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518200/0x22153cd396b7f242 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.833925:0:32404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6400/0x22153cd396b7f22d lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab004c expref: 19 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.833934:0:32404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518200/0x22153cd396b7f242 lrc: 4/0,1 mode: --/EX res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.833968:0:32404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6400/0x22153cd396b7f22d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab004c expref: 19 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.833982:0:32404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6400/0x22153cd396b7f22d lrc: 4/0,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab004c expref: 19 pid: 6519 timeout: 1339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826293.833996:0:32404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a9ada40 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:32404:1874670585119488:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826293.834101:0:32404:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068bd840 going to sleep for 11 seconds 00000100:00100000:0.0:1787826293.845864:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826293.846632:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563622528 00000100:00100000:3.0:1787826293.846642:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563622528 00010000:00010000:3.0:1787826293.846686:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6400/0x22153cd396b7f22d lrc: 4/0,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab004c expref: 20 pid: 6519 timeout: 1339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826293.846729:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 895 00000100:00100000:3.0:1787826293.846739:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf181fd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:2401:x1874670563622528:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826293.846755:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826293.846762:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6400/0x22153cd396b7f22d lrc: 4/0,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab004c expref: 20 pid: 6519 timeout: 1339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826293.846774:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6400/0x22153cd396b7f22d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab004c expref: 20 pid: 6519 timeout: 1339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826293.846808:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6400/0x22153cd396b7f22d lrc: 0/0,0 mode: --/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab004c expref: 20 pid: 6519 timeout: 1339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826293.846824:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xc:0x0].0x0 (ffff90cf0bd50500) 00010000:00010000:3.0:1787826293.846830:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518200/0x22153cd396b7f242 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826293.846839:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518200/0x22153cd396b7f242 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826293.846847:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518200/0x22153cd396b7f242 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826293.846877:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826293.846929:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf181fd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:2401:x1874670563622528:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 191us (1075us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826293.846936:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 895 00010000:00010000:0.0:1787826293.847190:0:32404:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518200/0x22153cd396b7f242 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826293.847199:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518200/0x22153cd396b7f242 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826293.847226:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0xc:0x0]: returning size 0 00000004:00080000:0.0:1787826293.847390:0:32404:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xdf:0x0], index 1: 0 00000004:00080000:0.0:1787826293.847400:0:32404:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xd3:0x0], index 0: 0 00010000:00010000:0.0:1787826293.847537:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518200/0x22153cd396b7f242 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826293.847545:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518200/0x22153cd396b7f242 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826293.847552:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518200/0x22153cd396b7f242 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826293.847558:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf01518200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826293.847562:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518200/0x22153cd396b7f242 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826293.847570:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518200/0x22153cd396b7f242 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826293.847579:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xc:0x0].0x0 (ffff90cf0bd50500) 00010000:00010000:0.0:1787826293.847582:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826293.847586:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518200/0x22153cd396b7f242 lrc: 2/0,0 mode: --/EX res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826293.847592:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518200/0x22153cd396b7f242 lrc: 0/0,0 mode: --/EX res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826293.847653:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519600/0x22153cd396b7f23b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0053 expref: 19 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826293.847665:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cf39656000) 00010000:00010000:0.0:1787826293.847667:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787826293.847671:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519600/0x22153cd396b7f23b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0053 expref: 19 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826293.847681:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf01519600, rc 0) 00000100:00100000:0.0:1787826293.847717:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf39608c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+18:50426:x1874670563622400:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 13979us (14140us total) trans 4294969288 rc 301/301 00000100:00100000:0.0:1787826293.847726:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3221 00000100:00100000:3.0:1787826293.859527:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826293.923268:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826293.923383:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563623168 00000100:00100000:1.0:1787826293.923393:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563623168 00000100:00100000:1.0:1787826293.923451:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3222 00000100:00100000:1.0:1787826293.923461:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f826580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:50434:x1874670563623168:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:1.0:1787826293.923507:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826293.923539:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518400/0x22153cd396b7f250 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab005a expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.923627:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518e00/0x22153cd396b7f257 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.923642:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518e00/0x22153cd396b7f257 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.923658:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518e00/0x22153cd396b7f257 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826293.923701:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787826293.923704:0:8247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826293.923723:0:8247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518e00/0x22153cd396b7f257 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.923746:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518400/0x22153cd396b7f250 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab005a expref: 22 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.923764:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518e00/0x22153cd396b7f257 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab005a expref: 21 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.923773:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cf39656000) 00010000:00010000:1.0:1787826293.923775:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787826293.923779:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf01518e00, rc 0) 00000100:00100000:1.0:1787826293.923841:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f826580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:50434:x1874670563623168:12345-192.168.203.39@tcp:101:dd.0 Request processed in 380us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826293.923849:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3222 00000100:00100000:3.0:1787826293.927974:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826293.928047:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563623424 00000100:00100000:1.0:1787826293.928056:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563623424 00000100:00100000:1.0:1787826293.928120:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3223 00000100:00100000:1.0:1787826293.928133:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f877840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:50434:x1874670563623424:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:1.0:1787826293.928155:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826293.928160:0:16564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787826293.928186:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518e00/0x22153cd396b7f257 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab005a expref: 21 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.928204:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cf39656000) 00010000:00010000:1.0:1787826293.928209:0:16564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826293.928220:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519600/0x22153cd396b7f25e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0061 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.928361:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518200/0x22153cd396b7f265 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.928375:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518200/0x22153cd396b7f265 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.928389:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518200/0x22153cd396b7f265 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.928403:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519c00/0x22153cd396b7f26c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.928410:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519c00/0x22153cd396b7f26c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.928417:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519c00/0x22153cd396b7f26c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.928509:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518600/0x22153cd396b7f273 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.928517:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518600/0x22153cd396b7f273 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.928524:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518600/0x22153cd396b7f273 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826293.928698:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0xc:0x0]: returning size 0 00010000:00010000:1.0:1787826293.928781:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518200/0x22153cd396b7f265 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.928788:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518200/0x22153cd396b7f265 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.928794:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518200/0x22153cd396b7f265 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.928800:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf01518200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826293.928804:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518200/0x22153cd396b7f265 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.928812:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518200/0x22153cd396b7f265 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.928821:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cf39656000) 00010000:00010000:1.0:1787826293.928823:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826293.928827:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518200/0x22153cd396b7f265 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.928832:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518200/0x22153cd396b7f265 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.928842:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519c00/0x22153cd396b7f26c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.928849:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519c00/0x22153cd396b7f26c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.928858:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519c00/0x22153cd396b7f26c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.928862:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf01519c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826293.928865:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519c00/0x22153cd396b7f26c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.928871:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519c00/0x22153cd396b7f26c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.928878:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xcdb08acc (ffff90cf0bd50f00) 00010000:00010000:1.0:1787826293.928881:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826293.928884:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519c00/0x22153cd396b7f26c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.928890:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519c00/0x22153cd396b7f26c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.929064:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519600/0x22153cd396b7f25e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0061 expref: 23 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.929076:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518600/0x22153cd396b7f273 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0061 expref: 22 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.929083:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xc:0x0].0x0 (ffff90cf06894d00) 00010000:00010000:1.0:1787826293.929085:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826293.929087:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf01518600, rc 0) 00000100:00100000:1.0:1787826293.929150:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f877840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:50434:x1874670563623424:12345-192.168.203.39@tcp:101:dd.0 Request processed in 1021us (1185us total) trans 4294969291 rc 0/0 00000100:00100000:1.0:1787826293.929161:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3223 00000100:00100000:1.0:1787826293.935528:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563623552 00000100:00100000:1.0:1787826293.935538:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563623552 00000100:00100000:1.0:1787826293.935588:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3224 00000100:00100000:1.0:1787826293.935596:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136d7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:50434:x1874670563623552:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:1.0:1787826293.935619:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826293.935639:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518400/0x22153cd396b7f281 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0068 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.935676:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a838800/0x22153cd396b7f288 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.935688:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a838800/0x22153cd396b7f288 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.935699:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a838800/0x22153cd396b7f288 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.935812:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518400/0x22153cd396b7f281 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0068 expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.935829:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a838800/0x22153cd396b7f288 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0068 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.935837:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xc:0x0].0x0 (ffff90cf06894d00) 00010000:00010000:1.0:1787826293.935840:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787826293.935843:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a838800, rc 0) 00000100:00100000:1.0:1787826293.935914:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136d7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+23:50434:x1874670563623552:12345-192.168.203.39@tcp:101:dd.0 Request processed in 310us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826293.935922:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3224 00000100:00100000:0.0:1787826293.949772:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826293.969288:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826293.969973:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563623936 00000100:00100000:1.0:1787826293.969983:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563623936 00000100:00100000:1.0:1787826293.970056:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3226 00000100:00100000:1.0:1787826293.970065:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:50434:x1874670563623936:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:1.0:1787826293.970089:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826293.970110:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839a00/0x22153cd396b7f296 lrc: 2/0,0 mode: --/CR res: [0x200000405:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab006f expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.970172:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839a00/0x22153cd396b7f296 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab006f expref: 26 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.970187:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839a00/0x22153cd396b7f296 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab006f expref: 26 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.970206:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xc:0x0].0x0 (ffff90cf06894d00) 00010000:00010000:1.0:1787826293.970210:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826293.970213:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a839a00, rc 0) 00000100:00100000:1.0:1787826293.970281:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:50434:x1874670563623936:12345-192.168.203.39@tcp:101:dd.0 Request processed in 217us (1130us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826293.970297:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3226 00000100:00100000:0.0:1787826293.974055:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826293.974240:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563624192 00000100:00100000:1.0:1787826293.974249:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563624192 00000100:00100000:1.0:1787826293.974310:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3227 00000100:00100000:1.0:1787826293.974318:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f827480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:50434:x1874670563624192:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:1.0:1787826293.974335:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826293.974339:0:16564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787826293.974364:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839a00/0x22153cd396b7f296 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab006f expref: 26 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.974383:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xc:0x0].0x0 (ffff90cf06894d00) 00010000:00010000:1.0:1787826293.974387:0:16564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826293.974399:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839200/0x22153cd396b7f29d lrc: 2/0,0 mode: --/EX res: [0x200000405:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0076 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.974464:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839800/0x22153cd396b7f2a4 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.974660:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839800/0x22153cd396b7f2a4 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0xc:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.974671:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839800/0x22153cd396b7f2a4 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0xc:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787826293.974872:0:16564:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].257, 88 off29648 00000004:00080000:1.0:1787826293.974879:0:16564:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1239986407390ns, next at 1239032062236ns, rc = 0 00000040:00080000:1.0:1787826293.974910:0:16564:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].265, 88 off30264 00000004:00080000:1.0:1787826293.974915:0:16564:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1239986443262ns, next at 1239031980041ns, rc = 0 00000001:00080000:1.0:1787826293.986733:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969294 is committed 00000004:00080000:1.0:1787826293.986757:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 249 committed 00000004:00080000:1.0:1787826293.986778:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 240 committed 00010000:00010000:1.0:1787826293.986874:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839800/0x22153cd396b7f2a4 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xc:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0076 expref: 20 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.986888:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xc:0x0].0x0 (ffff90cf06894d00) 00010000:00010000:1.0:1787826293.986891:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1787826293.986907:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839200/0x22153cd396b7f29d lrc: 0/0,0 mode: --/EX res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0076 expref: 20 pid: 16564 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.986925:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839800/0x22153cd396b7f2a4 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xc:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0076 expref: 19 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.986955:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xc:0x0].0x0 (ffff90cf06894d00) 00010000:00010000:1.0:1787826293.986957:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1787826293.986960:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a839800, rc 0) 00000100:00100000:1.0:1787826293.987045:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f827480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:50434:x1874670563624192:12345-192.168.203.39@tcp:101:dd.0 Request processed in 12724us (12996us total) trans 4294969294 rc 0/0 00000100:00100000:1.0:1787826293.987056:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3227 00000100:00100000:3.0:1787826293.987156:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f876d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585119744:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787826293.987243:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826293.987303:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787826293.987311:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f876580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585119616:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787826293.988719:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f826940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585119872:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787826293.988870:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826293.988917:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585119744 00000100:00100000:0.0:1787826293.988926:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585119744 00000100:00100000:3.0:1787826293.988987:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826293.989020:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787826293.989041:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f825a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585120000:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787826293.989088:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826293.989124:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585119616 00000100:00100000:3.0:1787826293.989131:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585119616 00000100:00100000:3.0:1787826293.989189:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585119872 00000100:00100000:3.0:1787826293.989192:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585119872 00000100:00100000:3.0:1787826293.989215:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585120000 00000100:00100000:3.0:1787826293.989218:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585120000 00000100:00100000:3.0:1787826293.989242:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1652 00000100:00100000:3.0:1787826293.989251:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f877480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3645:x1874670585119616:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787826293.989290:0:30694:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:222 count 1 00000100:00100000:0.0:1787826293.989786:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1654 00000100:00100000:0.0:1787826293.989794:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f877c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3646:x1874670585120000:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787826293.989974:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f877c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3646:x1874670585120000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 181us (884us total) trans 21474836884 rc 0/0 00000100:00100000:0.0:1787826293.989981:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1654 00000100:00100000:0.0:1787826293.989996:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1655 00000100:00100000:0.0:1787826293.990002:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f875e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1874670585119744:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787826293.990119:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f875e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3645:x1874670585119744:12345-0@lo:2:osp-syn-1-0.0 Request processed in 117us (2877us total) trans 17179869561 rc 0/0 00000100:00100000:0.0:1787826293.990126:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1655 00010000:00010000:3.0:1787826293.990525:0:30694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000086fb5c8/0x22153cd396b7f2ab lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xde:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826293.990558:0:30694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000723be610/0x22153cd396b7f1af lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xde:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0037 expref: 7 pid: 14864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826293.990573:0:30694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xde:0x0].0x0 since=6s v=(0 0) 00010000:00010000:3.0:1787826293.990578:0:30694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xde:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826293.990583:0:30694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000086fb5c8/0x22153cd396b7f2ab lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0xde:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826293.990634:0:30694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000723be610/0x22153cd396b7f1af lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xde:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0037 expref: 7 pid: 14864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826293.990654:0:30694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000723be610/0x22153cd396b7f1af lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xde:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0037 expref: 7 pid: 14864 timeout: 1339 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826293.990670:0:30694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f8752c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:30694:1874670585120128:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826293.990788:0:30694:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce030c93c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826293.990863:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869560 gen 2 00000004:00080000:3.0:1787826293.990870:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3abc0f00, transno 17179869558 00000004:00080000:3.0:1787826293.990883:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3abc30c0, transno 17179869559 00000004:00080000:3.0:1787826293.990886:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf136d70c0, transno 17179869560 00000100:00100000:3.0:1787826293.990893:0:3645:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff90cf3f876d00 x1874670585119744/t17179869561(17179869561) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1787826309 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1787826293.990905:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3f876d00/2, rc 0, transno 17179869561 00000100:00100000:3.0:1787826293.990912:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f876d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585119744:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1787826293.991243:0:9969:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 2 in progress, 1 in flight, 3 done 00000004:00080000:3.0:1787826293.991277:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3f825a40/2, rc 0, transno 21474836884 00000100:00100000:3.0:1787826293.991285:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f825a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585120000:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787826293.991363:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826293.991528:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563624320 00000100:00100000:3.0:1787826293.991536:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563624320 00000100:00100000:3.0:1787826293.991629:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1656 00000100:00100000:3.0:1787826293.991641:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f874b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:50434:x1874670563624320:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:3.0:1787826293.991657:0:30398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826293.991679:0:30398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c969551/0x22153cd396b7f2b9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xdf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab007d expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826293.991704:0:30398:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xdf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826293.991723:0:30398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdf:0x0].0x0 since=1240s v=(0 0) 00010000:00010000:3.0:1787826293.991727:0:30398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826293.991736:0:30398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c969551/0x22153cd396b7f2b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab007d expref: 9 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826293.991755:0:30398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006c969551/0x22153cd396b7f2b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab007d expref: 9 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826293.991769:0:30398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3abd6e00, rc 0) 00000100:00100000:3.0:1787826293.991824:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f874b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:50434:x1874670563624320:12345-192.168.203.39@tcp:101:dd.0 Request processed in 185us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826293.991831:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1656 00000100:00100000:3.0:1787826293.993682:0:30694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f8752c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:30694:1874670585120128:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826293.993715:0:30694:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000086fb5c8/0x22153cd396b7f2ab lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xde:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826293.998067:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826293.998312:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826293.998395:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563624576 00000100:00100000:1.0:1787826293.998409:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563624576 00002000:00010000:1.0:1787826293.998523:0:8440:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/223 (0->18446744073709551615) 00002000:00100000:1.0:1787826293.998529:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf3f827840 with x1874670563624576 ext(0->18446744073709551615) 00002000:00010000:1.0:1787826293.998545:0:8440:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90cf3f827840. 00000100:00100000:1.0:1787826293.998679:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 638 00000100:00100000:1.0:1787826293.998698:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f827840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563624576:12345-192.168.203.39@tcp:10:dd.0 00000100:00100000:3.0:1787826293.998776:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563624448 00000100:00100000:3.0:1787826293.998783:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563624448 00010000:00010000:3.0:1787826293.998818:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000723be610/0x22153cd396b7f1af lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xde:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0037 expref: 10 pid: 14864 timeout: 1339 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826293.998869:0:8440:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xdf:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:3.0:1787826293.998875:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 896 00002000:00010000:1.0:1787826293.998878:0:8440:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xdf:0x0] updating lvb mtime from disk: 0 -> 1787826294 00002000:00010000:1.0:1787826293.998884:0:8440:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xdf:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787826293.998886:0:8440:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xdf:0x0] updating lvb ctime from disk: 0 -> 1787826294 00002000:00010000:1.0:1787826293.998890:0:8440:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xdf:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1787826293.998894:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f824000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2403:x1874670563624448:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826293.998914:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826293.998921:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 00000000723be610/0x22153cd396b7f1af lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xde:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0037 expref: 11 pid: 14864 timeout: 1339 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826293.998938:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000723be610/0x22153cd396b7f1af lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xde:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0037 expref: 11 pid: 14864 timeout: 1339 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826293.998958:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f827840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2404:x1874670563624576:12345-192.168.203.39@tcp:10:dd.0 Request processed in 265us (651us total) trans 17179869562 rc 0/0 00000100:00100000:1.0:1787826293.998973:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 638 00010000:00010000:3.0:1787826293.998973:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000723be610/0x22153cd396b7f1af lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xde:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0037 expref: 11 pid: 14864 timeout: 1339 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826293.998985:0:8440:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/223 (0->18446744073709551615) 00002000:00100000:1.0:1787826293.998998:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf3f827840 with x1874670563624576 ext(0->18446744073709551615) 00002000:00010000:1.0:1787826293.999006:0:8440:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90cf3f827840. 00010000:00010000:3.0:1787826293.999015:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xde:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787826293.999033:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xde:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826293.999041:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000086fb5c8/0x22153cd396b7f2ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xde:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826293.999055:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000086fb5c8/0x22153cd396b7f2ab lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0xde:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826293.999105:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826293.999167:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f824000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670563624448:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 279us (1114us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826293.999176:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 896 00010000:00010000:1.0:1787826293.999329:0:30694:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000086fb5c8/0x22153cd396b7f2ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.999345:0:30694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000086fb5c8/0x22153cd396b7f2ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.999356:0:30694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000086fb5c8/0x22153cd396b7f2ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.999364:0:30694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000086fb5c8/0x22153cd396b7f2ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826293.999385:0:30694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787826293.999539:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f877480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:3645:x1874670585119616:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10286us (12199us total) trans 17179869563 rc 0/0 00000100:00100000:1.0:1787826293.999547:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1652 00010000:00010000:3.0:1787826293.999591:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826293.999611:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000086fb5c8/0x22153cd396b7f2ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826293.999622:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3abd6400 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826293.999627:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000086fb5c8/0x22153cd396b7f2ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826293.999637:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000086fb5c8/0x22153cd396b7f2ab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826293.999652:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000086fb5c8/0x22153cd396b7f2ab lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826293.999988:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000086fb5c8/0x22153cd396b7f2ab lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826294.000024:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826294.000036:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826294.000040:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826294.003257:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826294.003920:0:8545:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf136d70c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8545:1874670585120256:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826294.003963:0:8545:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005f6bb251/0x22153cd396b7f2b2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826294.004451:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563624704 00000100:00100000:1.0:1787826294.004463:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563624704 00010000:00010000:1.0:1787826294.004550:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007dfa189d/0x22153cd396b7f17e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0022 expref: 8 pid: 8435 timeout: 1340 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826294.004592:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 897 00000100:00100000:1.0:1787826294.004603:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03975a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2403:x1874670563624704:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826294.004622:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826294.004628:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007dfa189d/0x22153cd396b7f17e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0022 expref: 8 pid: 8435 timeout: 1340 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826294.004652:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007dfa189d/0x22153cd396b7f17e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0022 expref: 8 pid: 8435 timeout: 1340 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826294.004678:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007dfa189d/0x22153cd396b7f17e lrc: 0/0,0 mode: --/PR res: [0x280000401:0xd2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0022 expref: 8 pid: 8435 timeout: 1340 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826294.004695:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787826294.004852:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826294.004859:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005f6bb251/0x22153cd396b7f2b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826294.004870:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f6bb251/0x22153cd396b7f2b2 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826294.004911:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826294.004970:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03975a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2403:x1874670563624704:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 370us (1722us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826294.004978:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 897 00010000:00010000:3.0:1787826294.005129:0:8545:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005f6bb251/0x22153cd396b7f2b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826294.005145:0:8545:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f6bb251/0x22153cd396b7f2b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787826294.005587:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787826294.006842:0:8545:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f6bb251/0x22153cd396b7f2b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826294.006856:0:8545:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f6bb251/0x22153cd396b7f2b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826294.006999:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826294.007009:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f6bb251/0x22153cd396b7f2b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826294.007022:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce02427a00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826294.007039:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f6bb251/0x22153cd396b7f2b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826294.007050:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f6bb251/0x22153cd396b7f2b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826294.007071:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f6bb251/0x22153cd396b7f2b2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826294.007080:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f6bb251/0x22153cd396b7f2b2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826294.007105:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826294.007108:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826294.007110:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826294.007189:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f874780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3646:x1874670585119872:12345-0@lo:6:osp-syn-0-0.0 Request processed in 17532us (18199us total) trans 21474836885 rc 0/0 00000100:00100000:1.0:1787826294.007198:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1653 00000004:00080000:3.0:1787826294.007352:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3f826940/2, rc 0, transno 21474836885 00000100:00100000:3.0:1787826294.007363:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f826940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585119872:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787826294.020366:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787826294.020405:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a9af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585120384:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787826294.020547:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826294.023062:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03976940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e3c550b8-2c3c-46c3-ad36-671c284167ea:3645:1874670585120512:0@lo:400:kworker.0 00000100:00100000:3.0:1787826294.023163:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826294.023236:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce039743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585121024:0@lo:400:kworker.0 00000100:00100000:3.0:1787826294.023286:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826294.023334:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585120896 00000100:00100000:0.0:1787826294.023343:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585120896 00000100:00100000:0.0:1787826294.023396:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585121408 00000100:00100000:0.0:1787826294.023400:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585121408 00000100:00100000:0.0:1787826294.023435:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1432 00000100:00100000:0.0:1787826294.023445:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03bdd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874670585121408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826294.026016:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585120384 00000100:00100000:1.0:1787826294.026043:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585120384 00000100:00100000:1.0:1787826294.027122:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585121024 00000100:00100000:1.0:1787826294.027131:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585121024 00000100:00100000:1.0:1787826294.027177:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585120768 00000100:00100000:1.0:1787826294.027180:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585120768 00000100:00100000:1.0:1787826294.027199:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1281 00000100:00100000:1.0:1787826294.027207:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1874670585120384:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787826294.027242:0:7796:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446178816 avail 1299939328 00000100:00100000:1.0:1787826294.027297:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1874670585120384:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (6752us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826294.027306:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1281 00000100:00100000:1.0:1787826294.027325:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1282 00000100:00100000:1.0:1787826294.027331:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874670585121024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826294.027359:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874670585121024:12345-0@lo:400:kworker.0 Request processed in 29us (4076us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826294.027366:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1282 00000100:00100000:1.0:1787826294.027375:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1283 00000100:00100000:1.0:1787826294.027381:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03bde1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3646:x1874670585120768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826294.028274:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03bde1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3646:x1874670585120768:12345-0@lo:400:kworker.0 Request processed in 891us (3049us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826294.028283:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1283 00000100:00100000:1.0:1787826294.028397:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1435 00000100:00100000:1.0:1787826294.028407:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03bdcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874670585121792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826294.028450:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03bdcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874670585121792:12345-0@lo:400:kworker.0 Request processed in 45us (1408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826294.028457:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1435 00000100:00100000:0.0:1787826294.029707:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03bdd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874670585121408:12345-0@lo:400:kworker.0 Request processed in 6260us (6355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826294.029718:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1432 00000100:00080000:0.0:1787826294.029833:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787826294.029842:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787826294.029844:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787826294.029992:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826294.030770:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585121536 00000100:00100000:3.0:1787826294.030775:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585121536 00000100:00100000:3.0:1787826294.030829:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1436 00000100:00080000:0.0:1787826294.030832:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787826294.030838:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce039770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874670585121536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826294.030886:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce039770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874670585121536:12345-0@lo:400:kworker.0 Request processed in 51us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826294.030893:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1436 00000100:00100000:0.0:1787826294.031007:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03738780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1874670585121536:0@lo:400:kworker.0 00000100:00100000:0.0:1787826294.041209:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00080000:3.0:1787826294.062107:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787826294.076919:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563625088 00000100:00100000:0.0:1787826294.076929:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563625088 00000100:00100000:0.0:1787826294.076988:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3228 00000100:00100000:0.0:1787826294.077000:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03976940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+18:50435:x1874670563625088:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826294.077035:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826294.077057:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70e200/0x22153cd396b7f2c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0084 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826294.077149:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70e400/0x22153cd396b7f2c7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826294.077165:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70e400/0x22153cd396b7f2c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826294.077182:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70e400/0x22153cd396b7f2c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826294.077232:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787826294.077235:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826294.077258:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70e400/0x22153cd396b7f2c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826294.077282:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70e200/0x22153cd396b7f2c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0084 expref: 20 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826294.077301:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70e400/0x22153cd396b7f2c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0084 expref: 19 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826294.077309:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cf39656000) 00010000:00010000:0.0:1787826294.077312:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787826294.077316:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0a70e400, rc 0) 00000100:00100000:0.0:1787826294.077393:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03976940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:50435:x1874670563625088:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 395us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826294.077401:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3228 00010000:00010000:0.0:1787826294.083830:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826294.086147:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826294.101457:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826294.106435:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00010000:00010000:1.0:1787826294.107206:0:8247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426e00/0x22153cd396b7f2f1 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826294.107214:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426e00/0x22153cd396b7f2f1 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826294.107233:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0xc:0x0]: returning size 1048576 00010000:00010000:1.0:1787826294.107377:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427400/0x22153cd396b7f2ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0092 expref: 22 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826294.107392:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426e00/0x22153cd396b7f2f1 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0xc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0092 expref: 21 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826294.107401:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xc:0x0].0x0 (ffff90cf06894d00) 00010000:00010000:1.0:1787826294.107404:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787826294.107406:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce02426e00, rc 0) 00000100:00100000:1.0:1787826294.107442:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:50435:x1874670563625472:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 5724us (5997us total) trans 4294969296 rc 0/0 00000100:00100000:1.0:1787826294.107449:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3230 00000100:00100000:1.0:1787826294.122519:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826294.126782:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826294.126865:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563625856 00000100:00100000:3.0:1787826294.126875:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563625856 00010000:00010000:3.0:1787826294.126914:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426e00/0x22153cd396b7f2f1 lrc: 5/0,0 mode: CW/CW res: [0x200000405:0xc:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0092 expref: 23 pid: 8247 timeout: 1340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826294.126969:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 899 00000100:00100000:3.0:1787826294.126979:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+23:2403:x1874670563625856:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826294.126995:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826294.127003:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426e00/0x22153cd396b7f2f1 lrc: 5/0,0 mode: CW/CW res: [0x200000405:0xc:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0092 expref: 23 pid: 8247 timeout: 1340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826294.127016:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426e00/0x22153cd396b7f2f1 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0xc:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0092 expref: 23 pid: 8247 timeout: 1340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826294.127052:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xc:0x0].0x0 (ffff90cf06894d00) 00010000:00010000:3.0:1787826294.127058:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426c00/0x22153cd396b7f306 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xc:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826294.127068:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426c00/0x22153cd396b7f306 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826294.127076:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426c00/0x22153cd396b7f306 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826294.127097:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826294.127155:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+23:2403:x1874670563625856:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 177us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826294.127163:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 899 00000100:00100000:0.0:1787826294.136921:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826294.140686:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826294.140827:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563626240 00000100:00100000:0.0:1787826294.140836:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563626240 00000100:00100000:0.0:1787826294.140901:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1657 00000100:00100000:0.0:1787826294.140912:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f876940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670563626240:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:0.0:1787826294.140959:0:30398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007dfa189d/0x22153cd396b7f322 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xdf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826294.140980:0:30398:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006c969551/0x22153cd396b7f2b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab007d expref: 9 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826294.140989:0:30398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0xdf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826294.140993:0:30398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdf:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826294.140997:0:30398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007dfa189d/0x22153cd396b7f322 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0xdf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826294.141042:0:30398:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006c969551/0x22153cd396b7f2b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xdf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab007d expref: 9 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826294.141058:0:30398:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006c969551/0x22153cd396b7f2b9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xdf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab007d expref: 9 pid: 30398 timeout: 1340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826294.141073:0:30398:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03739a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:30398:1874670585122176:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826294.141161:0:30398:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf18385f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826294.145115:0:30398:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03739a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:30398:1874670585122176:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826294.145147:0:30398:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007dfa189d/0x22153cd396b7f322 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xdf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826294.149041:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826294.195681:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00010000:00010000:0.0:1787826294.199185:0:30398:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007dfa189d/0x22153cd396b7f322 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826294.200980:0:30398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007dfa189d/0x22153cd396b7f322 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826294.201022:0:30398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007dfa189d/0x22153cd396b7f322 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826294.201043:0:30398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007dfa189d/0x22153cd396b7f322 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826294.201052:0:30398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007dfa189d/0x22153cd396b7f322 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826294.201060:0:30398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0a70ec00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826294.201065:0:30398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007dfa189d/0x22153cd396b7f322 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826294.201074:0:30398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007dfa189d/0x22153cd396b7f322 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826294.201101:0:30398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007dfa189d/0x22153cd396b7f322 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826294.201110:0:30398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007dfa189d/0x22153cd396b7f322 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826294.201266:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f876940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670563626240:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 60350us (60582us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826294.201278:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1657 00000100:00100000:1.0:1787826294.204787:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000001:00080000:1.0:1787826294.208402:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969298 is committed 00000004:00080000:1.0:1787826294.208416:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 250 committed 00000004:00080000:1.0:1787826294.208740:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 241 committed 00000100:00080000:0.0:1787826294.209065:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1787826294.209828:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce03739a40/2, rc 0, transno 21474836886 00000100:00100000:0.0:1787826294.209842:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03739a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585122304:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787826294.210451:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03975680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585122432:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787826294.210544:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826294.210581:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585122432 00000100:00100000:3.0:1787826294.210588:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585122432 00000100:00100000:3.0:1787826294.210643:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1659 00000100:00100000:3.0:1787826294.210651:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f874f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:3645:x1874670585122432:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1787826294.210941:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426600/0x22153cd396b7f329 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826294.210955:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426600/0x22153cd396b7f329 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826294.210962:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426600/0x22153cd396b7f329 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826294.210969:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce02426600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826294.210973:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426600/0x22153cd396b7f329 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826294.210981:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426600/0x22153cd396b7f329 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826294.210998:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xc:0x0].0x0 (ffff90cf06894d00) 00010000:00010000:0.0:1787826294.211001:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826294.211007:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426600/0x22153cd396b7f329 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826294.211013:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426600/0x22153cd396b7f329 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787826294.211557:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826294.213160:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f874f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+8:3645:x1874670585122432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2497us (2603us total) trans 17179869565 rc 0/0 00000100:00100000:3.0:1787826294.213177:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1659 00000100:00100000:1.0:1787826294.217829:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826294.223670:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826294.230790:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826294.329644:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826294.336595:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826294.336740:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563627392 00000100:00100000:3.0:1787826294.336750:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563627392 00000100:00100000:3.0:1787826294.336863:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1662 00000100:00100000:3.0:1787826294.336873:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9ac780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2403:x1874670563627392:12345-192.168.203.39@tcp:23:lfs.0 00000100:00100000:3.0:1787826294.337087:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9ac780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2403:x1874670563627392:12345-192.168.203.39@tcp:23:lfs.0 Request processed in 215us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826294.337096:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1662 00000100:00100000:1.0:1787826294.341500:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826294.341587:0:25422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563627520 00000100:00100000:3.0:1787826294.341596:0:25422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563627520 00000100:00100000:3.0:1787826294.341675:0:25422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 639 00000100:00100000:3.0:1787826294.341685:0:25422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2404:x1874670563627520:12345-192.168.203.39@tcp:3:lfs.0 00010000:00010000:3.0:1787826294.341723:0:25422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000086fb5c8/0x22153cd396b7f34c lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xdf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826294.341741:0:25422:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826294.341745:0:25422:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826294.341752:0:25422:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000086fb5c8/0x22153cd396b7f34c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xdf:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826294.341766:0:25422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000086fb5c8/0x22153cd396b7f34c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xdf:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826294.368320:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826294.368510:0:30178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563627648 00000100:00100000:1.0:1787826294.368519:0:30178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563627648 00000100:00100000:1.0:1787826294.368586:0:30178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 640 00000100:00100000:1.0:1787826294.368595:0:30178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f07840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2403:x1874670563627648:12345-192.168.203.39@tcp:4:lfs.0 00002000:00010000:1.0:1787826294.368640:0:30178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826294.368648:0:30178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6d63c31/0x22153cd396b7f353 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826294.368665:0:30178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd3:0x0].0x0 since=1240s v=(0 0) 00010000:00010000:1.0:1787826294.368670:0:30178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826294.368676:0:30178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6d63c31/0x22153cd396b7f353 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd3:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826294.368689:0:30178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6d63c31/0x22153cd396b7f353 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd3:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787826294.391729:0:26205:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836887 is committed 00000001:00080000:3.0:1787826294.391747:0:26205:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836886 is committed 00000100:00100000:3.0:1787826294.418302:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826294.425187:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563628032 00000100:00100000:1.0:1787826294.425205:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563628032 00000100:00100000:1.0:1787826294.425265:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1663 00000100:00100000:1.0:1787826294.425285:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03974780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:50435:x1874670563628032:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826294.425302:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826294.425322:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8d9bc84/0x22153cd396b7f361 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xd3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab00bc expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826294.425351:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd3:0x0] initial LVB size: 1048576, mtime: 0x6a901076, atime: 0x0, ctime: 0x6a901076, blocks: 0x800 00010000:00010000:1.0:1787826294.425372:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd3:0x0].0x0 since=1240s v=(0 0) 00010000:00010000:1.0:1787826294.425377:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826294.425385:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8d9bc84/0x22153cd396b7f361 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab00bc expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826294.425400:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a8d9bc84/0x22153cd396b7f361 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab00bc expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826294.425412:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01f16c00, rc 0) 00000100:00100000:1.0:1787826294.425467:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03974780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:50435:x1874670563628032:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 194us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826294.425501:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1663 00000100:00100000:1.0:1787826294.428980:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826294.433212:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826294.433397:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563628416 00000100:00100000:1.0:1787826294.433406:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563628416 00000100:00100000:1.0:1787826294.433467:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3237 00000100:00100000:1.0:1787826294.433501:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f06580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:50435:x1874670563628416:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:1.0:1787826294.433611:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f16800/0x22153cd396b7f368 lrc: 3/0,1 mode: --/PW res: [0x200000405:0xc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826294.433630:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f16800/0x22153cd396b7f368 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826294.433642:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f16800/0x22153cd396b7f368 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826294.433739:0:9966:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a49bd153 reply state 000000003ac9e628 transno 4294969301 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f16800/0x22153cd396b7f368 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826294.433751:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f16800/0x22153cd396b7f368 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826294.433758:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xc:0x0].0x0 (ffff90cf06894d00) 00010000:00010000:1.0:1787826294.433760:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826294.433764:0:9966:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826294.433849:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f06580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:50435:x1874670563628416:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 350us (663us total) trans 4294969301 rc 0/0 00000100:00100000:1.0:1787826294.433857:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3237 00000100:00100000:3.0:1787826294.437321:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826294.437508:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563628544 00000100:00100000:0.0:1787826294.437518:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563628544 00000100:00100000:0.0:1787826294.437575:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1664 00000100:00100000:0.0:1787826294.437584:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f04780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:50435:x1874670563628544:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826294.437601:0:8545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826294.437619:0:8545:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c43350b1/0x22153cd396b7f36f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xdf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab00c3 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826294.437648:0:8545:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007319b908/0x22153cd396b7f345 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xdf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab00b5 expref: 12 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826294.437658:0:8545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826294.437662:0:8545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xdf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826294.437667:0:8545:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c43350b1/0x22153cd396b7f36f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xdf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab00c3 expref: 12 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826294.437700:0:8545:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007319b908/0x22153cd396b7f345 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xdf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab00b5 expref: 12 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826294.437713:0:8545:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007319b908/0x22153cd396b7f345 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xdf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab00b5 expref: 12 pid: 8435 timeout: 1340 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826294.437727:0:8545:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0373bc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8545:1874670585122560:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826294.437802:0:8545:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf18385f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826294.442002:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00010000:00010000:0.0:1787826294.442814:0:8545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007319b908/0x22153cd396b7f345 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xdf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab00b5 expref: 13 pid: 8435 timeout: 1340 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826294.442829:0:8545:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0373bc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8545:1874670585122560:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826294.442852:0:8545:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c43350b1/0x22153cd396b7f36f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xdf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab00c3 expref: 12 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826294.442863:0:8545:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0a70e600, rc 0) 00000100:00100000:0.0:1787826294.442901:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f04780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:50435:x1874670563628544:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 5318us (5589us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826294.442908:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1664 00000100:00100000:1.0:1787826294.447806:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826294.447870:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563628800 00000100:00100000:3.0:1787826294.447887:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563628800 00000100:00100000:3.0:1787826294.447944:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1665 00000100:00100000:3.0:1787826294.447954:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a98a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563628800:12345-192.168.203.39@tcp:2:lfs.0 00002000:00010000:3.0:1787826294.448104:0:28853:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xdf:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1787826294.448108:0:28853:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xdf:0x0] updating lvb mtime from disk: 1787826294 -> 1787826294 00002000:00010000:3.0:1787826294.448110:0:28853:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xdf:0x0] updating lvb atime from disk: 0 -> 1787826294 00002000:00010000:3.0:1787826294.448113:0:28853:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xdf:0x0] updating lvb ctime from disk: 1787826294 -> 1787826295 00002000:00010000:3.0:1787826294.448115:0:28853:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xdf:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:3.0:1787826294.448179:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a98a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2404:x1874670563628800:12345-192.168.203.39@tcp:2:lfs.0 Request processed in 226us (380us total) trans 17179869566 rc 0/0 00000100:00100000:3.0:1787826294.448186:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1665 00000100:00100000:1.0:1787826294.454732:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826294.459238:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826294.459327:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563629184 00000100:00100000:3.0:1787826294.459336:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563629184 00010000:00010000:3.0:1787826294.459377:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426c00/0x22153cd396b7f330 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab00a7 expref: 25 pid: 8247 timeout: 1340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826294.459418:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 902 00000100:00100000:3.0:1787826294.459427:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf181ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:2404:x1874670563629184:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826294.459442:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826294.459448:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426c00/0x22153cd396b7f330 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab00a7 expref: 25 pid: 8247 timeout: 1340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826294.459462:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426c00/0x22153cd396b7f330 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab00a7 expref: 25 pid: 8247 timeout: 1340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826294.459676:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xc:0x0].0x0 (ffff90cf06894d00) 00010000:00010000:3.0:1787826294.459682:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426600/0x22153cd396b7f376 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826294.459693:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426600/0x22153cd396b7f376 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826294.459701:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426600/0x22153cd396b7f376 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826294.459720:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826294.460920:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf181ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:2404:x1874670563629184:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 1490us (1688us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826294.460929:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 902 00000001:00080000:0.0:1787826294.462792:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969302 is committed 00000004:00080000:0.0:1787826294.462804:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 251 committed 00000004:00080000:0.0:1787826294.462823:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 242 committed 00000100:00100000:3.0:1787826294.463994:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787826294.464004:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce04f052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585123072:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787826294.464044:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826294.464075:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585122944 00000100:00100000:3.0:1787826294.464081:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585122944 00000100:00100000:3.0:1787826294.464118:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585123072 00000100:00100000:3.0:1787826294.464121:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585123072 00000100:00100000:3.0:1787826294.464143:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1666 00000100:00100000:3.0:1787826294.464151:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03977c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3646:x1874670585122944:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1787826294.464300:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xdf:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1787826294.464304:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xdf:0x0] updating lvb mtime from disk: 1787826294 -> 1787826294 00002000:00010000:3.0:1787826294.464307:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xdf:0x0] updating lvb atime from disk: 1787826294 -> 1787826294 00002000:00010000:3.0:1787826294.464309:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xdf:0x0] updating lvb ctime from disk: 1787826295 -> 1787826295 00002000:00010000:3.0:1787826294.464312:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xdf:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:3.0:1787826294.464345:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03977c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3646:x1874670585122944:12345-0@lo:2:osp-syn-1-0.0 Request processed in 195us (1026us total) trans 17179869567 rc 0/0 00000100:00100000:3.0:1787826294.464352:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1666 00000100:00100000:3.0:1787826294.464367:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1667 00000100:00100000:3.0:1787826294.464375:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f06d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874670585123072:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1787826294.464442:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xd3:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1787826294.464445:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xd3:0x0] updating lvb mtime from disk: 1787826295 -> 1787826295 00002000:00010000:3.0:1787826294.464447:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xd3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787826294.464449:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xd3:0x0] updating lvb ctime from disk: 1787826295 -> 1787826295 00002000:00010000:3.0:1787826294.464451:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xd3:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:3.0:1787826294.464509:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f06d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1874670585123072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 135us (463us total) trans 21474836889 rc 0/0 00000100:00100000:3.0:1787826294.464515:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1667 00000100:00100000:3.0:1787826294.464554:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836886 gen 2 00000004:00080000:3.0:1787826294.464559:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce04f070c0, transno 21474836883 00000004:00080000:3.0:1787826294.464563:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3f825a40, transno 21474836884 00000004:00080000:3.0:1787826294.464565:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3f826940, transno 21474836885 00000004:00080000:3.0:1787826294.464568:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce03739a40, transno 21474836886 00000100:00100000:3.0:1787826294.464576:0:3646:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff90ce04f052c0 x1874670585123072/t21474836889(21474836889) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1787826310 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1787826294.464586:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce04f052c0/2, rc 0, transno 21474836889 00000100:00100000:3.0:1787826294.464592:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce04f052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585123072:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1787826294.464605:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce0373bc00/2, rc 0, transno 17179869567 00000100:00100000:3.0:1787826294.464610:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0373bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585122944:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1787826294.464701:0:8543:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 1 in progress, 0 in flight, 4 done 00000100:00100000:1.0:1787826294.469698:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826294.473116:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826294.473223:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563629568 00000100:00100000:3.0:1787826294.473234:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563629568 00000100:00100000:3.0:1787826294.473289:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 961 00000100:00100000:3.0:1787826294.473299:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a988000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+18:50435:x1874670563629568:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:3.0:1787826294.473567:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a988000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:50435:x1874670563629568:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 268us (460us total) trans 4294969303 rc 0/0 00000100:00100000:3.0:1787826294.473575:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 961 00000100:00100000:1.0:1787826294.499391:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826294.505093:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826294.505496:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563629952 00000100:00100000:3.0:1787826294.505505:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563629952 00000100:00100000:3.0:1787826294.505562:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3240 00000100:00100000:3.0:1787826294.505572:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03739e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:50436:x1874670563629952:12345-192.168.203.39@tcp:41:filefrag.0 00000004:00000024:3.0:1787826294.505628:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 7836479488 avail 7373434880 00000100:00100000:3.0:1787826294.505706:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03739e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:50436:x1874670563629952:12345-192.168.203.39@tcp:41:filefrag.0 Request processed in 135us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826294.505714:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3240 00000100:00100000:1.0:1787826294.509651:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826294.517086:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826294.517169:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563630208 00000100:00100000:3.0:1787826294.517179:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563630208 00000100:00100000:3.0:1787826294.517246:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1669 00000100:00100000:3.0:1787826294.517257:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aad6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:50436:x1874670563630208:12345-192.168.203.39@tcp:7:filefrag.0 00000100:00100000:3.0:1787826294.517389:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aad6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:50436:x1874670563630208:12345-192.168.203.39@tcp:7:filefrag.0 Request processed in 134us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826294.517395:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1669 00000100:00100000:1.0:1787826294.521382:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826294.544784:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826294.544864:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563630720 00000100:00100000:3.0:1787826294.544874:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563630720 00000100:00100000:3.0:1787826294.544948:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3241 00000100:00100000:3.0:1787826294.544957:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce063043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:50438:x1874670563630720:12345-192.168.203.39@tcp:101:filefrag.0 00010000:00010000:3.0:1787826294.544981:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826294.545002:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7e00/0x22153cd396b7f3a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab00d8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826294.545138:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7200/0x22153cd396b7f3ae lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826294.545154:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7200/0x22153cd396b7f3ae lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826294.545167:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7200/0x22153cd396b7f3ae lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826294.545181:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0xc:0x0]: returning size 1048576 00010000:00010000:3.0:1787826294.545304:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7e00/0x22153cd396b7f3a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab00d8 expref: 25 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826294.545321:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7200/0x22153cd396b7f3ae lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xc:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab00d8 expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826294.545330:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xc:0x0].0x0 (ffff90cf06894d00) 00010000:00010000:3.0:1787826294.545332:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787826294.545335:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3abd7200, rc 0) 00000100:00100000:3.0:1787826294.545400:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce063043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:50438:x1874670563630720:12345-192.168.203.39@tcp:101:filefrag.0 Request processed in 444us (626us total) trans 4294969306 rc 0/0 00000100:00100000:3.0:1787826294.545408:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3241 00000100:00100000:0.0:1787826294.559184:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826294.559291:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563630848 00000100:00100000:3.0:1787826294.559302:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563630848 00000100:00100000:3.0:1787826294.559361:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1670 00000100:00100000:3.0:1787826294.559370:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03738000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:50438:x1874670563630848:12345-192.168.203.39@tcp:7:filefrag.0 00000100:00100000:3.0:1787826294.559513:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03738000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:50438:x1874670563630848:12345-192.168.203.39@tcp:7:filefrag.0 Request processed in 143us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826294.559522:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1670 00000100:00100000:1.0:1787826294.561624:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826294.561708:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563630976 00000100:00100000:3.0:1787826294.561718:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563630976 00000100:00100000:3.0:1787826294.561787:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1671 00000100:00100000:3.0:1787826294.561797:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06306940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:50438:x1874670563630976:12345-192.168.203.39@tcp:7:filefrag.0 00000100:00100000:3.0:1787826294.561951:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06306940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:50438:x1874670563630976:12345-192.168.203.39@tcp:7:filefrag.0 Request processed in 155us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826294.561959:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1671 00000100:00100000:1.0:1787826295.556842:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787826295.556852:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce06306580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585123456:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826295.556879:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826295.556906:0:25628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585123456 00000100:00100000:1.0:1787826295.556911:0:25628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585123456 00000100:00100000:1.0:1787826295.557621:0:25628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585123328 00000100:00100000:1.0:1787826295.557626:0:25628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585123328 00000100:00100000:1.0:1787826295.557645:0:25628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 695 00000100:00100000:1.0:1787826295.557652:0:25628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce063052c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874670585123456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787826295.557666:0:25628:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 61333184 pending 1073152 free 3920338944 avail 3688816640 00000100:00100000:1.0:1787826295.557703:0:25628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce063052c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874670585123456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826295.557721:0:25628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 695 00000100:00100000:1.0:1787826295.557736:0:25628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 696 00000100:00100000:1.0:1787826295.557742:0:25628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce039743c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1874670585123328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787826295.557751:0:25628:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43441856 pending 0 free 3919286272 avail 3686690816 00000100:00100000:1.0:1787826295.557778:0:25628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce039743c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1874670585123328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 36us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826295.557783:0:25628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 696 00000100:00100000:1.0:1787826295.557801:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce04f04780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585123584:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826295.557826:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826295.557855:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce06306580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585123456:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826295.557877:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585123584 00000100:00100000:1.0:1787826295.557879:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585123584 00000100:00100000:1.0:1787826295.557895:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 697 00000100:00100000:1.0:1787826295.557902:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06305a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3647:x1874670585123584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787826295.557911:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 61333184 pending 1073152 free 3920338944 avail 3688816640 00000100:00100000:1.0:1787826295.558387:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06305a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3647:x1874670585123584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 484us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826295.558393:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 697 00000100:00100000:1.0:1787826295.558426:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce04f04780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585123584:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826295.953082:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826295.953873:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826295.953912:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826295.953933:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826295.954029:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563631104 00000100:00100000:0.0:1787826295.954038:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563631104 00000100:00100000:0.0:1787826295.954091:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 866 00000100:00100000:0.0:1787826295.954100:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf185c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:307626ff-a376-4faf-93e0-9f55b723d964+10:2401:x1874670563631104:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1787826295.954170:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf185c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:307626ff-a376-4faf-93e0-9f55b723d964+10:2401:x1874670563631104:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 71us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826295.954177:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 866 00000100:00100000:3.0:1787826295.954216:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563631488 00000100:00100000:3.0:1787826295.954230:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563631488 00000100:00100000:3.0:1787826295.954304:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 826 00000100:00100000:3.0:1787826295.954315:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06304b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2401:x1874670563631488:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1787826295.954407:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06304b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2401:x1874670563631488:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 95us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826295.954415:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 826 00000100:00100000:1.0:1787826295.957010:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826295.958068:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563631616 00000100:00100000:3.0:1787826295.958088:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563631616 00000100:00080000:0.0:1787826295.958726:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787826295.959123:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 827 00000100:00100000:3.0:1787826295.959139:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06307840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2401:x1874670563631616:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1787826295.959453:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06307840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2401:x1874670563631616:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 312us (2447us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826295.959463:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 827 00010000:00010000:3.0:1787826296.136904:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826297.155964:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826298.115864:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0373a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585123712:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826298.116031:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826298.116448:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585123712 00000100:00100000:1.0:1787826298.116458:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585123712 00000100:00100000:1.0:1787826298.116531:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1284 00000100:00100000:1.0:1787826298.116540:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03738780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3644:x1874670585123712:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787826298.116582:0:7796:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445888000 avail 1299648512 00000100:00100000:1.0:1787826298.116634:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03738780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3644:x1874670585123712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826298.116641:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1284 00000100:00100000:0.0:1787826298.117674:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0373a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585123712:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787826298.180437:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826299.146825:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03975a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874670585124096:0@lo:400:kworker.0 00000100:00100000:3.0:1787826299.146897:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826299.146972:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585124096 00000100:00100000:0.0:1787826299.146997:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585124096 00000100:00100000:0.0:1787826299.147071:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1439 00000100:00100000:0.0:1787826299.147083:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f04b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874670585124096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826299.157160:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f04b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874670585124096:12345-0@lo:400:kworker.0 Request processed in 10075us (10259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826299.157171:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1439 00000100:00100000:3.0:1787826299.157331:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03975a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874670585124096:0@lo:400:kworker.0 00000001:00080000:3.0:1787826300.173840:0:27651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179869567 is committed 00000001:00080000:3.0:1787826300.173855:0:27651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179869566 is committed 00000001:00080000:1.0:1787826300.174746:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969306 is committed 00010000:00010000:3.0:1787826300.229919:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826300.676937:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787826300.676959:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce06304780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585125632:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826300.677038:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826300.677095:0:12021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585125632 00000100:00100000:1.0:1787826300.677102:0:12021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585125632 00000100:00100000:1.0:1787826300.677149:0:12021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 698 00000100:00100000:1.0:1787826300.677168:0:12021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874670585125632:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787826300.677199:0:12021:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 60260032 pending 0 free 3921387520 avail 3689865216 00000100:00100000:1.0:1787826300.677242:0:12021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874670585125632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826300.677249:0:12021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 698 00000100:00100000:1.0:1787826300.677293:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce06304780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585125632:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826300.677649:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787826300.677660:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce04f06d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585125760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787826300.677696:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826300.677727:0:25628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585125760 00000100:00100000:3.0:1787826300.677731:0:25628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585125760 00000100:00100000:3.0:1787826300.677759:0:25628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 699 00000100:00100000:3.0:1787826300.677766:0:25628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f05680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874670585125760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787826300.677778:0:25628:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 60260032 pending 0 free 3921387520 avail 3689865216 00000100:00100000:3.0:1787826300.677806:0:25628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f05680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874670585125760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826300.677812:0:25628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 699 00000100:00100000:3.0:1787826300.677837:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869567 gen 2 00000004:00080000:3.0:1787826300.677842:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3f876d00, transno 17179869561 00000004:00080000:3.0:1787826300.677849:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3f876580, transno 17179869563 00000004:00080000:3.0:1787826300.677851:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce03975680, transno 17179869565 00000004:00080000:3.0:1787826300.677854:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce0373bc00, transno 17179869567 00000100:00100000:3.0:1787826300.677861:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce04f06d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585125760:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1787826300.678347:0:9969:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 4 done 00000100:00100000:0.0:1787826300.678867:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787826300.678881:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0373bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585125888:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787826300.678925:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826300.678965:0:12021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585125888 00000100:00100000:0.0:1787826300.678970:0:12021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585125888 00000100:00100000:0.0:1787826300.679015:0:12021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 700 00000100:00100000:0.0:1787826300.679023:0:12021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874670585125888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787826300.679046:0:12021:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43441856 pending 0 free 3919286272 avail 3687763968 00000100:00100000:0.0:1787826300.681523:0:12021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874670585125888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2491us (2587us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826300.681538:0:12021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 700 00000100:00100000:0.0:1787826300.682360:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836889 gen 2 00000004:00080000:0.0:1787826300.682366:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce04f052c0, transno 21474836889 00000100:00100000:0.0:1787826300.687091:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0373bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585125888:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826300.898962:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826300.899038:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00080000:1.0:1787826300.902128:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787826300.929166:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826300.929562:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563632128 00000100:00100000:0.0:1787826300.929571:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563632128 00000100:00100000:0.0:1787826300.929653:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3244 00000100:00100000:0.0:1787826300.929662:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06304780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:51031:x1874670563632128:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826300.929684:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826300.929703:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70fe00/0x22153cd396b7f3d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab00df expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.929776:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70ee00/0x22153cd396b7f3d8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.929789:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70ee00/0x22153cd396b7f3d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.929799:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70ee00/0x22153cd396b7f3d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826300.929845:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787826300.929848:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826300.929867:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70ee00/0x22153cd396b7f3d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.929892:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70fe00/0x22153cd396b7f3d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab00df expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.929906:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70ee00/0x22153cd396b7f3d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab00df expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.929915:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cf39656000) 00010000:00010000:0.0:1787826300.929918:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787826300.929921:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0a70ee00, rc 0) 00000100:00100000:0.0:1787826300.929991:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06304780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:51031:x1874670563632128:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 329us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826300.929998:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3244 00000100:00100000:0.0:1787826300.940762:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826300.941082:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3245 00000100:00100000:2.0:1787826300.941092:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:51031:x1874670563632256:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826300.941111:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826300.941131:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426000/0x22153cd396b7f3df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab00e6 expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.941220:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7f3e6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.941235:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7f3e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.941247:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7f3e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.941259:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427600/0x22153cd396b7f3ed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.941265:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427600/0x22153cd396b7f3ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.941271:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427600/0x22153cd396b7f3ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.941346:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427200/0x22153cd396b7f3f4 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.941355:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427200/0x22153cd396b7f3f4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.941361:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427200/0x22153cd396b7f3f4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826300.941400:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0xe:0x0]: returning size 4096 00000004:00200000:2.0:1787826300.941404:0:9966:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826300.941423:0:9966:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427200/0x22153cd396b7f3f4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.941437:0:9966:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7f3e6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.941444:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7f3e6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.941450:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7f3e6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.941456:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7f3e6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.941462:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce02426200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826300.941467:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7f3e6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.941526:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7f3e6 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.941539:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cf39656000) 00010000:00010000:2.0:1787826300.941541:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826300.941547:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7f3e6 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.941554:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7f3e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.941567:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427600/0x22153cd396b7f3ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.941573:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427600/0x22153cd396b7f3ed lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.941579:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427600/0x22153cd396b7f3ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.941584:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce02427600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826300.941586:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427600/0x22153cd396b7f3ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.941592:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427600/0x22153cd396b7f3ed lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.941599:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfe7a1a38 (ffff90cf3a84a600) 00010000:00010000:2.0:1787826300.941601:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826300.941603:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427600/0x22153cd396b7f3ed lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.941609:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427600/0x22153cd396b7f3ed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.941634:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426000/0x22153cd396b7f3df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab00e6 expref: 24 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.941647:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427200/0x22153cd396b7f3f4 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab00e6 expref: 23 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826300.941659:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0x0 (ffff90cf3a84aa00) 00010000:00010000:2.0:1787826300.941662:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787826300.941665:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce02427200, rc 0) 00000100:00100000:2.0:1787826300.941734:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+23:51031:x1874670563632256:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 642us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826300.941740:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3245 00000100:00100000:1.0:1787826300.961305:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826300.961391:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563632512 00000100:00100000:3.0:1787826300.961400:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563632512 00000100:00100000:3.0:1787826300.961460:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3246 00000100:00100000:3.0:1787826300.961492:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f805a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+23:51031:x1874670563632512:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826300.961511:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826300.961532:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7000/0x22153cd396b7f3fb lrc: 2/0,0 mode: --/CW res: [0x200000405:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab00ed expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.961660:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7e00/0x22153cd396b7f402 lrc: 3/0,1 mode: --/CW res: [0x200000405:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.961673:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7e00/0x22153cd396b7f402 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.961685:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7e00/0x22153cd396b7f402 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.961746:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7400/0x22153cd396b7f409 lrc: 3/0,1 mode: --/PW res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.961753:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7400/0x22153cd396b7f409 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.961760:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7400/0x22153cd396b7f409 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.962145:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6c00/0x22153cd396b7f410 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.962387:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6c00/0x22153cd396b7f410 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.962397:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6c00/0x22153cd396b7f410 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826300.962408:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0xf:0x0]: returning size 0 00010000:00010000:3.0:1787826300.962434:0:32404:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7e00/0x22153cd396b7f402 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.962441:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7e00/0x22153cd396b7f402 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.962447:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7e00/0x22153cd396b7f402 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.962454:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7e00/0x22153cd396b7f402 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.962462:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3abd7e00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826300.962466:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7e00/0x22153cd396b7f402 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.962503:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7e00/0x22153cd396b7f402 lrc: 5/0,0 mode: CW/CW res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.962515:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0x0 (ffff90cf3a84aa00) 00010000:00010000:3.0:1787826300.962517:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826300.962522:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7e00/0x22153cd396b7f402 lrc: 3/0,0 mode: --/CW res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.962529:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7e00/0x22153cd396b7f402 lrc: 0/0,0 mode: --/CW res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826300.962542:0:32404:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e5390f1a reply state 00000000324e71db transno 4294969308 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7400/0x22153cd396b7f409 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.962552:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7400/0x22153cd396b7f409 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.962558:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0xaf1e71b4 (ffff90cf11e81800) 00010000:00010000:3.0:1787826300.962561:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826300.962563:0:32404:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787826300.962597:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7000/0x22153cd396b7f3fb lrc: 0/0,0 mode: --/CW res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab00ed expref: 26 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.962623:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6c00/0x22153cd396b7f410 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab00ed expref: 25 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.962636:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff90cf11e81200) 00010000:00010000:3.0:1787826300.962639:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826300.962641:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3abd6c00, rc 0) 00000100:00100000:3.0:1787826300.962707:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f805a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:51031:x1874670563632512:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1238us (1411us total) trans 4294969308 rc 0/0 00000100:00100000:3.0:1787826300.962716:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3246 00000100:00100000:1.0:1787826300.972794:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826300.974015:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563632768 00000100:00100000:0.0:1787826300.974027:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563632768 00000100:00100000:0.0:1787826300.974084:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3247 00000100:00100000:0.0:1787826300.974094:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f806940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:51031:x1874670563632768:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826300.974117:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826300.974138:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70fe00/0x22153cd396b7f41e lrc: 2/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab00f4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.974435:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70ec00/0x22153cd396b7f425 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.974450:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6c00/0x22153cd396b7f410 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab00ed expref: 27 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.974459:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70ec00/0x22153cd396b7f425 lrc: 4/0,1 mode: --/EX res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.974522:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6c00/0x22153cd396b7f410 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab00ed expref: 27 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826300.974536:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6c00/0x22153cd396b7f410 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab00ed expref: 27 pid: 32404 timeout: 1346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826300.974556:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03739680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1874670585126144:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826300.975313:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf1817e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826300.983317:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826300.983348:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563632896 00000100:00100000:3.0:1787826300.983357:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563632896 00010000:00010000:3.0:1787826300.983396:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6c00/0x22153cd396b7f410 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab00ed expref: 28 pid: 32404 timeout: 1346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826300.983500:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 903 00000100:00100000:3.0:1787826300.983509:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f052c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+28:2404:x1874670563632896:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826300.983524:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826300.983532:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6c00/0x22153cd396b7f410 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab00ed expref: 28 pid: 32404 timeout: 1346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.983545:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6c00/0x22153cd396b7f410 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab00ed expref: 28 pid: 32404 timeout: 1346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.983568:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff90cf11e81200) 00010000:00010000:3.0:1787826300.983574:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70ec00/0x22153cd396b7f425 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.983582:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70ec00/0x22153cd396b7f425 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.983590:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70ec00/0x22153cd396b7f425 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.983610:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826300.983662:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f052c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+28:2404:x1874670563632896:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 154us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826300.983670:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 903 00010000:00010000:3.0:1787826300.983718:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6c00/0x22153cd396b7f410 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab00ed expref: 27 pid: 32404 timeout: 1346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826300.983732:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03739680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1874670585126144:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826300.983752:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70ec00/0x22153cd396b7f425 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.983760:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70ec00/0x22153cd396b7f425 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.983767:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70ec00/0x22153cd396b7f425 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826300.983784:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0xf:0x0]: returning size 0 00000004:00080000:3.0:1787826300.983926:0:6520:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xd4:0x0], index 0: 0 00010000:00010000:3.0:1787826300.984040:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70ec00/0x22153cd396b7f425 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.984049:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70ec00/0x22153cd396b7f425 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.984055:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70ec00/0x22153cd396b7f425 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.984061:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0a70ec00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826300.984066:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70ec00/0x22153cd396b7f425 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.984073:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70ec00/0x22153cd396b7f425 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.984082:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff90cf11e81200) 00010000:00010000:3.0:1787826300.984084:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826300.984089:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70ec00/0x22153cd396b7f425 lrc: 2/0,0 mode: --/EX res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.984095:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70ec00/0x22153cd396b7f425 lrc: 0/0,0 mode: --/EX res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.984154:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70fe00/0x22153cd396b7f41e lrc: 1/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab00f4 expref: 27 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.984164:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0x0 (ffff90cf3a84aa00) 00010000:00010000:3.0:1787826300.984166:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787826300.984169:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70fe00/0x22153cd396b7f41e lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab00f4 expref: 27 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826300.984178:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0a70fe00, rc 0) 00000100:00100000:3.0:1787826300.984204:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f806940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:51031:x1874670563632768:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 10112us (11420us total) trans 4294969309 rc 301/301 00000100:00100000:3.0:1787826300.984212:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3247 00000100:00100000:0.0:1787826300.990543:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826300.990578:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563633152 00000100:00100000:0.0:1787826300.990588:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563633152 00000100:00100000:0.0:1787826300.990654:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 963 00000100:00100000:0.0:1787826300.990664:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03739680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:51031:x1874670563633152:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:0.0:1787826300.990934:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03739680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:51031:x1874670563633152:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 269us (400us total) trans 4294969310 rc 0/0 00000100:00100000:0.0:1787826300.990942:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 963 00000100:00100000:3.0:1787826301.001080:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826301.001151:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563633280 00000100:00100000:1.0:1787826301.001159:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563633280 00000100:00100000:1.0:1787826301.001212:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3248 00000100:00100000:1.0:1787826301.001222:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f06d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:51031:x1874670563633280:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826301.001243:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826301.001263:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f17600/0x22153cd396b7f433 lrc: 2/0,0 mode: --/CR res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab00fb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.001313:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f17600/0x22153cd396b7f433 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab00fb expref: 28 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.001329:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f17600/0x22153cd396b7f433 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab00fb expref: 28 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.001345:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff90cf39e67f00) 00010000:00010000:1.0:1787826301.001348:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826301.001351:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01f17600, rc 0) 00000100:00100000:1.0:1787826301.001401:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f06d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+28:51031:x1874670563633280:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 182us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826301.001408:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3248 00000100:00100000:3.0:1787826301.008846:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826301.008946:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563633536 00000100:00100000:1.0:1787826301.008956:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563633536 00000100:00100000:1.0:1787826301.009029:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 964 00000100:00100000:1.0:1787826301.009039:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+28:51031:x1874670563633536:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:1.0:1787826301.009601:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+29:51031:x1874670563633536:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 561us (761us total) trans 4294969311 rc 0/0 00000100:00100000:1.0:1787826301.009610:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 964 00000100:00100000:1.0:1787826301.033651:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826301.034618:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563633792 00000100:00100000:2.0:1787826301.034630:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563633792 00000100:00100000:2.0:1787826301.034726:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3249 00000100:00100000:2.0:1787826301.034735:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+29:51032:x1874670563633792:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826301.034767:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826301.034789:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427600/0x22153cd396b7f43a lrc: 2/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0102 expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.034885:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7f441 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.034899:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7f441 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.034910:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7f441 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.034921:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427000/0x22153cd396b7f448 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.034929:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427000/0x22153cd396b7f448 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.034940:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427000/0x22153cd396b7f448 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.035047:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426e00/0x22153cd396b7f44f lrc: 3/1,0 mode: --/PR res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.035056:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426e00/0x22153cd396b7f44f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.035064:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426e00/0x22153cd396b7f44f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826301.035074:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0xf:0x0]: returning size 0 00010000:00010000:2.0:1787826301.035147:0:9966:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7f441 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.035265:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7f441 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.035272:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7f441 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.035278:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7f441 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.035285:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce02426200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826301.035289:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7f441 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.035296:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7f441 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.035311:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0x0 (ffff90cf3a84aa00) 00010000:00010000:2.0:1787826301.035314:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826301.035318:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7f441 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.035325:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7f441 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.035337:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427000/0x22153cd396b7f448 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.035344:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427000/0x22153cd396b7f448 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.035350:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427000/0x22153cd396b7f448 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.035355:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce02427000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826301.035358:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427000/0x22153cd396b7f448 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.035364:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427000/0x22153cd396b7f448 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.035372:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0xaf1e71b4 (ffff90cf11e81800) 00010000:00010000:2.0:1787826301.035375:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826301.035378:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427000/0x22153cd396b7f448 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.035384:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427000/0x22153cd396b7f448 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.035424:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427600/0x22153cd396b7f43a lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0102 expref: 32 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.035438:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426e00/0x22153cd396b7f44f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0102 expref: 31 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.035445:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff90cf39e67f00) 00010000:00010000:2.0:1787826301.035448:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826301.035450:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce02426e00, rc 0) 00000100:00100000:2.0:1787826301.035658:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:51032:x1874670563633792:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 924us (2016us total) trans 4294969312 rc 0/0 00000100:00100000:2.0:1787826301.035667:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3249 00000100:00100000:3.0:1787826301.040926:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826301.041064:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563634048 00000100:00100000:1.0:1787826301.041075:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563634048 00000100:00100000:1.0:1787826301.041137:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3250 00000100:00100000:1.0:1787826301.041147:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f04780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:51032:x1874670563634048:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826301.041177:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826301.041200:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f17400/0x22153cd396b7f45d lrc: 2/0,0 mode: --/CW res: [0x200000405:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0109 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.041686:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f16800/0x22153cd396b7f464 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.041701:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f16800/0x22153cd396b7f464 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.041711:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f16800/0x22153cd396b7f464 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826301.041721:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x10:0x0]: returning size 0 00010000:00010000:1.0:1787826301.041775:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f17400/0x22153cd396b7f45d lrc: 0/0,0 mode: --/CW res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0109 expref: 34 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.041793:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f16800/0x22153cd396b7f464 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0109 expref: 33 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.041803:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x10:0x0].0x0 (ffff90cf39e67500) 00010000:00010000:1.0:1787826301.041806:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826301.041809:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01f16800, rc 0) 00000100:00100000:1.0:1787826301.041868:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f04780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:51032:x1874670563634048:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 723us (952us total) trans 4294969313 rc 0/0 00000100:00100000:1.0:1787826301.041875:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3250 00000100:00100000:0.0:1787826301.046400:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826301.046512:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563634304 00000100:00100000:3.0:1787826301.046522:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563634304 00000100:00100000:3.0:1787826301.046574:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3251 00000100:00100000:3.0:1787826301.046583:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03739a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:51032:x1874670563634304:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826301.046603:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826301.046622:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6c00/0x22153cd396b7f472 lrc: 2/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0110 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.046750:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7000/0x22153cd396b7f479 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.046765:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f16800/0x22153cd396b7f464 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0109 expref: 34 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.046774:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7000/0x22153cd396b7f479 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.046806:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f16800/0x22153cd396b7f464 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0109 expref: 34 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.046820:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f16800/0x22153cd396b7f464 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0109 expref: 34 pid: 16564 timeout: 1347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826301.046834:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03bdd680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1874670585126272:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826301.046911:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf19bfe180 going to sleep for 11 seconds 00000100:00100000:0.0:1787826301.052834:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826301.052834:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03bdd680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1874670585126272:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826301.052861:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7000/0x22153cd396b7f479 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826301.052925:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563634432 00000100:00100000:1.0:1787826301.052933:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563634432 00010000:00010000:1.0:1787826301.052974:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f16800/0x22153cd396b7f464 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0109 expref: 35 pid: 16564 timeout: 1347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826301.053026:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 904 00000100:00100000:1.0:1787826301.053035:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06305680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:2404:x1874670563634432:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826301.053051:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826301.053058:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f16800/0x22153cd396b7f464 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0109 expref: 35 pid: 16564 timeout: 1347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.053070:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f16800/0x22153cd396b7f464 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0109 expref: 35 pid: 16564 timeout: 1347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.053094:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f16800/0x22153cd396b7f464 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0109 expref: 35 pid: 16564 timeout: 1347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.053108:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x10:0x0].0x0 (ffff90cf39e67500) 00010000:00010000:1.0:1787826301.053113:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7000/0x22153cd396b7f479 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.053123:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7000/0x22153cd396b7f479 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.053131:0:10340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7000/0x22153cd396b7f479 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.053158:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826301.053214:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06305680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:2404:x1874670563634432:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 181us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826301.053223:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 904 00010000:00010000:3.0:1787826301.053365:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7000/0x22153cd396b7f479 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.053372:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7000/0x22153cd396b7f479 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826301.053390:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x10:0x0]: returning size 0 00000004:00080000:3.0:1787826301.053564:0:6520:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xe0:0x0], index 1: 0 00010000:00010000:3.0:1787826301.053661:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7000/0x22153cd396b7f479 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.053669:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7000/0x22153cd396b7f479 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.053674:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7000/0x22153cd396b7f479 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.053679:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3abd7000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826301.053683:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7000/0x22153cd396b7f479 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.053690:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7000/0x22153cd396b7f479 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.053700:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x10:0x0].0x0 (ffff90cf39e67500) 00010000:00010000:3.0:1787826301.053703:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826301.053706:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7000/0x22153cd396b7f479 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.053716:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7000/0x22153cd396b7f479 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.053774:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6c00/0x22153cd396b7f472 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0110 expref: 34 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.053785:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0x0 (ffff90cf3a84aa00) 00010000:00010000:3.0:1787826301.053787:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787826301.053791:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6c00/0x22153cd396b7f472 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0110 expref: 34 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.053800:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3abd6c00, rc 0) 00000100:00100000:3.0:1787826301.053826:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03739a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:51032:x1874670563634304:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 7243us (7437us total) trans 4294969314 rc 301/301 00000100:00100000:3.0:1787826301.053833:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3251 00000100:00100000:1.0:1787826301.058584:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826301.058676:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563634688 00000100:00100000:0.0:1787826301.058686:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563634688 00000100:00100000:0.0:1787826301.058737:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 965 00000100:00100000:0.0:1787826301.058746:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:51032:x1874670563634688:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:0.0:1787826301.059513:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:51032:x1874670563634688:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 764us (936us total) trans 4294969315 rc 0/0 00000100:00100000:0.0:1787826301.059522:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 965 00000100:00100000:0.0:1787826301.064351:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826301.064466:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563634816 00000100:00100000:2.0:1787826301.064532:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563634816 00000100:00080000:1.0:1787826301.064651:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826301.064695:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1672 00000100:00100000:2.0:1787826301.064707:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2403:x1874670563634816:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826301.064724:0:30695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826301.064745:0:30695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9f7375/0x22153cd396b7f487 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0117 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787826301.064786:0:30695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826301.064806:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd4:0x0].0x0 since=1247s v=(0 0) 00010000:00010000:2.0:1787826301.064810:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826301.064819:0:30695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9f7375/0x22153cd396b7f487 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0117 expref: 9 pid: 30695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.064844:0:30695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9f7375/0x22153cd396b7f487 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0117 expref: 9 pid: 30695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.064858:0:30695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce02427600, rc 0) 00000100:00100000:2.0:1787826301.064917:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670563634816:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 213us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826301.064923:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1672 00000100:00100000:1.0:1787826301.067996:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826301.068091:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563634944 00000100:00100000:3.0:1787826301.068101:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563634944 00000100:00100000:3.0:1787826301.068252:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3252 00000100:00100000:3.0:1787826301.068263:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f804780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:51032:x1874670563634944:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826301.068286:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826301.068308:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6c00/0x22153cd396b7f48e lrc: 2/0,0 mode: --/CR res: [0x200000405:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab011e expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.068400:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7000/0x22153cd396b7f495 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.068415:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7000/0x22153cd396b7f495 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.068427:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7000/0x22153cd396b7f495 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826301.068467:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x10:0x0]: returning size 0 00000004:00200000:3.0:1787826301.068501:0:8247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826301.068520:0:8247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7000/0x22153cd396b7f495 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.068544:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6c00/0x22153cd396b7f48e lrc: 0/0,0 mode: --/CR res: [0x200000405:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab011e expref: 36 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.068564:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7000/0x22153cd396b7f495 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab011e expref: 35 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.068573:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x10:0x0].0x0 (ffff90cf11e81200) 00010000:00010000:3.0:1787826301.068575:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787826301.068579:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3abd7000, rc 0) 00000100:00100000:3.0:1787826301.068624:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f804780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:51032:x1874670563634944:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 364us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826301.068631:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3252 00000100:00100000:1.0:1787826301.072861:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826301.072900:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826301.072988:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826301.073050:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563635072 00000100:00100000:3.0:1787826301.073059:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563635072 00000100:00100000:3.0:1787826301.073130:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1673 00000100:00100000:3.0:1787826301.073141:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f807840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2403:x1874670563635072:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826301.073166:0:30694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826301.073186:0:30694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061e22549/0x22153cd396b7f49c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xe0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0125 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826301.073216:0:30694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826301.073237:0:30694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe0:0x0].0x0 since=1247s v=(0 0) 00010000:00010000:3.0:1787826301.073241:0:30694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826301.073251:0:30694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061e22549/0x22153cd396b7f49c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xe0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0125 expref: 9 pid: 30694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.073270:0:30694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000061e22549/0x22153cd396b7f49c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xe0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0125 expref: 9 pid: 30694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.073284:0:30694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3abd7e00, rc 0) 00000100:00100000:3.0:1787826301.073331:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f807840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670563635072:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 193us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826301.073338:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1673 00000100:00080000:1.0:1787826301.073656:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826301.073786:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563635200 00000100:00100000:0.0:1787826301.073791:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563635200 00000100:00100000:0.0:1787826301.073826:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 868 00000100:00100000:0.0:1787826301.073833:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf185c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:307626ff-a376-4faf-93e0-9f55b723d964+10:2404:x1874670563635200:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1787826301.073875:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf185c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:307626ff-a376-4faf-93e0-9f55b723d964+10:2404:x1874670563635200:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 43us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826301.073882:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 868 00000100:00100000:0.0:1787826301.073910:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563635328 00000100:00100000:0.0:1787826301.073914:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563635328 00000100:00100000:0.0:1787826301.073946:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1445 00000100:00100000:0.0:1787826301.073953:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:2404:x1874670563635328:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1787826301.073990:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:2404:x1874670563635328:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 38us (1090us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826301.073997:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1445 00000100:00080000:0.0:1787826301.074012:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826301.079365:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826301.079463:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563635584 00000100:00100000:2.0:1787826301.079513:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563635584 00000100:00100000:2.0:1787826301.079575:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3253 00000100:00100000:2.0:1787826301.079585:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f804f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:51032:x1874670563635584:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826301.079606:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826301.079627:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427000/0x22153cd396b7f4a3 lrc: 2/0,0 mode: --/CR res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab012c expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.079756:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7f4aa lrc: 3/0,1 mode: --/PW res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.079771:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7f4aa lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xf:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.079782:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7f4aa lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xf:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826301.079793:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0xf:0x0]: returning size 0 00010000:00010000:2.0:1787826301.079898:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427000/0x22153cd396b7f4a3 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab012c expref: 38 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.079921:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7f4aa lrc: 3/0,0 mode: PW/PW res: [0x200000405:0xf:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab012c expref: 37 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.079929:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff90cf39e67f00) 00010000:00010000:2.0:1787826301.079932:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787826301.079935:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce02426200, rc 0) 00000100:00100000:2.0:1787826301.080005:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f804f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:51032:x1874670563635584:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 420us (649us total) trans 4294969316 rc 0/0 00000100:00100000:2.0:1787826301.080012:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3253 00000100:00100000:1.0:1787826301.084263:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826301.084347:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563635712 00000100:00100000:2.0:1787826301.084357:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563635712 00000100:00100000:2.0:1787826301.084415:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1674 00000100:00100000:2.0:1787826301.084425:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f806580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670563635712:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:2.0:1787826301.084497:0:28853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002e498e57/0x22153cd396b7f4b8 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.084516:0:28853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826301.084521:0:28853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826301.084528:0:28853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e498e57/0x22153cd396b7f4b8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.084542:0:28853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e498e57/0x22153cd396b7f4b8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.084568:0:28853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002e498e57/0x22153cd396b7f4b8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.084577:0:28853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e498e57/0x22153cd396b7f4b8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.084586:0:28853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e498e57/0x22153cd396b7f4b8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.084593:0:28853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce02427800 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826301.084597:0:28853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e498e57/0x22153cd396b7f4b8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.084606:0:28853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e498e57/0x22153cd396b7f4b8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.084621:0:28853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e498e57/0x22153cd396b7f4b8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.084628:0:28853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e498e57/0x22153cd396b7f4b8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826301.084694:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f806580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670563635712:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 271us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826301.084701:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1674 00000100:00100000:3.0:1787826301.145591:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826301.145694:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563635840 00000100:00100000:0.0:1787826301.145704:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563635840 00000100:00100000:0.0:1787826301.145763:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3254 00000100:00100000:0.0:1787826301.145773:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03bdd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:51032:x1874670563635840:12345-192.168.203.39@tcp:44:lfs.0 00000001:00080000:1.0:1787826301.148146:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969316 is committed 00010000:00010000:2.0:1787826301.148394:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426800/0x22153cd396b7f3c3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.148410:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426800/0x22153cd396b7f3c3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.148417:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426800/0x22153cd396b7f3c3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.148628:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce02426800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826301.148634:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426800/0x22153cd396b7f3c3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.148643:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426800/0x22153cd396b7f3c3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.148658:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfe7a1a38 (ffff90cf3a84a600) 00010000:00010000:2.0:1787826301.148662:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826301.148666:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426800/0x22153cd396b7f3c3 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.148673:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426800/0x22153cd396b7f3c3 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.148693:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427c00/0x22153cd396b7f3ca lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.148699:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427c00/0x22153cd396b7f3ca lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.148705:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427c00/0x22153cd396b7f3ca lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.148711:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce02427c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826301.148714:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427c00/0x22153cd396b7f3ca lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.148720:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427c00/0x22153cd396b7f3ca lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.148727:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0x0 (ffff90cf3a84aa00) 00010000:00010000:2.0:1787826301.148730:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826301.148733:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427c00/0x22153cd396b7f3ca lrc: 2/0,0 mode: --/TXN res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.148739:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427c00/0x22153cd396b7f3ca lrc: 0/0,0 mode: --/TXN res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.148754:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7400/0x22153cd396b7f409 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.148761:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7400/0x22153cd396b7f409 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.148767:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7400/0x22153cd396b7f409 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.148772:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3abd7400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826301.148775:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7400/0x22153cd396b7f409 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.148781:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7400/0x22153cd396b7f409 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.148789:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0xaf1e71b4 (ffff90cf11e81800) 00010000:00010000:2.0:1787826301.148791:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826301.148794:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7400/0x22153cd396b7f409 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.148800:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7400/0x22153cd396b7f409 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826301.148899:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03bdd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:51032:x1874670563635840:12345-192.168.203.39@tcp:44:lfs.0 Request processed in 3124us (3315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826301.148909:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3254 00000100:00100000:1.0:1787826301.160341:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826301.160636:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563635968 00000100:00100000:2.0:1787826301.160647:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563635968 00000100:00100000:2.0:1787826301.160709:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1675 00000100:00100000:2.0:1787826301.160719:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f806d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563635968:12345-192.168.203.39@tcp:16:lfs.0 00000100:00100000:2.0:1787826301.160834:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f806d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563635968:12345-192.168.203.39@tcp:16:lfs.0 Request processed in 116us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826301.160842:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1675 00000100:00100000:1.0:1787826301.194850:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826301.194936:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563636096 00000100:00100000:2.0:1787826301.194946:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563636096 00000100:00100000:2.0:1787826301.195015:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1676 00000100:00100000:2.0:1787826301.195026:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03b903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670563636096:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:2.0:1787826301.195076:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000046185508/0x22153cd396b7f4bf lrc: 3/1,0 mode: --/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.195092:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826301.195097:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826301.195103:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046185508/0x22153cd396b7f4bf lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.195122:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046185508/0x22153cd396b7f4bf lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.195148:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000046185508/0x22153cd396b7f4bf lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.195169:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000046185508/0x22153cd396b7f4bf lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.195179:0:14864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000046185508/0x22153cd396b7f4bf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.195186:0:14864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce02427c00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826301.195190:0:14864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000046185508/0x22153cd396b7f4bf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.195199:0:14864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000046185508/0x22153cd396b7f4bf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.195215:0:14864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000046185508/0x22153cd396b7f4bf lrc: 2/0,0 mode: --/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.195223:0:14864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046185508/0x22153cd396b7f4bf lrc: 0/0,0 mode: --/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826301.195303:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03b903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670563636096:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 279us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826301.195311:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1676 00000100:00100000:3.0:1787826301.198381:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826301.198514:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563636352 00000100:00100000:0.0:1787826301.198525:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563636352 00000100:00100000:0.0:1787826301.198586:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3255 00000100:00100000:0.0:1787826301.198596:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03bdf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:51032:x1874670563636352:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:0.0:1787826301.198650:0:8247:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826301.198676:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7000/0x22153cd396b7f495 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab011e expref: 25 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.198693:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x10:0x0].0x0 (ffff90cf11e81200) 00010000:00010000:0.0:1787826301.198702:0:8247:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826301.198733:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70f400/0x22153cd396b7f4c6 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.198746:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70f400/0x22153cd396b7f4c6 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.198755:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70f400/0x22153cd396b7f4c6 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826301.198888:0:8247:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a8070197 reply state 000000007966b2d1 transno 4294969317 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70f400/0x22153cd396b7f4c6 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.198900:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70f400/0x22153cd396b7f4c6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.198906:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x10:0x0].0x0 (ffff90ce01f45900) 00010000:00010000:0.0:1787826301.198909:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826301.198911:0:8247:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787826301.199010:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03bdf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:51032:x1874670563636352:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 416us (637us total) trans 4294969317 rc 0/0 00000100:00100000:0.0:1787826301.199017:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3255 00000100:00100000:1.0:1787826301.204134:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826301.204338:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563636480 00000100:00100000:0.0:1787826301.204348:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563636480 00000100:00100000:0.0:1787826301.204408:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3256 00000100:00100000:0.0:1787826301.204418:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03b91680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:51032:x1874670563636480:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826301.204441:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826301.204461:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70fc00/0x22153cd396b7f4cd lrc: 2/0,0 mode: --/CR res: [0x200000405:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0133 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.204547:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70fc00/0x22153cd396b7f4cd lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0133 expref: 27 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.204568:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70fc00/0x22153cd396b7f4cd lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0133 expref: 27 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.204586:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x10:0x0].0x0 (ffff90ce01f45900) 00010000:00010000:0.0:1787826301.204589:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826301.204592:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0a70fc00, rc 0) 00000100:00100000:0.0:1787826301.204649:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03b91680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:51032:x1874670563636480:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 233us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826301.204656:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3256 00000100:00100000:3.0:1787826301.207747:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826301.207889:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563636608 00000100:00100000:2.0:1787826301.207898:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563636608 00000100:00100000:2.0:1787826301.207946:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1677 00000100:00100000:2.0:1787826301.207955:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f876d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2402:x1874670563636608:12345-192.168.203.39@tcp:2:lfs.0 00002000:00010000:2.0:1787826301.208128:0:8437:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xe0:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787826301.208133:0:8437:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xe0:0x0] updating lvb mtime from disk: 0 -> 1787826301 00002000:00010000:2.0:1787826301.208135:0:8437:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xe0:0x0] updating lvb atime from disk: 0 -> 1787826301 00002000:00010000:2.0:1787826301.208137:0:8437:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xe0:0x0] updating lvb ctime from disk: 0 -> 1787826301 00002000:00010000:2.0:1787826301.208139:0:8437:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xe0:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1787826301.208320:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f876d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2402:x1874670563636608:12345-192.168.203.39@tcp:2:lfs.0 Request processed in 366us (582us total) trans 17179869568 rc 0/0 00000100:00100000:2.0:1787826301.208328:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1677 00000100:00100000:3.0:1787826301.211796:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826301.211925:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563636864 00000100:00100000:1.0:1787826301.211934:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563636864 00000100:00100000:1.0:1787826301.212046:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3257 00000100:00100000:1.0:1787826301.212057:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f876580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:51032:x1874670563636864:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:1.0:1787826301.212110:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826301.212138:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426e00/0x22153cd396b7f44f lrc: 0/0,0 mode: --/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0102 expref: 27 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.212170:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff90cf39e67f00) 00010000:00010000:1.0:1787826301.212175:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826301.212231:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f17000/0x22153cd396b7f4d4 lrc: 3/0,1 mode: --/PW res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.212245:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f17000/0x22153cd396b7f4d4 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.212255:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f17000/0x22153cd396b7f4d4 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826301.212352:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ec72e7bb reply state 0000000049491206 transno 4294969318 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f17000/0x22153cd396b7f4d4 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.212364:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f17000/0x22153cd396b7f4d4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.212371:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff90cf39e67f00) 00010000:00010000:1.0:1787826301.212373:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826301.212376:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826301.212743:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f876580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+28:51032:x1874670563636864:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 687us (954us total) trans 4294969318 rc 0/0 00000100:00100000:1.0:1787826301.212750:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3257 00000100:00100000:1.0:1787826301.215653:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826301.215965:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563636992 00000100:00100000:3.0:1787826301.215983:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563636992 00000100:00100000:3.0:1787826301.216095:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1678 00000100:00100000:3.0:1787826301.216105:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03b92d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2402:x1874670563636992:12345-192.168.203.39@tcp:2:lfs.0 00002000:00010000:3.0:1787826301.216311:0:30694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xd4:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787826301.216315:0:30694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xd4:0x0] updating lvb mtime from disk: 0 -> 1787826301 00002000:00010000:3.0:1787826301.216317:0:30694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xd4:0x0] updating lvb atime from disk: 0 -> 1787826301 00002000:00010000:3.0:1787826301.216320:0:30694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xd4:0x0] updating lvb ctime from disk: 0 -> 1787826301 00002000:00010000:3.0:1787826301.216322:0:30694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xd4:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1787826301.216382:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03b92d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2402:x1874670563636992:12345-192.168.203.39@tcp:2:lfs.0 Request processed in 279us (737us total) trans 21474836890 rc 0/0 00000100:00100000:3.0:1787826301.216391:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1678 00000100:00100000:1.0:1787826301.220042:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826301.220114:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563637248 00000100:00100000:2.0:1787826301.220125:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563637248 00000100:00100000:2.0:1787826301.220360:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 966 00000100:00100000:2.0:1787826301.220372:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03b92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+28:51032:x1874670563637248:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:2.0:1787826301.220449:0:14257:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000405:0xf:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7f4aa lrc: 3/0,0 mode: PW/PW res: [0x200000405:0xf:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab012c expref: 28 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.220517:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427c00/0x22153cd396b7f4db lrc: 3/0,1 mode: --/EX res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.220536:0:14257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f17600/0x22153cd396b7f433 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab00fb expref: 28 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.220544:0:14257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427c00/0x22153cd396b7f4db lrc: 4/0,1 mode: --/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.220575:0:14257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f17600/0x22153cd396b7f433 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab00fb expref: 28 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.220587:0:14257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f17600/0x22153cd396b7f433 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab00fb expref: 28 pid: 6519 timeout: 1347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826301.220601:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab14780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585126400:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826301.220680:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf117b0b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826301.224730:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826301.224806:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563637376 00000100:00100000:3.0:1787826301.224815:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563637376 00010000:00010000:3.0:1787826301.224848:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f17600/0x22153cd396b7f433 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab00fb expref: 29 pid: 6519 timeout: 1347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826301.224884:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 905 00000100:00100000:3.0:1787826301.224893:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03b90780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+29:2404:x1874670563637376:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826301.224907:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826301.224913:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f17600/0x22153cd396b7f433 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab00fb expref: 29 pid: 6519 timeout: 1347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.224925:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f17600/0x22153cd396b7f433 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab00fb expref: 29 pid: 6519 timeout: 1347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.224946:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff90cf39e67f00) 00010000:00010000:3.0:1787826301.224952:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427c00/0x22153cd396b7f4db lrc: 3/0,1 mode: --/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.224960:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427c00/0x22153cd396b7f4db lrc: 3/0,1 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.224967:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427c00/0x22153cd396b7f4db lrc: 4/0,1 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.224997:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826301.225045:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03b90780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+29:2404:x1874670563637376:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 153us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826301.225052:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 905 00010000:00010000:2.0:1787826301.226213:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f17600/0x22153cd396b7f433 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab00fb expref: 28 pid: 6519 timeout: 1347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826301.226235:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab14780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585126400:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826301.226257:0:14257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427c00/0x22153cd396b7f4db lrc: 3/0,1 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.226267:0:14257:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427c00/0x22153cd396b7f4db lrc: 3/0,1 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.226272:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427c00/0x22153cd396b7f4db lrc: 3/0,1 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.226294:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426800/0x22153cd396b7f4e2 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.226306:0:14257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70fc00/0x22153cd396b7f4cd lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0133 expref: 27 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.226313:0:14257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426800/0x22153cd396b7f4e2 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x10:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.226342:0:14257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70fc00/0x22153cd396b7f4cd lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0133 expref: 27 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.226355:0:14257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70fc00/0x22153cd396b7f4cd lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0133 expref: 27 pid: 6518 timeout: 1347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826301.226369:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab14780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585126528:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826301.226437:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf117b0b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826301.230540:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826301.230791:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab14780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585126528:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826301.230818:0:14257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426800/0x22153cd396b7f4e2 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x10:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826301.230888:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563637504 00000100:00100000:3.0:1787826301.230895:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563637504 00010000:00010000:3.0:1787826301.230929:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70fc00/0x22153cd396b7f4cd lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0133 expref: 28 pid: 6518 timeout: 1347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826301.230966:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 906 00000100:00100000:3.0:1787826301.230985:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03b930c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+28:2403:x1874670563637504:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826301.231001:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826301.231009:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70fc00/0x22153cd396b7f4cd lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0133 expref: 28 pid: 6518 timeout: 1347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.231021:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70fc00/0x22153cd396b7f4cd lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0133 expref: 28 pid: 6518 timeout: 1347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.231042:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70fc00/0x22153cd396b7f4cd lrc: 0/0,0 mode: --/CR res: [0x200000405:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0133 expref: 28 pid: 6518 timeout: 1347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.231059:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x10:0x0].0x0 (ffff90ce01f45900) 00010000:00010000:3.0:1787826301.231064:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426800/0x22153cd396b7f4e2 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x10:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.231074:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426800/0x22153cd396b7f4e2 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x10:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.231086:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426800/0x22153cd396b7f4e2 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x10:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.231118:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826301.231429:0:14257:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426800/0x22153cd396b7f4e2 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.231437:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426800/0x22153cd396b7f4e2 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826301.231730:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab14780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585126656:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1787826301.231790:0:14257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826301.231824:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf117b0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787826301.231894:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03b930c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+28:2403:x1874670563637504:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 918us (1362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826301.231903:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 906 00000100:00100000:1.0:1787826301.232082:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585126656 00000100:00100000:1.0:1787826301.232089:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585126656 00000100:00080000:2.0:1787826301.232363:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826301.232412:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1288 00000100:00100000:1.0:1787826301.232424:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab14f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:14257:x1874670585126656:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1787826301.232541:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab14f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:14257:x1874670585126656:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 119us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826301.232605:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab14780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585126656:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1787826301.232681:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab14780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585126784:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1787826301.232708:0:14257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826301.232726:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce04d24d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787826301.232741:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585126784 00000100:00100000:2.0:1787826301.232745:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585126784 00000100:00100000:1.0:1787826301.234841:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1288 00000100:00100000:2.0:1787826301.235038:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1289 00000100:00100000:2.0:1787826301.235054:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:14257:x1874670585126784:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1787826301.235183:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:14257:x1874670585126784:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 136us (2473us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826301.235190:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1289 00000100:00100000:1.0:1787826301.235267:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab14780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585126784:0@lo:1000:mdt_rdpg00_002.0 00000040:00080000:1.0:1787826301.235447:0:14257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x2:0x0].32, 280 off58544 00000001:00080000:1.0:1787826301.235460:0:14257:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294969319 00000100:00100000:1.0:1787826301.235540:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03b93840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585126912:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1787826301.235577:0:14257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826301.235934:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068bdf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787826301.236004:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585126912 00000100:00100000:3.0:1787826301.236010:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585126912 00000100:00100000:3.0:1787826301.236041:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1290 00000100:00100000:3.0:1787826301.236048:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03b93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:14257:x1874670585126912:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1787826301.236307:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03b93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:14257:x1874670585126912:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 259us (729us total) trans 17179869569 rc 0/0 00000100:00100000:3.0:1787826301.236314:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1290 00000100:00080000:2.0:1787826301.236360:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826301.236422:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03b93840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585126912:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1787826301.236451:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03b90000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585127040:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1787826301.236560:0:14257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826301.236601:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf117b00c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826301.236630:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585127040 00000100:00100000:3.0:1787826301.236633:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585127040 00000100:00100000:3.0:1787826301.236681:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1291 00000100:00100000:3.0:1787826301.236687:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f936580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:14257:x1874670585127040:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1787826301.236952:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f936580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:14257:x1874670585127040:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 265us (391us total) trans 21474836891 rc 0/0 00000100:00100000:3.0:1787826301.236960:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1291 00000100:00100000:1.0:1787826301.237016:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03b90000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585127040:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:1.0:1787826301.237074:0:14257:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294969320 00010000:00010000:1.0:1787826301.237100:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426800/0x22153cd396b7f4e2 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.237110:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426800/0x22153cd396b7f4e2 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.237117:0:14257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426800/0x22153cd396b7f4e2 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.237128:0:14257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce02426800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826301.237132:0:14257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426800/0x22153cd396b7f4e2 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.237139:0:14257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426800/0x22153cd396b7f4e2 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.237166:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x10:0x0].0x0 (ffff90ce01f45900) 00010000:00010000:1.0:1787826301.237169:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787826301.237174:0:14257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426800/0x22153cd396b7f4e2 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.237180:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426800/0x22153cd396b7f4e2 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.237194:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427c00/0x22153cd396b7f4db lrc: 3/0,1 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.237201:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427c00/0x22153cd396b7f4db lrc: 2/0,0 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.237206:0:14257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427c00/0x22153cd396b7f4db lrc: 3/0,0 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.237210:0:14257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce02427c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826301.237212:0:14257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427c00/0x22153cd396b7f4db lrc: 3/0,0 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.237218:0:14257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427c00/0x22153cd396b7f4db lrc: 4/0,0 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.237228:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff90cf39e67f00) 00010000:00010000:1.0:1787826301.237230:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787826301.237234:0:14257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427c00/0x22153cd396b7f4db lrc: 2/0,0 mode: --/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.237239:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427c00/0x22153cd396b7f4db lrc: 0/0,0 mode: --/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.237250:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff90cf39e67f00) 00010000:00010000:1.0:1787826301.237252:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787826301.237258:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7f4aa lrc: 0/0,0 mode: --/PW res: [0x200000405:0xf:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab012c expref: 29 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826301.237347:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03b92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+28:51032:x1874670563637248:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 16977us (17313us total) trans 4294969321 rc 0/0 00000100:00100000:1.0:1787826301.237355:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 966 00000020:00080000:1.0:1787826301.237359:0:14257:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1787826301.242014:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826301.242108:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563637632 00000100:00100000:2.0:1787826301.242117:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563637632 00000100:00100000:2.0:1787826301.242329:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3258 00000100:00100000:2.0:1787826301.242341:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f9343c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+28:51032:x1874670563637632:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826301.242365:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826301.242385:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427800/0x22153cd396b7f4e9 lrc: 2/0,0 mode: --/CR res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab013a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.242755:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427800/0x22153cd396b7f4e9 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab013a expref: 29 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.242770:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427800/0x22153cd396b7f4e9 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab013a expref: 29 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826301.242794:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff90cf39e67f00) 00010000:00010000:2.0:1787826301.242797:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826301.242801:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce02427800, rc 0) 00000100:00100000:2.0:1787826301.242896:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f9343c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+29:51032:x1874670563637632:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 557us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826301.242904:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3258 00000100:00100000:0.0:1787826301.246047:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826301.246219:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563637888 00000100:00100000:3.0:1787826301.246229:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563637888 00000100:00100000:3.0:1787826301.246320:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 967 00000100:00100000:3.0:1787826301.246330:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf10476050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+29:51032:x1874670563637888:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:2.0:1787826301.246872:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf10476050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:51032:x1874670563637888:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 541us (830us total) trans 4294969322 rc 0/0 00000100:00100000:2.0:1787826301.246882:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 967 00000100:00100000:3.0:1787826301.249333:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826301.249399:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563638144 00000100:00100000:1.0:1787826301.249408:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563638144 00000100:00100000:1.0:1787826301.249461:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 968 00000100:00100000:1.0:1787826301.249491:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:51032:x1874670563638144:12345-192.168.203.39@tcp:35:lfs.0 00000004:00080000:1.0:1787826301.249663:0:14257:0:(mdd_object.c:4014:mdd_close()) Object [0x200000405:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:1.0:1787826301.249739:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f16800/0x22153cd396b7f4f0 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.249754:0:14257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f16800/0x22153cd396b7f4f0 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.249780:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f16800/0x22153cd396b7f4f0 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.249788:0:14257:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f16800/0x22153cd396b7f4f0 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.249794:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f16800/0x22153cd396b7f4f0 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.249800:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f16800/0x22153cd396b7f4f0 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.250150:0:14257:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787826301.250244:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:51032:x1874670563638144:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 773us (918us total) trans 4294969323 rc 0/0 00000100:00100000:1.0:1787826301.250253:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 968 00010000:00010000:3.0:1787826301.259847:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826301.259862:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f16800/0x22153cd396b7f4f0 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.259873:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01f16800 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826301.259878:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f16800/0x22153cd396b7f4f0 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.259887:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f16800/0x22153cd396b7f4f0 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.259906:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x10:0x0].0x0 (ffff90ce01f45900) 00010000:00010000:3.0:1787826301.259909:0:8451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787826301.259914:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f16800/0x22153cd396b7f4f0 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.259920:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f16800/0x22153cd396b7f4f0 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826301.259939:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826301.259942:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826301.259943:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826301.260301:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826301.278327:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826301.278866:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563638400 00000100:00100000:0.0:1787826301.278875:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563638400 00000100:00100000:0.0:1787826301.278942:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3259 00000100:00100000:0.0:1787826301.278952:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f877c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:51034:x1874670563638400:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826301.278983:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826301.279005:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70f200/0x22153cd396b7f4f7 lrc: 2/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0141 expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.279099:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70f000/0x22153cd396b7f4fe lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.279113:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70f000/0x22153cd396b7f4fe lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.279125:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70f000/0x22153cd396b7f4fe lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.279145:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70f800/0x22153cd396b7f505 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.279207:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70f800/0x22153cd396b7f505 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.279218:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70f800/0x22153cd396b7f505 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.279293:0:8247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70f000/0x22153cd396b7f4fe lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.279300:0:8247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70f000/0x22153cd396b7f4fe lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.279307:0:8247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70f000/0x22153cd396b7f4fe lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.279312:0:8247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0a70f000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826301.279316:0:8247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70f000/0x22153cd396b7f4fe lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.279325:0:8247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70f000/0x22153cd396b7f4fe lrc: 4/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.279336:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0x0 (ffff90cf3a84aa00) 00010000:00010000:0.0:1787826301.279339:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826301.279343:0:8247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70f000/0x22153cd396b7f4fe lrc: 2/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.279350:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70f000/0x22153cd396b7f4fe lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.279362:0:8247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70f800/0x22153cd396b7f505 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.279369:0:8247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70f800/0x22153cd396b7f505 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.279374:0:8247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70f800/0x22153cd396b7f505 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.279380:0:8247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0a70f800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826301.279383:0:8247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70f800/0x22153cd396b7f505 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.279388:0:8247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70f800/0x22153cd396b7f505 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.279395:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0xaf1e71b4 (ffff90ce01f45500) 00010000:00010000:0.0:1787826301.279398:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826301.279400:0:8247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70f800/0x22153cd396b7f505 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.279406:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70f800/0x22153cd396b7f505 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.279442:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70f200/0x22153cd396b7f4f7 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0141 expref: 32 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.279451:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0x0 (ffff90cf3a84aa00) 00010000:00010000:0.0:1787826301.279454:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787826301.279457:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70f200/0x22153cd396b7f4f7 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0141 expref: 32 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826301.279467:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0a70f200, rc 0) 00000100:00100000:0.0:1787826301.279880:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f877c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:51034:x1874670563638400:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 928us (1560us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826301.279888:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3259 00000100:00100000:2.0:1787826301.288144:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826301.288233:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563638656 00000100:00100000:1.0:1787826301.288243:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563638656 00000100:00100000:1.0:1787826301.288305:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3260 00000100:00100000:1.0:1787826301.288315:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:51034:x1874670563638656:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826301.288335:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826301.288355:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f17400/0x22153cd396b7f50c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0148 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826301.288506:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0xe:0x0]: returning size 4096 00010000:00010000:1.0:1787826301.288605:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f17400/0x22153cd396b7f50c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0148 expref: 33 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.288624:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cf39656000) 00010000:00010000:1.0:1787826301.288627:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787826301.288633:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f17400/0x22153cd396b7f50c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0148 expref: 33 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.288646:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01f17400, rc 0) 00000100:00100000:1.0:1787826301.288698:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+32:51034:x1874670563638656:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 384us (562us total) trans 4294969324 rc 301/301 00000100:00100000:1.0:1787826301.288705:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3260 00000100:00100000:3.0:1787826301.291589:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826301.291707:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563638784 00000100:00100000:1.0:1787826301.291716:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563638784 00000100:00100000:1.0:1787826301.291782:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3261 00000100:00100000:1.0:1787826301.291791:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f875e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+32:51034:x1874670563638784:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:1.0:1787826301.291865:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f17600/0x22153cd396b7f51a lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.291881:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f17600/0x22153cd396b7f51a lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.291893:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f17600/0x22153cd396b7f51a lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.291909:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f17a00/0x22153cd396b7f521 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.291915:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f17a00/0x22153cd396b7f521 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.291924:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f17a00/0x22153cd396b7f521 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.292027:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f16600/0x22153cd396b7f528 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.292035:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f16600/0x22153cd396b7f528 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.292042:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f16600/0x22153cd396b7f528 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826301.292083:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0xf:0x0]: returning size 0 00000004:00200000:1.0:1787826301.292088:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826301.292102:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f16600/0x22153cd396b7f528 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.292117:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f17600/0x22153cd396b7f51a lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.292124:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f17600/0x22153cd396b7f51a lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.292130:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f17600/0x22153cd396b7f51a lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.292138:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f17600/0x22153cd396b7f51a lrc: 4/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.292145:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01f17600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826301.292157:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f17600/0x22153cd396b7f51a lrc: 4/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.292171:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f17600/0x22153cd396b7f51a lrc: 5/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.292183:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0x0 (ffff90cf3a84aa00) 00010000:00010000:1.0:1787826301.292186:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826301.292190:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f17600/0x22153cd396b7f51a lrc: 3/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.292197:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f17600/0x22153cd396b7f51a lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.292213:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f17a00/0x22153cd396b7f521 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.292219:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f17a00/0x22153cd396b7f521 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.292224:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f17a00/0x22153cd396b7f521 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.292229:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01f17a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826301.292231:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f17a00/0x22153cd396b7f521 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.292236:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f17a00/0x22153cd396b7f521 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.292243:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0xaf1e71b4 (ffff90cf06894100) 00010000:00010000:1.0:1787826301.292246:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826301.292249:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f17a00/0x22153cd396b7f521 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.292258:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f17a00/0x22153cd396b7f521 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.292270:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f16600/0x22153cd396b7f528 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.292276:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f16600/0x22153cd396b7f528 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.292281:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f16600/0x22153cd396b7f528 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.292286:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01f16600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826301.292288:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f16600/0x22153cd396b7f528 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.292293:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f16600/0x22153cd396b7f528 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.292300:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff90cf39e67f00) 00010000:00010000:1.0:1787826301.292302:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826301.292305:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f16600/0x22153cd396b7f528 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826301.292310:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f16600/0x22153cd396b7f528 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826301.292382:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f875e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+32:51034:x1874670563638784:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 591us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826301.292390:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3261 00000100:00100000:3.0:1787826301.299209:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826301.299598:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563639040 00000100:00100000:0.0:1787826301.299608:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563639040 00000100:00100000:0.0:1787826301.299699:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 969 00000100:00100000:0.0:1787826301.299709:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f874b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+32:51034:x1874670563639040:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:0.0:1787826301.299988:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f874b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:51034:x1874670563639040:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 280us (789us total) trans 4294969325 rc 0/0 00000100:00100000:0.0:1787826301.299996:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 969 00010000:00010000:2.0:1787826302.280433:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787826303.165987:0:34057:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1787826303.166040:0:34057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff90cf10a06e00/0x22153cd396b6d38f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x22153cd396b6d396 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.166053:0:34057:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff90cf10a06e00/0x22153cd396b6d38f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x22153cd396b6d396 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.166060:0:34057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff90cf10a06e00/0x22153cd396b6d38f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x22153cd396b6d396 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.166066:0:34057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.139@tcp lock: ffff90cf10a06e00/0x22153cd396b6d38f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x22153cd396b6d396 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.166090:0:34057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787826303.166096:0:34057:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787826303.166120:0:34057:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787826303.166124:0:34057:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787826303.166129:0:34057:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787826303.166151:0:34057:0:(import.c:65:import_set_state_nolock()) ffff90cf180eb000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1787826303.166245:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826303.166252:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff90cf10a06e00/0x22153cd396b6d38f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x22153cd396b6d396 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.166259:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf10a06e00 already unused, calling callback (ffffffffc12e3c20) 10000000:00010000:2.0:1787826303.166263:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff90cf10a06e00/0x22153cd396b6d38f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x22153cd396b6d396 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.166271:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff90cf10a06e00/0x22153cd396b6d38f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x22153cd396b6d396 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787826303.166278:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff90cf10a06e00/0x22153cd396b6d38f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x22153cd396b6d396 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826303.166284:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787826303.166286:0:6506:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787826303.166289:0:6506:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787826303.166315:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff90cf10a06e00/0x22153cd396b6d38f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x22153cd396b6d396 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.166322:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787826303.166345:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff90cf10a06e00/0x22153cd396b6d38f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x22153cd396b6d396 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.166352:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff90cf10a06e00/0x22153cd396b6d38f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x22153cd396b6d396 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.166364:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826303.166365:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826303.166367:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826303.166373:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787826303.166389:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e3c550b8-2c3c-46c3-ad36-671c284167ea:3646:1874670585127296:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787826303.166444:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826303.166521:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585127296 00000100:00100000:2.0:1787826303.166526:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585127296 00000100:00100000:2.0:1787826303.166566:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1787826303.166575:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab16d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e3c550b8-2c3c-46c3-ad36-671c284167ea+24:3646:x1874670585127296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787826303.166586:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826303.166645:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cf0165e600/0x22153cd396b6d396 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22153cd396b6d38f expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826303.166658:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826303.166688:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab16d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e3c550b8-2c3c-46c3-ad36-671c284167ea+23:3646:x1874670585127296:12345-0@lo:103:ldlm_bl.0 Request processed in 114us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826303.166695:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1787826303.166723:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e3c550b8-2c3c-46c3-ad36-671c284167ea:3646:1874670585127296:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826303.167323:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab92940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874670585127168:0@lo:39:umount.0 00000100:00100000:1.0:1787826303.167361:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826303.169136:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585127168 00000100:00100000:0.0:1787826303.169145:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585127168 00000100:00100000:0.0:1787826303.169207:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3262 00000100:00100000:0.0:1787826303.169215:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f934b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874670585127168:12345-0@lo:39:umount.0 00000020:00000080:0.0:1787826303.169245:0:6520:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x22153cd396b6cef0 00000100:00080000:0.0:1787826303.169254:0:6520:0:(import.c:65:import_set_state_nolock()) ffff90cf39eb2000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787826303.169343:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f934b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3643:x1874670585127168:12345-0@lo:39:umount.0 Request processed in 129us (1981us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826303.169351:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3262 00000020:00000080:0.0:1787826303.169362:0:6520:0:(genops.c:885:class_export_put()) final put ffff90cf39eb4800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:1.0:1787826303.169449:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90cf180eb000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787826303.169490:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab92940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874670585127168:0@lo:39:umount.0 00000020:00000080:1.0:1787826303.169518:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90cf39eb4800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1787826303.169563:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90cf39eb2000 for lustre-MDT0000 00000100:00080000:0.0:1787826303.169619:0:34057:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787826303.169623:0:34057:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787826303.169628:0:34057:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787826303.170602:0:34057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff90cf3a838000/0x22153cd396b6d39d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x22153cd396b6d3a4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.170615:0:34057:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff90cf3a838000/0x22153cd396b6d39d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x22153cd396b6d3a4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.170621:0:34057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff90cf3a838000/0x22153cd396b6d39d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x22153cd396b6d3a4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.170628:0:34057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.139@tcp lock: ffff90cf3a838000/0x22153cd396b6d39d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x22153cd396b6d3a4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.171369:0:34057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826303.171379:0:34057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff90cf3a838e00/0x22153cd396b77c68 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22153cd396b77c6f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.171388:0:34057:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff90cf3a838e00/0x22153cd396b77c68 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x22153cd396b77c6f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.171394:0:34057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff90cf3a838e00/0x22153cd396b77c68 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x22153cd396b77c6f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.171400:0:34057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.139@tcp lock: ffff90cf3a838e00/0x22153cd396b77c68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x22153cd396b77c6f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.171655:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787826303.171663:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff90cf3a838000/0x22153cd396b6d39d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x22153cd396b6d3a4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.171670:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a838000 already unused, calling callback (ffffffffc12e3c20) 10000000:00010000:1.0:1787826303.171673:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff90cf3a838000/0x22153cd396b6d39d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x22153cd396b6d3a4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.171681:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff90cf3a838000/0x22153cd396b6d39d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x22153cd396b6d3a4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787826303.171688:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff90cf3a838000/0x22153cd396b6d39d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x22153cd396b6d3a4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826303.171693:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787826303.171696:0:6507:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1787826303.171729:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff90cf3a838000/0x22153cd396b6d39d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x22153cd396b6d3a4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.171735:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787826303.171767:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff90cf3a838000/0x22153cd396b6d39d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x22153cd396b6d3a4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.171774:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff90cf3a838000/0x22153cd396b6d39d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x22153cd396b6d3a4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.171788:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826303.171792:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff90cf3a838e00/0x22153cd396b77c68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x22153cd396b77c6f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.171798:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a838e00 already unused, calling callback (ffffffffc12e3c20) 10000000:00010000:1.0:1787826303.171800:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff90cf3a838e00/0x22153cd396b77c68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x22153cd396b77c6f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.171807:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff90cf3a838e00/0x22153cd396b77c68 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x22153cd396b77c6f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787826303.171813:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff90cf3a838e00/0x22153cd396b77c68 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x22153cd396b77c6f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826303.171817:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1787826303.171819:0:6507:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:1.0:1787826303.171831:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff90cf3a838e00/0x22153cd396b77c68 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x22153cd396b77c6f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.171837:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787826303.171843:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff90cf3a838e00/0x22153cd396b77c68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x22153cd396b77c6f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.171851:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826303.171852:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826303.171854:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826303.171869:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f935e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e3c550b8-2c3c-46c3-ad36-671c284167ea:3645:1874670585127552:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826303.171930:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826303.171985:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787826303.171991:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f936d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e3c550b8-2c3c-46c3-ad36-671c284167ea:3645:1874670585127424:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826303.172014:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826303.172039:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585127552 00000100:00100000:1.0:1787826303.172044:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585127552 00000100:00100000:1.0:1787826303.172082:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585127424 00000100:00100000:1.0:1787826303.172085:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585127424 00000100:00100000:1.0:1787826303.172106:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1787826303.172114:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f936940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3c550b8-2c3c-46c3-ad36-671c284167ea+24:3645:x1874670585127552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787826303.172126:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826303.172140:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90ce05661a00/0x22153cd396b77c6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22153cd396b77c68 expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.172152:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826303.172184:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f936940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3c550b8-2c3c-46c3-ad36-671c284167ea+23:3645:x1874670585127552:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826303.172191:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1787826303.172207:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1787826303.172212:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf181fe050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3c550b8-2c3c-46c3-ad36-671c284167ea+22:3645:x1874670585127424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787826303.172220:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826303.172229:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cf0165ea00/0x22153cd396b6d3a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22153cd396b6d39d expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.172238:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826303.172258:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf181fe050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3c550b8-2c3c-46c3-ad36-671c284167ea+21:3645:x1874670585127424:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826303.172264:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1787826303.172317:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f936d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e3c550b8-2c3c-46c3-ad36-671c284167ea:3645:1874670585127424:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826303.172325:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f935e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e3c550b8-2c3c-46c3-ad36-671c284167ea:3645:1874670585127552:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787826303.172528:0:34057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787826303.172535:0:34057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff90cf3a838e00/0x22153cd396b77c68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x22153cd396b77c6f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826303.172546:0:34057:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1787826303.172554:0:34057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff90cf2f401600/0x22153cd396b6d437 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22153cd396b6d43e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.172562:0:34057:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff90cf2f401600/0x22153cd396b6d437 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x22153cd396b6d43e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.172569:0:34057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff90cf2f401600/0x22153cd396b6d437 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x22153cd396b6d43e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.172576:0:34057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.139@tcp lock: ffff90cf2f401600/0x22153cd396b6d437 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x22153cd396b6d43e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.172596:0:34057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826303.172602:0:34057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff90cf0165f400/0x22153cd396b6ce4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22153cd396b6ce56 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.172609:0:34057:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff90cf0165f400/0x22153cd396b6ce4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x22153cd396b6ce56 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.172615:0:34057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff90cf0165f400/0x22153cd396b6ce4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x22153cd396b6ce56 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.172621:0:34057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.139@tcp lock: ffff90cf0165f400/0x22153cd396b6ce4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x22153cd396b6ce56 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826303.172630:0:34057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1787826303.172633:0:34057:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1787826303.172636:0:34057:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1787826303.172667:0:34057:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1787826303.172671:0:34057:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:0.0:1787826303.172675:0:34057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:02000400:0.0:1787826303.172679:0:34057:0:(obd_config.c:933:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:1.0:1787826303.173103:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787826303.173109:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff90cf2f401600/0x22153cd396b6d437 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x22153cd396b6d43e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.173117:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401600 already unused, calling callback (ffffffffc12e3c20) 10000000:00010000:1.0:1787826303.173121:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff90cf2f401600/0x22153cd396b6d437 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x22153cd396b6d43e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.173129:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff90cf2f401600/0x22153cd396b6d437 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x22153cd396b6d43e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787826303.173136:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff90cf2f401600/0x22153cd396b6d437 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x22153cd396b6d43e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826303.173142:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787826303.173144:0:6507:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787826303.173146:0:6507:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787826303.173167:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff90cf2f401600/0x22153cd396b6d437 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x22153cd396b6d43e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.173173:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787826303.173192:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff90cf2f401600/0x22153cd396b6d437 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x22153cd396b6d43e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.173199:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff90cf2f401600/0x22153cd396b6d437 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x22153cd396b6d43e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.173208:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826303.173211:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff90cf0165f400/0x22153cd396b6ce4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x22153cd396b6ce56 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.173221:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165f400 already unused, calling callback (ffffffffc12e3c20) 10000000:00010000:1.0:1787826303.173224:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff90cf0165f400/0x22153cd396b6ce4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x22153cd396b6ce56 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.173231:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff90cf0165f400/0x22153cd396b6ce4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x22153cd396b6ce56 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787826303.173237:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff90cf0165f400/0x22153cd396b6ce4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x22153cd396b6ce56 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826303.173242:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1787826303.173244:0:6507:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1787826303.173246:0:6507:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1787826303.173258:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff90cf0165f400/0x22153cd396b6ce4f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x22153cd396b6ce56 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.173264:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787826303.173270:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff90cf0165f400/0x22153cd396b6ce4f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x22153cd396b6ce56 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.173277:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff90cf0165f400/0x22153cd396b6ce4f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x22153cd396b6ce56 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.173286:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826303.173288:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826303.173290:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826303.173377:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f936d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e3c550b8-2c3c-46c3-ad36-671c284167ea:3647:1874670585127808:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826303.173418:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826303.173454:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787826303.173461:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f935e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e3c550b8-2c3c-46c3-ad36-671c284167ea:3647:1874670585127680:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826303.173501:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826303.173527:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585127808 00000100:00100000:1.0:1787826303.173531:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585127808 00000100:00100000:1.0:1787826303.173562:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585127680 00000100:00100000:1.0:1787826303.173566:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585127680 00000100:00100000:1.0:1787826303.173586:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1787826303.173595:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f936940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3c550b8-2c3c-46c3-ad36-671c284167ea+22:3647:x1874670585127808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787826303.173605:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826303.173615:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cf421f3600/0x22153cd396b6ce56 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22153cd396b6ce4f expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.173626:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826303.173656:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f936940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3c550b8-2c3c-46c3-ad36-671c284167ea+21:3647:x1874670585127808:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826303.173662:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1787826303.173676:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1787826303.173683:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f9352c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3c550b8-2c3c-46c3-ad36-671c284167ea+20:3647:x1874670585127680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787826303.173691:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826303.173700:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cf3abd6000/0x22153cd396b6d43e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22153cd396b6d437 expref: 20 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.173707:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826303.173725:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f9352c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3c550b8-2c3c-46c3-ad36-671c284167ea+19:3647:x1874670585127680:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826303.173730:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1787826303.173756:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f935e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e3c550b8-2c3c-46c3-ad36-671c284167ea:3647:1874670585127680:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826303.173764:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f936d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e3c550b8-2c3c-46c3-ad36-671c284167ea:3647:1874670585127808:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787826303.173784:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826303.176197:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826303.176787:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000080:0.0:1787826303.178282:0:34057:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00080000:1.0:1787826303.181491:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969325 is committed 00000020:00080000:1.0:1787826303.181516:0:6497:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90cf117b0b40 refcount 2 committed 0 result 0 batchid 55 00000020:00080000:1.0:1787826303.181521:0:6497:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cf2f5d3000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90ce030c9480 00000020:00080000:1.0:1787826303.181525:0:6497:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cf3a9ebc00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90cf10a04c00 00000020:00080000:1.0:1787826303.181528:0:6497:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cf3a9eb500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90ce01da5e00 00000020:00080000:1.0:1787826303.181531:0:6497:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000400:0x2:0x0].32 00010000:00010000:3.0:1787826303.181597:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70f400/0x22153cd396b7f4c6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.181609:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70f400/0x22153cd396b7f4c6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.181622:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70f400/0x22153cd396b7f4c6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.181628:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0a70f400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826303.181632:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70f400/0x22153cd396b7f4c6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.181640:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70f400/0x22153cd396b7f4c6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.181658:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x10:0x0].0x0 (ffff90ce01f45900) 00010000:00010000:3.0:1787826303.181661:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826303.181666:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70f400/0x22153cd396b7f4c6 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.181673:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70f400/0x22153cd396b7f4c6 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.181697:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f17000/0x22153cd396b7f4d4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.181703:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f17000/0x22153cd396b7f4d4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.181709:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f17000/0x22153cd396b7f4d4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.181714:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01f17000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826303.181717:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f17000/0x22153cd396b7f4d4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.181726:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f17000/0x22153cd396b7f4d4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.181733:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff90cf39e67f00) 00010000:00010000:3.0:1787826303.181735:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826303.181738:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f17000/0x22153cd396b7f4d4 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.181745:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f17000/0x22153cd396b7f4d4 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787826303.181758:0:6550:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 55 committed batchid 54 00000020:00080000:3.0:1787826303.181808:0:6550:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 54 00000020:00000080:0.0:1787826303.181909:0:34057:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:0.0:1787826303.181919:0:34057:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff90ce0743f800 09ed01c7-7b8c-4e06-9d82-a6b70e42014a 192.168.203.39@tcp 21 (0 0 17) 0 0 0 0: 0000000000000000 4294969325 stale:0 00000020:00080000:0.0:1787826303.181927:0:34057:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff90cf07853000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787826303.181932:0:34057:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff90ce05f9f800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787826303.181937:0:34057:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff90cf05e61800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787826303.181941:0:34057:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff90cf3720e800 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 1) 0 0 0 0: 0000000000000000 4294969178 stale:0 00000020:00080000:0.0:1787826303.181947:0:34057:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff90cf264f8000) has exports, disconnecting them 00000020:00080000:0.0:1787826303.181952:0:34057:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.203.39@tcp (ffff90ce0743f800), last request at 1787826301 00000020:00000080:0.0:1787826303.181959:0:34057:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x22153cd396b7de0d 00000020:00010000:0.0:1787826303.181993:0:34057:0:(genops.c:1921:obd_stale_export_put()) Put export ffff90ce0743f800: total 0 00000100:00080000:0.0:1787826303.181998:0:34057:0:(import.c:65:import_set_state_nolock()) ffff90ce07439000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787826303.182051:0:34057:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.203.39@tcp (ffff90ce0743f800): rc 0 00000020:00080000:0.0:1787826303.182055:0:34057:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff90cf07853000), last request at 1787826299 00000020:00000080:0.0:1787826303.182058:0:34057:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x22153cd396b77c30 00000100:00080000:0.0:1787826303.182062:0:34057:0:(import.c:65:import_set_state_nolock()) ffff90cf07854000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787826303.182105:0:34057:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90cf07853000): rc 0 00000020:00000080:0.0:1787826303.182108:0:34057:0:(genops.c:885:class_export_put()) final put ffff90cf07853000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1787826303.182117:0:34057:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff90ce05f9f800), last request at 1787826299 00000020:00000080:0.0:1787826303.182120:0:34057:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x22153cd396b77b57 00000100:00080000:0.0:1787826303.182124:0:34057:0:(import.c:65:import_set_state_nolock()) ffff90ce05f9d800 : changing import state from FULL to CLOSED 00000020:00010000:3.0:1787826303.182277:0:6506:0:(genops.c:1907:obd_stale_export_get()) Get export ffff90ce0743f800: total 1 00010000:00010000:3.0:1787826303.182282:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826303.182321:0:6506:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90ce0743f800, canceled 0 locks, left on hash table 17. 00010000:00010000:3.0:1787826303.182346:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70ee00/0x22153cd396b7f3d8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab00df expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.182363:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b7ec3e lrc: 0/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafe70 expref: 17 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.182380:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421f2800/0x22153cd396b7e8da lrc: 0/0,0 mode: --/CR res: [0x200000405:0x3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafd82 expref: 16 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.182394:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026aee00/0x22153cd396b7ead2 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafe00 expref: 15 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.182409:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427800/0x22153cd396b7f4e9 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab013a expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.182424:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427a00/0x22153cd396b7f37d lrc: 0/0,0 mode: --/CR res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab00ca expref: 13 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.182448:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7200/0x22153cd396b7f3ae lrc: 0/0,0 mode: --/CR res: [0x200000405:0xc:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab00d8 expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.182461:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b7df56 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafae2 expref: 11 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.182656:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a000/0x22153cd396b7e48f lrc: 0/0,0 mode: --/PR res: [0x200000405:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafc4e expref: 10 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.182669:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b7e791 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafd20 expref: 9 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.182684:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b7ea93 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafdeb expref: 8 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.182696:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067c00/0x22153cd396b7ec30 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafe69 expref: 7 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.182710:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce026aea00/0x22153cd396b7e9eb lrc: 0/0,0 mode: --/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafdba expref: 6 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.182724:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a838800/0x22153cd396b7f288 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0068 expref: 5 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.182743:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427200/0x22153cd396b7f3f4 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab00e6 expref: 4 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.182758:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f17200/0x22153cd396b7de53 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafaaa expref: 3 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.182772:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426c00/0x22153cd396b7f399 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab00d1 expref: 2 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826303.182998:0:6506:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90ce0743f800, canceled 17 locks, left on hash table 0. 00000020:00000080:2.0:1787826303.183534:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90cf07853000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1787826303.183597:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90cf07854000 for lustre-MDT0000 00000020:00080000:0.0:1787826303.185677:0:34057:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90ce05f9f800): rc 0 00000020:00000080:0.0:1787826303.185684:0:34057:0:(genops.c:885:class_export_put()) final put ffff90ce05f9f800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1787826303.185698:0:34057:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff90cf05e61800), last request at 1787825294 00000020:00000080:0.0:1787826303.185706:0:34057:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x22153cd396b6cfd7 00000100:00080000:0.0:1787826303.185720:0:34057:0:(import.c:65:import_set_state_nolock()) ffff90cf05e65000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787826303.185774:0:34057:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90cf05e61800): rc 0 00000020:00000080:0.0:1787826303.185775:0:34057:0:(genops.c:885:class_export_put()) final put ffff90cf05e61800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1787826303.185780:0:34057:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff90cf3720e800), last request at 1787825294 00000020:00000080:0.0:1787826303.185783:0:34057:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x22153cd396b6cf98 00000020:00010000:0.0:1787826303.185798:0:34057:0:(genops.c:1921:obd_stale_export_put()) Put export ffff90cf3720e800: total 2 00000100:00080000:0.0:1787826303.185801:0:34057:0:(import.c:65:import_set_state_nolock()) ffff90cf36498000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787826303.185806:0:34057:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90cf3720e800): rc 0 00000004:00000080:0.0:1787826303.185813:0:34057:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffff9d4cc806bae0 00000100:00080000:0.0:1787826303.185831:0:34057:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787826303.185835:0:34057:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967576 gen 3 00000100:00080000:0.0:1787826303.187650:0:34057:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1787826303.187682:0:34057:0:(import.c:65:import_set_state_nolock()) ffff90cf05e17800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000020:00010000:1.0:1787826303.187816:0:6507:0:(genops.c:1907:obd_stale_export_get()) Get export ffff90cf3720e800: total 2 00000100:00100000:1.0:1787826303.187836:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab92940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874670585127936:0@lo:39:umount.0 00000100:00100000:1.0:1787826303.187898:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:1.0:1787826303.187951:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90ce05f9f800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1787826303.187999:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90cf05e61800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1787826303.188024:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90ce05f9d800 for lustre-MDT0000 00000020:00000080:1.0:1787826303.188028:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90cf05e65000 for lustre-MDT0000 00010000:00010000:1.0:1787826303.188185:0:6507:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90cf3720e800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787826303.188219:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b6d652 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x22153cd396b6d64b expref: 2 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826303.188239:0:6507:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90cf3720e800, canceled 1 locks, left on hash table 0. 00000100:00100000:0.0:1787826303.190275:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585127936 00000100:00100000:0.0:1787826303.190288:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585127936 00000100:00100000:0.0:1787826303.190356:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1292 00000100:00100000:0.0:1787826303.190366:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f936d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874670585127936:12345-0@lo:39:umount.0 00000020:00000080:0.0:1787826303.190397:0:6523:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x22153cd396b6d032 00000100:00080000:0.0:1787826303.190407:0:6523:0:(import.c:65:import_set_state_nolock()) ffff90cf3aa3b000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787826303.190423:0:6523:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967576 00000100:00100000:0.0:1787826303.191433:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f936d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3643:x1874670585127936:12345-0@lo:39:umount.0 Request processed in 1067us (3533us total) trans 4294967577 rc 0/0 00000100:00100000:0.0:1787826303.191443:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1292 00000100:00080000:0.0:1787826303.191632:0:34057:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787826303.191636:0:34057:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836889 gen 3 00000100:00100000:0.0:1787826303.191644:0:34057:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff90ce03b90000 x1874670585127040/t21474836891(21474836891) o1000->lustre-OST0000-osc-MDT0000@0@lo:24/4 lens 408/4320 e 0 to 0 dl 1787826317 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'mdt_rdpg00_002.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1787826303.191654:0:34057:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474836891 committed transno 21474836889 00000004:00080000:0.0:1787826303.191681:0:34057:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787826303.191753:0:34057:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1787826303.191771:0:34057:0:(import.c:65:import_set_state_nolock()) ffff90cf3f4c7000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1787826303.191781:0:34057:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787826303.191783:0:34057:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869567 gen 3 00000100:00100000:0.0:1787826303.191789:0:34057:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff90ce03b93840 x1874670585126912/t17179869569(17179869569) o1000->lustre-OST0001-osc-MDT0000@0@lo:24/4 lens 408/4320 e 0 to 0 dl 1787826317 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'mdt_rdpg00_002.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1787826303.191796:0:34057:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869569 committed transno 17179869567 00000004:00080000:0.0:1787826303.191820:0:34057:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787826303.191877:0:34057:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1787826303.191886:0:34057:0:(import.c:65:import_set_state_nolock()) ffff90ce036ec000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1787826303.191911:0:34057:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff90cf264f8000) has no exports 00010000:00010000:2.0:1787826303.193647:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826303.193670:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826303.199671:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab93840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874670585128064:0@lo:9:umount.0 00000100:00100000:0.0:1787826303.199749:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826303.199830:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce058bd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874670585128192:0@lo:9:umount.0 00000100:00100000:0.0:1787826303.199853:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787826303.207721:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90cf05e17800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787826303.207737:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab92940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874670585127936:0@lo:39:umount.0 00000100:00100000:2.0:1787826303.212249:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585128064 00000100:00100000:2.0:1787826303.212263:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585128064 00000100:00100000:2.0:1787826303.212340:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585128192 00000100:00100000:2.0:1787826303.212344:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585128192 00000100:00100000:2.0:1787826303.212371:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1679 00000100:00100000:2.0:1787826303.212383:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a183c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3643:x1874670585128064:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787826303.212413:0:28853:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x22153cd396b77b1f 00000100:00080000:2.0:1787826303.212423:0:28853:0:(import.c:65:import_set_state_nolock()) ffff90ce0374a000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787826303.212467:0:28853:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474836891 00000100:00100000:2.0:1787826303.213781:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a183c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+3:3643:x1874670585128064:12345-0@lo:9:umount.0 Request processed in 1396us (14027us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826303.213793:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1679 00000100:00100000:2.0:1787826303.213818:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1680 00000100:00100000:2.0:1787826303.213826:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a19680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3643:x1874670585128192:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787826303.213843:0:28853:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x22153cd396b77bf8 00000100:00080000:2.0:1787826303.213851:0:28853:0:(import.c:65:import_set_state_nolock()) ffff90ce0247a000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787826303.213884:0:28853:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179869569 00000100:00100000:2.0:1787826303.213973:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a19680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+3:3643:x1874670585128192:12345-0@lo:9:umount.0 Request processed in 135us (14105us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826303.213980:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1680 00000100:00080000:2.0:1787826303.214017:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787826303.214022:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787826303.214033:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787826303.214063:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90cf3f4c7000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787826303.214076:0:3643:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787826303.214079:0:3643:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787826303.214082:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab93840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874670585128064:0@lo:9:umount.0 00000100:00080000:2.0:1787826303.214094:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90ce036ec000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787826303.214101:0:3643:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787826303.214103:0:3643:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787826303.214105:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce058bd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874670585128192:0@lo:9:umount.0 00010000:00010000:0.0:1787826303.221004:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787826303.221823:0:6506:0:(genops.c:885:class_export_put()) final put ffff90ce0743f800/09ed01c7-7b8c-4e06-9d82-a6b70e42014a 00000020:00000080:1.0:1787826303.223250:0:6507:0:(genops.c:885:class_export_put()) final put ffff90cf3720e800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787826303.223419:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90ce0743f800/09ed01c7-7b8c-4e06-9d82-a6b70e42014a for lustre-MDT0000 00000020:00000080:2.0:1787826303.223500:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90ce07439000 for lustre-MDT0000 00010000:00010000:2.0:1787826303.223510:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826303.223513:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826303.223515:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826303.223916:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826303.223918:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826303.223920:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787826303.224044:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90cf3720e800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1787826303.224196:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90cf36498000 for lustre-MDT0000 00000100:00100000:2.0:1787826303.235734:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03a18b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585128320:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787826303.235812:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826303.235886:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585128320 00000100:00100000:3.0:1787826303.235893:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585128320 00000100:00100000:3.0:1787826303.235944:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1293 00000100:00100000:3.0:1787826303.235952:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3644:x1874670585128320:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:3.0:1787826303.235959:0:7796:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787826303.245364:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3644:x1874670585128320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 9401us (9541us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787826303.245378:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1293 00000100:02020000:2.0:1787826303.246139:0:3644:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:2.0:1787826303.257701:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787826303.257709:0:3644:0:(import.c:65:import_set_state_nolock()) ffff90cf3720f800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787826303.257715:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1787826303.270014:0:3644:0:(import.c:65:import_set_state_nolock()) ffff90cf3720f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826303.270025:0:3644:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 240 00000100:00080000:2.0:1787826303.270034:0:3644:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff90cf3720f800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:3.0:1787826303.270399:0:3644:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cf3f876940 x1874670585128448/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826303.270456:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f876940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874670585128448:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1787826303.270567:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826303.270771:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585128448 00000100:00100000:2.0:1787826303.270778:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585128448 00000100:00100000:2.0:1787826303.270939:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1294 00000100:00100000:2.0:1787826303.270947:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab17840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1874670585128448:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:2.0:1787826303.270977:0:6524:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1787826303.278821:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab17840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1874670585128448:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 7863us (8243us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826303.278835:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1294 00000100:00080000:2.0:1787826303.278935:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90cf3720f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826303.278941:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826303.278946:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f876940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874670585128448:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:2.0:1787826303.300361:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787826304.267301:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787826304.267307:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787826304.267311:0:8:0:(import.c:65:import_set_state_nolock()) ffff90cf3720f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787826304.267318:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 1249 00000100:00080000:1.0:1787826304.267324:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787826304.267331:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff90cf3720f800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:1.0:1787826304.267352:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cf3f934000 x1874670585128704/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826304.267431:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f934000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874670585128704:0@lo:38:kworker.0 00000100:00100000:0.0:1787826304.267516:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826304.267644:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f937c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874670585128832:0@lo:400:kworker.0 00000100:00100000:1.0:1787826304.267676:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826304.267695:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f9370c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874670585129344:0@lo:400:kworker.0 00000100:00100000:1.0:1787826304.267713:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826304.267734:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787826304.267739:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f935a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585128960:0@lo:400:kworker.0 00000100:00100000:1.0:1787826304.267760:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826304.267784:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce06305680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874670585129472:0@lo:400:kworker.0 00000100:00100000:1.0:1787826304.267803:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826304.267832:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585128832 00000100:00100000:1.0:1787826304.267837:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585128832 00000100:00100000:1.0:1787826304.267870:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585129344 00000100:00100000:1.0:1787826304.267873:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585129344 00000100:00100000:1.0:1787826304.267901:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585129472 00000100:00100000:1.0:1787826304.267904:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585129472 00000100:00100000:1.0:1787826304.267919:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1446 00000100:00100000:1.0:1787826304.267928:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b433c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874670585129344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826304.267987:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b433c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874670585129344:12345-0@lo:400:kworker.0 Request processed in 60us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826304.267994:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1446 00000100:00100000:1.0:1787826304.268010:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3263 00000100:00100000:1.0:1787826304.268013:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b433840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3646:x1874670585128832:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787826304.268019:0:16564:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787826304.268042:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b433840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3646:x1874670585128832:12345-0@lo:400:kworker.0 Request processed in 27us (366us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787826304.268047:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3263 00000100:00100000:1.0:1787826304.268057:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3264 00000100:00100000:1.0:1787826304.268061:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b4303c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3646:x1874670585129472:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787826304.268064:0:16564:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787826304.268201:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585128960 00000100:00100000:2.0:1787826304.268206:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585128960 00000100:00100000:2.0:1787826304.268237:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 832 00000100:00100000:2.0:1787826304.268244:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b432940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1874670585128960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826304.268297:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b4303c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3646:x1874670585129472:12345-0@lo:400:kworker.0 Request processed in 234us (492us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787826304.268303:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3264 00000100:00100000:3.0:1787826304.269197:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585128704 00000100:00100000:3.0:1787826304.269205:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585128704 00000100:00100000:3.0:1787826304.269236:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1295 00000100:00100000:3.0:1787826304.269242:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a1ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3643:x1874670585128704:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1787826304.269257:0:7796:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:0.0:1787826304.273861:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787826304.273872:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787826304.273903:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f935e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e3c550b8-2c3c-46c3-ad36-671c284167ea:3645:1874670585128576:0@lo:400:kworker.0 00000100:00100000:0.0:1787826304.273989:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826304.274041:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f935680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874670585129216:0@lo:400:kworker.0 00000100:00100000:0.0:1787826304.274186:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826304.274218:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787826304.274226:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f937480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585129088:0@lo:400:kworker.0 00000100:00100000:3.0:1787826304.274259:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a1ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3643:x1874670585128704:12345-0@lo:38:kworker.0 Request processed in 5013us (6741us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787826304.274261:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826304.274274:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1295 00000100:00100000:0.0:1787826304.274286:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0b432d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874670585129600:0@lo:400:kworker.0 00000100:00100000:0.0:1787826304.274311:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826304.274311:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585129088 00000100:00100000:3.0:1787826304.274321:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585129088 00000100:00080000:0.0:1787826304.274366:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90cf3720f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787826304.274372:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787826304.274375:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 833 00000100:00100000:0.0:1787826304.274380:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f934000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874670585128704:0@lo:38:kworker.0 00000100:00100000:3.0:1787826304.274390:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049b92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3645:x1874670585129088:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787826304.274402:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826304.274426:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585129216 00000100:00100000:0.0:1787826304.274430:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585129216 00000100:00100000:3.0:1787826304.274442:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049b92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3645:x1874670585129088:12345-0@lo:400:kworker.0 Request processed in 56us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826304.274450:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 833 00000100:00100000:0.0:1787826304.274458:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585129600 00000100:00100000:0.0:1787826304.274463:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585129600 00000100:00100000:0.0:1787826304.274515:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1447 00000100:00100000:0.0:1787826304.274524:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049b9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874670585129600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826304.274525:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585128576 00000100:00100000:3.0:1787826304.274532:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585128576 00000100:00100000:0.0:1787826304.274570:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049b9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874670585129600:12345-0@lo:400:kworker.0 Request processed in 45us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826304.274570:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 869 00000100:00100000:0.0:1787826304.274584:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1447 00000100:00100000:3.0:1787826304.274585:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1803c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3c550b8-2c3c-46c3-ad36-671c284167ea+19:3645:x1874670585128576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826304.274604:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3265 00000100:00100000:0.0:1787826304.274610:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a1a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1874670585129216:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1787826304.274617:0:6518:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787826304.274627:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1803c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3c550b8-2c3c-46c3-ad36-671c284167ea+19:3645:x1874670585128576:12345-0@lo:400:kworker.0 Request processed in 46us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826304.274635:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 869 00000100:00100000:0.0:1787826304.274651:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a1a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1874670585129216:12345-0@lo:400:kworker.0 Request processed in 39us (464us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787826304.274659:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3265 00000100:00080000:0.0:1787826304.274690:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787826304.274714:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f937480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585129088:0@lo:400:kworker.0 00000100:00100000:0.0:1787826304.274725:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0b432d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874670585129600:0@lo:400:kworker.0 00000100:00100000:0.0:1787826304.274733:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f935e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e3c550b8-2c3c-46c3-ad36-671c284167ea:3645:1874670585128576:0@lo:400:kworker.0 00000100:00080000:0.0:1787826304.274741:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787826304.274745:0:3645:0:(import.c:65:import_set_state_nolock()) ffff90ce02455800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787826304.274748:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1787826304.274753:0:3645:0:(import.c:65:import_set_state_nolock()) ffff90ce02455800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826304.274757:0:3645:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 860 00000100:00080000:0.0:1787826304.274763:0:3645:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff90ce02455800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:0.0:1787826304.274788:0:3645:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90ce049bbc00 x1874670585129728/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826304.274807:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f935680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874670585129216:0@lo:400:kworker.0 00000100:00100000:0.0:1787826304.274832:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce049bbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1874670585129728:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1787826304.274856:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826304.274883:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585129728 00000100:00100000:0.0:1787826304.274888:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585129728 00000100:00100000:0.0:1787826304.274910:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3266 00000100:00100000:0.0:1787826304.274916:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049b83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1874670585129728:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:0.0:1787826304.274929:0:9966:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1787826304.274978:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049b83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1874670585129728:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 62us (121us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787826304.274985:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3266 00000100:00080000:3.0:1787826304.278418:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90ce02455800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787826304.278429:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787826304.278434:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce049bbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1874670585129728:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1787826304.281301:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b432940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1874670585128960:12345-0@lo:400:kworker.0 Request processed in 13049us (13530us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826304.281315:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 832 00000100:00100000:1.0:1787826304.281556:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f935a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585128960:0@lo:400:kworker.0 00000100:00080000:0.0:1787826304.287075:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787826304.287082:0:3646:0:(import.c:65:import_set_state_nolock()) ffff90ce05f9d000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787826304.287087:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1787826304.287092:0:3646:0:(import.c:65:import_set_state_nolock()) ffff90ce05f9d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826304.287097:0:3646:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 896 00000100:00080000:0.0:1787826304.287106:0:3646:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90ce05f9d000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:0.0:1787826304.287142:0:3646:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90ce049bb480 x1874670585129856/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826304.287187:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce06305680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874670585129472:0@lo:400:kworker.0 00000100:00080000:0.0:1787826304.287202:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787826304.287205:0:3646:0:(import.c:65:import_set_state_nolock()) ffff90cf264ed800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787826304.287208:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1787826304.287211:0:3646:0:(import.c:65:import_set_state_nolock()) ffff90cf264ed800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826304.287214:0:3646:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 240 00000100:00080000:0.0:1787826304.287218:0:3646:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff90cf264ed800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:0.0:1787826304.287231:0:3646:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90ce049bb0c0 x1874670585129984/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826304.287241:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f937c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874670585128832:0@lo:400:kworker.0 00000100:00100000:3.0:1787826304.287249:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce049bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1874670585129856:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1787826304.287259:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f9370c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874670585129344:0@lo:400:kworker.0 00000100:00100000:3.0:1787826304.287402:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826304.287535:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce049bb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874670585129984:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1787826304.287561:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826304.294497:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585129856 00000100:00100000:0.0:1787826304.294512:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585129856 00000100:00100000:0.0:1787826304.294580:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585129984 00000100:00100000:0.0:1787826304.294584:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585129984 00000100:00100000:0.0:1787826304.294878:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3267 00000100:00100000:0.0:1787826304.294888:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f874f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3643:x1874670585129856:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:0.0:1787826304.294907:0:32404:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1787826304.294997:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f874f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3643:x1874670585129856:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 110us (7595us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826304.297235:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3268 00000100:00100000:2.0:1787826304.297247:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f875680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1874670585129984:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:2.0:1787826304.297265:0:8247:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1787826304.297337:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f875680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1874670585129984:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 91us (9774us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826304.297356:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3268 00000100:00080000:2.0:1787826304.297434:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90cf264ed800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826304.297439:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826304.297443:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce049bb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874670585129984:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:2.0:1787826304.297454:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90ce05f9d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826304.297457:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826304.297460:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce049bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1874670585129856:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1787826304.299863:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3267 00010000:00010000:0.0:1787826304.324633:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826305.347838:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826305.795874:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0b430780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585130112:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826305.795953:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826305.796281:0:12021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585130112 00000100:00100000:1.0:1787826305.796291:0:12021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585130112 00000100:00100000:1.0:1787826305.796347:0:12021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 702 00000100:00100000:1.0:1787826305.796357:0:12021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049ba580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874670585130112:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787826305.796387:0:12021:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 60260032 pending 0 free 3921387520 avail 3689865216 00000100:00100000:1.0:1787826305.796445:0:12021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049ba580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874670585130112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826305.796453:0:12021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 702 00000100:00100000:0.0:1787826305.796554:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0b430780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585130112:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826305.796876:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f876940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585130240:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826305.796907:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826305.797084:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585130240 00000100:00100000:1.0:1787826305.797089:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585130240 00000100:00100000:1.0:1787826305.797133:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 703 00000100:00100000:1.0:1787826305.797140:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874670585130240:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787826305.797159:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43441856 pending 0 free 3919286272 avail 3687763968 00000100:00100000:1.0:1787826305.800688:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874670585130240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3540us (3772us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826305.800699:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f876940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585130240:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826305.800701:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 703 00000100:00100000:2.0:1787826306.191263:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826306.191320:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826306.191360:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826306.191393:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826306.191417:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826306.191639:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563639552 00000100:00100000:0.0:1787826306.191656:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563639552 00000100:00100000:3.0:1787826306.191686:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563639168 00000100:00100000:3.0:1787826306.191697:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563639168 00000100:00100000:0.0:1787826306.191748:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563639680 00000100:00100000:0.0:1787826306.191755:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563639680 00000100:00100000:3.0:1787826306.191761:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 870 00000100:00100000:3.0:1787826306.191777:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1803d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:307626ff-a376-4faf-93e0-9f55b723d964+10:2404:x1874670563639168:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1787826306.191805:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 834 00000100:00100000:0.0:1787826306.191818:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab15680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670563639552:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1787826306.191876:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1803d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:307626ff-a376-4faf-93e0-9f55b723d964+10:2404:x1874670563639168:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 101us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826306.191886:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 870 00000100:00100000:0.0:1787826306.191903:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab15680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670563639552:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 83us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826306.191915:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 834 00000100:00100000:3.0:1787826306.191951:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563639296 00000100:00100000:0.0:1787826306.191959:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 835 00000100:00100000:3.0:1787826306.191959:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563639296 00000100:00100000:0.0:1787826306.191975:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab14780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563639680:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1787826306.192003:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563639424 00000100:00100000:3.0:1787826306.192009:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563639424 00000100:00100000:3.0:1787826306.192052:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1448 00000100:00100000:3.0:1787826306.192225:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab16d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:2404:x1874670563639424:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1787826306.192271:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab16d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:2404:x1874670563639424:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 50us (877us total) trans 0 rc 0/0 00000100:00080000:2.0:1787826306.192293:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787826306.192300:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787826306.192303:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826306.192365:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab14780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563639680:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 42us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826306.192375:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 835 00000100:00100000:1.0:1787826306.196158:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3269 00000100:00100000:1.0:1787826306.196174:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab15a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2403:x1874670563639296:12345-192.168.203.39@tcp:400:kworker.0 00000020:00080000:1.0:1787826306.196186:0:6519:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.203.39@tcp 00000100:00100000:1.0:1787826306.196266:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab15a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2403:x1874670563639296:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 94us (4952us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787826306.196274:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3269 00000100:00100000:3.0:1787826306.200215:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1448 00000100:00100000:2.0:1787826306.220703:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826306.221830:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563639808 00000100:00100000:3.0:1787826306.221847:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563639808 00000100:00100000:3.0:1787826306.221928:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3270 00000100:00100000:3.0:1787826306.221949:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce058bd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2400:x1874670563639808:12345-192.168.203.39@tcp:38:ptlrpcd_01_00.0 00010000:02000000:3.0:1787826306.221975:0:16564:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.39@tcp (stopping) 00000100:00100000:3.0:1787826306.252106:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce058bd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2400:x1874670563639808:12345-192.168.203.39@tcp:38:ptlrpcd_01_00.0 Request processed in 30150us (31403us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787826306.264775:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3270 00010000:00010000:3.0:1787826306.372785:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787826306.825358:0:26205:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1787826306.825377:0:26205:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836891 is committed 00000020:00000080:2.0:1787826306.825383:0:26205:0:(genops.c:885:class_export_put()) final put ffff90cf3649d800/lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1787826306.825408:0:26205:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836890 is committed 00000020:00000080:0.0:1787826306.825548:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90cf3649d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1787826306.825604:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90ce0374a000 for lustre-OST0000 00000001:00100000:3.0:1787826306.825970:0:27651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1787826306.825979:0:27651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179869569 is committed 00000020:00000080:3.0:1787826306.825982:0:27651:0:(genops.c:885:class_export_put()) final put ffff90ce05f9e000/lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1787826306.825997:0:27651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179869568 is committed 00000020:00000080:0.0:1787826306.826045:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90ce05f9e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1787826306.826067:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90ce0247a000 for lustre-OST0001 00010000:00010000:2.0:1787826307.396554:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826308.420237:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787826308.872810:0:7449:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1787826308.872832:0:7449:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967577 is committed 00000020:00000080:2.0:1787826308.875639:0:7449:0:(genops.c:885:class_export_put()) final put ffff90cf3aa38800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787826308.876435:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90cf3aa38800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1787826308.876551:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90cf3aa3b000 for lustre-MDT0001 00000020:00080000:3.0:1787826308.879693:0:6497:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 55 batchid updated 00000020:00080000:2.0:1787826308.879794:0:6550:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90cf117b0b40 refcount 1 committed 1 result 0 batchid 55 00000020:00080000:2.0:1787826308.879811:0:6550:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cf2f5d3000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90ce030c9480 00000020:00080000:2.0:1787826308.879817:0:6550:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cf3a9ebc00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90cf10a04c00 00000020:00080000:2.0:1787826308.879820:0:6550:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cf3a9eb500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90ce01da5e00 00000020:00080000:2.0:1787826308.879824:0:6550:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000400:0x2:0x0].32 00000040:00080000:0.0:1787826308.888360:0:34057:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x240000401:0x1:0x0] first idx 0, last_idx 2 00000040:00080000:0.0:1787826308.888406:0:34057:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x240000401:0x1:0x0] first idx 1, last_idx 2 00000020:00080000:0.0:1787826308.891680:0:34057:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff90cf264f8000) has no exports 00000020:00000080:0.0:1787826308.986159:0:34057:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x22153cd396b6ceaa 00000020:00000080:0.0:1787826308.986173:0:34057:0:(genops.c:885:class_export_put()) final put ffff90cf264a3800/lustre-QMT0000_UUID 00000020:01000000:0.0:1787826308.986190:0:34057:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1787826308.986812:0:34057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787826308.986823:0:34057:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787826308.986827:0:34057:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff90cf10a24d28) has no exports 00000020:00000080:2.0:1787826308.987078:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90cf264a3800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1787826308.987438:0:34057:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x22153cd396b6cea3 00000020:00000080:2.0:1787826308.987448:0:34057:0:(genops.c:885:class_export_put()) final put ffff90cf39ce9000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787826308.987547:0:34057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787826308.987555:0:34057:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787826308.987558:0:34057:0:(genops.c:885:class_export_put()) final put ffff90cf264eb800/lustre-QMT0000_UUID 00000020:00000080:2.0:1787826308.987561:0:34057:0:(genops.c:844:class_export_destroy()) destroying export ffff90cf264eb800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1787826308.987565:0:34057:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1787826308.987689:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90cf39ce9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1787826308.987855:0:34057:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90ce024b8960 - data ffff90cf32b6b1b0/ffff90ce030aa800 00000020:01000000:1.0:1787826308.987994:0:34057:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90cf080dba80 - data ffff90cf113d3bd0/ffff90cf39ddd800 00000100:00080000:1.0:1787826309.035144:0:34057:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787826309.035153:0:34057:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967576 gen 4 00000100:00100000:1.0:1787826309.035169:0:34057:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff90cf3ab92940 x1874670585127936/t4294967577(4294967577) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787826313 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826309.035197:0:34057:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1787826309.038070:0:34057:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787826309.038078:0:34057:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836889 gen 4 00000004:00080000:1.0:1787826309.038164:0:34057:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787826309.038167:0:34057:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1787826309.041124:0:8543:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1787826309.041132:0:8543:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 267 count 1 00000040:00080000:2.0:1787826309.041144:0:8543:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1787826309.041866:0:34057:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787826309.041872:0:34057:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869567 gen 4 00000004:00080000:1.0:1787826309.041891:0:34057:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787826309.041894:0:34057:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787826309.042121:0:9969:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787826309.042125:0:9969:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 259 count 1 00000040:00080000:0.0:1787826309.042133:0:9969:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1787826309.042972:0:34057:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x22153cd396b6ce72 00000020:00000080:1.0:1787826309.042981:0:34057:0:(genops.c:885:class_export_put()) final put ffff90cf05e11000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787826309.044685:0:34057:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x22153cd396b6ce87 00000020:00000080:1.0:1787826309.044696:0:34057:0:(genops.c:885:class_export_put()) final put ffff90cf26c0f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787826309.046803:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90cf05e11000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1787826309.046856:0:34057:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1787826309.046888:0:34057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787826309.046897:0:34057:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787826309.046900:0:34057:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff90cf264f99b8) has no exports 00000004:01000000:1.0:1787826309.047076:0:34057:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1787826309.047083:0:34057:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x22153cd396b6d2bd 00000020:00000080:1.0:1787826309.047090:0:34057:0:(genops.c:885:class_export_put()) final put ffff90ce037f6800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787826309.048357:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90cf26c0f800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1787826309.048443:0:34057:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1787826309.048451:0:34057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787826309.048463:0:34057:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787826309.048467:0:34057:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff90ce02473370) has no exports 00000020:00000080:1.0:1787826309.048518:0:34057:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x22153cd396b6d2b6 00000020:00000080:1.0:1787826309.048524:0:34057:0:(genops.c:885:class_export_put()) final put ffff90ce036ea800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787826309.048557:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90ce037f6800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:1.0:1787826309.049155:0:34057:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1787826309.049160:0:34057:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787826309.049163:0:34057:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869567 gen 5 00000004:00080000:1.0:1787826309.049168:0:34057:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787826309.049171:0:34057:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787826309.049199:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90ce036ea800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787826309.049268:0:34057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787826309.049279:0:34057:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787826309.049287:0:34057:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x22153cd396b6d17b 00000020:00000080:1.0:1787826309.049292:0:34057:0:(genops.c:885:class_export_put()) final put ffff90cf3f4c5000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787826309.049310:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90ce036ec000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787826309.049316:0:36:0:(genops.c:885:class_export_put()) final put ffff90ce036e9800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787826309.049318:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90ce036e9800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1787826309.049322:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787826309.049442:0:34057:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1787826309.049447:0:34057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787826309.049517:0:34057:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787826309.049521:0:34057:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff90cf3ab03370) has no exports 00000020:00000080:1.0:1787826309.049525:0:34057:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x22153cd396b6d174 00000020:00000080:1.0:1787826309.049531:0:34057:0:(genops.c:885:class_export_put()) final put ffff90cf3f4c4800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787826309.049565:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90cf3f4c5000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:1.0:1787826309.050222:0:34057:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1787826309.050225:0:34057:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787826309.050227:0:34057:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836889 gen 5 00000004:00080000:1.0:1787826309.050233:0:34057:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787826309.050234:0:34057:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787826309.050342:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90cf3f4c4800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787826309.050417:0:34057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787826309.050425:0:34057:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1787826309.050439:0:34057:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1787826309.050444:0:34057:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x22153cd396b6d02b 00000020:00000080:1.0:1787826309.050449:0:34057:0:(genops.c:885:class_export_put()) final put ffff90cf3a8f4800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787826309.050489:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90cf3f4c7000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1787826309.050495:0:36:0:(genops.c:885:class_export_put()) final put ffff90cf3f493000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787826309.050497:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90cf3f493000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1787826309.050501:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787826309.050814:0:34057:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1787826309.050818:0:34057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787826309.050823:0:34057:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787826309.050826:0:34057:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff90cf1169b370) has no exports 00000020:00000080:1.0:1787826309.050830:0:34057:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x22153cd396b6d024 00000020:00000080:1.0:1787826309.050835:0:34057:0:(genops.c:885:class_export_put()) final put ffff90cf3a8f0000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787826309.050880:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90cf3a8f4800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1787826309.052302:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90cf3a8f0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1787826309.052540:0:34057:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1787826309.052546:0:34057:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787826309.052550:0:34057:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967576 gen 5 00000100:00100000:0.0:1787826309.052555:0:34057:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787826309.052601:0:34057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787826309.052610:0:34057:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787826309.052645:0:34057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787826309.052647:0:34057:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787826309.052651:0:34057:0:(genops.c:885:class_export_put()) final put ffff90cf05e17000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787826309.052654:0:34057:0:(genops.c:844:class_export_destroy()) destroying export ffff90cf05e17000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1787826309.052658:0:34057:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787826309.052746:0:34057:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x22153cd396b6ce8e 00000020:00000080:0.0:1787826309.052751:0:34057:0:(genops.c:885:class_export_put()) final put ffff90cf26c09800/lustre-MDD0000_UUID 00000020:01000000:0.0:1787826309.052754:0:34057:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1787826309.052757:0:34057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787826309.052760:0:34057:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787826309.052763:0:34057:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff90cf264fcd28) has no exports 00000020:00000080:0.0:1787826309.052779:0:34057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787826309.052782:0:34057:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1787826309.052784:0:34057:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x22153cd396b6ce95 00000020:00000080:0.0:1787826309.052787:0:34057:0:(genops.c:885:class_export_put()) final put ffff90cf26c0b800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1787826309.052794:0:34057:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90cf395d3800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1787826309.052797:0:34057:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90cf395d3800 3 00000020:01000004:0.0:1787826309.052800:0:34057:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff90cf395d3800 from lustre-MDT0000 00000020:00000080:0.0:1787826309.052814:0:34057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787826309.052816:0:34057:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1787826309.052818:0:34057:0:(genops.c:885:class_export_put()) final put ffff90cf05e16800/lustre-MDT0000_UUID 00000020:00000080:0.0:1787826309.052820:0:34057:0:(genops.c:844:class_export_destroy()) destroying export ffff90cf05e16800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1787826309.052825:0:34057:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1787826309.052846:0:34057:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1787826309.052849:0:34057:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1787826309.052852:0:34057:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1787826309.052854:0:34057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787826309.052856:0:34057:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1787826309.052863:0:34057:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff90ce052a6800 307626ff-a376-4faf-93e0-9f55b723d964 192.168.203.39@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787826309.052869:0:34057:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff90cf185d5800 e3c550b8-2c3c-46c3-ad36-671c284167ea 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787826309.052873:0:34057:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff90cf181c99b8) has exports, disconnecting them 00000020:00080000:0.0:1787826309.052877:0:34057:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 192.168.203.39@tcp (ffff90ce052a6800), last request at 1787826177 00000020:00000080:0.0:1787826309.052889:0:34057:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x22153cd396b7ddea 00000020:00010000:0.0:1787826309.052892:0:34057:0:(genops.c:1921:obd_stale_export_put()) Put export ffff90ce052a6800: total 2 00000100:00080000:0.0:1787826309.052895:0:34057:0:(import.c:65:import_set_state_nolock()) ffff90ce052a1000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787826309.052903:0:34057:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.203.39@tcp (ffff90ce052a6800): rc 0 00000020:00080000:0.0:1787826309.052906:0:34057:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff90cf185d5800), last request at 1787825275 00000020:00000080:0.0:1787826309.052911:0:34057:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x22153cd396b6ce33 00000020:00010000:0.0:1787826309.052913:0:34057:0:(genops.c:1921:obd_stale_export_put()) Put export ffff90cf185d5800: total 2 00000100:00080000:0.0:1787826309.052915:0:34057:0:(import.c:65:import_set_state_nolock()) ffff90cf185d4000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787826309.052936:0:34057:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90cf185d5800): rc 0 00000020:00080000:0.0:1787826309.052940:0:34057:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff90cf181c99b8) has no exports 00000100:00100000:0.0:1787826309.052997:0:6512:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff90cf1ee7a600:6512] 2 exiting: rc = 0 00000020:00010000:0.0:1787826309.054799:0:6507:0:(genops.c:1907:obd_stale_export_get()) Get export ffff90ce052a6800: total 2 00010000:00010000:0.0:1787826309.054850:0:6507:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90ce052a6800, canceled 0 locks, left on hash table 4. 00010000:00010000:0.0:1787826309.054882:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90ce01f16400/0x22153cd396b7ddf1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafa33 expref: 5 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826309.054900:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90ce0a066600/0x22153cd396b7de06 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafa72 expref: 4 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826309.054910:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cf2f46a800/0x22153cd396b7ddff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafa6b expref: 3 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826309.054929:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cf0165e200/0x22153cd396b7ddf8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafa3a expref: 2 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826309.054939:0:6507:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90ce052a6800, canceled 4 locks, left on hash table 0. 00000020:00000080:0.0:1787826309.054954:0:6507:0:(genops.c:885:class_export_put()) final put ffff90ce052a6800/307626ff-a376-4faf-93e0-9f55b723d964 00000020:00010000:0.0:1787826309.054961:0:6507:0:(genops.c:1907:obd_stale_export_get()) Get export ffff90cf185d5800: total 3 00010000:00010000:0.0:1787826309.054973:0:6507:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90cf185d5800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1787826309.054986:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cf2f46ae00/0x22153cd396b77c0d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22153cd396b77c06 expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826309.054996:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90ce0865b000/0x22153cd396b77bdc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22153cd396b77bd5 expref: 13 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826309.055006:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cf2f46ac00/0x22153cd396b77c1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22153cd396b77c14 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826309.055015:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cf01518a00/0x22153cd396b6cf3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22153cd396b6cf36 expref: 11 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826309.055027:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cf3a838a00/0x22153cd396b6d37a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22153cd396b6d373 expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826309.055036:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cf00031400/0x22153cd396b6cf2f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22153cd396b6cf28 expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826309.055047:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cf10a06c00/0x22153cd396b6d388 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22153cd396b6d381 expref: 8 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826309.055056:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cf3a838200/0x22153cd396b6d3b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22153cd396b6d3ab expref: 7 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826309.055065:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90ce01f16000/0x22153cd396b77b34 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22153cd396b77b2d expref: 6 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826309.055074:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cf3a839000/0x22153cd396b77b03 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22153cd396b77afc expref: 5 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826309.055083:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cf2f401200/0x22153cd396b6d430 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22153cd396b6d429 expref: 4 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826309.055092:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90ce05661c00/0x22153cd396b77c61 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22153cd396b77c5a expref: 3 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826309.055101:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cf3abd7a00/0x22153cd396b77b42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22153cd396b77b3b expref: 2 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826309.055109:0:6507:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90cf185d5800, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1787826309.055116:0:6507:0:(genops.c:885:class_export_put()) final put ffff90cf185d5800/e3c550b8-2c3c-46c3-ad36-671c284167ea 00010000:00010000:0.0:1787826309.055119:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826309.055121:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826309.055123:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787826309.056096:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90cf05e17800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1787826309.056109:0:36:0:(genops.c:885:class_export_put()) final put ffff90cf3a8f4000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787826309.056112:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90cf3a8f4000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:2.0:1787826309.056118:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787826309.056188:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90cf26c09800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1787826309.056192:0:36:0:(genops.c:885:class_export_put()) final put ffff90cf05e15000/lustre-MDD0000_UUID 00000020:00000080:2.0:1787826309.056194:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90cf05e15000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1787826309.056196:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1787826309.056218:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90cf26c0b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787826309.056224:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90ce052a6800/307626ff-a376-4faf-93e0-9f55b723d964 for MGS 00000020:00000080:2.0:1787826309.056254:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90cf185d5800/e3c550b8-2c3c-46c3-ad36-671c284167ea for MGS 00000020:00000080:2.0:1787826309.056267:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90ce052a1000 for MGS 00000020:00000080:2.0:1787826309.056271:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90cf185d4000 for MGS 00010000:00010000:2.0:1787826309.056284:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826309.056390:0:6510:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff90cf055eb200:6510] 0 exiting: rc = 1 00000100:00100000:2.0:1787826309.056506:0:6511:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff90cf06578a00:6511] 1 exiting: rc = 0 00000100:00100000:0.0:1787826309.056608:0:34057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826309.056615:0:34057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826309.056621:0:34057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826309.056626:0:34057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826309.056640:0:34057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826309.056646:0:34057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826309.056652:0:34057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826309.056659:0:34057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826309.056664:0:34057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826309.056669:0:34057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826309.056674:0:34057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826309.056680:0:34057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826309.056685:0:34057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826309.056691:0:34057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826309.056696:0:34057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826309.056701:0:34057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826309.056709:0:34057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826309.056714:0:34057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826309.056720:0:34057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826309.056725:0:34057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826309.056729:0:34057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826309.056734:0:34057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826309.056740:0:34057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826309.056744:0:34057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826309.056749:0:34057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826309.056754:0:34057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826309.056759:0:34057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826309.056767:0:34057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826309.056773:0:34057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826309.056777:0:34057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826309.056783:0:34057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826309.056788:0:34057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826309.056793:0:34057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826309.056798:0:34057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826309.056804:0:34057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826309.056809:0:34057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826309.056814:0:34057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826309.056819:0:34057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826309.056824:0:34057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826309.056828:0:34057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826309.056833:0:34057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826309.056838:0:34057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826309.056843:0:34057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826309.056848:0:34057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826309.056853:0:34057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826309.056857:0:34057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826309.056862:0:34057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826309.056868:0:34057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826309.056873:0:34057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826309.056879:0:34057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826309.056884:0:34057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826309.056889:0:34057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826309.056894:0:34057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826309.056900:0:34057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826309.056905:0:34057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826309.056909:0:34057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826309.056914:0:34057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826309.056919:0:34057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826309.056932:0:34057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826309.056937:0:34057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826309.056942:0:34057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826309.056947:0:34057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826309.056952:0:34057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787826309.056956:0:34057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1787826309.058026:0:34057:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90ce033f3ba0 - data ffff90cf32af8bd0/ffff90ce027ed800 00000020:01000000:0.0:1787826309.061439:0:34057:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90cf09faeb40 - data ffff90cf202665e8/ffff90cf07dbd400 00000020:00000080:0.0:1787826309.062234:0:34057:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x22153cd396b6ce17 00000020:00000080:0.0:1787826309.062242:0:34057:0:(genops.c:885:class_export_put()) final put ffff90cf116fe800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1787826309.062263:0:34057:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90cf395d3800 from MGS, refs=2 00000020:01000004:0.0:1787826309.062266:0:34057:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90cf395d3800 2 00000020:01000004:0.0:1787826309.062269:0:34057:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff90cf395d3800 from MGS 00000020:00000080:0.0:1787826309.062292:0:34057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787826309.062299:0:34057:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1787826309.062302:0:34057:0:(genops.c:885:class_export_put()) final put ffff90cf116fa000/MGS 00000020:00000080:0.0:1787826309.062305:0:34057:0:(genops.c:844:class_export_destroy()) destroying export ffff90cf116fa000/MGS for MGS 00000020:01000000:0.0:1787826309.062311:0:34057:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:00000080:2.0:1787826309.062350:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90cf116fe800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1787826309.062701:0:34057:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1787826309.062822:0:34057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787826309.062827:0:34057:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787826309.062833:0:34057:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff90cf05e65800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787826309.062839:0:34057:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff90cf1169cd28) has exports, disconnecting them 00000020:00080000:0.0:1787826309.062844:0:34057:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff90cf05e65800), last request at 1787825275 00000020:00000080:0.0:1787826309.062849:0:34057:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x22153cd396b6cee2 00000020:00080000:0.0:1787826309.062856:0:34057:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90cf05e65800): rc 0 00000020:00000080:0.0:1787826309.062860:0:34057:0:(genops.c:885:class_export_put()) final put ffff90cf05e65800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1787826309.063150:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90cf05e65800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1787826309.076565:0:34057:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1787826309.076575:0:34057:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787826309.076580:0:34057:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787826309.076587:0:34057:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787826309.076710:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90cf180eb000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1787826309.076865:0:34057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787826309.076873:0:34057:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1787826309.076879:0:34057:0:(genops.c:885:class_export_put()) final put ffff90cf05e64800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1787826309.076882:0:34057:0:(genops.c:844:class_export_destroy()) destroying export ffff90cf05e64800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1787826309.076887:0:34057:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1787826309.076962:0:34057:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90cf395d3800 1 00000020:00000080:2.0:1787826309.076967:0:34057:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x22153cd396b6ce09 00000020:00000080:2.0:1787826309.076973:0:34057:0:(genops.c:885:class_export_put()) final put ffff90cf116fd800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1787826309.076980:0:34057:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1787826309.076986:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90cf116fd800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787826309.076993:0:34057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787826309.076996:0:34057:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787826309.076999:0:34057:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff90cf116999b8) has no exports 00000020:00000080:2.0:1787826309.147005:0:34057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787826309.147019:0:34057:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1787826309.147025:0:34057:0:(genops.c:885:class_export_put()) final put ffff90cf09dca000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787826309.147029:0:34057:0:(genops.c:844:class_export_destroy()) destroying export ffff90cf09dca000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1787826309.147039:0:34057:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1787826309.147238:0:34057:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff90cf395d5000 00000020:02000400:2.0:1787826309.147311:0:34057:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000100:00080000:3.0:1787826309.382305:0:33115:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787826309.382311:0:33115:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787826309.382315:0:33115:0:(import.c:65:import_set_state_nolock()) ffff90cf3720f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826309.382322:0:33115:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 1250 00000100:00080000:3.0:1787826309.382327:0:33115:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787826309.382334:0:33115:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff90cf3720f800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:3.0:1787826309.382353:0:33115:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cf3f874780 x1874670585130496/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787826309.382368:0:33115:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787826309.382371:0:33115:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787826309.382373:0:33115:0:(import.c:65:import_set_state_nolock()) ffff90cf264ed800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826309.382376:0:33115:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 1250 00000100:00080000:3.0:1787826309.382378:0:33115:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787826309.382382:0:33115:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff90cf264ed800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:3.0:1787826309.382393:0:33115:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cf3f876940 x1874670585130624/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787826309.382422:0:33115:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787826309.382425:0:33115:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787826309.382426:0:33115:0:(import.c:65:import_set_state_nolock()) ffff90ce02455800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826309.382429:0:33115:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 1250 00000100:00080000:3.0:1787826309.382432:0:33115:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787826309.382435:0:33115:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff90ce02455800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:3.0:1787826309.382445:0:33115:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cf3a98a940 x1874670585131008/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787826309.382461:0:33115:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787826309.382464:0:33115:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787826309.382466:0:33115:0:(import.c:65:import_set_state_nolock()) ffff90ce05f9d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826309.382486:0:33115:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 1250 00000100:00080000:3.0:1787826309.382489:0:33115:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787826309.382492:0:33115:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90ce05f9d000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:3.0:1787826309.382503:0:33115:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cf3f826940 x1874670585131264/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826309.382550:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e3c550b8-2c3c-46c3-ad36-671c284167ea:3647:1874670585130368:0@lo:400:kworker.0 00000400:00000100:3.0:1787826309.382596:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874670585130368 offset 0 length 224: 4 00000100:00100000:3.0:1787826309.382634:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1874670585131392:0@lo:400:kworker.0 00000100:00100000:3.0:1787826309.382659:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826309.382680:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787826309.382685:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f825a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874670585131136:0@lo:400:kworker.0 00000100:00100000:3.0:1787826309.382701:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826309.382847:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f874780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874670585130496:0@lo:38:kworker.0 00000100:00100000:3.0:1787826309.382870:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826309.382891:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f876940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874670585130624:0@lo:38:kworker.0 00000100:00100000:3.0:1787826309.382907:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826309.382930:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a98a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1874670585131008:0@lo:38:kworker.0 00000100:00100000:3.0:1787826309.382948:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826309.382961:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f826940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1874670585131264:0@lo:38:kworker.0 00000100:00100000:3.0:1787826309.382975:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826309.382998:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a988780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585130752:0@lo:400:kworker.0 00000100:00100000:3.0:1787826309.383017:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826309.383035:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787826309.383039:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a988000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585130880:0@lo:400:kworker.0 00000100:00100000:3.0:1787826309.383055:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826309.383079:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585131392 00000100:00100000:3.0:1787826309.383084:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585131392 00000100:00100000:3.0:1787826309.383123:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585131136 00000100:00100000:3.0:1787826309.383126:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585131136 00000100:00100000:3.0:1787826309.383143:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585130624 00000100:00100000:3.0:1787826309.383146:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585130624 00000100:00100000:3.0:1787826309.383153:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585131008 00000100:00100000:3.0:1787826309.383156:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585131008 00000100:00100000:3.0:1787826309.383162:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585131264 00000100:00100000:3.0:1787826309.383163:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585131264 00000100:00100000:3.0:1787826309.383173:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1449 00000100:00100000:3.0:1787826309.383181:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874670585131392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826309.383228:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874670585131392:12345-0@lo:400:kworker.0 Request processed in 47us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826309.383234:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1449 00000100:00100000:3.0:1787826309.383249:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1450 00000100:00100000:3.0:1787826309.383256:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874670585131136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826309.383281:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874670585131136:12345-0@lo:400:kworker.0 Request processed in 26us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826309.383286:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1450 00000100:00100000:3.0:1787826309.383297:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3271 00000100:00100000:3.0:1787826309.383301:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1874670585130624:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787826309.383318:0:6518:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826309.383831:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585130496 00000100:00100000:2.0:1787826309.383838:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585130496 00000100:00100000:2.0:1787826309.383865:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1296 00000100:00100000:2.0:1787826309.383871:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9acb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3643:x1874670585130496:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787826309.383882:0:7796:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826309.383934:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9acb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3643:x1874670585130496:12345-0@lo:38:kworker.0 Request processed in 62us (1062us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826309.383941:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1296 00000100:00100000:2.0:1787826309.383963:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3272 00000100:00100000:2.0:1787826309.383968:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1874670585131008:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787826309.383977:0:8247:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826309.384003:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1874670585131008:12345-0@lo:38:kworker.0 Request processed in 34us (1054us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826309.384009:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3272 00000100:00100000:2.0:1787826309.384023:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3273 00000100:00100000:2.0:1787826309.384026:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb96940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1874670585131264:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787826309.384034:0:8247:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826309.384056:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb96940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1874670585131264:12345-0@lo:38:kworker.0 Request processed in 29us (1080us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826309.384060:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3273 00000100:00080000:2.0:1787826309.384076:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787826309.384192:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90cf3720f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826309.384198:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826309.384201:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f874780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874670585130496:0@lo:38:kworker.0 00000100:00080000:2.0:1787826309.384212:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90ce02455800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826309.384215:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826309.384217:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a98a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1874670585131008:0@lo:38:kworker.0 00000100:00080000:2.0:1787826309.384225:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90ce05f9d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826309.384228:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826309.384231:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f826940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1874670585131264:0@lo:38:kworker.0 00000100:00100000:2.0:1787826309.391620:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585130752 00000100:00100000:2.0:1787826309.391634:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585130752 00000100:00100000:2.0:1787826309.392808:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585130880 00000100:00100000:2.0:1787826309.392816:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585130880 00000100:00100000:2.0:1787826309.392869:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 836 00000100:00100000:2.0:1787826309.392879:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb943c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874670585130752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826309.393065:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 837 00000100:00100000:1.0:1787826309.393076:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb94780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3644:x1874670585130880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826309.393154:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb94780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3644:x1874670585130880:12345-0@lo:400:kworker.0 Request processed in 81us (10097us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826309.393161:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 837 00000100:00100000:0.0:1787826309.393857:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a988000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585130880:0@lo:400:kworker.0 00000100:00100000:2.0:1787826309.394390:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb943c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874670585130752:12345-0@lo:400:kworker.0 Request processed in 1511us (11369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826309.394399:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 836 00000100:00080000:2.0:1787826309.394432:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787826309.394436:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826309.394455:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a988780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585130752:0@lo:400:kworker.0 00000100:00100000:2.0:1787826309.394523:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f825a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874670585131136:0@lo:400:kworker.0 00000100:00100000:2.0:1787826309.394536:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1874670585131392:0@lo:400:kworker.0 00000100:00100000:2.0:1787826309.408683:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1874670585130624:12345-0@lo:38:kworker.0 Request processed in 25374us (25769us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826309.408696:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3271 00000100:00080000:3.0:1787826309.408834:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90cf264ed800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787826309.408841:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787826309.408849:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f876940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874670585130624:0@lo:38:kworker.0 00010000:00010000:2.0:1787826309.445080:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826310.467778:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826310.915861:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce06305680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585131520:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826310.915943:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826310.915997:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787826310.916004:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f825a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585131648:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826310.916040:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826310.922889:0:12021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585131520 00000100:00100000:2.0:1787826310.922918:0:12021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585131520 00000100:00100000:2.0:1787826310.922992:0:12021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585131648 00000100:00100000:2.0:1787826310.922996:0:12021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585131648 00000100:00100000:3.0:1787826310.923008:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 704 00000100:00100000:3.0:1787826310.923066:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f9370c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874670585131520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787826310.923097:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43441856 pending 0 free 3919286272 avail 3687763968 00000100:00100000:3.0:1787826310.923163:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f9370c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874670585131520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (7221us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826310.924019:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce06305680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585131520:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826310.928299:0:12021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 705 00000100:00100000:2.0:1787826310.928323:0:12021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f937c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874670585131648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787826310.928359:0:12021:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 60260032 pending 0 free 3921387520 avail 3689865216 00000100:00100000:2.0:1787826310.928445:0:12021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f937c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874670585131648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 132us (12404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826310.928453:0:12021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 705 00000100:00100000:2.0:1787826310.928531:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f825a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585131648:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826310.929170:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 704 00000100:00100000:0.0:1787826311.318573:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826311.318614:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000400:00000100:0.0:1787826311.318638:0:3639:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.39@tcp portal 26 match 1874670563639936 offset 0 length 224: 4 00000100:00100000:0.0:1787826311.318659:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826311.318686:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826311.318753:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563640448 00000100:00100000:3.0:1787826311.318762:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563640448 00000100:00100000:3.0:1787826311.318821:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563640320 00000100:00100000:3.0:1787826311.318825:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563640320 00000100:00100000:3.0:1787826311.318847:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 838 00000100:00100000:3.0:1787826311.318859:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f935680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563640448:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1787826311.318936:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f935680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563640448:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 79us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826311.318944:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 838 00000100:00100000:3.0:1787826311.318959:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 839 00000100:00100000:3.0:1787826311.318965:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aad5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563640320:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1787826311.318989:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aad5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563640320:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 24us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826311.318996:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 839 00000100:00080000:0.0:1787826311.319168:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787826311.319172:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826311.319319:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563640192 00000100:00100000:2.0:1787826311.319324:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563640192 00000100:00100000:2.0:1787826311.319373:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563640064 00000100:00100000:2.0:1787826311.319377:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563640064 00000100:00100000:2.0:1787826311.319405:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1451 00000100:00100000:2.0:1787826311.319413:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f935a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:2404:x1874670563640192:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1787826311.319444:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f935a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:2404:x1874670563640192:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 33us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826311.319450:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1451 00000100:00100000:2.0:1787826311.319462:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3274 00000100:00100000:2.0:1787826311.319466:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f935e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2400:x1874670563640064:12345-192.168.203.39@tcp:38:kworker.0 00010000:00020000:2.0:1787826311.319511:0:8247:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.39@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826311.319539:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f935e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2400:x1874670563640064:12345-192.168.203.39@tcp:38:kworker.0 Request processed in 71us (853us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826311.319545:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3274 00000100:00080000:0.0:1787826311.319743:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1787826311.491918:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826312.515624:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826313.539880:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787826314.499951:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787826314.499960:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787826314.499964:0:36:0:(import.c:65:import_set_state_nolock()) ffff90cf3720f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826314.499972:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 1255 00000100:00080000:3.0:1787826314.499979:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787826314.499987:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff90cf3720f800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:2.0:1787826314.500001:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787826314.500014:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cf3fb943c0 x1874670585131904/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826314.500025:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3fb94780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e3c550b8-2c3c-46c3-ad36-671c284167ea:3647:1874670585131776:0@lo:400:kworker.0 00000100:00080000:3.0:1787826314.500038:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787826314.500042:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787826314.500044:0:36:0:(import.c:65:import_set_state_nolock()) ffff90cf264ed800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826314.500049:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 1255 00000100:00080000:3.0:1787826314.500052:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787826314.500056:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff90cf264ed800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:3.0:1787826314.500070:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cf3fb94f00 x1874670585132032/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:2.0:1787826314.500083:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874670585131776 offset 0 length 224: 4 00000100:00080000:3.0:1787826314.500107:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787826314.500112:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787826314.500114:0:36:0:(import.c:65:import_set_state_nolock()) ffff90ce02455800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826314.500118:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 1255 00000100:00080000:3.0:1787826314.500121:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787826314.500125:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff90ce02455800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:2.0:1787826314.500159:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3fb94b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585132160:0@lo:400:kworker.0 00000100:00100000:2.0:1787826314.500200:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826314.500238:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585132160 00000100:00100000:2.0:1787826314.500245:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585132160 00000100:00100000:0.0:1787826314.500302:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787826314.500310:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 840 00000100:00100000:0.0:1787826314.500316:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3fb96d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585132288:0@lo:400:kworker.0 00000100:00100000:2.0:1787826314.500323:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f825a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1874670585132160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826314.500359:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826314.500389:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f825a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1874670585132160:12345-0@lo:400:kworker.0 Request processed in 71us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826314.500398:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 840 00000100:00100000:0.0:1787826314.500402:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3fb943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874670585131904:0@lo:38:kworker.0 00000100:00100000:2.0:1787826314.500415:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585132288 00000100:00100000:2.0:1787826314.500420:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585132288 00000100:00100000:0.0:1787826314.500439:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826314.500450:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 841 00000100:00100000:2.0:1787826314.500458:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f937480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1874670585132288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826314.500463:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3fb94f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874670585132032:0@lo:38:kworker.0 00000100:00100000:2.0:1787826314.500528:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f937480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1874670585132288:12345-0@lo:400:kworker.0 Request processed in 70us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826314.500534:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 841 00000100:00080000:2.0:1787826314.500551:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787826314.500554:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826314.500587:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3fb96d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585132288:0@lo:400:kworker.0 00000100:00100000:0.0:1787826314.500606:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826314.500619:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3fb94b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585132160:0@lo:400:kworker.0 00000100:00100000:0.0:1787826314.500651:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585131904 00000100:00100000:0.0:1787826314.500657:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585131904 00000100:00100000:2.0:1787826314.500660:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585132032 00000100:00100000:2.0:1787826314.500665:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585132032 00000100:00100000:0.0:1787826314.500686:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1297 00000100:00100000:0.0:1787826314.500692:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f934000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1874670585131904:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1787826314.500704:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3275 00000100:00100000:2.0:1787826314.500711:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f935680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3643:x1874670585132032:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787826314.500713:0:6524:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00020000:2.0:1787826314.500725:0:32404:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787826314.500766:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f934000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1874670585131904:12345-0@lo:38:kworker.0 Request processed in 71us (328us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787826314.500774:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1297 00000100:00100000:2.0:1787826314.500778:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f935680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3643:x1874670585132032:12345-0@lo:38:kworker.0 Request processed in 64us (171us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826314.500787:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3275 00000100:00080000:0.0:1787826314.500812:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90cf3720f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787826314.500818:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787826314.500823:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3fb943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874670585131904:0@lo:38:kworker.0 00000100:00080000:0.0:1787826314.500832:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90cf264ed800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787826314.500835:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787826314.500838:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3fb94f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874670585132032:0@lo:38:kworker.0 00000100:00100000:3.0:1787826314.500918:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cf3fb95680 x1874670585132416/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787826314.500958:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787826314.500963:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787826314.500964:0:36:0:(import.c:65:import_set_state_nolock()) ffff90ce05f9d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826314.500968:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 1255 00000100:00080000:3.0:1787826314.500970:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787826314.500974:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90ce05f9d000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:3.0:1787826314.500987:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cf3fb961c0 x1874670585132672/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826314.501021:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787826314.501030:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3fb97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874670585132544:0@lo:400:kworker.0 00000100:00100000:3.0:1787826314.501060:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826314.501088:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3fb95e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1874670585132800:0@lo:400:kworker.0 00000100:00100000:3.0:1787826314.501110:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826314.501383:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3fb95680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1874670585132416:0@lo:38:kworker.0 00000100:00100000:0.0:1787826314.501411:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826314.501680:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585132544 00000100:00100000:3.0:1787826314.501686:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585132544 00000100:00100000:0.0:1787826314.501771:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3fb961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1874670585132672:0@lo:38:kworker.0 00000100:00100000:0.0:1787826314.501795:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826314.506623:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585132800 00000100:00100000:0.0:1787826314.506691:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585132416 00000100:00100000:0.0:1787826314.506702:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585132416 00000100:00100000:2.0:1787826314.506703:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585132800 00000100:00100000:0.0:1787826314.506735:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585132672 00000100:00100000:0.0:1787826314.506738:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585132672 00000100:00100000:0.0:1787826314.506764:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1452 00000100:00100000:0.0:1787826314.506776:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb97c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874670585132544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826314.506848:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb97c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874670585132544:12345-0@lo:400:kworker.0 Request processed in 76us (5787us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826314.506856:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1452 00000100:00100000:0.0:1787826314.506872:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3276 00000100:00100000:0.0:1787826314.506876:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06306940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1874670585132416:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787826314.506905:0:6519:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787826314.506939:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06306940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1874670585132416:12345-0@lo:38:kworker.0 Request processed in 60us (5527us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787826314.506947:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3276 00000100:00100000:2.0:1787826314.506954:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1453 00000100:00100000:2.0:1787826314.506965:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb96580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874670585132800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826314.506966:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3277 00000100:00100000:0.0:1787826314.506976:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06304b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1874670585132672:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787826314.506987:0:6519:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826314.507021:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb96580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874670585132800:12345-0@lo:400:kworker.0 Request processed in 58us (5909us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826314.507027:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06304b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1874670585132672:12345-0@lo:38:kworker.0 Request processed in 49us (5229us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826314.507034:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1453 00000100:00100000:2.0:1787826314.507084:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3fb95e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1874670585132800:0@lo:400:kworker.0 00000100:00080000:2.0:1787826314.507328:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787826314.507336:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3fb97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874670585132544:0@lo:400:kworker.0 00000100:00080000:2.0:1787826314.507362:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90ce02455800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826314.507368:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826314.507373:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3fb95680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1874670585132416:0@lo:38:kworker.0 00000100:00080000:2.0:1787826314.507385:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90ce05f9d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826314.507389:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826314.507394:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3fb961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1874670585132672:0@lo:38:kworker.0 00000100:00100000:0.0:1787826314.510718:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3277 00010000:00010000:0.0:1787826314.567950:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826315.588634:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826316.037919:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce06307840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585132928:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826316.038008:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826316.038208:0:12021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585132928 00000100:00100000:3.0:1787826316.038217:0:12021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585132928 00000100:00100000:3.0:1787826316.038288:0:12021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 706 00000100:00100000:3.0:1787826316.038298:0:12021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b432580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874670585132928:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787826316.038327:0:12021:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43441856 pending 0 free 3919286272 avail 3687763968 00000100:00100000:3.0:1787826316.038374:0:12021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b432580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874670585132928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826316.038381:0:12021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 706 00000100:00100000:1.0:1787826316.038533:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce06307840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585132928:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787826316.038601:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826316.038931:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0b432940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585133056:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826316.038976:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826316.039110:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585133056 00000100:00100000:0.0:1787826316.039115:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585133056 00000100:00100000:0.0:1787826316.039167:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 707 00000100:00100000:0.0:1787826316.039174:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874670585133056:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787826316.039194:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 60260032 pending 0 free 3921387520 avail 3689865216 00000100:00100000:0.0:1787826316.039232:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874670585133056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826316.039238:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 707 00000100:00100000:3.0:1787826316.039321:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0b432940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585133056:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1787826316.039386:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826316.434325:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000400:00000100:3.0:1787826316.434369:0:3638:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.39@tcp portal 26 match 1874670563640576 offset 0 length 224: 4 00000100:00100000:3.0:1787826316.434394:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826316.434503:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563640704 00000100:00100000:2.0:1787826316.434513:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563640704 00000100:00100000:2.0:1787826316.434564:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3278 00000100:00100000:2.0:1787826316.434573:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2400:x1874670563640704:12345-192.168.203.39@tcp:38:kworker.0 00010000:00020000:2.0:1787826316.434596:0:6518:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.39@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826316.434669:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2400:x1874670563640704:12345-192.168.203.39@tcp:38:kworker.0 Request processed in 96us (354us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826316.434676:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3278 00000100:00100000:0.0:1787826316.435030:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563640960 00000100:00100000:0.0:1787826316.435035:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563640960 00000100:00100000:0.0:1787826316.435094:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 842 00000100:00100000:0.0:1787826316.435102:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb961c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670563640960:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1787826316.435153:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb961c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670563640960:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 52us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826316.435159:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 842 00000100:00080000:1.0:1787826316.435270:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826316.438328:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826316.438384:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826316.438458:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563641088 00000100:00100000:0.0:1787826316.438466:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563641088 00000100:00100000:0.0:1787826316.438557:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 843 00000100:00100000:0.0:1787826316.438566:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb95e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670563641088:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1787826316.438634:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb95e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670563641088:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 69us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826316.438641:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 843 00000100:00080000:1.0:1787826316.438998:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826316.439310:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563640832 00000100:00100000:2.0:1787826316.439316:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563640832 00000100:00100000:2.0:1787826316.439373:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1454 00000100:00100000:2.0:1787826316.439381:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb95680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:2403:x1874670563640832:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1787826316.439434:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb95680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:2403:x1874670563640832:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 53us (1115us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826316.439442:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1454 00000100:00080000:1.0:1787826316.439611:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1787826316.611948:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826317.635657:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826318.660659:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826319.621506:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0b430000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e3c550b8-2c3c-46c3-ad36-671c284167ea:3645:1874670585133184:0@lo:400:kworker.0 00000400:00000100:2.0:1787826319.621574:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874670585133184 offset 0 length 224: 4 00000100:00080000:1.0:1787826319.621670:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787826319.621676:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787826319.621680:0:36:0:(import.c:65:import_set_state_nolock()) ffff90cf3720f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787826319.621685:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 1260 00000100:00080000:1.0:1787826319.621690:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787826319.621697:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff90cf3720f800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:1.0:1787826319.621723:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90ce0b430780 x1874670585133312/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787826319.621741:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787826319.621744:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787826319.621746:0:36:0:(import.c:65:import_set_state_nolock()) ffff90cf264ed800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787826319.621750:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 1260 00000100:00080000:1.0:1787826319.621753:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1787826319.621756:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff90cf264ed800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:1.0:1787826319.621778:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90ce0b432d00 x1874670585133440/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787826319.621820:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787826319.621824:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787826319.621826:0:36:0:(import.c:65:import_set_state_nolock()) ffff90ce02455800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787826319.621829:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 1260 00000100:00080000:1.0:1787826319.621832:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1787826319.621836:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff90ce02455800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:0.0:1787826319.621845:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0b432940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585133568:0@lo:400:kworker.0 00000100:00100000:1.0:1787826319.621857:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cf3ab14780 x1874670585133824/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826319.621906:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826319.621926:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab16940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874670585133952:0@lo:400:kworker.0 00000100:00100000:0.0:1787826319.621941:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787826319.621950:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab15680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585133696:0@lo:400:kworker.0 00000100:00100000:3.0:1787826319.621969:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826319.621983:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826319.622019:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585133952 00000100:00100000:3.0:1787826319.622027:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585133952 00000100:00100000:0.0:1787826319.622051:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585133568 00000100:00100000:0.0:1787826319.622055:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585133568 00000100:00100000:3.0:1787826319.622089:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1455 00000100:00100000:0.0:1787826319.622094:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585133696 00000100:00100000:3.0:1787826319.622101:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb94f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874670585133952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826319.622112:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585133696 00000100:00100000:0.0:1787826319.622142:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 844 00000100:00100000:0.0:1787826319.622151:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06305680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3646:x1874670585133568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826319.622160:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb94f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874670585133952:12345-0@lo:400:kworker.0 Request processed in 61us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826319.622167:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1455 00000100:00100000:0.0:1787826319.622199:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06305680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3646:x1874670585133568:12345-0@lo:400:kworker.0 Request processed in 48us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826319.622207:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 844 00000100:00100000:3.0:1787826319.622215:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab16940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874670585133952:0@lo:400:kworker.0 00000100:00100000:0.0:1787826319.622226:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 845 00000100:00100000:0.0:1787826319.622235:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06307840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3646:x1874670585133696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826319.622269:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06307840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3646:x1874670585133696:12345-0@lo:400:kworker.0 Request processed in 35us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826319.622274:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0b430780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874670585133312:0@lo:38:kworker.0 00000100:00100000:0.0:1787826319.622281:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 845 00000100:00100000:3.0:1787826319.622309:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826319.622317:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab15680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585133696:0@lo:400:kworker.0 00000100:00100000:3.0:1787826319.622337:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0b432d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874670585133440:0@lo:38:kworker.0 00000100:00100000:0.0:1787826319.622338:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0b432940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585133568:0@lo:400:kworker.0 00000100:00100000:3.0:1787826319.622367:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787826319.622374:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787826319.622380:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787826319.622384:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787826319.622390:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab14780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1874670585133824:0@lo:38:kworker.0 00000100:00100000:0.0:1787826319.622407:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585133440 00000100:00100000:0.0:1787826319.622413:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585133440 00000100:00100000:3.0:1787826319.622416:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826319.622443:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585133824 00000100:00100000:0.0:1787826319.622447:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585133824 00000100:00100000:3.0:1787826319.622456:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585133312 00000100:00100000:3.0:1787826319.622463:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585133312 00000100:00100000:0.0:1787826319.622468:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3279 00000100:00100000:0.0:1787826319.622501:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb94b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1874670585133440:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1787826319.622511:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1298 00000100:00100000:3.0:1787826319.622518:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1874670585133312:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787826319.622520:0:9966:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00020000:3.0:1787826319.622536:0:6523:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787826319.622565:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb94b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1874670585133440:12345-0@lo:38:kworker.0 Request processed in 62us (196us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787826319.622574:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1874670585133312:12345-0@lo:38:kworker.0 Request processed in 54us (264us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787826319.622575:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3279 00000100:00100000:3.0:1787826319.622586:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1298 00000100:00100000:0.0:1787826319.622596:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3280 00000100:00100000:0.0:1787826319.622602:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb96d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1874670585133824:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787826319.622613:0:9966:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:3.0:1787826319.622619:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90cf3720f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787826319.622625:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787826319.622629:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0b430780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874670585133312:0@lo:38:kworker.0 00000100:00080000:3.0:1787826319.622642:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90cf264ed800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787826319.622647:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787826319.622649:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb96d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1874670585133824:12345-0@lo:38:kworker.0 Request processed in 43us (233us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787826319.622652:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0b432d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874670585133440:0@lo:38:kworker.0 00000100:00100000:0.0:1787826319.622663:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3280 00000100:00080000:3.0:1787826319.622669:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90ce02455800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787826319.622674:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787826319.622678:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab14780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1874670585133824:0@lo:38:kworker.0 00000100:00080000:1.0:1787826319.630817:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787826319.630829:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787826319.630833:0:36:0:(import.c:65:import_set_state_nolock()) ffff90ce05f9d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787826319.630842:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 1260 00000100:00080000:1.0:1787826319.630859:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1787826319.630867:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90ce05f9d000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:1.0:1787826319.630908:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cf3ab14780 x1874670585134080/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826319.631026:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab15680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874670585134208:0@lo:400:kworker.0 00000100:00100000:2.0:1787826319.631095:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826319.631251:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab14780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1874670585134080:0@lo:38:kworker.0 00000100:00100000:3.0:1787826319.631282:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826319.632260:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585134208 00000100:00100000:1.0:1787826319.632271:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585134208 00000100:00100000:1.0:1787826319.632393:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585134080 00000100:00100000:1.0:1787826319.632397:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585134080 00000100:00100000:1.0:1787826319.632418:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1456 00000100:00100000:1.0:1787826319.632427:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f826940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874670585134208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826319.632508:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f826940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874670585134208:12345-0@lo:400:kworker.0 Request processed in 82us (1413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826319.632515:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1456 00000100:00100000:1.0:1787826319.632533:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3281 00000100:00100000:1.0:1787826319.632536:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8f8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1874670585134080:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787826319.632556:0:8247:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826319.632589:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8f8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1874670585134080:12345-0@lo:38:kworker.0 Request processed in 51us (1307us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826319.632596:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3281 00000100:00080000:1.0:1787826319.632633:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90ce05f9d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787826319.632638:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787826319.632641:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab14780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1874670585134080:0@lo:38:kworker.0 00000100:00100000:2.0:1787826319.635927:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab15680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874670585134208:0@lo:400:kworker.0 00000100:00080000:0.0:1787826319.639295:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1787826319.683709:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826320.707837:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826321.156567:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787826321.156590:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0b432d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585134336:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826321.156657:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826321.156961:0:12021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585134336 00000100:00100000:2.0:1787826321.156969:0:12021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585134336 00000100:00100000:2.0:1787826321.157038:0:12021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 708 00000100:00100000:2.0:1787826321.157047:0:12021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b430780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874670585134336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787826321.157088:0:12021:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43441856 pending 0 free 3919286272 avail 3687763968 00000100:00100000:2.0:1787826321.157134:0:12021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b430780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874670585134336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826321.157141:0:12021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 708 00000100:00080000:0.0:1787826321.157209:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826321.157245:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0b432d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585134336:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826321.157381:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab14780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585134464:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826321.157404:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826321.157870:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585134464 00000100:00100000:1.0:1787826321.157876:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585134464 00000100:00100000:1.0:1787826321.157926:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 709 00000100:00100000:1.0:1787826321.157934:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b432d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874670585134464:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787826321.157952:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 60260032 pending 0 free 3921387520 avail 3689865216 00000100:00100000:1.0:1787826321.157994:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b432d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874670585134464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826321.158000:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 709 00000100:00080000:0.0:1787826321.158182:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826321.158213:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab14780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585134464:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826321.563654:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000400:00000100:2.0:1787826321.563683:0:3638:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.39@tcp portal 26 match 1874670563641216 offset 0 length 224: 4 00000100:00100000:2.0:1787826321.563702:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826321.563723:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826321.563745:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826321.563778:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563641344 00000100:00100000:2.0:1787826321.563788:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563641344 00000100:00100000:2.0:1787826321.563824:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563641472 00000100:00100000:2.0:1787826321.563827:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563641472 00000100:00100000:2.0:1787826321.563877:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1457 00000100:00100000:2.0:1787826321.563887:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049b92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:2404:x1874670563641472:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1787826321.563962:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049b92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:2404:x1874670563641472:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 77us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826321.563970:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1457 00000100:00100000:2.0:1787826321.563986:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3282 00000100:00100000:2.0:1787826321.563990:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f824000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2400:x1874670563641344:12345-192.168.203.39@tcp:38:kworker.0 00010000:00020000:2.0:1787826321.564008:0:9966:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.39@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826321.564033:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f824000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2400:x1874670563641344:12345-192.168.203.39@tcp:38:kworker.0 Request processed in 41us (390us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826321.564038:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3282 00000100:00100000:2.0:1787826321.564062:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563641728 00000100:00100000:2.0:1787826321.564065:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563641728 00000100:00100000:2.0:1787826321.564089:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563641600 00000100:00100000:2.0:1787826321.564091:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563641600 00000100:00100000:2.0:1787826321.564109:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 846 00000100:00100000:2.0:1787826321.564114:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563641728:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1787826321.564141:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563641728:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 27us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826321.564147:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 846 00000100:00100000:2.0:1787826321.564158:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 847 00000100:00100000:2.0:1787826321.564164:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049bbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563641600:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1787826321.564765:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049bbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563641600:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 597us (1014us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826321.564773:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 847 00000100:00080000:2.0:1787826321.564796:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787826321.564801:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787826321.564803:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1787826321.736987:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826322.755624:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826323.779773:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787826324.741174:0:33115:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787826324.741182:0:33115:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787826324.741186:0:33115:0:(import.c:65:import_set_state_nolock()) ffff90cf3720f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826324.741194:0:33115:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 1265 00000100:00080000:3.0:1787826324.741198:0:33115:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1787826324.741205:0:33115:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff90cf3720f800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:3.0:1787826324.741228:0:33115:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90ce01fde940 x1874670585134720/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787826324.741243:0:33115:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787826324.741247:0:33115:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787826324.741249:0:33115:0:(import.c:65:import_set_state_nolock()) ffff90cf264ed800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826324.741252:0:33115:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 1265 00000100:00080000:3.0:1787826324.741254:0:33115:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1787826324.741257:0:33115:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff90cf264ed800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:3.0:1787826324.741267:0:33115:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90ce01fdc000 x1874670585134848/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787826324.741297:0:33115:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787826324.741301:0:33115:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787826324.741303:0:33115:0:(import.c:65:import_set_state_nolock()) ffff90ce02455800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826324.741306:0:33115:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 1265 00000100:00080000:3.0:1787826324.741308:0:33115:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1787826324.741312:0:33115:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff90ce02455800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:3.0:1787826324.741323:0:33115:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90ce01fdcf00 x1874670585135232/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787826324.741337:0:33115:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787826324.741340:0:33115:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787826324.741342:0:33115:0:(import.c:65:import_set_state_nolock()) ffff90ce05f9d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826324.741345:0:33115:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 1265 00000100:00080000:3.0:1787826324.741347:0:33115:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1787826324.741351:0:33115:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90ce05f9d000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:3.0:1787826324.741362:0:33115:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90ce01fdfc00 x1874670585135488/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826324.741397:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fdd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585134976:0@lo:400:kworker.0 00000100:00100000:3.0:1787826324.741457:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826324.741578:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787826324.741585:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03a19680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e3c550b8-2c3c-46c3-ad36-671c284167ea:3645:1874670585134592:0@lo:400:kworker.0 00000400:00000100:3.0:1787826324.741603:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874670585134592 offset 0 length 224: 4 00000100:00100000:3.0:1787826324.741620:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fdda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874670585135616:0@lo:400:kworker.0 00000100:00100000:3.0:1787826324.741641:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826324.741665:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fdc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585135104:0@lo:400:kworker.0 00000100:00100000:3.0:1787826324.741685:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826324.741702:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787826324.741707:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fdde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874670585135360:0@lo:400:kworker.0 00000100:00100000:3.0:1787826324.741726:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826324.741759:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585134976 00000100:00100000:1.0:1787826324.742041:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fde940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874670585134720:0@lo:38:kworker.0 00000100:00100000:1.0:1787826324.742073:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826324.742094:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874670585134848:0@lo:38:kworker.0 00000100:00100000:1.0:1787826324.742115:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826324.742132:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fdcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1874670585135232:0@lo:38:kworker.0 00000100:00100000:1.0:1787826324.742153:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826324.742168:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fdfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1874670585135488:0@lo:38:kworker.0 00000100:00100000:1.0:1787826324.742188:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826324.742216:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585135616 00000100:00100000:1.0:1787826324.742220:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585135616 00000100:00100000:1.0:1787826324.742266:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585135360 00000100:00100000:1.0:1787826324.742269:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585135360 00000100:00100000:1.0:1787826324.742288:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585134848 00000100:00100000:1.0:1787826324.742290:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585134848 00000100:00100000:1.0:1787826324.742299:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585135232 00000100:00100000:1.0:1787826324.742301:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585135232 00000100:00100000:1.0:1787826324.742309:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585135488 00000100:00100000:1.0:1787826324.742310:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585135488 00000100:00100000:1.0:1787826324.742321:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1458 00000100:00100000:1.0:1787826324.742329:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874670585135616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826324.742379:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874670585135616:12345-0@lo:400:kworker.0 Request processed in 50us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826324.742386:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1458 00000100:00100000:1.0:1787826324.742400:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1459 00000100:00100000:1.0:1787826324.742406:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874670585135360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826324.742435:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874670585135360:12345-0@lo:400:kworker.0 Request processed in 29us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826324.742440:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1459 00000100:00100000:1.0:1787826324.742450:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3283 00000100:00100000:1.0:1787826324.742455:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab16940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1874670585134848:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787826324.742487:0:6518:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826324.742521:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab16940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1874670585134848:12345-0@lo:38:kworker.0 Request processed in 64us (404us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826324.742527:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3283 00000100:00100000:1.0:1787826324.742539:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3284 00000100:00100000:1.0:1787826324.742543:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab14780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1874670585135232:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787826324.742552:0:6518:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826324.742578:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab14780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1874670585135232:12345-0@lo:38:kworker.0 Request processed in 33us (424us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826324.742584:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3284 00000100:00100000:1.0:1787826324.742595:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3285 00000100:00100000:1.0:1787826324.742599:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8f9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1874670585135488:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787826324.742609:0:6518:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826324.742632:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8f9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1874670585135488:12345-0@lo:38:kworker.0 Request processed in 31us (443us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826324.742637:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3285 00000100:00100000:1.0:1787826324.742655:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585134720 00000100:00100000:1.0:1787826324.742658:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585134720 00000100:00100000:1.0:1787826324.742678:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1299 00000100:00100000:1.0:1787826324.742683:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab15680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3643:x1874670585134720:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787826324.742692:0:7796:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826324.742718:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab15680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3643:x1874670585134720:12345-0@lo:38:kworker.0 Request processed in 33us (643us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826324.742723:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1299 00000100:00080000:1.0:1787826324.742749:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826324.742790:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fdde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874670585135360:0@lo:400:kworker.0 00000100:00080000:1.0:1787826324.742830:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90cf3720f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787826324.742835:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787826324.742838:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fde940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874670585134720:0@lo:38:kworker.0 00000100:00080000:1.0:1787826324.742845:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90cf264ed800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787826324.742848:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787826324.742851:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874670585134848:0@lo:38:kworker.0 00000100:00080000:1.0:1787826324.742857:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90ce02455800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787826324.742860:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787826324.742863:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fdcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1874670585135232:0@lo:38:kworker.0 00000100:00080000:1.0:1787826324.742870:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90ce05f9d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787826324.742872:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787826324.742875:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fdfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1874670585135488:0@lo:38:kworker.0 00000100:00100000:1.0:1787826324.742906:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fdda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874670585135616:0@lo:400:kworker.0 00000100:00100000:1.0:1787826324.742939:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585135104 00000100:00100000:1.0:1787826324.742943:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585135104 00000100:00100000:1.0:1787826324.742974:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 848 00000100:00100000:1.0:1787826324.742980:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1874670585135104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826324.743015:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1874670585135104:12345-0@lo:400:kworker.0 Request processed in 35us (1329us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826324.743021:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 848 00000100:00080000:1.0:1787826324.743038:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826324.743053:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fdc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585135104:0@lo:400:kworker.0 00000100:00100000:3.0:1787826324.747193:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585134976 00000100:00100000:3.0:1787826324.747283:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 849 00000100:00100000:3.0:1787826324.747294:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874670585134976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826324.747387:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874670585134976:12345-0@lo:400:kworker.0 Request processed in 95us (5929us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826324.747394:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 849 00000100:00100000:3.0:1787826324.747492:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fdd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585134976:0@lo:400:kworker.0 00000100:00080000:1.0:1787826324.749913:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787826324.809803:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:3.0:1787826325.239712:0:3647:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787826309/real 1787826309] req@ffff90cf3f877480 x1874670585130368/t0(0) o400->MGC192.168.203.139@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1787826325 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826325.269213:0:3647:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff90cf3f877480 x1874670585130368/t0(0) o400->MGC192.168.203.139@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1787826325 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787826325.269227:0:3647:0:(import.c:65:import_set_state_nolock()) ffff90cf3966f800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1787826325.269232:0:3647:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.139@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1787826325.279434:0:3647:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.139@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1787826325.279439:0:3647:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1787826325.279448:0:3647:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90cf3f877480 x1874670585130368/t0(0) o400->MGC192.168.203.139@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1787826325 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826325.279461:0:3647:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90cf3fb94780 x1874670585131776/t0(0) o400->MGC192.168.203.139@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787826330 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826325.279485:0:3647:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90ce0b430000 x1874670585133184/t0(0) o400->MGC192.168.203.139@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787826335 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826325.279502:0:3647:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90ce03a19680 x1874670585134592/t0(0) o400->MGC192.168.203.139@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787826340 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1787826325.279511:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1787826325.279513:0:3647:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1787826325.279515:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1787826325.279517:0:3647:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:0.0:1787826325.282203:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03a19680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e3c550b8-2c3c-46c3-ad36-671c284167ea:3645:1874670585134592:0@lo:400:kworker.0 00000100:00100000:0.0:1787826325.282216:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0b430000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e3c550b8-2c3c-46c3-ad36-671c284167ea:3645:1874670585133184:0@lo:400:kworker.0 00000100:00080000:2.0:1787826325.283512:0:33115:0:(pinger.c:229:ptlrpc_pinger_process_import()) e3c550b8-2c3c-46c3-ad36-671c284167ea->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787826325.283519:0:33115:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1787826325.283523:0:33115:0:(import.c:65:import_set_state_nolock()) ffff90cf3966f800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826325.283529:0:33115:0:(import.c:510:import_select_connection()) MGC192.168.203.139@tcp: connect to NID 0@lo last attempt 221 00000100:00080000:2.0:1787826325.283537:0:33115:0:(import.c:624:import_select_connection()) MGC192.168.203.139@tcp: import ffff90cf3966f800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:2.0:1787826325.283581:0:33115:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cf3a98a940 x1874670585135744/t0(0) o250->MGC192.168.203.139@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787826325.283609:0:33115:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787826325.283613:0:33115:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787826325.283615:0:33115:0:(import.c:65:import_set_state_nolock()) ffff90cf3720f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826325.283619:0:33115:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 1270 00000100:00080000:2.0:1787826325.283621:0:33115:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787826325.283625:0:33115:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff90cf3720f800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:2.0:1787826325.283641:0:33115:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cf3a988000 x1874670585135872/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787826325.283650:0:33115:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787826325.283653:0:33115:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787826325.283654:0:33115:0:(import.c:65:import_set_state_nolock()) ffff90cf264ed800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826325.283658:0:33115:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 1270 00000100:00080000:2.0:1787826325.283660:0:33115:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787826325.283662:0:33115:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff90cf264ed800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:2.0:1787826325.283673:0:33115:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cf3a988780 x1874670585136000/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787826325.283721:0:33115:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787826325.283725:0:33115:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787826325.283727:0:33115:0:(import.c:65:import_set_state_nolock()) ffff90ce02455800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826325.283730:0:33115:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 1270 00000100:00080000:2.0:1787826325.283733:0:33115:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787826325.283736:0:33115:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff90ce02455800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:2.0:1787826325.283746:0:33115:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cf3f874780 x1874670585136384/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787826325.283760:0:33115:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787826325.283763:0:33115:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787826325.283765:0:33115:0:(import.c:65:import_set_state_nolock()) ffff90ce05f9d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787826325.283768:0:33115:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 1270 00000100:00080000:2.0:1787826325.283769:0:33115:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787826325.283773:0:33115:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90ce05f9d000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:2.0:1787826325.283782:0:33115:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cf3ab92940 x1874670585136640/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826325.283833:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874670585136512:0@lo:400:kworker.0 00000100:00100000:2.0:1787826325.283898:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826325.283935:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3fb94780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e3c550b8-2c3c-46c3-ad36-671c284167ea:3647:1874670585131776:0@lo:400:kworker.0 00000100:00100000:2.0:1787826325.283941:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e3c550b8-2c3c-46c3-ad36-671c284167ea:3647:1874670585130368:0@lo:400:kworker.0 00000100:00100000:0.0:1787826325.283951:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f876d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585136128:0@lo:400:kworker.0 00000100:00100000:2.0:1787826325.283962:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787826325.283971:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f876940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585136256:0@lo:400:kworker.0 00000100:00100000:0.0:1787826325.283992:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826325.284037:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787826325.284040:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585136128 00000100:00100000:0.0:1787826325.284044:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab93840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874670585136768:0@lo:400:kworker.0 00000100:00100000:2.0:1787826325.284048:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585136128 00000100:00100000:0.0:1787826325.284073:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826325.284102:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 850 00000100:00100000:1.0:1787826325.284157:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a98a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e3c550b8-2c3c-46c3-ad36-671c284167ea:3643:1874670585135744:0@lo:250:kworker.0 00000400:00000100:1.0:1787826325.284182:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874670585135744 offset 0 length 520: 4 00000100:00100000:1.0:1787826325.284208:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a988000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874670585135872:0@lo:38:kworker.0 00000100:00100000:1.0:1787826325.284244:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826325.284266:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a988780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874670585136000:0@lo:38:kworker.0 00000100:00100000:1.0:1787826325.284286:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826325.284300:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f874780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1874670585136384:0@lo:38:kworker.0 00000100:00100000:1.0:1787826325.284318:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826325.284335:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab92940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1874670585136640:0@lo:38:kworker.0 00000100:00100000:1.0:1787826325.284353:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826325.284386:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585136512 00000100:00100000:1.0:1787826325.284390:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585136512 00000100:00100000:1.0:1787826325.284417:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585136768 00000100:00100000:1.0:1787826325.284420:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585136768 00000100:00100000:1.0:1787826325.284434:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585136000 00000100:00100000:1.0:1787826325.284437:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585136000 00000100:00100000:1.0:1787826325.284446:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585136384 00000100:00100000:1.0:1787826325.284448:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585136384 00000100:00100000:1.0:1787826325.284456:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585136640 00000100:00100000:1.0:1787826325.284458:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585136640 00000100:00100000:1.0:1787826325.284465:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1460 00000100:00100000:1.0:1787826325.284499:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03738000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874670585136512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826325.284545:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03738000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874670585136512:12345-0@lo:400:kworker.0 Request processed in 73us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826325.284552:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1460 00000100:00100000:1.0:1787826325.284568:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1461 00000100:00100000:1.0:1787826325.284574:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a19680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874670585136768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826325.284607:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a19680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874670585136768:12345-0@lo:400:kworker.0 Request processed in 34us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826325.284613:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1461 00000100:00100000:1.0:1787826325.284625:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3286 00000100:00100000:1.0:1787826325.284629:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1874670585136000:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787826325.284646:0:6518:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826325.284679:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1874670585136000:12345-0@lo:38:kworker.0 Request processed in 48us (391us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826325.284685:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3286 00000100:00100000:1.0:1787826325.284697:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3287 00000100:00100000:1.0:1787826325.284700:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1874670585136384:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787826325.284710:0:6518:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826325.284733:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1874670585136384:12345-0@lo:38:kworker.0 Request processed in 30us (413us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826325.284739:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3287 00000100:00100000:1.0:1787826325.284750:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3288 00000100:00100000:1.0:1787826325.284754:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1874670585136640:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787826325.284763:0:6518:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826325.284786:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1874670585136640:12345-0@lo:38:kworker.0 Request processed in 31us (431us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826325.284792:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3288 00000100:00100000:1.0:1787826325.284825:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585135872 00000100:00100000:1.0:1787826325.284829:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585135872 00000100:00100000:1.0:1787826325.284850:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1300 00000100:00100000:1.0:1787826325.284854:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8fa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1874670585135872:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787826325.284865:0:6524:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826325.284893:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8fa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1874670585135872:12345-0@lo:38:kworker.0 Request processed in 38us (648us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826325.284899:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1300 00000100:00080000:1.0:1787826325.284948:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90cf3720f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787826325.284953:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787826325.284956:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a988000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874670585135872:0@lo:38:kworker.0 00000100:00080000:1.0:1787826325.284964:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90cf264ed800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787826325.284967:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787826325.284969:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a988780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874670585136000:0@lo:38:kworker.0 00000100:00080000:1.0:1787826325.284977:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90ce02455800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787826325.284980:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787826325.284982:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f874780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1874670585136384:0@lo:38:kworker.0 00000100:00080000:1.0:1787826325.284990:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90ce05f9d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787826325.284992:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787826325.284995:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab92940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1874670585136640:0@lo:38:kworker.0 00000100:00100000:1.0:1787826325.285033:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab93840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874670585136768:0@lo:400:kworker.0 00000100:00100000:2.0:1787826325.285182:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b430000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1874670585136128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826325.285232:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b430000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1874670585136128:12345-0@lo:400:kworker.0 Request processed in 1122us (1241us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826325.285295:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f876d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585136128:0@lo:400:kworker.0 00000100:00100000:3.0:1787826325.286825:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826325.286886:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874670585136512:0@lo:400:kworker.0 00000100:00100000:1.0:1787826325.287920:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585136256 00000100:00100000:1.0:1787826325.287930:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585136256 00000100:00100000:2.0:1787826325.290613:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 850 00000100:00100000:1.0:1787826325.293142:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 851 00000100:00100000:1.0:1787826325.293159:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3647:x1874670585136256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826325.293268:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3647:x1874670585136256:12345-0@lo:400:kworker.0 Request processed in 116us (6448us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826325.293276:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 851 00000100:00100000:2.0:1787826325.295416:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f876940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585136256:0@lo:400:kworker.0 00010000:00010000:3.0:1787826325.828131:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826326.276218:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a8acb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585136896:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826326.276284:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826326.276371:0:12021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585136896 00000100:00100000:0.0:1787826326.276378:0:12021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585136896 00000100:00100000:0.0:1787826326.276432:0:12021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 710 00000100:00100000:0.0:1787826326.276442:0:12021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874670585136896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787826326.276492:0:12021:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43441856 pending 0 free 3919286272 avail 3687763968 00000100:00100000:0.0:1787826326.276538:0:12021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874670585136896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826326.276546:0:12021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 710 00000100:00080000:0.0:1787826326.276569:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826326.276606:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a8acb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585136896:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826326.276757:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787826326.276778:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fdfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585137024:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826326.276819:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826326.276967:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585137024 00000100:00100000:1.0:1787826326.276972:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585137024 00000100:00100000:1.0:1787826326.277022:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 711 00000100:00100000:1.0:1787826326.277029:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03739680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874670585137024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787826326.277047:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 60260032 pending 0 free 3921387520 avail 3689865216 00000100:00100000:1.0:1787826326.277085:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03739680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874670585137024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826326.277092:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 711 00000100:00080000:2.0:1787826326.278103:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826326.278149:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fdfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585137024:0@lo:13:osp-pre-1-1.0 00000400:00000100:3.0:1787826326.674032:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.39@tcp portal 26 match 1874670563641856 offset 0 length 224: 4 00000100:00100000:3.0:1787826326.674069:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826326.674107:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826326.674129:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826326.674151:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826326.674189:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563642112 00000100:00100000:3.0:1787826326.674198:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563642112 00000100:00100000:3.0:1787826326.674250:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563641984 00000100:00100000:3.0:1787826326.674253:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563641984 00000100:00100000:3.0:1787826326.674268:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1462 00000100:00100000:3.0:1787826326.674277:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:2401:x1874670563642112:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1787826326.674346:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:2401:x1874670563642112:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 69us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826326.674353:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1462 00000100:00100000:3.0:1787826326.674369:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3289 00000100:00100000:3.0:1787826326.674374:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2400:x1874670563641984:12345-192.168.203.39@tcp:38:kworker.0 00010000:00020000:3.0:1787826326.674394:0:6518:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.39@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787826326.674418:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2400:x1874670563641984:12345-192.168.203.39@tcp:38:kworker.0 Request processed in 43us (267us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787826326.674425:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3289 00000100:00100000:3.0:1787826326.674441:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563642240 00000100:00100000:3.0:1787826326.674444:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563642240 00000100:00100000:3.0:1787826326.674491:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563642368 00000100:00100000:3.0:1787826326.674494:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563642368 00000100:00100000:3.0:1787826326.674515:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 852 00000100:00100000:3.0:1787826326.674521:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2401:x1874670563642240:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1787826326.674547:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2401:x1874670563642240:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 26us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826326.674552:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 852 00000100:00100000:3.0:1787826326.674562:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 853 00000100:00100000:3.0:1787826326.674567:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2401:x1874670563642368:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1787826326.674588:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2401:x1874670563642368:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 21us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826326.674593:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 853 00000100:00080000:3.0:1787826326.674610:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787826326.674613:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787826326.674616:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000400:00000100:3.0:1787826326.715926:0:3639:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.39@tcp portal 26 match 1874670563642496 offset 0 length 520: 4 00010000:00010000:0.0:1787826326.853829:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787826327.669256:0:34480:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787826327.669263:0:34480:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1787826327.669265:0:34480:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1787826327.669381:0:34480:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90ce034cb800 00000020:01000004:3.0:1787826327.669396:0:34480:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1787826327.669410:0:34480:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787826327.669424:0:34480:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff90cf3ab03370) 00000020:00000080:3.0:1787826327.669441:0:34480:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787826327.732386:0:34480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1787826327.732752:0:34480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1787826327.734231:0:34480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1787826327.735026:0:34480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1787826327.735393:0:34480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1787826327.735804:0:34480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1787826327.736078:0:34480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1787826327.736355:0:34480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1787826327.736612:0:34480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1787826327.736866:0:34480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1787826327.737114:0:34480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1787826327.737347:0:34480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1787826327.737586:0:34480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1787826327.738076:0:34480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1787826327.738352:0:34480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1787826327.738845:0:34480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1787826327.739152:0:34480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1787826327.739386:0:34480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1787826327.739601:0:34480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1787826327.739813:0:34480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1787826327.740023:0:34480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1787826327.740221:0:34480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1787826327.740427:0:34480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1787826327.740693:0:34480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1787826327.740903:0:34480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1787826327.741104:0:34480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1787826327.741618:0:34480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1787826327.741854:0:34480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1787826327.742077:0:34480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1787826327.742280:0:34480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1787826327.743359:0:34480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1787826327.743987:0:34480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1787826327.744259:0:34480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1787826327.744454:0:34480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1787826327.745704:0:34480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1787826327.758754:0:34480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1787826327.759228:0:34480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1787826327.759510:0:34480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1787826327.760086:0:34480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:1.0:1787826327.760318:0:34480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:1.0:1787826327.760539:0:34480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1787826327.760730:0:34480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:1.0:1787826327.761070:0:34480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:1.0:1787826327.761643:0:34480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1787826327.761865:0:34480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1787826327.762151:0:34480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1787826327.762369:0:34480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1787826327.764178:0:34480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1787826327.764836:0:34480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1787826327.765585:0:34480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1787826327.766131:0:34480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1787826327.766339:0:34480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1787826327.766706:0:34480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:1.0:1787826327.767168:0:34480:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1787826327.767376:0:34480:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1787826327.767383:0:34480:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787826327.767393:0:34480:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x22153cd396b7f536 00000020:01000004:1.0:1787826327.767400:0:34480:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1787826327.767411:0:34480:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1787826327.767416:0:34480:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90ce034cb800 from MGS 00000020:01000004:1.0:1787826327.767419:0:34480:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1787826327.767429:0:34480:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff90cf39f48000) 00000020:00000080:1.0:1787826327.767439:0:34480:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1787826327.768499:0:34480:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90ce034cb800 from MGS, refs=2 00080000:01000000:0.0:1787826327.768511:0:34480:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787826327.768521:0:34480:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x22153cd396b7f544 00010000:00010000:0.0:1787826327.768678:0:34480:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:0.0:1787826327.774364:0:34480:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1787826327.775244:0:34484:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1787826327.775286:0:34480:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1787826327.775321:0:34480:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787826327.778633:0:34480:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1787826327.778914:0:34480:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787826327.779102:0:34480:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1787826327.779109:0:34480:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1787826327.785715:0:34480:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1787826327.785733:0:34480:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1787826327.787747:0:34480:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1787826327.787759:0:34480:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1787826327.789958:0:34480:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1787826327.790330:0:34480:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:1.0:1787826327.790907:0:34480:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.139@tcp:Set MGC reconnect 2 10000000:01000000:1.0:1787826327.790912:0:34480:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.139@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:1.0:1787826327.790917:0:34480:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff90cf3966f800 already not connected (conn 2, was 0): CONNECTING 00000100:00100000:1.0:1787826327.790923:0:34480:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 10s for inflight to error out 00010000:00010000:2.0:1787826327.876108:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826328.899820:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826329.923890:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787826330.371649:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e3c550b8-2c3c-46c3-ad36-671c284167ea->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787826330.371660:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) e3c550b8-2c3c-46c3-ad36-671c284167ea->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787826330.371663:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787826330.371667:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787826330.371671:0:36:0:(import.c:65:import_set_state_nolock()) ffff90cf3720f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826330.371678:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 1271 00000100:00080000:0.0:1787826330.371682:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787826330.371689:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff90cf3720f800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:0.0:1787826330.371728:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cf3a8af480 x1874670585137152/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787826330.371752:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787826330.371755:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787826330.371757:0:36:0:(import.c:65:import_set_state_nolock()) ffff90cf264ed800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826330.371760:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 1271 00000100:00080000:0.0:1787826330.371763:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787826330.371766:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff90cf264ed800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:0.0:1787826330.371787:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cf3a8afc00 x1874670585137280/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787826330.371855:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787826330.371858:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787826330.371860:0:36:0:(import.c:65:import_set_state_nolock()) ffff90ce02455800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826330.371864:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 1271 00000100:00080000:0.0:1787826330.371866:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787826330.371870:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff90ce02455800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:0.0:1787826330.371880:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90ce03891680 x1874670585137664/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787826330.371893:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787826330.371897:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787826330.371898:0:36:0:(import.c:65:import_set_state_nolock()) ffff90ce05f9d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826330.371901:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 1271 00000100:00080000:0.0:1787826330.371904:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787826330.371906:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90ce05f9d000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:0.0:1787826330.371916:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90ce03893840 x1874670585137920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826330.371960:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce038903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1874670585137792:0@lo:400:kworker.0 00000100:00100000:0.0:1787826330.372028:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826330.372087:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787826330.372094:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03890b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585137536:0@lo:400:kworker.0 00000100:00100000:0.0:1787826330.372119:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826330.372215:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03891a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1874670585138048:0@lo:400:kworker.0 00000100:00100000:3.0:1787826330.372245:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826330.372276:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787826330.372295:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a8acb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585137408:0@lo:400:kworker.0 00000100:00100000:3.0:1787826330.372318:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826330.372363:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585137536 00000100:00100000:3.0:1787826330.372370:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585137536 00000100:00100000:3.0:1787826330.372415:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585137408 00000100:00100000:3.0:1787826330.372418:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585137408 00000100:00100000:3.0:1787826330.372437:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 854 00000100:00100000:3.0:1787826330.372447:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf2f45de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874670585137536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826330.372527:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf2f45de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874670585137536:12345-0@lo:400:kworker.0 Request processed in 81us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826330.372534:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 854 00000100:00100000:3.0:1787826330.372548:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 855 00000100:00100000:3.0:1787826330.372555:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874670585137408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826330.372586:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874670585137408:12345-0@lo:400:kworker.0 Request processed in 32us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826330.372592:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 855 00000100:00080000:3.0:1787826330.372612:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787826330.372616:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826330.372645:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a8acb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585137408:0@lo:400:kworker.0 00000100:00100000:3.0:1787826330.372672:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03890b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585137536:0@lo:400:kworker.0 00000100:00100000:1.0:1787826330.373121:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a8af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874670585137152:0@lo:38:kworker.0 00000100:00100000:1.0:1787826330.373160:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826330.373188:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a8afc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874670585137280:0@lo:38:kworker.0 00000100:00100000:1.0:1787826330.373211:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826330.373238:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03891680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1874670585137664:0@lo:38:kworker.0 00000100:00100000:1.0:1787826330.373260:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826330.373278:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03893840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1874670585137920:0@lo:38:kworker.0 00000100:00100000:1.0:1787826330.373313:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826330.373345:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585137792 00000100:00100000:1.0:1787826330.373350:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585137792 00000100:00100000:1.0:1787826330.373387:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585138048 00000100:00100000:1.0:1787826330.373390:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585138048 00000100:00100000:1.0:1787826330.373410:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585137280 00000100:00100000:1.0:1787826330.373413:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585137280 00000100:00100000:1.0:1787826330.373421:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585137664 00000100:00100000:1.0:1787826330.373423:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585137664 00000100:00100000:1.0:1787826330.373430:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585137920 00000100:00100000:1.0:1787826330.373432:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585137920 00000100:00100000:1.0:1787826330.373442:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1463 00000100:00100000:1.0:1787826330.373449:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf2f45d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874670585137792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826330.373508:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf2f45d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874670585137792:12345-0@lo:400:kworker.0 Request processed in 59us (1479us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826330.373514:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1463 00000100:00100000:1.0:1787826330.373527:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1464 00000100:00100000:1.0:1787826330.373533:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874670585138048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826330.373567:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874670585138048:12345-0@lo:400:kworker.0 Request processed in 34us (1322us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826330.373573:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1464 00000100:00100000:1.0:1787826330.373585:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3290 00000100:00100000:1.0:1787826330.373589:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1874670585137280:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787826330.373607:0:8247:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826330.373638:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1874670585137280:12345-0@lo:38:kworker.0 Request processed in 47us (425us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826330.373659:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3290 00000100:00100000:1.0:1787826330.373670:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3291 00000100:00100000:1.0:1787826330.373674:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1874670585137664:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787826330.373684:0:8247:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826330.373707:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1874670585137664:12345-0@lo:38:kworker.0 Request processed in 31us (446us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826330.373712:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3291 00000100:00100000:1.0:1787826330.373723:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3292 00000100:00100000:1.0:1787826330.373727:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fde940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1874670585137920:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787826330.373736:0:8247:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826330.373761:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fde940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1874670585137920:12345-0@lo:38:kworker.0 Request processed in 32us (447us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826330.373767:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3292 00000100:00080000:1.0:1787826330.373805:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826330.373829:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03891a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1874670585138048:0@lo:400:kworker.0 00000100:00080000:1.0:1787826330.373855:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90cf264ed800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787826330.373860:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787826330.373863:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a8afc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874670585137280:0@lo:38:kworker.0 00000100:00080000:1.0:1787826330.373871:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90ce02455800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787826330.373874:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787826330.373877:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03891680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1874670585137664:0@lo:38:kworker.0 00000100:00080000:1.0:1787826330.373884:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90ce05f9d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787826330.373887:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787826330.373890:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03893840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1874670585137920:0@lo:38:kworker.0 00000100:00100000:3.0:1787826330.374166:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585137152 00000100:00100000:3.0:1787826330.374171:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585137152 00000100:00100000:3.0:1787826330.374200:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1301 00000100:00100000:3.0:1787826330.374204:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf092d0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1874670585137152:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787826330.374215:0:6523:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787826330.374259:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf092d0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1874670585137152:12345-0@lo:38:kworker.0 Request processed in 54us (1098us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787826330.374265:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1301 00000100:00100000:3.0:1787826330.374467:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce038903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1874670585137792:0@lo:400:kworker.0 00000100:00080000:2.0:1787826330.374590:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90cf3720f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826330.374595:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826330.374598:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a8af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874670585137152:0@lo:38:kworker.0 00010000:00010000:0.0:1787826330.949840:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826331.396035:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787826331.396053:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf2f45d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585138176:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826331.396077:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787826331.396086:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fdde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585138304:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826331.404620:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826331.405228:0:12021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585138176 00000100:00100000:0.0:1787826331.405237:0:12021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585138176 00000100:00100000:0.0:1787826331.405301:0:12021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 712 00000100:00100000:0.0:1787826331.405310:0:12021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874670585138176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787826331.405342:0:12021:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43441856 pending 0 free 3919286272 avail 3687763968 00000100:00100000:0.0:1787826331.405415:0:12021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874670585138176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826331.405421:0:12021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 712 00000100:00100000:1.0:1787826331.405660:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826331.405842:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585138304 00000100:00100000:2.0:1787826331.405848:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585138304 00000100:00100000:2.0:1787826331.405884:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 713 00000100:00100000:2.0:1787826331.405891:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874670585138304:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787826331.405909:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 60260032 pending 0 free 3921387520 avail 3689865216 00000100:00100000:2.0:1787826331.405949:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874670585138304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826331.405956:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 713 00000100:00100000:1.0:1787826331.406062:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fdde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585138304:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826331.406427:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf2f45d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585138176:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787826331.798152:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826331.798197:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826331.798318:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563642624 00000100:00100000:1.0:1787826331.798327:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563642624 00000100:00100000:1.0:1787826331.798379:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3293 00000100:00100000:1.0:1787826331.798386:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03bdda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2400:x1874670563642624:12345-192.168.203.39@tcp:38:kworker.0 00010000:00020000:1.0:1787826331.798408:0:8247:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.39@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826331.798468:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03bdda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2400:x1874670563642624:12345-192.168.203.39@tcp:38:kworker.0 Request processed in 80us (325us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826331.798511:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3293 00000100:00100000:3.0:1787826331.799803:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826331.799840:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826331.800180:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563642752 00000100:00100000:1.0:1787826331.800188:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563642752 00000100:00100000:1.0:1787826331.800267:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1465 00000100:00100000:1.0:1787826331.800276:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03bde1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:2402:x1874670563642752:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1787826331.800343:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03bde1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:2402:x1874670563642752:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 69us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826331.800350:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1465 00000100:00080000:0.0:1787826331.800468:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787826331.801379:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563642880 00000100:00100000:2.0:1787826331.801387:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563642880 00000100:00100000:2.0:1787826331.801501:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563643008 00000100:00100000:2.0:1787826331.801505:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563643008 00000100:00100000:1.0:1787826331.801549:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 856 00000100:00100000:1.0:1787826331.801561:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03bdfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2402:x1874670563642880:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1787826331.801630:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03bdfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2402:x1874670563642880:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 72us (3432us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826331.801638:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 856 00000100:00080000:0.0:1787826331.802166:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787826331.802172:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826331.802638:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 857 00000100:00100000:2.0:1787826331.802648:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2402:x1874670563643008:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1787826331.802701:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2402:x1874670563643008:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 55us (2859us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826331.802708:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 857 00010000:00010000:2.0:1787826331.971679:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826332.995883:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826334.019708:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826335.044635:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826335.491620:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787826325/real 1787826325] req@ffff90cf3a98a940 x1874670585135744/t0(0) o250->MGC192.168.203.139@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787826335 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787826335.491657:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90cf3a98a940 x1874670585135744/t0(0) o250->MGC192.168.203.139@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787826335 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787826335.491676:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90cf3966f800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826335.491702:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1787826335.491718:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a98a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e3c550b8-2c3c-46c3-ad36-671c284167ea:3643:1874670585135744:0@lo:250:kworker.0 10000000:01000000:1.0:1787826335.491909:0:34480:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:1.0:1787826335.491925:0:34480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff90cf0165fe00/0x22153cd396b6cf28 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x22153cd396b6cf2f expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787826335.491936:0:34480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff90cf0165fe00/0x22153cd396b6cf28 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x22153cd396b6cf2f expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826335.491942:0:34480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1787826335.491973:0:34480:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787826335.491984:0:34480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff90cf0165fe00/0x22153cd396b6cf28 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x22153cd396b6cf2f expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826335.492004:0:34480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff90cf3abd7c00/0x22153cd396b6d373 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x22153cd396b6d37a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787826335.492011:0:34480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff90cf3abd7c00/0x22153cd396b6d373 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x22153cd396b6d37a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826335.492016:0:34480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787826335.492020:0:34480:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787826335.492025:0:34480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff90cf3abd7c00/0x22153cd396b6d373 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x22153cd396b6d37a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826335.492034:0:34480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff90cf3a839e00/0x22153cd396b6d381 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x22153cd396b6d388 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787826335.492041:0:34480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff90cf3a839e00/0x22153cd396b6d381 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x22153cd396b6d388 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826335.492046:0:34480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787826335.492050:0:34480:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787826335.492054:0:34480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff90cf3a839e00/0x22153cd396b6d381 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x22153cd396b6d388 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826335.492062:0:34480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff90cf2f400a00/0x22153cd396b6d3ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x22153cd396b6d3b2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787826335.492068:0:34480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff90cf2f400a00/0x22153cd396b6d3ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x22153cd396b6d3b2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826335.492073:0:34480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787826335.492075:0:34480:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787826335.492079:0:34480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff90cf2f400a00/0x22153cd396b6d3ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x22153cd396b6d3b2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826335.492087:0:34480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff90ce01f17c00/0x22153cd396b77afc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x22153cd396b77b03 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787826335.492093:0:34480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff90ce01f17c00/0x22153cd396b77afc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x22153cd396b77b03 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826335.492102:0:34480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787826335.492105:0:34480:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787826335.492109:0:34480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff90ce01f17c00/0x22153cd396b77afc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x22153cd396b77b03 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826335.492117:0:34480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff90cf3abd7800/0x22153cd396b77b3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x22153cd396b77b42 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787826335.492122:0:34480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff90cf3abd7800/0x22153cd396b77b3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x22153cd396b77b42 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826335.492127:0:34480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787826335.492130:0:34480:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787826335.492133:0:34480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff90cf3abd7800/0x22153cd396b77b3b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x22153cd396b77b42 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787826335.492133:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e3c550b8-2c3c-46c3-ad36-671c284167ea->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787826335.492138:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1787826335.492140:0:36:0:(import.c:65:import_set_state_nolock()) ffff90cf3966f800 MGS: changing import state from DISCONN to CONNECTING 00010000:00010000:1.0:1787826335.492142:0:34480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff90cf3a839c00/0x22153cd396b77bd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x22153cd396b77bdc expref: -99 pid: 27650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787826335.492145:0:36:0:(import.c:510:import_select_connection()) MGC192.168.203.139@tcp: connect to NID 0@lo last attempt 1271 10000000:00010000:1.0:1787826335.492148:0:34480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff90cf3a839c00/0x22153cd396b77bd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x22153cd396b77bdc expref: -99 pid: 27650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787826335.492150:0:36:0:(import.c:589:import_select_connection()) MGC192.168.203.139@tcp: tried all connections, increasing latency to 5s 10000000:01000000:1.0:1787826335.492152:0:34480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787826335.492155:0:34480:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00000100:00080000:3.0:1787826335.492156:0:36:0:(import.c:624:import_select_connection()) MGC192.168.203.139@tcp: import ffff90cf3966f800 using connection 192.168.203.139@tcp/0@lo 00010000:00010000:1.0:1787826335.492158:0:34480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff90cf3a839c00/0x22153cd396b77bd5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x22153cd396b77bdc expref: -99 pid: 27650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826335.492166:0:34480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff90ce05661000/0x22153cd396b77c14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x22153cd396b77c1b expref: -99 pid: 27650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787826335.492176:0:34480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff90ce05661000/0x22153cd396b77c14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x22153cd396b77c1b expref: -99 pid: 27650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826335.492180:0:34480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787826335.492183:0:34480:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787826335.492186:0:34480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff90ce05661000/0x22153cd396b77c14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x22153cd396b77c1b expref: -99 pid: 27650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826335.492187:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90ce03a1ad00 x1874670585138432/t0(0) o250->MGC192.168.203.139@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:1.0:1787826335.492198:0:34480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff90cf3a838400/0x22153cd396b77c5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x22153cd396b77c61 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787826335.492204:0:34480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff90cf3a838400/0x22153cd396b77c5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x22153cd396b77c61 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826335.492209:0:34480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787826335.492212:0:34480:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00000100:00080000:3.0:1787826335.492213:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00010000:00010000:1.0:1787826335.492215:0:34480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff90cf3a838400/0x22153cd396b77c5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x22153cd396b77c61 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787826335.492217:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787826335.492219:0:36:0:(import.c:65:import_set_state_nolock()) ffff90cf3720f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826335.492222:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 1276 00000100:00080000:3.0:1787826335.492225:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00010000:00010000:1.0:1787826335.492227:0:34480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff90cf0165f600/0x22153cd396b6cf36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x22153cd396b6cf3d expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787826335.492228:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff90cf3720f800 using connection 192.168.203.139@tcp/0@lo 10000000:00010000:1.0:1787826335.492233:0:34480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff90cf0165f600/0x22153cd396b6cf36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x22153cd396b6cf3d expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826335.492238:0:34480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:1.0:1787826335.492241:0:34480:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787826335.492245:0:34480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff90cf0165f600/0x22153cd396b6cf36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x22153cd396b6cf3d expref: -99 pid: 7448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826335.492245:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cf3a9acb40 x1874670585138560/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787826335.492254:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787826335.492257:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787826335.492259:0:36:0:(import.c:65:import_set_state_nolock()) ffff90cf264ed800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00010000:00010000:1.0:1787826335.492260:0:34480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff90cf3abd6200/0x22153cd396b6d429 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x22153cd396b6d430 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787826335.492262:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 1276 00000100:00080000:3.0:1787826335.492265:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 10000000:00010000:1.0:1787826335.492267:0:34480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff90cf3abd6200/0x22153cd396b6d429 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x22153cd396b6d430 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787826335.492268:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff90cf264ed800 using connection 192.168.203.139@tcp/0@lo 10000000:01000000:1.0:1787826335.492272:0:34480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787826335.492274:0:34480:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787826335.492278:0:34480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff90cf3abd6200/0x22153cd396b6d429 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x22153cd396b6d430 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826335.492278:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cf3f937840 x1874670585138688/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:1.0:1787826335.492288:0:34480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff90ce01f17e00/0x22153cd396b77b2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x22153cd396b77b34 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787826335.492294:0:34480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff90ce01f17e00/0x22153cd396b77b2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x22153cd396b77b34 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826335.492299:0:34480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787826335.492301:0:34480:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787826335.492304:0:34480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff90ce01f17e00/0x22153cd396b77b2d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x22153cd396b77b34 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826335.492313:0:34480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff90ce0865b800/0x22153cd396b77c06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x22153cd396b77c0d expref: -99 pid: 27650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787826335.492317:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 10000000:00010000:1.0:1787826335.492319:0:34480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff90ce0865b800/0x22153cd396b77c06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x22153cd396b77c0d expref: -99 pid: 27650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787826335.492320:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787826335.492322:0:36:0:(import.c:65:import_set_state_nolock()) ffff90ce02455800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 10000000:01000000:1.0:1787826335.492324:0:34480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00080000:3.0:1787826335.492325:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 1276 00010000:00010000:1.0:1787826335.492328:0:34480:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00000100:00080000:3.0:1787826335.492328:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1787826335.492331:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff90ce02455800 using connection 192.168.203.139@tcp/0@lo 00010000:00010000:1.0:1787826335.492332:0:34480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff90ce0865b800/0x22153cd396b77c06 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x22153cd396b77c0d expref: -99 pid: 27650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826335.492340:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cf3f934780 x1874670585139072/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787826335.492346:0:34480:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff90cf3966f800 already not connected (conn 3, was 0): CONNECTING 00000100:00080000:1.0:1787826335.492350:0:34480:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00080000:3.0:1787826335.492353:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787826335.492356:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787826335.492357:0:36:0:(import.c:65:import_set_state_nolock()) ffff90ce05f9d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787826335.492360:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 1276 00000100:00080000:3.0:1787826335.492363:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1787826335.492365:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90ce05f9d000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:3.0:1787826335.492375:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cf3f936d00 x1874670585139328/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826335.492383:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f9361c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585138816:0@lo:400:kworker.0 00000100:00100000:3.0:1787826335.492400:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f936580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874670585139200:0@lo:400:kworker.0 00000100:00100000:2.0:1787826335.492465:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03a1ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e3c550b8-2c3c-46c3-ad36-671c284167ea:3643:1874670585138432:0@lo:250:kworker.0 00000100:00100000:0.0:1787826335.492495:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f934000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874670585139456:0@lo:400:kworker.0 00000100:00100000:1.0:1787826335.494829:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826335.494946:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585138816 00000100:00100000:1.0:1787826335.496120:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585138816 00000100:00100000:1.0:1787826335.496205:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 858 00000100:00100000:1.0:1787826335.496214:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874670585138816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826335.496295:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874670585138816:12345-0@lo:400:kworker.0 Request processed in 82us (1471us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826335.496302:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 858 00000100:00100000:1.0:1787826335.496354:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f9361c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585138816:0@lo:400:kworker.0 00000100:00100000:1.0:1787826335.496397:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f934f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585138944:0@lo:400:kworker.0 00000100:00100000:1.0:1787826335.496443:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787826335.496511:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826335.496548:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585138944 00000100:00100000:1.0:1787826335.496551:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585138944 00000100:00100000:1.0:1787826335.496582:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 859 00000100:00100000:1.0:1787826335.496587:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b430f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874670585138944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826335.497003:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b430f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874670585138944:12345-0@lo:400:kworker.0 Request processed in 414us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826335.497011:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 859 00000100:00080000:1.0:1787826335.497030:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826335.497051:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f934f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585138944:0@lo:400:kworker.0 00000100:00100000:2.0:1787826335.498158:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826335.498209:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a9acb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874670585138560:0@lo:38:kworker.0 00000100:00100000:1.0:1787826335.499630:0:34485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585138432 00000100:00100000:1.0:1787826335.499641:0:34485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585138432 00000100:00100000:1.0:1787826335.499678:0:34485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787826335.499685:0:34485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce030a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3643:x1874670585138432:12345-0@lo:250:kworker.0 00010000:00080000:1.0:1787826335.499709:0:34485:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from e3c550b8-2c3c-46c3-ad36-671c284167ea@0@lo t0 exp 0000000000000000 cur 1281 last 0 00000020:00000080:1.0:1787826335.499746:0:34485:0:(genops.c:1385:class_connect()) connect: client e3c550b8-2c3c-46c3-ad36-671c284167ea, cookie 0x22153cd396b7f54b 00000100:00080000:1.0:1787826335.499868:0:34485:0:(import.c:65:import_set_state_nolock()) ffff90cf05e64800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787826335.499933:0:34485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce030a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3c550b8-2c3c-46c3-ad36-671c284167ea+5:3643:x1874670585138432:12345-0@lo:250:kworker.0 Request processed in 247us (1778us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826335.499941:0:34485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787826335.501565:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826335.502800:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826335.502860:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f937840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874670585138688:0@lo:38:kworker.0 00000100:00100000:2.0:1787826335.502910:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826335.503310:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585138560 00000100:00100000:0.0:1787826335.503318:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585138560 00000100:00100000:0.0:1787826335.503361:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1302 00000100:00100000:0.0:1787826335.503368:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03738780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3643:x1874670585138560:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787826335.503390:0:7796:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787826335.503434:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03738780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3643:x1874670585138560:12345-0@lo:38:kworker.0 Request processed in 65us (638us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787826335.503441:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1302 00000100:00100000:2.0:1787826335.507634:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f934780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1874670585139072:0@lo:38:kworker.0 00000100:00100000:0.0:1787826335.507692:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826335.514911:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585139456 00000100:00100000:1.0:1787826335.514929:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585139456 00000100:00100000:1.0:1787826335.515011:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585138688 00000100:00100000:1.0:1787826335.515016:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585138688 00000100:00100000:1.0:1787826335.515040:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1466 00000100:00100000:1.0:1787826335.515052:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf2f45e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874670585139456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826335.515147:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf2f45e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874670585139456:12345-0@lo:400:kworker.0 Request processed in 98us (13585us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826335.515155:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1466 00000100:00100000:1.0:1787826335.515176:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3294 00000100:00100000:1.0:1787826335.515180:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3643:x1874670585138688:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787826335.515199:0:16564:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826335.515231:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3643:x1874670585138688:12345-0@lo:38:kworker.0 Request processed in 49us (12320us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826335.515237:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3294 00000100:00080000:1.0:1787826335.515270:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826335.515309:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f934000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874670585139456:0@lo:400:kworker.0 00000100:00100000:2.0:1787826335.527385:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826335.536572:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f936d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1874670585139328:0@lo:38:kworker.0 00000100:00100000:2.0:1787826335.536653:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826335.537860:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585139200 00000100:00100000:1.0:1787826335.537872:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585139200 00000100:00100000:1.0:1787826335.538107:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585139072 00000100:00100000:1.0:1787826335.538111:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585139072 00000100:00100000:1.0:1787826335.538134:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1467 00000100:00100000:1.0:1787826335.538144:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf2f45f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874670585139200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826335.538218:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf2f45f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874670585139200:12345-0@lo:400:kworker.0 Request processed in 76us (30527us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826335.538225:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1467 00000100:00100000:1.0:1787826335.538242:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3295 00000100:00100000:1.0:1787826335.538247:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1874670585139072:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787826335.538268:0:6518:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787826335.538297:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1874670585139072:12345-0@lo:38:kworker.0 Request processed in 49us (10920us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787826335.538304:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3295 00000100:00100000:1.0:1787826335.538368:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f936580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874670585139200:0@lo:400:kworker.0 00000100:00100000:2.0:1787826335.540435:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585139328 00000100:00100000:2.0:1787826335.540446:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585139328 00000100:00100000:2.0:1787826335.540507:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3296 00000100:00100000:2.0:1787826335.540515:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f876940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1874670585139328:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787826335.540537:0:8247:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787826335.540590:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f876940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1874670585139328:12345-0@lo:38:kworker.0 Request processed in 74us (3937us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787826335.540597:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3296 00000100:00080000:3.0:1787826335.540628:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90ce05f9d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787826335.540634:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787826335.540639:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f936d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1874670585139328:0@lo:38:kworker.0 00000100:00080000:3.0:1787826335.540673:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.139@tcp: connect to target with instance 0 10000000:01000000:3.0:1787826335.540682:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:02000400:3.0:1787826335.540686:0:3643:0:(import.c:1284:ptlrpc_connect_interpret()) Evicted from MGS (at 0@lo) after server handle changed from 0x0 to 0x22153cd396b7f54b 00000100:00080000:0.0:1787826335.543032:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787826335.557396:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90cf3966f800 MGS: changing import state from CONNECTING to EVICTED 00000100:00080000:3.0:1787826335.557411:0:3643:0:(import.c:1674:ptlrpc_import_recovery_state_machine()) evicted from MGS@0@lo; invalidating 00000100:00100000:2.0:1787826335.559038:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03a1ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e3c550b8-2c3c-46c3-ad36-671c284167ea:3643:1874670585138432:0@lo:250:kworker.0 00000100:00080000:2.0:1787826335.559080:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90cf3720f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826335.559084:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826335.559088:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a9acb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874670585138560:0@lo:38:kworker.0 00000100:00080000:2.0:1787826335.559098:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90cf264ed800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826335.559102:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826335.559105:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f937840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874670585138688:0@lo:38:kworker.0 00000100:00080000:2.0:1787826335.559114:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90ce02455800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787826335.559117:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787826335.559119:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f934780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1874670585139072:0@lo:38:kworker.0 00000100:00080000:0.0:1787826335.559211:0:34480:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished EVICTED, rc = 0 00000020:01000004:0.0:1787826335.559222:0:34480:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1787826335.559261:0:34480:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1787826335.559266:0:34480:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.139@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1787826335.559371:0:34480:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.139@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787826335.559410:0:34480:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.139@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1787826335.559414:0:34480:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787826335.559416:0:34480:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787826335.559417:0:34480:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787826335.559418:0:34480:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787826335.559420:0:34480:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787826335.559434:0:34480:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787826335.559436:0:34480:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787826335.559437:0:34480:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787826335.559439:0:34480:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787826335.559441:0:34480:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787826335.559444:0:34480:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1787826335.559446:0:34480:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787826335.559448:0:34480:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787826335.559449:0:34480:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787826335.559450:0:34480:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787826335.559451:0:34480:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787826335.559453:0:34480:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787826335.559454:0:34480:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787826335.559455:0:34480:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787826335.559456:0:34480:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787826335.559457:0:34480:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787826335.559502:0:34480:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787826335.559516:0:34480:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3f7d8840 going to sleep for 0 seconds 00000100:00100000:0.0:1787826335.559522:0:34480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf2f45c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3c550b8-2c3c-46c3-ad36-671c284167ea:34480:1874670585139584:0@lo:253:mount.lustre.0 00000020:00080000:0.0:1787826335.559536:0:34480:0:(tgt_mount.c:1454:server_register_target()) lustre-MDT0000: error registering with the MGS: rc = -108 (not fatal) 00000020:01000004:0.0:1787826335.559548:0:34480:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90ce034cb800 from lustre-MDT0000 10000000:01000000:0.0:1787826335.559567:0:34480:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1787826335.559570:0:34480:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787826335.559578:0:34480:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90ce034cb800 10000000:01000000:0.0:1787826335.559582:0:34480:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787826335.559586:0:34480:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff90ce034cb800 10000000:01000000:0.0:1787826335.559589:0:34480:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787826335.559592:0:34480:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff90ce034cb800 from 1 10000000:01000000:0.0:1787826335.559596:0:34480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787826335.559623:0:34480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff90ce0a70ee00/0x22153cd396b7f552 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 34480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826335.559633:0:34480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff90ce0a70ee00/0x22153cd396b7f552 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 34480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826335.559643:0:34480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff90ce0a70ee00/0x22153cd396b7f552 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 34480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826335.559654:0:34480:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3f7d8600 going to sleep for 0 seconds 00000100:00100000:0.0:1787826335.559658:0:34480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf2f45c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3c550b8-2c3c-46c3-ad36-671c284167ea:34480:1874670585139712:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787826335.559667:0:34480:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: MGC192.168.203.139@tcp lock: ffff90ce0a70ee00/0x22153cd396b7f552 lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 34480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826335.559675:0:34480:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: MGC192.168.203.139@tcp lock: ffff90ce0a70ee00/0x22153cd396b7f552 lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1206400000000 nid: local remote: 0x0 expref: -99 pid: 34480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826335.559681:0:34480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff90ce0a70ee00/0x22153cd396b7f552 lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11206400000000 nid: local remote: 0x0 expref: -99 pid: 34480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826335.559692:0:34480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.139@tcp lock: ffff90ce0a70ee00/0x22153cd396b7f552 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11206400000000 nid: local remote: 0x0 expref: -99 pid: 34480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826335.559699:0:34480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff90ce0a70ee00/0x22153cd396b7f552 lrc: 4/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1206400000000 nid: local remote: 0x0 expref: -99 pid: 34480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826335.559706:0:34480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0a70ee00 already unused, calling callback (ffffffffc12e3c20) 10000000:00010000:0.0:1787826335.559709:0:34480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff90ce0a70ee00/0x22153cd396b7f552 lrc: 4/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1206400000000 nid: local remote: 0x0 expref: -99 pid: 34480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826335.559717:0:34480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff90ce0a70ee00/0x22153cd396b7f552 lrc: 5/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x120e400000000 nid: local remote: 0x0 expref: -99 pid: 34480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787826335.559724:0:34480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff90ce0a70ee00/0x22153cd396b7f552 lrc: 5/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x120f400000000 nid: local remote: 0x0 expref: -99 pid: 34480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826335.559730:0:34480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:0.0:1787826335.559733:0:34480:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787826335.559750:0:34480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff90ce0a70ee00/0x22153cd396b7f552 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5a0f400000000 nid: local remote: 0x0 expref: -99 pid: 34480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826335.559757:0:34480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff90ce0a70ee00/0x22153cd396b7f552 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5a0f400000000 nid: local remote: 0x0 expref: -99 pid: 34480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826335.559774:0:34480:0:(mgc_request.c:1817:mgc_process_log()) Can't get cfg lock: -108 00000100:00080000:0.0:1787826335.559777:0:34480:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:EVICTED 00000100:00080000:1.0:1787826335.560304:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e3c550b8-2c3c-46c3-ad36-671c284167ea->MGS: level EVICTED/10 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787826335.560312:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) e3c550b8-2c3c-46c3-ad36-671c284167ea->MGS: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00080000:3.0:1787826335.560383:0:34490:0:(import.c:1598:ptlrpc_invalidate_import_thread()) thread invalidate import MGC192.168.203.139@tcp to MGS@0@lo 00000100:00100000:3.0:1787826335.560387:0:34490:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1787826335.560391:0:34490:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000100:00080000:3.0:1787826335.560553:0:34490:0:(import.c:65:import_set_state_nolock()) ffff90cf3966f800 MGS: changing import state from EVICTED to RECOVER 00000100:00080000:3.0:1787826335.560559:0:34490:0:(import.c:65:import_set_state_nolock()) ffff90cf3966f800 MGS: changing import state from RECOVER to FULL 10000000:01000000:3.0:1787826335.560561:0:34490:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1787826335.560593:0:34490:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:02000000:3.0:1787826335.560597:0:34490:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) MGC192.168.203.139@tcp: Connection restored to 0@lo (at 0@lo) 00000020:01000000:2.0:1787826335.561105:0:36:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.203.139@tcp 10000000:01000000:2.0:1787826335.561124:0:36:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:2.0:1787826335.561127:0:36:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1787826335.561128:0:36:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787826335.561130:0:36:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787826335.561132:0:36:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787826335.561133:0:36:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787826335.561135:0:36:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787826335.561136:0:36:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787826335.561138:0:36:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787826335.561139:0:36:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1787826335.561182:0:36:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 10000000:01000000:2.0:1787826335.561190:0:36:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:2.0:1787826335.561191:0:36:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1787826335.561193:0:36:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787826335.561194:0:36:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787826335.561195:0:36:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787826335.561196:0:36:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787826335.561197:0:36:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787826335.561198:0:36:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787826335.561199:0:36:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787826335.561200:0:36:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1787826335.561219:0:36:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:2.0:1787826335.561225:0:36:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:2.0:1787826335.561226:0:36:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1787826335.561227:0:36:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787826335.561229:0:36:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787826335.561230:0:36:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787826335.561231:0:36:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787826335.561232:0:36:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787826335.561233:0:36:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787826335.561234:0:36:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787826335.561235:0:36:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1787826335.561246:0:36:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 00000100:00100000:2.0:1787826335.561277:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f876d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e3c550b8-2c3c-46c3-ad36-671c284167ea:3645:1874670585139840:0@lo:253:kworker.0 00000100:00100000:2.0:1787826335.561350:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826335.561437:0:34488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585139840 00000100:00100000:2.0:1787826335.561444:0:34488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585139840 00000100:00100000:2.0:1787826335.561512:0:34488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787826335.561521:0:34488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce030aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3c550b8-2c3c-46c3-ad36-671c284167ea+5:3645:x1874670585139840:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1787826335.561549:0:34488:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 10000000:01000000:2.0:1787826335.561720:0:34491:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1787826335.562561:0:34480:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff90ce034cb800 from 1 10000000:01000000:0.0:1787826335.562568:0:34480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787826335.562605:0:34480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff90ce0a70f400/0x22153cd396b7f559 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 34480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826335.562621:0:34480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff90ce0a70f400/0x22153cd396b7f559 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 34480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826335.562631:0:34480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff90ce0a70f400/0x22153cd396b7f559 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 34480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826335.562650:0:34480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf2f45c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3c550b8-2c3c-46c3-ad36-671c284167ea:34480:1874670585140224:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787826335.562702:0:34480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826335.562733:0:34480:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3f7d8600 going to sleep for 11 seconds 00000100:00100000:0.0:1787826335.562774:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f874780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e3c550b8-2c3c-46c3-ad36-671c284167ea:3646:1874670585139968:0@lo:253:kworker.0 00000100:00100000:0.0:1787826335.562809:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826335.562849:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787826335.562855:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e3c550b8-2c3c-46c3-ad36-671c284167ea:3646:1874670585140096:0@lo:253:kworker.0 00000100:00100000:0.0:1787826335.562881:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826335.562905:0:34485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585140224 00000100:00100000:0.0:1787826335.562910:0:34485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585140224 00000100:00100000:0.0:1787826335.564645:0:34485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585139968 00000100:00100000:0.0:1787826335.564657:0:34485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585139968 00000100:00100000:0.0:1787826335.564670:0:34485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585140096 00000100:00100000:0.0:1787826335.564674:0:34485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585140096 00000100:00100000:0.0:1787826335.564691:0:34485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787826335.564701:0:34485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce030a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3c550b8-2c3c-46c3-ad36-671c284167ea+8:34480:x1874670585140224:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787826335.564720:0:34485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826335.564760:0:34485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90ce0a70fa00/0x22153cd396b7f560 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x22153cd396b7f559 expref: -99 pid: 34485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826335.564791:0:34485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ce0a70fa00/0x22153cd396b7f560 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22153cd396b7f559 expref: 9 pid: 34485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826335.564803:0:34485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90ce0a70fa00/0x22153cd396b7f560 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22153cd396b7f559 expref: 9 pid: 34485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826335.564825:0:34485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0a70fa00, rc 0) 00000100:00100000:0.0:1787826335.564902:0:34485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce030a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3c550b8-2c3c-46c3-ad36-671c284167ea+9:34480:x1874670585140224:12345-0@lo:101:mount.lustre.0 Request processed in 203us (2200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826335.564979:0:34485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787826335.565012:0:34485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787826335.565018:0:34485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce030aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3c550b8-2c3c-46c3-ad36-671c284167ea+8:3646:x1874670585139968:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1787826335.565041:0:34485:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000100:00100000:0.0:1787826335.565085:0:34480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf2f45c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3c550b8-2c3c-46c3-ad36-671c284167ea:34480:1874670585140224:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787826335.565103:0:34480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff90ce0a70f400/0x22153cd396b7f559 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22153cd396b7f560 expref: -99 pid: 34480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826335.565112:0:34480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff90ce0a70f400/0x22153cd396b7f559 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x22153cd396b7f560 expref: -99 pid: 34480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826335.565134:0:34480:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1787826335.565148:0:34480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff90ce0a70f400/0x22153cd396b7f559 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22153cd396b7f560 expref: -99 pid: 34480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826335.565156:0:34480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff90ce0a70f400/0x22153cd396b7f559 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22153cd396b7f560 expref: -99 pid: 34480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826335.565164:0:34480:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787826335.565180:0:34480:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787826335.565186:0:34480:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff90ce034cb800 10000000:01000000:0.0:1787826335.565189:0:34480:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1787826335.565193:0:34480:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1787826335.565196:0:34480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787826335.565220:0:34480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff90ce0a70f000/0x22153cd396b7f567 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 34480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826335.565227:0:34480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff90ce0a70f000/0x22153cd396b7f567 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 34480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826335.565234:0:34480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff90ce0a70f000/0x22153cd396b7f567 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 34480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826335.565252:0:34480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf2f45c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3c550b8-2c3c-46c3-ad36-671c284167ea:34480:1874670585140352:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787826335.565280:0:34480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826335.565303:0:34480:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3f7d8600 going to sleep for 11 seconds 00000100:00100000:2.0:1787826335.567030:0:34487:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:2.0:1787826335.567046:0:34487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 20000000:01000000:2.0:1787826335.567186:0:34488:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 13 00000100:00100000:2.0:1787826335.569670:0:34487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585140352 00000100:00100000:2.0:1787826335.569684:0:34487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585140352 00000100:00100000:0.0:1787826335.570362:0:34492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787826335.570372:0:34492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce030abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e3c550b8-2c3c-46c3-ad36-671c284167ea+9:3646:x1874670585140096:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1787826335.570401:0:34492:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787826335.574340:0:34493:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1787826335.574360:0:34493:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1787826335.574363:0:34493:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1787826335.574366:0:34493:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1787826335.574753:0:34493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1787826335.575050:0:34488:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787826335.575074:0:34488:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787826335.580403:0:34488:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787826335.580423:0:34488:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1787826335.580451:0:34485:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787826335.580653:0:34491:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787826335.580658:0:34491:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787826335.580683:0:34491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90ce02427c00/0x22153cd396b7f56e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 34491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826335.580700:0:34491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ce02427c00/0x22153cd396b7f56e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 34491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787826335.580710:0:34491:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000052204s 00010000:00010000:2.0:1787826335.580715:0:34491:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90ce02427c00/0x22153cd396b7f56e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 34491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826335.580721:0:34491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90ce02427c00/0x22153cd396b7f56e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 34491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826335.580727:0:34491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90ce02427c00/0x22153cd396b7f56e lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 34491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826335.580734:0:34491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90ce02427c00/0x22153cd396b7f56e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 34491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826335.580758:0:34491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce02427c00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826335.580762:0:34491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90ce02427c00/0x22153cd396b7f56e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 34491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826335.580770:0:34491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90ce02427c00/0x22153cd396b7f56e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 34491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826335.580786:0:34491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90ce02427c00/0x22153cd396b7f56e lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 34491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826335.580793:0:34491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90ce02427c00/0x22153cd396b7f56e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 34491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826335.580799:0:34491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90ce02427c00/0x22153cd396b7f56e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 34491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826335.581140:0:34488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce030aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3c550b8-2c3c-46c3-ad36-671c284167ea+9:3645:x1874670585139840:12345-0@lo:253:kworker.0 Request processed in 19616us (19786us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826335.581151:0:34488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787826335.581193:0:34488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787826335.581204:0:34488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce030a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3c550b8-2c3c-46c3-ad36-671c284167ea+8:34480:x1874670585140352:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787826335.581218:0:34488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826335.581231:0:34488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90ce02427800/0x22153cd396b7f575 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x22153cd396b7f567 expref: -99 pid: 34488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826335.581252:0:34488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ce02427800/0x22153cd396b7f575 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22153cd396b7f567 expref: 9 pid: 34488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826335.581262:0:34488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90ce02427800/0x22153cd396b7f575 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22153cd396b7f567 expref: 9 pid: 34488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826335.581269:0:34488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce02427800, rc 0) 00000020:01000004:1.0:1787826335.581396:0:3645:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1787826335.581399:0:3645:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787826335.581400:0:3645:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787826335.581403:0:3645:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787826335.581404:0:3645:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787826335.581405:0:3645:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787826335.581407:0:3645:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787826335.581408:0:3645:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787826335.581410:0:3645:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1787826335.581414:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f876d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e3c550b8-2c3c-46c3-ad36-671c284167ea:3645:1874670585139840:0@lo:253:kworker.0 00000100:00100000:2.0:1787826335.581557:0:34488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce030a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3c550b8-2c3c-46c3-ad36-671c284167ea+9:34480:x1874670585140352:12345-0@lo:101:mount.lustre.0 Request processed in 355us (16275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826335.581570:0:34488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 20000000:01000000:1.0:1787826335.587989:0:34485:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787826335.588004:0:34485:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1787826335.588323:0:34485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce030aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3c550b8-2c3c-46c3-ad36-671c284167ea+8:3646:x1874670585139968:12345-0@lo:253:kworker.0 Request processed in 23300us (25507us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826335.588335:0:34485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 20000000:01000000:2.0:1787826335.588442:0:34491:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787826335.588448:0:34491:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787826335.588468:0:34491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90ce02427a00/0x22153cd396b7f57c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 34491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826335.588501:0:34491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ce02427a00/0x22153cd396b7f57c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 34491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787826335.588510:0:34491:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000063622s 00010000:00010000:2.0:1787826335.588515:0:34491:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90ce02427a00/0x22153cd396b7f57c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 34491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826335.588524:0:34491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90ce02427a00/0x22153cd396b7f57c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 34491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826335.588531:0:34491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90ce02427a00/0x22153cd396b7f57c lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 34491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826335.588538:0:34491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90ce02427a00/0x22153cd396b7f57c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 34491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826335.588544:0:34491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce02427a00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826335.588549:0:34491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90ce02427a00/0x22153cd396b7f57c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 34491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787826335.588553:0:3646:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1787826335.588557:0:3646:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00010000:00010000:2.0:1787826335.588557:0:34491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90ce02427a00/0x22153cd396b7f57c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 34491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787826335.588560:0:3646:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787826335.588564:0:3646:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787826335.588567:0:3646:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787826335.588570:0:3646:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787826335.588572:0:3646:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787826335.588574:0:3646:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787826335.588575:0:3646:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:2.0:1787826335.588576:0:34491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90ce02427a00/0x22153cd396b7f57c lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 34491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826335.588580:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f874780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e3c550b8-2c3c-46c3-ad36-671c284167ea:3646:1874670585139968:0@lo:253:kworker.0 00010000:00010000:2.0:1787826335.588591:0:34491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90ce02427a00/0x22153cd396b7f57c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 34491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826335.588604:0:34491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90ce02427a00/0x22153cd396b7f57c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 34491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787826335.588952:0:34492:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1787826335.591367:0:34480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf2f45c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3c550b8-2c3c-46c3-ad36-671c284167ea:34480:1874670585140352:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787826335.591397:0:34480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff90ce0a70f000/0x22153cd396b7f567 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22153cd396b7f575 expref: -99 pid: 34480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826335.591410:0:34480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff90ce0a70f000/0x22153cd396b7f567 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x22153cd396b7f575 expref: -99 pid: 34480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826335.591656:0:34480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0b432940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3c550b8-2c3c-46c3-ad36-671c284167ea:34480:1874670585140480:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787826335.591718:0:34480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826335.591770:0:34480:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a2cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826335.591870:0:34487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585140480 00000100:00100000:2.0:1787826335.591877:0:34487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585140480 00000100:00100000:2.0:1787826335.591931:0:34487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787826335.591940:0:34487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce030a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3c550b8-2c3c-46c3-ad36-671c284167ea+8:34480:x1874670585140480:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787826335.592149:0:34487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce030a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3c550b8-2c3c-46c3-ad36-671c284167ea+9:34480:x1874670585140480:12345-0@lo:501:mount.lustre.0 Request processed in 209us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826335.592157:0:34487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787826335.592757:0:34480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0b432940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3c550b8-2c3c-46c3-ad36-671c284167ea:34480:1874670585140480:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787826335.592799:0:34480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f936d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3c550b8-2c3c-46c3-ad36-671c284167ea:34480:1874670585140608:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787826335.592851:0:34480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826335.592919:0:34480:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a2f780 going to sleep for 11 seconds 00000100:00100000:2.0:1787826335.601150:0:34485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585140608 00000100:00100000:2.0:1787826335.601165:0:34485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585140608 00000100:00100000:2.0:1787826335.601231:0:34485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787826335.601241:0:34485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce030ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3c550b8-2c3c-46c3-ad36-671c284167ea+9:34480:x1874670585140608:12345-0@lo:503:mount.lustre.0 20000000:01000000:1.0:1787826335.602002:0:34492:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787826335.602014:0:34492:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1787826335.605357:0:34491:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787826335.605368:0:34491:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787826335.605389:0:34491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90ce02427200/0x22153cd396b7f583 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 34491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826335.605408:0:34491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ce02427200/0x22153cd396b7f583 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 34491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787826335.605420:0:34491:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000063622s 00010000:00010000:2.0:1787826335.605425:0:34491:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90ce02427200/0x22153cd396b7f583 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 34491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826335.605431:0:34491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90ce02427200/0x22153cd396b7f583 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 34491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826335.605443:0:34491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90ce02427200/0x22153cd396b7f583 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 34491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826335.605450:0:34491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90ce02427200/0x22153cd396b7f583 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 34491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826335.605457:0:34491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce02427200 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826335.605461:0:34491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90ce02427200/0x22153cd396b7f583 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 34491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826335.605487:0:34491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90ce02427200/0x22153cd396b7f583 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 34491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826335.605502:0:34491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90ce02427200/0x22153cd396b7f583 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 34491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826335.605511:0:34491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90ce02427200/0x22153cd396b7f583 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 34491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826335.605517:0:34491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90ce02427200/0x22153cd396b7f583 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 34491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826335.606998:0:34492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce030abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e3c550b8-2c3c-46c3-ad36-671c284167ea+9:3646:x1874670585140096:12345-0@lo:253:kworker.0 Request processed in 36619us (44106us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826335.607011:0:34492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:01000004:1.0:1787826335.609061:0:3646:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1787826335.609067:0:3646:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787826335.609069:0:3646:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787826335.609071:0:3646:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787826335.609072:0:3646:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787826335.609075:0:3646:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787826335.609076:0:3646:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787826335.609078:0:3646:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787826335.609080:0:3646:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1787826335.609086:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e3c550b8-2c3c-46c3-ad36-671c284167ea:3646:1874670585140096:0@lo:253:kworker.0 00000100:00100000:3.0:1787826335.611800:0:34485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce030ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3c550b8-2c3c-46c3-ad36-671c284167ea+8:34480:x1874670585140608:12345-0@lo:503:mount.lustre.0 Request processed in 10551us (18939us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826335.611818:0:34485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787826335.611953:0:34480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f936d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3c550b8-2c3c-46c3-ad36-671c284167ea:34480:1874670585140608:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787826335.612427:0:34494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf2f45c780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e3c550b8-2c3c-46c3-ad36-671c284167ea:34494:1874670585140736:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787826335.612713:0:34494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826335.612769:0:34494:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf135663c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826335.612823:0:34487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585140736 00000100:00100000:3.0:1787826335.612829:0:34487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585140736 00000100:00100000:3.0:1787826335.612873:0:34487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787826335.612881:0:34487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce030aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3c550b8-2c3c-46c3-ad36-671c284167ea+8:34494:x1874670585140736:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787826335.613551:0:34487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce030aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3c550b8-2c3c-46c3-ad36-671c284167ea+8:34494:x1874670585140736:12345-0@lo:502:llog_process_th.0 Request processed in 669us (1054us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826335.613559:0:34487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787826335.615485:0:34494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf2f45c780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e3c550b8-2c3c-46c3-ad36-671c284167ea:34494:1874670585140736:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787826335.615534:0:34494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787826335.615548:0:34494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826335.615551:0:34494:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787826335.615555:0:34494:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1787826335.615559:0:34494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787826335.615575:0:34494:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff90ce0baf19b8) 00000020:00000080:2.0:1787826335.615599:0:34494:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1787826335.615607:0:34494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1787826335.615689:0:34494:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:2.0:1787826335.615698:0:34494:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x22153cd396b7f591 00000020:00000080:2.0:1787826335.615931:0:34494:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787826335.615937:0:34494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787826335.615941:0:34494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826335.615942:0:34494:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787826335.615944:0:34494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787826335.615948:0:34494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826335.615949:0:34494:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1787826335.615962:0:34494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787826335.615971:0:34494:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff90ce0baf0000) 00000020:00000080:2.0:1787826335.615983:0:34494:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1787826335.615988:0:34494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1787826335.615990:0:34494:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1787826335.615993:0:34494:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1787826335.615999:0:34494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787826335.616046:0:34494:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90ce034cb800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1787826335.616060:0:34494:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff90ce0baf4d28) 00000020:00000080:2.0:1787826335.616072:0:34494:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1787826335.616129:0:34494:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1787826335.616136:0:34494:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x22153cd396b7f5a6 00000020:00000080:2.0:1787826335.616234:0:34494:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1787826335.616241:0:34494:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1787826335.616247:0:34494:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x22153cd396b7f5ad 00080000:01000000:2.0:1787826335.616252:0:34494:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787826335.616257:0:34494:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x22153cd396b7f5b4 00010000:00010000:2.0:1787826335.745965:0:34494:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:2.0:1787826335.746693:0:34494:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 0 lr: 0 srv lr: 4294969159 lx: 0 gen 1 00000001:00080000:2.0:1787826335.746755:0:34494:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 09ed01c7-7b8c-4e06-9d82-a6b70e42014a idx: 2 lr: 0 srv lr: 4294969159 lx: 0 gen 5 00000001:00000004:2.0:1787826335.746781:0:34494:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294969159 00000001:00080000:2.0:1787826335.747129:0:34494:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:2.0:1787826335.747184:0:34494:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff90cf0689d180: xid 1874670563639040, transno 4294969325, client gen 5, slot idx 0 00000001:00080000:2.0:1787826335.747192:0:34494:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff90cf0689d6c0: xid 1874670563638656, transno 4294969324, client gen 5, slot idx 1 00000001:00080000:2.0:1787826335.747197:0:34494:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff90cf0689d000: xid 1874670585070336, transno 4294969178, client gen 1, slot idx 2 00000001:00080000:2.0:1787826335.747202:0:34494:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff90ce024193c0: xid 1874670563637248, transno 4294969320, client gen 5, slot idx 3 00000020:00000080:2.0:1787826335.748327:0:34494:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff90cf116999b8) 00000020:00000080:2.0:1787826335.749452:0:34494:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787826335.749824:0:34494:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787826335.749897:0:34494:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x22153cd396b7f5d0 00000020:00000080:2.0:1787826335.758635:0:34494:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787826335.763339:0:34494:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x22153cd396b7f5d7 00000020:00000080:2.0:1787826335.763819:0:34494:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1787826335.763842:0:34494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787826335.763848:0:34494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826335.763850:0:34494:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1787826335.763854:0:34494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787826335.763857:0:34494:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:2.0:1787826335.763858:0:34494:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787826335.763860:0:34494:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787826335.763861:0:34494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787826335.763864:0:34494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826335.763865:0:34494:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787826335.763868:0:34494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787826335.763873:0:34494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826335.763875:0:34494:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1787826335.763880:0:34494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787826335.763933:0:34494:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1787826335.763950:0:34494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787826335.763953:0:34494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826335.763955:0:34494:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1787826335.763959:0:34494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787826335.763962:0:34494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826335.763963:0:34494:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1787826335.763966:0:34494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787826335.763971:0:34494:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.139@tcp to nid 0x20000c0a8cb8b (192.168.203.139@tcp) 00000020:00000080:2.0:1787826335.763995:0:34494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787826335.764009:0:34494:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff90cf1169cd28) 00000020:00000080:2.0:1787826335.764027:0:34494:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1787826335.764032:0:34494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787826335.764084:0:34494:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1787826335.764089:0:34494:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787826335.764094:0:34494:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x22153cd396b7f5e5 00010000:00080000:2.0:1787826335.764122:0:34494:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90cf071a6800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.139@tcp at head 00010000:00010000:2.0:1787826335.769558:0:34494:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:2.0:1787826335.778014:0:34494:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787826335.778339:0:34494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1787826335.778462:0:34494:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787826335.778684:0:34494:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x22153cd396b7f5ec 00000100:00080000:3.0:1787826335.778695:0:34494:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787826335.778700:0:34494:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff90cf071a6800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:3.0:1787826335.778732:0:34494:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cf3f936d00 x1874670585140864/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826335.778790:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f936d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874670585140864:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787826335.778862:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787826335.779012:0:34494:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1787826335.779082:0:34494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787826335.779086:0:34494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826335.779088:0:34494:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1787826335.779091:0:34494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787826335.779094:0:34494:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:3.0:1787826335.779095:0:34494:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787826335.779097:0:34494:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787826335.779099:0:34494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787826335.779101:0:34494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826335.779102:0:34494:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787826335.779104:0:34494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787826335.779109:0:34494:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1787826335.779111:0:34494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826335.779113:0:34494:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787826335.779115:0:34494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787826335.779119:0:34494:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.139@tcp to nid 0x20000c0a8cb8b (192.168.203.139@tcp) 00000020:01000000:3.0:1787826335.779137:0:34494:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787826335.779139:0:34494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787826335.779163:0:34494:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff90ce0bb299b8) 00000020:00000080:3.0:1787826335.779180:0:34494:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:3.0:1787826335.779185:0:34494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787826335.779250:0:34494:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1787826335.779256:0:34494:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:3.0:1787826335.779260:0:34494:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x22153cd396b7f5fa 00010000:00080000:3.0:1787826335.779284:0:34494:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90ce07439800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.139@tcp at head 00010000:00010000:3.0:1787826335.779518:0:34494:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:2.0:1787826335.781093:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf2f45c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e3c550b8-2c3c-46c3-ad36-671c284167ea:3644:1874670585140992:0@lo:400:kworker.0 00000100:00100000:2.0:1787826335.781152:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826335.781297:0:34492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585140992 00000100:00100000:0.0:1787826335.781305:0:34492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585140992 00000100:00100000:0.0:1787826335.781357:0:34492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787826335.781365:0:34492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce030aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e3c550b8-2c3c-46c3-ad36-671c284167ea+8:3644:x1874670585140992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826335.781412:0:34492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce030aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e3c550b8-2c3c-46c3-ad36-671c284167ea+8:3644:x1874670585140992:12345-0@lo:400:kworker.0 Request processed in 48us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826335.781419:0:34492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787826335.781566:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf2f45c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e3c550b8-2c3c-46c3-ad36-671c284167ea:3644:1874670585140992:0@lo:400:kworker.0 00000040:01000000:3.0:1787826335.782210:0:34494:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787826335.783052:0:34494:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:1.0:1787826335.784137:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585140864 00000100:00100000:1.0:1787826335.784149:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585140864 00000100:00100000:1.0:1787826335.784233:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1303 00000100:00100000:1.0:1787826335.784241:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f877480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1874670585140864:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787826335.784270:0:6524:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 1281 last 0 00000020:00000080:1.0:1787826335.784305:0:6524:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x22153cd396b7f601 00000004:00100000:1.0:1787826335.784321:0:6524:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787826335.784400:0:6524:0:(import.c:65:import_set_state_nolock()) ffff90cf07844000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787826335.784505:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f877480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1874670585140864:12345-0@lo:38:llog_process_th.0 Request processed in 262us (5641us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826335.784512:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1303 00000100:00100000:2.0:1787826335.784595:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787826335.784603:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787826335.784610:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1787826335.784615:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1787826335.784618:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90cf071a6800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787826335.784633:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f936d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874670585140864:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1787826335.785505:0:34494:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787826335.785815:0:34494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1787826335.786103:0:34494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000100:00100000:0.0:1787826335.786389:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf2f45cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585141120:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826335.786459:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826335.786622:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585141120 00000100:00100000:3.0:1787826335.786629:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585141120 00000100:00100000:3.0:1787826335.786673:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1304 00000100:00100000:3.0:1787826335.786681:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf2f45e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1874670585141120:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787826335.786715:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446178816 avail 1299939328 00000100:00100000:3.0:1787826335.786776:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf2f45e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1874670585141120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826335.786782:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1304 00000100:00100000:3.0:1787826335.786829:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf2f45cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585141120:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1787826335.789335:0:34500:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787826335.789352:0:34500:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787826335.790682:0:34494:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787826335.790695:0:34494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787826335.790745:0:34494:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787826335.790769:0:34494:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x22153cd396b7f608 00000100:00080000:2.0:1787826335.790780:0:34494:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787826335.790785:0:34494:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90ce07439800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:2.0:1787826335.790819:0:34494:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cf3f874780 x1874670585141248/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826335.791081:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f874780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874670585141248:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1787826335.791163:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826335.791249:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585141248 00000100:00100000:0.0:1787826335.791256:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585141248 00000100:00100000:0.0:1787826335.791298:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1681 00000100:00100000:0.0:1787826335.791306:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f934780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3643:x1874670585141248:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1787826335.791336:0:28853:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 1281 last 0 00000020:00000080:0.0:1787826335.791373:0:28853:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x22153cd396b7f60f 00002000:00100000:0.0:1787826335.791387:0:28853:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff90ce04a18800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113945 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1787826335.791391:0:28853:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1787826335.791394:0:28853:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787826335.791468:0:28853:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787826335.791517:0:28853:0:(import.c:65:import_set_state_nolock()) ffff90ce02478000 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1787826335.791713:0:34494:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1787826335.791798:0:34494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787826335.791803:0:34494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826335.791805:0:34494:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787826335.791808:0:34494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787826335.791812:0:34494:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1787826335.791814:0:34494:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787826335.791815:0:34494:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787826335.791817:0:34494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787826335.791819:0:34494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826335.791820:0:34494:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787826335.791823:0:34494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787826335.791828:0:34494:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1787826335.791832:0:34494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826335.791833:0:34494:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787826335.791836:0:34494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787826335.791840:0:34494:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.139@tcp to nid 0x20000c0a8cb8b (192.168.203.139@tcp) 00000020:01000000:2.0:1787826335.791859:0:34494:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787826335.791862:0:34494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787826335.791876:0:34494:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff90cf1169b370) 00000020:00000080:2.0:1787826335.791891:0:34494:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:2.0:1787826335.791896:0:34494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787826335.792054:0:34494:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1787826335.792061:0:34494:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:2.0:1787826335.792067:0:34494:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x22153cd396b7f61d 00010000:00080000:2.0:1787826335.792092:0:34494:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90cf3f491000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.139@tcp at head 00010000:00010000:2.0:1787826335.792311:0:34494:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:2.0:1787826335.792566:0:34494:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787826335.792581:0:34494:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787826335.794521:0:34494:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787826335.794944:0:34494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1787826335.795084:0:34494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1787826335.795661:0:34502:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787826335.795666:0:34502:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787826335.796338:0:34494:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787826335.796360:0:34494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787826335.796405:0:34494:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787826335.796428:0:34494:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x22153cd396b7f624 00000100:00080000:2.0:1787826335.796439:0:34494:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787826335.796445:0:34494:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90cf3f491000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:2.0:1787826335.796505:0:34494:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cf3f876d00 x1874670585141376/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787826335.796522:0:34494:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787826335.796571:0:34494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787826335.796576:0:34494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826335.796578:0:34494:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787826335.796581:0:34494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787826335.796584:0:34494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826335.796585:0:34494:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787826335.796588:0:34494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787826335.796590:0:34494:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787826335.796592:0:34494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787826335.796594:0:34494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826335.796595:0:34494:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787826335.796597:0:34494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787826335.796599:0:34494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826335.796600:0:34494:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787826335.796603:0:34494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787826335.796634:0:34494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a9acb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e3c550b8-2c3c-46c3-ad36-671c284167ea:34494:1874670585141504:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787826335.796708:0:34494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826335.796755:0:34494:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf116f7900 going to sleep for 11 seconds 00000100:00100000:0.0:1787826335.797541:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f934780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3643:x1874670585141248:12345-0@lo:8:llog_process_th.0 Request processed in 6229us (6373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826335.797556:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1681 00000100:00100000:3.0:1787826335.797752:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787826335.797763:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 5 00000100:00080000:3.0:1787826335.797771:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787826335.797777:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787826335.797780:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90ce07439800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787826335.797840:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787826335.797848:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f874780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874670585141248:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1787826335.797876:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f876d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874670585141376:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1787826335.797933:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826335.797983:0:34487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585141504 00000100:00100000:3.0:1787826335.797989:0:34487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585141504 00000100:00100000:3.0:1787826335.798026:0:34487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787826335.798034:0:34487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03573050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3c550b8-2c3c-46c3-ad36-671c284167ea+8:34494:x1874670585141504:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787826335.798154:0:34487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03573050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3c550b8-2c3c-46c3-ad36-671c284167ea+8:34494:x1874670585141504:12345-0@lo:502:llog_process_th.0 Request processed in 120us (1445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826335.798161:0:34487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787826335.798216:0:34494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a9acb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e3c550b8-2c3c-46c3-ad36-671c284167ea:34494:1874670585141504:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787826335.798242:0:34494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787826335.798248:0:34494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787826335.798250:0:34494:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787826335.798256:0:34494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1787826335.798554:0:34480:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1787826335.798582:0:34480:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787826335.798599:0:34480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff90ce0a70f000/0x22153cd396b7f567 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22153cd396b7f575 expref: -99 pid: 34480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826335.798610:0:34480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff90ce0a70f000/0x22153cd396b7f567 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22153cd396b7f575 expref: -99 pid: 34480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826335.798618:0:34480:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90ce034cb800 from 1 10000000:01000000:3.0:1787826335.798621:0:34480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787826335.798648:0:34480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff90cf3abd6a00/0x22153cd396b7f62b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 34480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826335.798656:0:34480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff90cf3abd6a00/0x22153cd396b7f62b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 34480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826335.798667:0:34480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff90cf3abd6a00/0x22153cd396b7f62b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 34480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826335.798684:0:34480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f936580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3c550b8-2c3c-46c3-ad36-671c284167ea:34480:1874670585141632:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787826335.798712:0:34480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826335.798726:0:34480:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce04aa5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787826335.799221:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585141376 00000100:00100000:0.0:1787826335.799228:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585141376 00000100:00100000:0.0:1787826335.799265:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1682 00000100:00100000:0.0:1787826335.799271:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f937840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0+-99:3643:x1874670585141376:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1787826335.799315:0:30695:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 1281 last 0 00000020:00000080:0.0:1787826335.799363:0:30695:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x22153cd396b7f632 00002000:00100000:0.0:1787826335.799377:0:30695:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff90ce0247a800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113945 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1787826335.799381:0:30695:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1787826335.799384:0:30695:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787826335.799451:0:30695:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787826335.799496:0:30695:0:(import.c:65:import_set_state_nolock()) ffff90ce02478800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787826335.799545:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f937840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3643:x1874670585141376:12345-0@lo:8:llog_process_th.0 Request processed in 273us (1611us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826335.799552:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1682 00000100:00100000:0.0:1787826335.799573:0:34492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585141632 00000100:00100000:0.0:1787826335.799577:0:34492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585141632 00000100:00100000:0.0:1787826335.799602:0:34492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787826335.799608:0:34492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03572050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e3c550b8-2c3c-46c3-ad36-671c284167ea+8:34480:x1874670585141632:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787826335.799616:0:34492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826335.799630:0:34492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90ce0a70ee00/0x22153cd396b7f639 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x22153cd396b7f62b expref: -99 pid: 34492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826335.799652:0:34492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ce0a70ee00/0x22153cd396b7f639 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22153cd396b7f62b expref: 9 pid: 34492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826335.799663:0:34492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90ce0a70ee00/0x22153cd396b7f639 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22153cd396b7f62b expref: 9 pid: 34492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826335.799673:0:34492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0a70ee00, rc 0) 00000100:00100000:0.0:1787826335.799701:0:34492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03572050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e3c550b8-2c3c-46c3-ad36-671c284167ea+9:34480:x1874670585141632:12345-0@lo:101:mount.lustre.0 Request processed in 93us (988us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826335.799707:0:34492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000004:00080000:2.0:1787826335.800083:0:34500:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787826335.800140:0:34500:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1281811667755ns, next at 0ns, rc = 0 00080000:00080000:2.0:1787826335.800146:0:34500:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1787826335.801355:0:34480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f936580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3c550b8-2c3c-46c3-ad36-671c284167ea:34480:1874670585141632:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787826335.801379:0:34480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff90cf3abd6a00/0x22153cd396b7f62b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22153cd396b7f639 expref: -99 pid: 34480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826335.801394:0:34480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff90cf3abd6a00/0x22153cd396b7f62b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x22153cd396b7f639 expref: -99 pid: 34480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826335.801990:0:34480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f936580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3c550b8-2c3c-46c3-ad36-671c284167ea:34480:1874670585141760:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1787826335.802053:0:34480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826335.802091:0:34480:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce04aa5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787826335.802129:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787826335.802137:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 4 00000100:00080000:3.0:1787826335.802144:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787826335.802150:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787826335.802153:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90cf3f491000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787826335.802178:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787826335.802184:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f876d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874670585141376:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1787826335.802246:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f934000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585141888:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787826335.802272:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826335.802311:0:12021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585141888 00000100:00100000:3.0:1787826335.802316:0:12021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585141888 00000100:00100000:3.0:1787826335.802363:0:12021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 714 00000100:00100000:3.0:1787826335.802372:0:12021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f934f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1874670585141888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787826335.802398:0:12021:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 60260032 pending 0 free 3921387520 avail 3689865216 00000100:00100000:3.0:1787826335.802437:0:12021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f934f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1874670585141888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826335.802445:0:12021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 714 00000100:00080000:3.0:1787826335.802466:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826335.802512:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f934000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585141888:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1787826335.804044:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:2.0:1787826335.804170:0:34487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585141760 00000100:00100000:2.0:1787826335.804177:0:34487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585141760 00000100:00100000:2.0:1787826335.804226:0:34487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787826335.804235:0:34487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03570850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3c550b8-2c3c-46c3-ad36-671c284167ea+9:34480:x1874670585141760:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1787826335.804255:0:34487:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787826335.804277:0:34487:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787826335.804282:0:34487:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787826335.804285:0:34487:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787826335.804288:0:34487:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 16 00000100:00100000:2.0:1787826335.804409:0:34487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03570850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3c550b8-2c3c-46c3-ad36-671c284167ea+9:34480:x1874670585141760:12345-0@lo:256:mount.lustre.0 Request processed in 175us (2354us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826335.804417:0:34487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787826335.804465:0:34480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f936580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3c550b8-2c3c-46c3-ad36-671c284167ea:34480:1874670585141760:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1787826335.806264:0:34480:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787826335.806287:0:34480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff90cf3abd6a00/0x22153cd396b7f62b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22153cd396b7f639 expref: -99 pid: 34480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826335.806299:0:34480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff90cf3abd6a00/0x22153cd396b7f62b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22153cd396b7f639 expref: -99 pid: 34480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826335.806308:0:34480:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90ce034cb800 from 1 10000000:01000000:2.0:1787826335.806310:0:34480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00000004:00080000:1.0:1787826335.806462:0:34502:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787826335.806647:0:34502:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1281818174540ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787826335.806654:0:34502:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1787826335.807464:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0b432940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585142144:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787826335.808005:0:34480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff90ce02427a00/0x22153cd396b7f640 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 34480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826335.808018:0:34480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff90ce02427a00/0x22153cd396b7f640 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 34480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826335.808030:0:34480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff90ce02427a00/0x22153cd396b7f640 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 34480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826335.808049:0:34480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a9acb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3c550b8-2c3c-46c3-ad36-671c284167ea:34480:1874670585142016:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787826335.808107:0:34480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826335.808142:0:34480:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf116f70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826335.808228:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826335.808270:0:25628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585142144 00000100:00100000:3.0:1787826335.808276:0:25628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585142144 00000100:00100000:3.0:1787826335.808330:0:25628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 715 00000100:00100000:3.0:1787826335.808339:0:25628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f934000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1874670585142144:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826335.808451:0:34492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585142016 00000100:00100000:1.0:1787826335.808456:0:34492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585142016 00000100:00100000:1.0:1787826335.808505:0:34492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787826335.808513:0:34492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf39ccc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e3c550b8-2c3c-46c3-ad36-671c284167ea+9:34480:x1874670585142016:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787826335.808526:0:34492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826335.808543:0:34492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90ce01f17e00/0x22153cd396b7f647 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x22153cd396b7f640 expref: -99 pid: 34492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826335.808965:0:34492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ce01f17e00/0x22153cd396b7f647 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22153cd396b7f640 expref: 10 pid: 34492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826335.808983:0:34492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90ce01f17e00/0x22153cd396b7f647 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22153cd396b7f640 expref: 10 pid: 34492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826335.808991:0:34492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01f17e00, rc 0) 00000100:00100000:1.0:1787826335.809034:0:34492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf39ccc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e3c550b8-2c3c-46c3-ad36-671c284167ea+10:34480:x1874670585142016:12345-0@lo:101:mount.lustre.0 Request processed in 522us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826335.809041:0:34492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00002000:00000024:3.0:1787826335.809136:0:25628:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43441856 pending 0 free 3919286272 avail 3687763968 00000100:00100000:3.0:1787826335.809180:0:25628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f934000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1874670585142144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 842us (951us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826335.809187:0:25628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 715 00000100:00080000:2.0:1787826335.809250:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826335.809279:0:34480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a9acb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3c550b8-2c3c-46c3-ad36-671c284167ea:34480:1874670585142016:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787826335.809294:0:34480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff90ce02427a00/0x22153cd396b7f640 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22153cd396b7f647 expref: -99 pid: 34480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826335.809304:0:34480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff90ce02427a00/0x22153cd396b7f640 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x22153cd396b7f647 expref: -99 pid: 34480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826335.809883:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0b432940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585142144:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787826335.810319:0:34480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a9acb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3c550b8-2c3c-46c3-ad36-671c284167ea:34480:1874670585142272:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787826335.811166:0:34480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826335.811207:0:34480:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf116f70c0 going to sleep for 11 seconds 00000004:00080000:0.0:1787826335.811289:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1787826335.811417:0:34487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585142272 00000100:00100000:3.0:1787826335.811424:0:34487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585142272 00000100:00100000:3.0:1787826335.811493:0:34487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787826335.811503:0:34487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf39ccf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3c550b8-2c3c-46c3-ad36-671c284167ea+10:34480:x1874670585142272:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787826335.812131:0:34487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf39ccf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3c550b8-2c3c-46c3-ad36-671c284167ea+10:34480:x1874670585142272:12345-0@lo:501:mount.lustre.0 Request processed in 629us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826335.812139:0:34487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787826335.812222:0:34480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a9acb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3c550b8-2c3c-46c3-ad36-671c284167ea:34480:1874670585142272:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787826335.812262:0:34480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a9acb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3c550b8-2c3c-46c3-ad36-671c284167ea:34480:1874670585142400:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787826335.812308:0:34480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826335.812338:0:34480:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf116f70c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826335.812434:0:34492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585142400 00000100:00100000:1.0:1787826335.812439:0:34492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585142400 00000100:00100000:1.0:1787826335.812498:0:34492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787826335.812506:0:34492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf39ccec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e3c550b8-2c3c-46c3-ad36-671c284167ea+10:34480:x1874670585142400:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787826335.812840:0:34492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf39ccec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e3c550b8-2c3c-46c3-ad36-671c284167ea+10:34480:x1874670585142400:12345-0@lo:503:mount.lustre.0 Request processed in 334us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826335.812848:0:34492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787826335.812934:0:34480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a9acb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3c550b8-2c3c-46c3-ad36-671c284167ea:34480:1874670585142400:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787826335.813882:0:34504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a9acb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e3c550b8-2c3c-46c3-ad36-671c284167ea:34504:1874670585142528:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787826335.814005:0:34504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826335.814073:0:34504:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf116f7900 going to sleep for 11 seconds 00000100:00100000:0.0:1787826335.814114:0:34488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585142528 00000100:00100000:0.0:1787826335.814120:0:34488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585142528 00000100:00100000:0.0:1787826335.814188:0:34488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787826335.814197:0:34488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf39ccd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3c550b8-2c3c-46c3-ad36-671c284167ea+10:34504:x1874670585142528:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787826335.814672:0:34488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf39ccd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3c550b8-2c3c-46c3-ad36-671c284167ea+10:34504:x1874670585142528:12345-0@lo:502:llog_process_th.0 Request processed in 467us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826335.814680:0:34488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787826335.814770:0:34504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a9acb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e3c550b8-2c3c-46c3-ad36-671c284167ea:34504:1874670585142528:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787826335.814796:0:34504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787826335.814806:0:34504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826335.814808:0:34504:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787826335.814815:0:34504:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90ce034cb800 00000020:00000080:2.0:1787826335.814817:0:34504:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787826335.814825:0:34504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787826335.814828:0:34504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826335.814830:0:34504:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787826335.814833:0:34504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787826335.814835:0:34504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787826335.814836:0:34504:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787826335.814840:0:34504:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90ce034cb800 00000020:00000080:2.0:1787826335.814842:0:34504:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787826335.814920:0:34504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a9acb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e3c550b8-2c3c-46c3-ad36-671c284167ea:34504:1874670585142656:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787826335.814954:0:34504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826335.828009:0:34487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585142656 00000100:00100000:3.0:1787826335.828025:0:34487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585142656 00000100:00100000:3.0:1787826335.828090:0:34487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787826335.828100:0:34487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf39cccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3c550b8-2c3c-46c3-ad36-671c284167ea+10:34504:x1874670585142656:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787826335.828255:0:34487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf39cccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3c550b8-2c3c-46c3-ad36-671c284167ea+10:34504:x1874670585142656:12345-0@lo:502:llog_process_th.0 Request processed in 156us (13299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826335.828263:0:34487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787826335.828590:0:34504:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf116f7900 going to sleep for 11 seconds 00000100:00100000:0.0:1787826335.828616:0:34504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a9acb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e3c550b8-2c3c-46c3-ad36-671c284167ea:34504:1874670585142656:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787826335.828649:0:34504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787826335.828657:0:34504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787826335.828660:0:34504:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787826335.828664:0:34504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787826335.831955:0:34480:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:2.0:1787826335.831993:0:34480:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787826335.832049:0:34480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff90ce02427a00/0x22153cd396b7f640 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22153cd396b7f647 expref: -99 pid: 34480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826335.832063:0:34480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff90ce02427a00/0x22153cd396b7f640 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22153cd396b7f647 expref: -99 pid: 34480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826335.832119:0:34480:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787826335.832122:0:34480:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90ce034cb800 10000000:01000000:2.0:1787826335.832126:0:34480:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90ce034cb800 10000000:01000000:2.0:1787826335.832131:0:34480:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787826335.832137:0:34480:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90ce034cb800 from 1 10000000:01000000:2.0:1787826335.832140:0:34480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787826335.832175:0:34480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff90ce02427c00/0x22153cd396b7f64e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 34480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826335.832184:0:34480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff90ce02427c00/0x22153cd396b7f64e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 34480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826335.832195:0:34480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff90ce02427c00/0x22153cd396b7f64e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 34480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826335.832219:0:34480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a9acb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3c550b8-2c3c-46c3-ad36-671c284167ea:34480:1874670585142784:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787826335.832290:0:34480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826335.832332:0:34480:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf116f7600 going to sleep for 11 seconds 00000100:00100000:3.0:1787826335.832465:0:34487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585142784 00000100:00100000:3.0:1787826335.832515:0:34487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585142784 00000100:00100000:3.0:1787826335.832560:0:34487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787826335.832569:0:34487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf39ccfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3c550b8-2c3c-46c3-ad36-671c284167ea+10:34480:x1874670585142784:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787826335.832582:0:34487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826335.832597:0:34487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cf3abd6200/0x22153cd396b7f655 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x22153cd396b7f64e expref: -99 pid: 34487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826335.832619:0:34487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cf3abd6200/0x22153cd396b7f655 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22153cd396b7f64e expref: 11 pid: 34487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826335.832630:0:34487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cf3abd6200/0x22153cd396b7f655 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22153cd396b7f64e expref: 11 pid: 34487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826335.832638:0:34487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3abd6200, rc 0) 00000100:00100000:3.0:1787826335.832674:0:34487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf39ccfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3c550b8-2c3c-46c3-ad36-671c284167ea+11:34480:x1874670585142784:12345-0@lo:101:mount.lustre.0 Request processed in 106us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826335.832681:0:34487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787826335.832813:0:34480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a9acb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3c550b8-2c3c-46c3-ad36-671c284167ea:34480:1874670585142784:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787826335.832827:0:34480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff90ce02427c00/0x22153cd396b7f64e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22153cd396b7f655 expref: -99 pid: 34480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826335.832837:0:34480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff90ce02427c00/0x22153cd396b7f64e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x22153cd396b7f655 expref: -99 pid: 34480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826335.832887:0:34480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a9acb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3c550b8-2c3c-46c3-ad36-671c284167ea:34480:1874670585142912:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787826335.832913:0:34480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826335.832940:0:34480:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf116f7600 going to sleep for 11 seconds 00000100:00100000:3.0:1787826335.832988:0:34488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585142912 00000100:00100000:3.0:1787826335.832993:0:34488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585142912 00000100:00100000:3.0:1787826335.833024:0:34488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787826335.833031:0:34488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf39cce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3c550b8-2c3c-46c3-ad36-671c284167ea+11:34480:x1874670585142912:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787826335.833219:0:34488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf39cce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3c550b8-2c3c-46c3-ad36-671c284167ea+11:34480:x1874670585142912:12345-0@lo:501:mount.lustre.0 Request processed in 188us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826335.833228:0:34488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787826335.833322:0:34480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a9acb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3c550b8-2c3c-46c3-ad36-671c284167ea:34480:1874670585142912:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787826335.833430:0:34480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0b432940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3c550b8-2c3c-46c3-ad36-671c284167ea:34480:1874670585143040:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787826335.833599:0:34480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826335.833654:0:34480:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f4230c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826335.833685:0:34487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585143040 00000100:00100000:3.0:1787826335.833690:0:34487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585143040 00000100:00100000:3.0:1787826335.833753:0:34487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787826335.833760:0:34487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf39ccd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3c550b8-2c3c-46c3-ad36-671c284167ea+11:34480:x1874670585143040:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787826335.833849:0:34487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf39ccd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3c550b8-2c3c-46c3-ad36-671c284167ea+11:34480:x1874670585143040:12345-0@lo:503:mount.lustre.0 Request processed in 89us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826335.833856:0:34487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787826335.833927:0:34480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0b432940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3c550b8-2c3c-46c3-ad36-671c284167ea:34480:1874670585143040:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787826335.834264:0:34507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a9acb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e3c550b8-2c3c-46c3-ad36-671c284167ea:34507:1874670585143168:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787826335.834299:0:34507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826335.834503:0:34507:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3f7d8840 going to sleep for 11 seconds 00000100:00100000:1.0:1787826335.834590:0:34492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585143168 00000100:00100000:1.0:1787826335.834595:0:34492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585143168 00000100:00100000:1.0:1787826335.834633:0:34492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787826335.834640:0:34492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf39ccf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e3c550b8-2c3c-46c3-ad36-671c284167ea+11:34507:x1874670585143168:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787826335.834726:0:34492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf39ccf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e3c550b8-2c3c-46c3-ad36-671c284167ea+11:34507:x1874670585143168:12345-0@lo:502:llog_process_th.0 Request processed in 85us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826335.834744:0:34492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787826335.834828:0:34507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a9acb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e3c550b8-2c3c-46c3-ad36-671c284167ea:34507:1874670585143168:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1787826335.834875:0:34507:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1787826335.834897:0:34507:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff90ce0767b370) 00000020:00000080:2.0:1787826335.834922:0:34507:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1787826335.835011:0:34507:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90ce034cb800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787826335.835016:0:34507:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90ce034cb800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787826335.835018:0:34507:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90ce034cb800 4 00010000:00080000:2.0:1787826335.835060:0:34507:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90ce03230000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.139@tcp at head 00010000:00010000:2.0:1787826335.836688:0:34507:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:2.0:1787826335.836895:0:34507:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1787826335.836933:0:34507:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787826335.836946:0:34507:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x22153cd396b7f663 00000100:00080000:2.0:1787826335.836956:0:34507:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787826335.836962:0:34507:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff90ce03230000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:2.0:1787826335.836995:0:34507:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cf3a9acb40 x1874670585143296/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787826335.837020:0:34507:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787826335.841159:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a9acb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874670585143296:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787826335.841233:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826335.841897:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585143296 00000100:00100000:2.0:1787826335.841906:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585143296 00000100:00100000:2.0:1787826335.841948:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3297 00000100:00100000:2.0:1787826335.841955:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f9361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1874670585143296:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787826335.842019:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f9361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1874670585143296:12345-0@lo:38:llog_process_th.0 Request processed in 62us (784us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787826335.842026:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3297 00000100:00100000:3.0:1787826335.842101:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787826335.842109:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90ce03230000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787826335.842113:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787826335.842117:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a9acb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874670585143296:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787826335.842262:0:34507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf2f45fc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e3c550b8-2c3c-46c3-ad36-671c284167ea:34507:1874670585143424:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787826335.842309:0:34507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826335.842609:0:34507:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f6119c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826335.844533:0:34492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585143424 00000100:00100000:2.0:1787826335.844547:0:34492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585143424 00000100:00100000:2.0:1787826335.844600:0:34492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787826335.844609:0:34492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf39ccc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e3c550b8-2c3c-46c3-ad36-671c284167ea+11:34507:x1874670585143424:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787826335.844774:0:34492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf39ccc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e3c550b8-2c3c-46c3-ad36-671c284167ea+11:34507:x1874670585143424:12345-0@lo:502:llog_process_th.0 Request processed in 165us (2463us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826335.844782:0:34492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787826335.844901:0:34507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf2f45fc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e3c550b8-2c3c-46c3-ad36-671c284167ea:34507:1874670585143424:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787826335.844965:0:34507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf2f45fc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e3c550b8-2c3c-46c3-ad36-671c284167ea:34507:1874670585143552:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787826335.845009:0:34507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826335.845045:0:34507:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce04d24180 going to sleep for 11 seconds 00000100:00100000:1.0:1787826335.845160:0:34488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585143552 00000100:00100000:1.0:1787826335.845165:0:34488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585143552 00000100:00100000:1.0:1787826335.845202:0:34488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787826335.845210:0:34488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf39ccc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3c550b8-2c3c-46c3-ad36-671c284167ea+11:34507:x1874670585143552:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787826335.845282:0:34488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf39ccc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3c550b8-2c3c-46c3-ad36-671c284167ea+11:34507:x1874670585143552:12345-0@lo:502:llog_process_th.0 Request processed in 73us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826335.845289:0:34488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787826335.845438:0:34507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf2f45fc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e3c550b8-2c3c-46c3-ad36-671c284167ea:34507:1874670585143552:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787826335.845459:0:34507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1787826335.845667:0:34480:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1787826335.845698:0:34480:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787826335.845718:0:34480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff90ce02427c00/0x22153cd396b7f64e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22153cd396b7f655 expref: -99 pid: 34480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826335.845728:0:34480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff90ce02427c00/0x22153cd396b7f64e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22153cd396b7f655 expref: -99 pid: 34480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787826335.845784:0:34480:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787826335.845786:0:34480:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787826335.845788:0:34480:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787826335.845789:0:34480:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787826335.845790:0:34480:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787826335.845792:0:34480:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787826335.845793:0:34480:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787826335.845795:0:34480:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787826335.845796:0:34480:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787826335.845798:0:34480:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787826335.845802:0:34480:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1787826335.845804:0:34480:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787826335.845806:0:34480:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787826335.845807:0:34480:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787826335.845808:0:34480:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787826335.845810:0:34480:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787826335.845811:0:34480:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787826335.845812:0:34480:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787826335.845813:0:34480:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787826335.845814:0:34480:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787826335.845815:0:34480:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787826335.845829:0:34480:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787826335.845841:0:34480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0b432940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3c550b8-2c3c-46c3-ad36-671c284167ea:34480:1874670585143680:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787826335.845875:0:34480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826335.845891:0:34480:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf081ec480 going to sleep for 11 seconds 00000100:00100000:2.0:1787826335.845962:0:34487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585143680 00000100:00100000:2.0:1787826335.845967:0:34487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585143680 00000100:00100000:2.0:1787826335.845999:0:34487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787826335.846006:0:34487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf03de0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3c550b8-2c3c-46c3-ad36-671c284167ea+11:34480:x1874670585143680:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787826335.846026:0:34487:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787826335.846038:0:34487:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787826335.852175:0:34487:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787826335.852220:0:34487:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1787826335.852547:0:34487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf03de0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3c550b8-2c3c-46c3-ad36-671c284167ea+11:34480:x1874670585143680:12345-0@lo:253:mount.lustre.0 Request processed in 6536us (6667us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826335.852560:0:34487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787826335.853010:0:34480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0b432940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3c550b8-2c3c-46c3-ad36-671c284167ea:34480:1874670585143680:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787826335.853025:0:34480:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787826335.853028:0:34480:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787826335.853030:0:34480:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787826335.853031:0:34480:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787826335.853033:0:34480:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787826335.853035:0:34480:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787826335.853036:0:34480:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787826335.853038:0:34480:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787826335.853039:0:34480:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787826335.853041:0:34480:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787826335.853042:0:34480:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787826335.853056:0:34480:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1787826335.855871:0:34491:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787826335.855882:0:34491:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787826335.855983:0:34491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90ce02426c00/0x22153cd396b7f66a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 34491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826335.856003:0:34491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90ce0a70ee00/0x22153cd396b7f639 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22153cd396b7f62b expref: 10 pid: 34492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826335.856011:0:34491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90ce02426c00/0x22153cd396b7f66a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 34491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826335.856052:0:34491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90ce0a70ee00/0x22153cd396b7f639 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22153cd396b7f62b expref: 10 pid: 34492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826335.856068:0:34491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90ce0a70ee00/0x22153cd396b7f639 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22153cd396b7f62b expref: 10 pid: 34492 timeout: 1381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826335.856083:0:34491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a9acb40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:34491:1874670585143808:0@lo:104: 00000100:00100000:2.0:1787826335.856143:0:34491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826335.856198:0:34491:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3ab4c240 going to sleep for 11 seconds 00000100:00100000:0.0:1787826335.856452:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585143808 00000100:00100000:0.0:1787826335.856459:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585143808 00000100:00100000:0.0:1787826335.856525:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787826335.856534:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a1ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e3c550b8-2c3c-46c3-ad36-671c284167ea+3:34491:x1874670585143808:12345-0@lo:104: 00010000:00010000:0.0:1787826335.856548:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff90cf3abd6a00/0x22153cd396b7f62b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x22153cd396b7f639 expref: -99 pid: 34480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826335.856596:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787826335.856602:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a1ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e3c550b8-2c3c-46c3-ad36-671c284167ea+3:34491:x1874670585143808:12345-0@lo:104: Request processed in 70us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826335.856609:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00010000:2.0:1787826335.856675:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826335.856681:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff90cf3abd6a00/0x22153cd396b7f62b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x22153cd396b7f639 expref: -99 pid: 34480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826335.856689:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3abd6a00 already unused, calling callback (ffffffffc12e3c20) 10000000:00010000:2.0:1787826335.856693:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff90cf3abd6a00/0x22153cd396b7f62b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x22153cd396b7f639 expref: -99 pid: 34480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826335.856702:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff90cf3abd6a00/0x22153cd396b7f62b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x22153cd396b7f639 expref: -99 pid: 34480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787826335.856710:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff90cf3abd6a00/0x22153cd396b7f62b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x22153cd396b7f639 expref: -99 pid: 34480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826335.856717:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787826335.856760:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff90cf3abd6a00/0x22153cd396b7f62b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22153cd396b7f639 expref: -99 pid: 34480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826335.856766:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787826335.856786:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff90cf3abd6a00/0x22153cd396b7f62b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22153cd396b7f639 expref: -99 pid: 34480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826335.856794:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff90cf3abd6a00/0x22153cd396b7f62b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22153cd396b7f639 expref: -99 pid: 34480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826335.856810:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826335.856812:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826335.856814:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826335.856827:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3fb943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e3c550b8-2c3c-46c3-ad36-671c284167ea:3644:1874670585143936:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787826335.856855:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826335.856903:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585143936 00000100:00100000:2.0:1787826335.856919:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585143936 00010000:00010000:2.0:1787826335.856937:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90ce0a70ee00/0x22153cd396b7f639 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22153cd396b7f62b expref: 11 pid: 34492 timeout: 1381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826335.856959:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 907 00000100:00100000:2.0:1787826335.856967:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb94780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3c550b8-2c3c-46c3-ad36-671c284167ea+11:3644:x1874670585143936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787826335.856976:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826335.856982:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90ce0a70ee00/0x22153cd396b7f639 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22153cd396b7f62b expref: 11 pid: 34492 timeout: 1381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826335.856992:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90ce0a70ee00/0x22153cd396b7f639 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22153cd396b7f62b expref: 11 pid: 34492 timeout: 1381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826335.857008:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90ce02426c00/0x22153cd396b7f66a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 34491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826335.857016:0:10340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ce02426c00/0x22153cd396b7f66a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 34491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787826335.857030:0:10340:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001149311s 00010000:00010000:2.0:1787826335.857035:0:10340:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90ce02426c00/0x22153cd396b7f66a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 34491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826335.857042:0:10340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90ce02426c00/0x22153cd396b7f66a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 34491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826335.857055:0:10340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90ce02426c00/0x22153cd396b7f66a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 34491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826335.857062:0:10340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90ce02426c00/0x22153cd396b7f66a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 34491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826335.857068:0:10340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce02426c00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826335.857072:0:10340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90ce02426c00/0x22153cd396b7f66a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 34491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826335.857079:0:10340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90ce02426c00/0x22153cd396b7f66a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 34491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826335.857088:0:10340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90ce02426c00/0x22153cd396b7f66a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 34491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826335.857096:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826335.857123:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb94780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3c550b8-2c3c-46c3-ad36-671c284167ea+11:3644:x1874670585143936:12345-0@lo:103:ldlm_bl.0 Request processed in 157us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826335.857129:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 907 00000100:00100000:2.0:1787826335.857161:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3fb943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e3c550b8-2c3c-46c3-ad36-671c284167ea:3644:1874670585143936:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787826335.857186:0:34491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90ce0a70ee00/0x22153cd396b7f639 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22153cd396b7f62b expref: 10 pid: 34492 timeout: 1381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826335.857196:0:34491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a9acb40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:34491:1874670585143808:0@lo:104: 00010000:00010000:2.0:1787826335.857208:0:34491:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90ce02426c00/0x22153cd396b7f66a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 34491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826335.857221:0:34491:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90ce02426c00/0x22153cd396b7f66a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 34491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826335.857228:0:34491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90ce02426c00/0x22153cd396b7f66a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 34491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826335.857235:0:34491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90ce02426c00/0x22153cd396b7f66a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 34491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787826335.871842:0:34480:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 55 00000040:01000000:1.0:1787826335.872177:0:34480:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1787826335.872573:0:34512:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 55 00000020:00080000:2.0:1787826335.872577:0:34512:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 55 00000040:01000000:1.0:1787826335.872711:0:34513:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:1.0:1787826335.875122:0:34513:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x200000400:0x1:0x0] first idx 0, last_idx 1 00000040:00080000:1.0:1787826335.875436:0:34513:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787826335.875440:0:34513:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x200000400:0x2:0x0] at index 1 of catalog [0x200000400:0x1:0x0] 00000040:01000000:3.0:1787826335.880733:0:34480:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:1.0:1787826335.881215:0:34514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0b432940 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:34514:1874670585144064:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787826335.881284:0:34514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826335.881321:0:34514:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce024a3000 going to sleep for 11 seconds 00000040:01000000:3.0:1787826335.881815:0:34480:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1787826335.881856:0:34480:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1787826335.882567:0:34480:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000100:00100000:0.0:1787826335.882777:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585144064 00000100:00100000:0.0:1787826335.882786:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585144064 00000100:00100000:0.0:1787826335.882846:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1305 00000100:00100000:0.0:1787826335.882856:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab91680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:34514:x1874670585144064:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787826335.882976:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab91680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:34514:x1874670585144064:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 121us (1692us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826335.882984:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1305 00000100:00100000:3.0:1787826335.883195:0:34514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0b432940 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:34514:1874670585144064:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1787826335.883229:0:34514:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1787826335.883268:0:34514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f936580 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:34514:1874670585144192:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787826335.883306:0:34514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826335.883335:0:34514:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10aba180 going to sleep for 11 seconds 00000100:00100000:0.0:1787826335.883458:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585144192 00000100:00100000:0.0:1787826335.883463:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585144192 00000100:00100000:0.0:1787826335.883519:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1306 00000100:00100000:0.0:1787826335.883526:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f936d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:34514:x1874670585144192:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787826335.883642:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f936d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:34514:x1874670585144192:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 115us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826335.883648:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1306 00000100:00100000:2.0:1787826335.883790:0:34514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f936580 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:34514:1874670585144192:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787826335.883854:0:34514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3fb943c0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:34514:1874670585144320:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787826335.883881:0:34514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826335.883906:0:34514:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3ab4c300 going to sleep for 11 seconds 00000100:00100000:3.0:1787826335.883988:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585144320 00000100:00100000:3.0:1787826335.883993:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585144320 00000100:00100000:3.0:1787826335.884023:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1307 00000100:00100000:3.0:1787826335.884030:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9acb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:34514:x1874670585144320:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787826335.884077:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9acb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:34514:x1874670585144320:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 47us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826335.884084:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1307 00000100:00100000:2.0:1787826335.884164:0:34514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3fb943c0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:34514:1874670585144320:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787826335.884227:0:34514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3fb943c0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:34514:1874670585144448:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787826335.884276:0:34514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826335.884298:0:34514:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3ab4c600 going to sleep for 11 seconds 00000100:00100000:3.0:1787826335.884416:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585144448 00000100:00100000:3.0:1787826335.884420:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585144448 00000100:00100000:3.0:1787826335.884449:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1308 00000100:00100000:3.0:1787826335.884455:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f05e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:34514:x1874670585144448:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787826335.884675:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f05e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:34514:x1874670585144448:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 219us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826335.884682:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1308 00000100:00100000:2.0:1787826335.884759:0:34514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3fb943c0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:34514:1874670585144448:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1787826335.884789:0:34514:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x240000401:0x1:0x0] first idx 0, last_idx 2 00000100:00100000:2.0:1787826335.884869:0:34514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce04f052c0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:34514:1874670585144576:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787826335.884979:0:34514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826335.885037:0:34514:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3ab4c600 going to sleep for 11 seconds 00000040:01000000:1.0:1787826335.885197:0:34480:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1787826335.885269:0:34480:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787826335.886488:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585144576 00000100:00100000:0.0:1787826335.886497:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585144576 00000100:00100000:0.0:1787826335.886538:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1309 00000100:00100000:0.0:1787826335.886547:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:34514:x1874670585144576:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787826335.886974:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:34514:x1874670585144576:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 426us (2064us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826335.886983:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1309 00000100:00100000:2.0:1787826335.887075:0:34514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce04f052c0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:34514:1874670585144576:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1787826335.887134:0:34514:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 2 synced_idx: 0 lgh_last_idx: 2 00000040:00080000:2.0:1787826335.887138:0:34514:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x240000401:0x3:0x0] at index 1 of catalog [0x240000401:0x1:0x0] 00000100:00100000:2.0:1787826335.887201:0:34514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce04f052c0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:34514:1874670585144704:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787826335.887236:0:34514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826335.887266:0:34514:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3ab4c300 going to sleep for 11 seconds 00000100:00100000:0.0:1787826335.887526:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585144704 00000100:00100000:0.0:1787826335.887532:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585144704 00000100:00100000:0.0:1787826335.887564:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1310 00000100:00100000:0.0:1787826335.887577:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:34514:x1874670585144704:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787826335.887637:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:34514:x1874670585144704:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 60us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826335.887643:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1310 00000100:00100000:2.0:1787826335.887798:0:34514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce04f052c0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:34514:1874670585144704:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787826335.887860:0:34514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce04f052c0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:34514:1874670585144832:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787826335.887920:0:34514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826335.887934:0:34514:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3ab4c600 going to sleep for 11 seconds 00000100:00100000:3.0:1787826335.887989:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585144832 00000100:00100000:3.0:1787826335.887994:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585144832 00000100:00100000:3.0:1787826335.888029:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1311 00000100:00100000:3.0:1787826335.888036:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aaf1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:34514:x1874670585144832:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787826335.888253:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aaf1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:34514:x1874670585144832:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 216us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826335.888261:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1311 00000100:00100000:2.0:1787826335.888796:0:34514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce04f052c0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:34514:1874670585144832:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787826335.888879:0:34514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aaf3480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:34514:1874670585144960:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787826335.889174:0:34514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826335.889205:0:34514:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3ab4c840 going to sleep for 11 seconds 00000100:00100000:3.0:1787826335.889505:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585144960 00000100:00100000:3.0:1787826335.889511:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585144960 00000100:00100000:3.0:1787826335.889590:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1312 00000100:00100000:3.0:1787826335.889599:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aaf1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:34514:x1874670585144960:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787826335.889669:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aaf1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:34514:x1874670585144960:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 71us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826335.889676:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1312 00000040:00080000:1.0:1787826335.890383:0:34480:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1787826335.891048:0:34480:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787826335.891082:0:34480:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1787826335.891192:0:34480:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787826335.891229:0:34514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aaf3480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:34514:1874670585144960:0@lo:1000:lod0000_rec0001.0 00000004:00080000:2.0:1787826335.891289:0:34514:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff90cf3ab4cd80 with version 1 00000040:00080000:2.0:1787826335.891313:0:34514:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x240000401:0x1:0x0] first idx 1, last_idx 2 00000004:00080000:2.0:1787826335.891324:0:34514:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff90cf20695cc0 with version 2 00000040:00080000:2.0:1787826335.891328:0:34514:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x240000401:0x3:0x0] at index 1 of catalog [0x240000401:0x1:0x0] 00000004:00080000:0.0:1787826335.891815:0:34498:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff90cf39def9c0 version 1 rpc_version 1 00000020:00100000:0.0:1787826335.891841:0:34498:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826335.891849:0:34498:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff90cf2f45fc00 x1874670585145216/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 416/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826335.891870:0:34498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf2f45fc00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:34498:1874670585145216:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826335.891921:0:34498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826335.891956:0:34498:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf104c0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787826335.892454:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585145216 00000100:00100000:2.0:1787826335.892461:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585145216 00000100:00100000:2.0:1787826335.892526:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1313 00000100:00100000:2.0:1787826335.892536:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf2f45da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:34498:x1874670585145216:12345-0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1787826335.893976:0:34513:0:(lod_dev.c:318:lod_process_recovery_updates()) lustre-MDT0000-mdtlov: process recovery updates [0x200000400:0x2:0x0].32 00000020:00080000:2.0:1787826335.893985:0:34513:0:(update_recovery.c:366:insert_update_records_to_replay_list()) lustre-MDT0000: insert record batchid = 55 transno = 0 mdt_index 0 00000040:00080000:2.0:1787826335.893996:0:34513:0:(llog.c:862:llog_process_thread()) stop processing plain [0x200000400:0x2:0x0] index 33 count 2 00000040:00080000:2.0:1787826335.894014:0:34513:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 2 count 2 00080000:10000000:1.0:1787826335.894016:0:34480:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000004:00080000:2.0:1787826335.894073:0:34513:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00010000:00080000:1.0:1787826335.896334:0:34480:0:(ldlm_lib.c:3079:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 4294969325 00000001:00080000:2.0:1787826335.896661:0:7449:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967578 is committed 00000001:00100000:2.0:1787826335.896670:0:7449:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:1.0:1787826335.897174:0:34515:0:(ldlm_lib.c:2879:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 34515 00010000:02000000:1.0:1787826335.897192:0:34515:0:(ldlm_lib.c:2361:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00000020:01000004:2.0:1787826335.897253:0:34480:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787826335.897267:0:34480:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.139@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787826335.897284:0:34480:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1787826335.897301:0:34480:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000100:00100000:3.0:1787826335.897347:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf2f45da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:34498:x1874670585145216:12345-0@lo:1000:osp_up1-0.0 Request processed in 4807us (5420us total) trans 4294967578 rc 0/0 00000100:00100000:3.0:1787826335.897359:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1313 00000004:00080000:0.0:1787826335.900330:0:34498:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967578 committed transno 4294967578 00000100:00100000:0.0:1787826335.900338:0:34498:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967578 gen 2 00000100:00100000:0.0:1787826335.900362:0:34498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf2f45fc00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:34498:1874670585145216:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1787826335.900391:0:34498:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff90cf39def9c0 version 2 rpc_version 2 00000020:00100000:0.0:1787826335.900414:0:34498:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826335.900422:0:34498:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff90cf2f45fc00 x1874670585145472/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 744/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826335.900443:0:34498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf2f45fc00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:34498:1874670585145472:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826335.900519:0:34498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826335.900557:0:34498:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf104c0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787826335.900591:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585145472 00000100:00100000:0.0:1787826335.900597:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585145472 00000100:00100000:0.0:1787826335.900645:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1314 00000100:00100000:0.0:1787826335.900655:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf2f45f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:34498:x1874670585145472:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826335.900834:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf2f45f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:34498:x1874670585145472:12345-0@lo:1000:osp_up1-0.0 Request processed in 180us (315us total) trans 4294967579 rc 0/0 00000100:00100000:0.0:1787826335.900842:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1314 00000100:00100000:0.0:1787826335.900883:0:34498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf2f45fc00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:34498:1874670585145472:0@lo:1000:osp_up1-0.0 00010000:00080000:1.0:1787826335.903035:0:34515:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1787826335.903042:0:34515:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:0.0:1787826335.909864:0:34514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf2f45f0c0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:34514:1874670585145600:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787826335.909965:0:34514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826335.910008:0:34514:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf104c0900 going to sleep for 11 seconds 00000100:00100000:1.0:1787826335.910026:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585145600 00000100:00100000:1.0:1787826335.910036:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585145600 00000100:00100000:1.0:1787826335.910087:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1315 00000100:00100000:1.0:1787826335.910097:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf2f45cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:34514:x1874670585145600:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787826335.910316:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf2f45cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:34514:x1874670585145600:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 218us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826335.910323:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1315 00000020:00000004:0.0:1787826335.911158:0:34480:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000100:00100000:1.0:1787826335.913119:0:34514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf2f45f0c0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:34514:1874670585145600:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1787826335.913254:0:34514:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787826335.913259:0:34514:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x240000401:0x4:0x0] at index 2 of catalog [0x240000401:0x1:0x0] 00000100:00100000:1.0:1787826335.913342:0:34514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab90780 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:34514:1874670585145728:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787826335.913401:0:34514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826335.913437:0:34514:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce05f8ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1787826335.913514:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585145728 00000100:00100000:3.0:1787826335.913520:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585145728 00000100:00100000:3.0:1787826335.913567:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1316 00000100:00100000:3.0:1787826335.913576:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab92d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:34514:x1874670585145728:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787826335.913655:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab92d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:34514:x1874670585145728:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 80us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826335.913663:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1316 00000100:00100000:1.0:1787826335.914018:0:34514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab90780 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:34514:1874670585145728:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1787826335.914065:0:34514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1787826335.914104:0:34514:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff90ce05f8ec00 with version 3 00000004:00080000:1.0:1787826335.914149:0:34514:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff90ce05f8e6c0 with version 4 00000040:00080000:1.0:1787826335.914153:0:34514:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x240000401:0x4:0x0] at index 2 of catalog [0x240000401:0x1:0x0] 00000040:00080000:1.0:1787826335.914167:0:34514:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 2 count 1 00000004:00080000:1.0:1787826335.914346:0:34514:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787826335.914351:0:34514:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00080000:1.0:1787826335.914450:0:34515:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000004:00080000:0.0:1787826335.917754:0:34498:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff90cf39def9c0 version 3 rpc_version 3 00000020:00100000:0.0:1787826335.917793:0:34498:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826335.917805:0:34498:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff90cf2f45c3c0 x1874670585145984/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 416/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826335.917831:0:34498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf2f45c3c0 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:34498:1874670585145984:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826335.917903:0:34498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826335.917946:0:34498:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf104c0e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826335.918001:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585145984 00000100:00100000:1.0:1787826335.918010:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585145984 00000100:00100000:1.0:1787826335.918070:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1317 00000100:00100000:1.0:1787826335.918082:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf2f45c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:34498:x1874670585145984:12345-0@lo:1000:osp_up1-0.0 00000020:00000004:0.0:1787826335.918101:0:34480:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787826335.918323:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf2f45c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:34498:x1874670585145984:12345-0@lo:1000:osp_up1-0.0 Request processed in 243us (417us total) trans 4294967580 rc 0/0 00000100:00100000:1.0:1787826335.918331:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1317 00000100:00100000:0.0:1787826335.918367:0:34498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf2f45c3c0 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:34498:1874670585145984:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1787826335.918377:0:34498:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff90cf39def9c0 version 4 rpc_version 4 00000020:00100000:0.0:1787826335.918390:0:34498:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826335.918395:0:34498:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff90cf2f45c000 x1874670585146240/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 744/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826335.918409:0:34498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf2f45c000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:34498:1874670585146240:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826335.918434:0:34498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826335.918454:0:34498:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf104c0e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787826335.918515:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585146240 00000100:00100000:3.0:1787826335.918521:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585146240 00000100:00100000:3.0:1787826335.918554:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1318 00000100:00100000:3.0:1787826335.918563:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf2f45d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:34498:x1874670585146240:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826335.918676:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf2f45d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:34498:x1874670585146240:12345-0@lo:1000:osp_up1-0.0 Request processed in 114us (240us total) trans 4294967581 rc 0/0 00000100:00100000:3.0:1787826335.918683:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1318 00000100:00100000:1.0:1787826335.920340:0:34498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf2f45c000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:34498:1874670585146240:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1787826336.068293:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826336.516806:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf2f45e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585146368:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787826336.516912:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826336.517086:0:12021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585146368 00000100:00100000:0.0:1787826336.517097:0:12021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585146368 00000100:00100000:0.0:1787826336.517168:0:12021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 716 00000100:00100000:0.0:1787826336.517179:0:12021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b432940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874670585146368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787826336.517218:0:12021:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43441856 pending 0 free 3919286272 avail 3687763968 00000100:00100000:1.0:1787826336.517677:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f876d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585146496:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826336.517714:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826336.517938:0:25628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585146496 00000100:00100000:3.0:1787826336.517944:0:25628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585146496 00000100:00100000:3.0:1787826336.517984:0:25628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 717 00000100:00100000:3.0:1787826336.517991:0:25628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab90780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874670585146496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787826336.518004:0:25628:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 60260032 pending 0 free 3921387520 avail 3689865216 00000100:00100000:3.0:1787826336.518042:0:25628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab90780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874670585146496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826336.518049:0:25628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 717 00000100:00100000:1.0:1787826336.518211:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f876d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585146496:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826336.519367:0:12021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b432940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874670585146368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2118us (2393us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826336.519379:0:12021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 716 00000100:00100000:1.0:1787826336.519709:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf2f45e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585146368:0@lo:13:osp-pre-0-1.0 10000000:01000000:3.0:1787826336.836082:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787826336.836093:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90ce034cb800 from 17 10000000:01000000:3.0:1787826336.836101:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787826336.836241:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff90cf3abd7800/0x22153cd396b7f671 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826336.836263:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff90cf3abd7800/0x22153cd396b7f671 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826336.836277:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff90cf3abd7800/0x22153cd396b7f671 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826336.836312:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f874780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585146624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787826336.836656:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826336.837023:0:34485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585146624 00000100:00100000:0.0:1787826336.837035:0:34485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585146624 00000100:00100000:0.0:1787826336.837119:0:34485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787826336.837214:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f6113c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826336.837294:0:34485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf0819b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3c550b8-2c3c-46c3-ad36-671c284167ea+10:6515:x1874670585146624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826336.837314:0:34485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826336.837337:0:34485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90ce0a70fc00/0x22153cd396b7f678 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x22153cd396b7f671 expref: -99 pid: 34485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826336.837448:0:34485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ce0a70fc00/0x22153cd396b7f678 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22153cd396b7f671 expref: 11 pid: 34485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826336.837460:0:34485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90ce0a70fc00/0x22153cd396b7f678 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22153cd396b7f671 expref: 11 pid: 34485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826336.837573:0:34485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0a70fc00, rc 0) 00000100:00100000:0.0:1787826336.837674:0:34485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf0819b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3c550b8-2c3c-46c3-ad36-671c284167ea+11:6515:x1874670585146624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 546us (1018us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826336.837682:0:34485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787826336.837793:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f874780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585146624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787826336.837813:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff90cf3abd7800/0x22153cd396b7f671 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22153cd396b7f678 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826336.837823:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff90cf3abd7800/0x22153cd396b7f671 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x22153cd396b7f678 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826336.838112:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f874780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585146752:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787826336.838230:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826336.838304:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f6113c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826336.838342:0:34488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585146752 00000100:00100000:1.0:1787826336.838349:0:34488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585146752 00000100:00100000:1.0:1787826336.838538:0:34488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787826336.838548:0:34488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf08198050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3c550b8-2c3c-46c3-ad36-671c284167ea+11:6515:x1874670585146752:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787826336.838567:0:34488:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787826336.838588:0:34488:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787826336.838591:0:34488:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 17 00000100:00100000:1.0:1787826336.839076:0:34488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf08198050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3c550b8-2c3c-46c3-ad36-671c284167ea+11:6515:x1874670585146752:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 527us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826336.839085:0:34488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787826336.839223:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f874780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585146752:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787826336.839293:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787826336.839303:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff90cf3abd7800/0x22153cd396b7f671 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22153cd396b7f678 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826336.839313:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff90cf3abd7800/0x22153cd396b7f671 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22153cd396b7f678 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826336.839325:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787826336.839328:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90cf3a8f2800 from 52 10000000:01000000:0.0:1787826336.839331:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787826336.839364:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff90ce0a70f600/0x22153cd396b7f67f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826336.839372:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff90ce0a70f600/0x22153cd396b7f67f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826336.839381:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff90ce0a70f600/0x22153cd396b7f67f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826336.839400:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf2f45ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585146880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787826336.839435:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826336.839546:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf087ac6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826336.839648:0:34492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585146880 00000100:00100000:1.0:1787826336.839654:0:34492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585146880 00000100:00100000:1.0:1787826336.839741:0:34492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787826336.839751:0:34492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf0819bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e3c550b8-2c3c-46c3-ad36-671c284167ea+11:6515:x1874670585146880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787826336.839762:0:34492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826336.839779:0:34492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90ce01f16600/0x22153cd396b7f686 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x22153cd396b7f67f expref: -99 pid: 34492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826336.839803:0:34492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ce01f16600/0x22153cd396b7f686 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22153cd396b7f67f expref: 12 pid: 34492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826336.839816:0:34492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90ce01f16600/0x22153cd396b7f686 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22153cd396b7f67f expref: 12 pid: 34492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826336.839825:0:34492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01f16600, rc 0) 00000100:00100000:1.0:1787826336.839908:0:34492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf0819bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e3c550b8-2c3c-46c3-ad36-671c284167ea+12:6515:x1874670585146880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826336.839914:0:34492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787826336.840325:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf2f45ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585146880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787826336.840344:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff90ce0a70f600/0x22153cd396b7f67f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22153cd396b7f686 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826336.840354:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff90ce0a70f600/0x22153cd396b7f67f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x22153cd396b7f686 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826336.840438:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f874780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585147008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787826336.840509:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826336.840545:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3000 going to sleep for 11 seconds 00000100:00100000:0.0:1787826336.840611:0:34487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585147008 00000100:00100000:0.0:1787826336.840616:0:34487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585147008 00000100:00100000:0.0:1787826336.840660:0:34487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787826336.840668:0:34487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf0819b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3c550b8-2c3c-46c3-ad36-671c284167ea+12:6515:x1874670585147008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787826336.841037:0:34487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf0819b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3c550b8-2c3c-46c3-ad36-671c284167ea+12:6515:x1874670585147008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 368us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826336.841046:0:34487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787826336.841091:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f874780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585147008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787826336.841229:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf2f45ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585147136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787826336.841268:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826336.841283:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf087ac3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826336.841296:0:34485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585147136 00000100:00100000:0.0:1787826336.841300:0:34485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585147136 00000100:00100000:0.0:1787826336.841323:0:34485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787826336.841329:0:34485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf08199450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3c550b8-2c3c-46c3-ad36-671c284167ea+12:6515:x1874670585147136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787826336.841417:0:34485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf08199450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3c550b8-2c3c-46c3-ad36-671c284167ea+12:6515:x1874670585147136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826336.841423:0:34485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787826336.841463:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf2f45ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585147136:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787826336.842775:0:34567:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1787826336.843110:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1787826336.843210:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787826336.843224:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff90ce0a70f600/0x22153cd396b7f67f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22153cd396b7f686 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826336.843236:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff90ce0a70f600/0x22153cd396b7f67f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22153cd396b7f686 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826336.843252:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1787826336.843255:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:1.0:1787826336.843258:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787826336.843295:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff90ce01f17a00/0x22153cd396b7f68d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826336.843304:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff90ce01f17a00/0x22153cd396b7f68d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826336.843316:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff90ce01f17a00/0x22153cd396b7f68d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826336.843339:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab92580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585147264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787826336.843405:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826336.843603:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce05f8e840 going to sleep for 11 seconds 00000100:00100000:0.0:1787826336.843824:0:34485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585147264 00000100:00100000:0.0:1787826336.844033:0:34485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585147264 00000100:00100000:0.0:1787826336.844143:0:34485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787826336.844155:0:34485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf39ddd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3c550b8-2c3c-46c3-ad36-671c284167ea+12:6515:x1874670585147264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826336.844172:0:34485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826336.844188:0:34485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90ce0a70e800/0x22153cd396b7f694 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x22153cd396b7f68d expref: -99 pid: 34485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826336.844216:0:34485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ce0a70e800/0x22153cd396b7f694 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22153cd396b7f68d expref: 13 pid: 34485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826336.844229:0:34485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90ce0a70e800/0x22153cd396b7f694 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22153cd396b7f68d expref: 13 pid: 34485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826336.844239:0:34485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0a70e800, rc 0) 00000100:00100000:0.0:1787826336.844303:0:34485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf39ddd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3c550b8-2c3c-46c3-ad36-671c284167ea+13:6515:x1874670585147264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826336.844311:0:34485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787826336.844397:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab92580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585147264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787826336.844416:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff90ce01f17a00/0x22153cd396b7f68d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22153cd396b7f694 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826336.844426:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff90ce01f17a00/0x22153cd396b7f68d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x22153cd396b7f694 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826336.844549:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f876d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585147392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787826336.844585:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826336.844874:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3540 going to sleep for 11 seconds 00000100:00100000:1.0:1787826336.845115:0:34487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585147392 00000100:00100000:1.0:1787826336.845121:0:34487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585147392 00000100:00100000:1.0:1787826336.845172:0:34487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787826336.845181:0:34487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf39ddc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3c550b8-2c3c-46c3-ad36-671c284167ea+13:6515:x1874670585147392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787826336.845362:0:34487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf39ddc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3c550b8-2c3c-46c3-ad36-671c284167ea+13:6515:x1874670585147392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 183us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826336.845371:0:34487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787826336.845417:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f876d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585147392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787826336.845457:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab90b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585147520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787826336.845515:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826336.845528:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce05f8e900 going to sleep for 11 seconds 00000100:00100000:1.0:1787826336.845539:0:34487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585147520 00000100:00100000:1.0:1787826336.845542:0:34487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585147520 00000100:00100000:1.0:1787826336.845559:0:34487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787826336.845565:0:34487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1099f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3c550b8-2c3c-46c3-ad36-671c284167ea+13:6515:x1874670585147520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787826336.847022:0:34487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1099f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3c550b8-2c3c-46c3-ad36-671c284167ea+13:6515:x1874670585147520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1447us (1498us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826336.847047:0:34487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787826336.847132:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab90b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585147520:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787826336.849511:0:34568:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:1.0:1787826336.849671:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:1.0:1787826336.849713:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787826336.849726:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff90ce01f17a00/0x22153cd396b7f68d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22153cd396b7f694 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826336.849755:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff90ce01f17a00/0x22153cd396b7f68d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22153cd396b7f694 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826336.849765:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787826336.849768:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90cf3a8f2800 from 7 10000000:01000000:1.0:1787826336.849771:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787826336.849811:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff90ce01f17600/0x22153cd396b7f69b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826336.849819:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff90ce01f17600/0x22153cd396b7f69b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826336.849830:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff90ce01f17600/0x22153cd396b7f69b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826336.849858:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab90b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585147648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787826336.850154:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826336.850207:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce05f8e900 going to sleep for 11 seconds 00000100:00100000:0.0:1787826336.850321:0:34492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585147648 00000100:00100000:0.0:1787826336.850329:0:34492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585147648 00000100:00100000:0.0:1787826336.850866:0:34492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787826336.850880:0:34492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1099d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e3c550b8-2c3c-46c3-ad36-671c284167ea+13:6515:x1874670585147648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826336.850893:0:34492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826336.851133:0:34492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90ce0a70f200/0x22153cd396b7f6a2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x22153cd396b7f69b expref: -99 pid: 34492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826336.851160:0:34492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ce0a70f200/0x22153cd396b7f6a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22153cd396b7f69b expref: 14 pid: 34492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826336.851175:0:34492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90ce0a70f200/0x22153cd396b7f6a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22153cd396b7f69b expref: 14 pid: 34492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826336.851183:0:34492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0a70f200, rc 0) 00000100:00100000:0.0:1787826336.851242:0:34492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1099d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e3c550b8-2c3c-46c3-ad36-671c284167ea+14:6515:x1874670585147648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 366us (1088us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826336.851249:0:34492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787826336.851331:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab90b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585147648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787826336.851349:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff90ce01f17600/0x22153cd396b7f69b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22153cd396b7f6a2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826336.851358:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff90ce01f17600/0x22153cd396b7f69b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x22153cd396b7f6a2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826336.851436:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab90b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585147776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787826336.851498:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826336.853748:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce05f8e900 going to sleep for 11 seconds 00000100:00100000:3.0:1787826336.853829:0:34485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585147776 00000100:00100000:3.0:1787826336.853838:0:34485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585147776 00000100:00100000:3.0:1787826336.853893:0:34485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787826336.854040:0:34485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1099cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3c550b8-2c3c-46c3-ad36-671c284167ea+14:6515:x1874670585147776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787826336.854263:0:34485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1099cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3c550b8-2c3c-46c3-ad36-671c284167ea+14:6515:x1874670585147776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 362us (2793us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826336.854270:0:34485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787826336.854799:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab90b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585147776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787826336.854872:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab90b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585147904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787826336.855273:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826336.855452:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce05f8e900 going to sleep for 11 seconds 00000100:00100000:3.0:1787826336.855637:0:34485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585147904 00000100:00100000:3.0:1787826336.855644:0:34485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585147904 00000100:00100000:3.0:1787826336.855741:0:34485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787826336.855751:0:34485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1099c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3c550b8-2c3c-46c3-ad36-671c284167ea+14:6515:x1874670585147904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787826336.855873:0:34485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1099c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3c550b8-2c3c-46c3-ad36-671c284167ea+14:6515:x1874670585147904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 124us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826336.855881:0:34485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787826336.856077:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab90b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585147904:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787826336.860247:0:34569:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787826336.860795:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787826336.860829:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787826336.860841:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff90ce01f17600/0x22153cd396b7f69b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22153cd396b7f6a2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826336.860853:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff90ce01f17600/0x22153cd396b7f69b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22153cd396b7f6a2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826336.866340:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787826336.866352:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90cf39f29000 from 52 10000000:01000000:0.0:1787826336.866359:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787826336.866420:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff90ce0a70f800/0x22153cd396b7f6a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826336.866434:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff90ce0a70f800/0x22153cd396b7f6a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826336.866448:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff90ce0a70f800/0x22153cd396b7f6a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826336.866908:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf2f45ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585148032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787826336.868809:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826336.868882:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce02700e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787826336.869282:0:34487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585148032 00000100:00100000:3.0:1787826336.869298:0:34487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585148032 00000100:00100000:3.0:1787826336.869378:0:34487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787826336.869388:0:34487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1099c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3c550b8-2c3c-46c3-ad36-671c284167ea+14:6515:x1874670585148032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787826336.869405:0:34487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826336.869424:0:34487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cf3abd7c00/0x22153cd396b7f6b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x22153cd396b7f6a9 expref: -99 pid: 34487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826336.869465:0:34487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cf3abd7c00/0x22153cd396b7f6b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22153cd396b7f6a9 expref: 15 pid: 34487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826336.869505:0:34487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cf3abd7c00/0x22153cd396b7f6b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22153cd396b7f6a9 expref: 15 pid: 34487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826336.869515:0:34487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3abd7c00, rc 0) 00000100:00100000:3.0:1787826336.869804:0:34487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1099c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3c550b8-2c3c-46c3-ad36-671c284167ea+15:6515:x1874670585148032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 417us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826336.869812:0:34487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787826336.871145:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf2f45ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585148032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826336.871172:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff90ce0a70f800/0x22153cd396b7f6a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x22153cd396b7f6b0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826336.871184:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff90ce0a70f800/0x22153cd396b7f6a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x22153cd396b7f6b0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826336.871273:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf2f45ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585148160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787826336.871326:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826336.871371:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce02700e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787826336.871712:0:34492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585148160 00000100:00100000:2.0:1787826336.871718:0:34492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585148160 00000100:00100000:2.0:1787826336.871777:0:34492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787826336.871791:0:34492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf2f426850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e3c550b8-2c3c-46c3-ad36-671c284167ea+15:6515:x1874670585148160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787826336.872407:0:34492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf2f426850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e3c550b8-2c3c-46c3-ad36-671c284167ea+15:6515:x1874670585148160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 616us (1080us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826336.872415:0:34492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787826336.872741:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf2f45ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585148160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787826336.872793:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f876d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585148288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787826336.872857:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826336.872885:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a13f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826336.873164:0:34492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585148288 00000100:00100000:2.0:1787826336.873169:0:34492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585148288 00000100:00100000:2.0:1787826336.873203:0:34492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787826336.873212:0:34492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf2f424450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e3c550b8-2c3c-46c3-ad36-671c284167ea+15:6515:x1874670585148288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787826336.875722:0:34492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf2f424450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e3c550b8-2c3c-46c3-ad36-671c284167ea+15:6515:x1874670585148288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2503us (2856us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826336.875747:0:34492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787826336.876027:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f876d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585148288:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787826336.877655:0:34572:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1787826336.878085:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1787826336.878117:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787826336.878128:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff90ce0a70f800/0x22153cd396b7f6a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x22153cd396b7f6b0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826336.878142:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff90ce0a70f800/0x22153cd396b7f6a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x22153cd396b7f6b0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787826336.878153:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1787826336.878156:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:3.0:1787826336.878160:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787826336.878195:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff90cf3abd7200/0x22153cd396b7f6b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826336.878202:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff90cf3abd7200/0x22153cd396b7f6b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826336.878213:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff90cf3abd7200/0x22153cd396b7f6b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826336.878237:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f876d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585148416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787826336.878309:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826336.878364:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf078fef00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826336.878723:0:34485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585148416 00000100:00100000:2.0:1787826336.878740:0:34485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585148416 00000100:00100000:2.0:1787826336.878796:0:34485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787826336.878807:0:34485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf2f427050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3c550b8-2c3c-46c3-ad36-671c284167ea+15:6515:x1874670585148416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787826336.878820:0:34485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826336.878832:0:34485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90ce02426000/0x22153cd396b7f6be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x22153cd396b7f6b7 expref: -99 pid: 34485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826336.878854:0:34485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ce02426000/0x22153cd396b7f6be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22153cd396b7f6b7 expref: 16 pid: 34485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826336.878865:0:34485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90ce02426000/0x22153cd396b7f6be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22153cd396b7f6b7 expref: 16 pid: 34485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826336.878873:0:34485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce02426000, rc 0) 00000100:00100000:2.0:1787826336.878985:0:34485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf2f427050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3c550b8-2c3c-46c3-ad36-671c284167ea+16:6515:x1874670585148416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826336.878993:0:34485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787826336.879597:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f876d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585148416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787826336.879616:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff90cf3abd7200/0x22153cd396b7f6b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x22153cd396b7f6be expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826336.879627:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff90cf3abd7200/0x22153cd396b7f6b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x22153cd396b7f6be expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826336.879692:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f876d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585148544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787826336.879740:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826336.879762:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf078fef00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826336.880401:0:34487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585148544 00000100:00100000:2.0:1787826336.880407:0:34487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585148544 00000100:00100000:2.0:1787826336.880461:0:34487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787826336.880489:0:34487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf2f426c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3c550b8-2c3c-46c3-ad36-671c284167ea+16:6515:x1874670585148544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787826336.880825:0:34487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf2f426c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3c550b8-2c3c-46c3-ad36-671c284167ea+16:6515:x1874670585148544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 356us (1095us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826336.880833:0:34487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787826336.881223:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f876d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585148544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787826336.881266:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f876d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585148672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787826336.881328:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826336.881353:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf078fef00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826336.881804:0:34485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585148672 00000100:00100000:2.0:1787826336.881809:0:34485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585148672 00000100:00100000:2.0:1787826336.881848:0:34485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787826336.881856:0:34485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf2f426050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3c550b8-2c3c-46c3-ad36-671c284167ea+16:6515:x1874670585148672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787826336.883846:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f876d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585148672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787826336.883913:0:34485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf2f426050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3c550b8-2c3c-46c3-ad36-671c284167ea+16:6515:x1874670585148672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2049us (2575us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826336.883924:0:34485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000040:00080000:3.0:1787826336.887853:0:34573:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:0.0:1787826336.888320:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:0.0:1787826336.888345:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787826336.888356:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff90cf3abd7200/0x22153cd396b7f6b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x22153cd396b7f6be expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826336.888367:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff90cf3abd7200/0x22153cd396b7f6b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x22153cd396b7f6be expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787826336.888377:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787826336.888380:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90cf39f29000 from 7 10000000:01000000:0.0:1787826336.888382:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787826336.888420:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff90ce0a70ee00/0x22153cd396b7f6c5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826336.888651:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff90ce0a70ee00/0x22153cd396b7f6c5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826336.888666:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff90ce0a70ee00/0x22153cd396b7f6c5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826336.888689:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf2f45e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585148800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787826336.888768:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826336.888813:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce02700c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826336.888858:0:34487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585148800 00000100:00100000:2.0:1787826336.888866:0:34487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585148800 00000100:00100000:2.0:1787826336.888927:0:34487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787826336.888938:0:34487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0346ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3c550b8-2c3c-46c3-ad36-671c284167ea+16:6515:x1874670585148800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787826336.888951:0:34487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826336.888964:0:34487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90ce02427e00/0x22153cd396b7f6cc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x22153cd396b7f6c5 expref: -99 pid: 34487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826336.888988:0:34487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ce02427e00/0x22153cd396b7f6cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22153cd396b7f6c5 expref: 17 pid: 34487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826336.888998:0:34487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90ce02427e00/0x22153cd396b7f6cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22153cd396b7f6c5 expref: 17 pid: 34487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826336.889006:0:34487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce02427e00, rc 0) 00000100:00100000:2.0:1787826336.889056:0:34487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0346ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3c550b8-2c3c-46c3-ad36-671c284167ea+17:6515:x1874670585148800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826336.889064:0:34487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787826336.889150:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf2f45e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585148800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826336.889166:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff90ce0a70ee00/0x22153cd396b7f6c5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22153cd396b7f6cc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826336.889180:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff90ce0a70ee00/0x22153cd396b7f6c5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x22153cd396b7f6cc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826336.889237:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf2f45e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585148928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787826336.889264:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826336.890205:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce02700c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787826336.897242:0:34488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585148928 00000100:00100000:3.0:1787826336.897258:0:34488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585148928 00000100:00100000:2.0:1787826336.903993:0:34488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787826336.904016:0:34488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0346bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3c550b8-2c3c-46c3-ad36-671c284167ea+17:6515:x1874670585148928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787826336.904407:0:34488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0346bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3c550b8-2c3c-46c3-ad36-671c284167ea+17:6515:x1874670585148928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 400us (15140us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826336.904416:0:34488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787826336.904558:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf2f45e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585148928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787826336.904620:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f876d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585149056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787826336.904674:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826336.905918:0:34488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585149056 00000100:00100000:2.0:1787826336.905927:0:34488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585149056 00000100:00100000:3.0:1787826336.905963:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf078fef00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826336.905997:0:34492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787826336.906007:0:34492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce027e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e3c550b8-2c3c-46c3-ad36-671c284167ea+17:6515:x1874670585149056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787826336.906273:0:34492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce027e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e3c550b8-2c3c-46c3-ad36-671c284167ea+17:6515:x1874670585149056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 267us (1598us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826336.906281:0:34492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787826336.907162:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f876d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585149056:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787826336.910989:0:34574:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787826336.911954:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787826336.911992:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787826336.912004:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff90ce0a70ee00/0x22153cd396b7f6c5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22153cd396b7f6cc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826336.912016:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff90ce0a70ee00/0x22153cd396b7f6c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22153cd396b7f6cc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826336.912026:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787826336.912029:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90cf39eb6800 from 52 10000000:01000000:2.0:1787826336.912032:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787826336.912067:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff90ce02426a00/0x22153cd396b7f6d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826336.912075:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff90ce02426a00/0x22153cd396b7f6d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826336.912085:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff90ce02426a00/0x22153cd396b7f6d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826336.912109:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aaf3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585149184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787826336.912175:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826336.912219:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3f7d80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826336.912410:0:34485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585149184 00000100:00100000:1.0:1787826336.912423:0:34485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585149184 00000100:00100000:1.0:1787826336.912517:0:34485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787826336.912531:0:34485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce027ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3c550b8-2c3c-46c3-ad36-671c284167ea+17:6515:x1874670585149184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787826336.912550:0:34485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826336.912571:0:34485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90ce01f17400/0x22153cd396b7f6da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x22153cd396b7f6d3 expref: -99 pid: 34485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826336.912964:0:34485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ce01f17400/0x22153cd396b7f6da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22153cd396b7f6d3 expref: 18 pid: 34485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826336.912984:0:34485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90ce01f17400/0x22153cd396b7f6da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22153cd396b7f6d3 expref: 18 pid: 34485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826336.912994:0:34485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01f17400, rc 0) 00000100:00100000:1.0:1787826336.913160:0:34485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce027ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3c550b8-2c3c-46c3-ad36-671c284167ea+18:6515:x1874670585149184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 631us (982us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826336.913170:0:34485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787826336.913417:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aaf3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585149184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787826336.913442:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff90ce02426a00/0x22153cd396b7f6d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x22153cd396b7f6da expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826336.913454:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff90ce02426a00/0x22153cd396b7f6d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x22153cd396b7f6da expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826336.913625:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aaf3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585149312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787826336.913667:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826336.913753:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3f7d80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826336.913893:0:34492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585149312 00000100:00100000:1.0:1787826336.913899:0:34492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585149312 00000100:00100000:1.0:1787826336.913972:0:34492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787826336.913981:0:34492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce027e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e3c550b8-2c3c-46c3-ad36-671c284167ea+18:6515:x1874670585149312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787826336.914124:0:34492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce027e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e3c550b8-2c3c-46c3-ad36-671c284167ea+18:6515:x1874670585149312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 144us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826336.914141:0:34492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787826336.914553:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aaf3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585149312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787826336.914591:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aaf3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585149440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787826336.914645:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826336.914661:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3f7d80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826336.914676:0:34487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585149440 00000100:00100000:2.0:1787826336.914680:0:34487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585149440 00000100:00100000:2.0:1787826336.914916:0:34487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787826336.914924:0:34487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce027e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3c550b8-2c3c-46c3-ad36-671c284167ea+18:6515:x1874670585149440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787826336.915017:0:34487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce027e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3c550b8-2c3c-46c3-ad36-671c284167ea+18:6515:x1874670585149440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826336.915025:0:34487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787826336.915069:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aaf3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585149440:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787826336.916421:0:34576:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1787826336.916973:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1787826336.917004:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787826336.917017:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff90ce02426a00/0x22153cd396b7f6d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x22153cd396b7f6da expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826336.917030:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff90ce02426a00/0x22153cd396b7f6d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x22153cd396b7f6da expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826336.917041:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787826336.917044:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90cf39eb6800 from 14 10000000:01000000:1.0:1787826336.917048:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787826336.917094:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff90ce01f17000/0x22153cd396b7f6e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826336.917109:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff90ce01f17000/0x22153cd396b7f6e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826336.917121:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff90ce01f17000/0x22153cd396b7f6e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826336.917218:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab90b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585149568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787826336.917288:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826336.917418:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f568c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826336.917463:0:34488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585149568 00000100:00100000:2.0:1787826336.917528:0:34488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585149568 00000100:00100000:2.0:1787826336.917616:0:34488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787826336.917627:0:34488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce027e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3c550b8-2c3c-46c3-ad36-671c284167ea+18:6515:x1874670585149568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787826336.917641:0:34488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826336.917657:0:34488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90ce02426e00/0x22153cd396b7f6e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x22153cd396b7f6e1 expref: -99 pid: 34488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826336.917828:0:34488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ce02426e00/0x22153cd396b7f6e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22153cd396b7f6e1 expref: 19 pid: 34488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826336.917844:0:34488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90ce02426e00/0x22153cd396b7f6e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22153cd396b7f6e1 expref: 19 pid: 34488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826336.917855:0:34488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce02426e00, rc 0) 00000100:00100000:2.0:1787826336.917907:0:34488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce027e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3c550b8-2c3c-46c3-ad36-671c284167ea+19:6515:x1874670585149568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 282us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826336.917915:0:34488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787826336.918016:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab90b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585149568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787826336.918035:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff90ce01f17000/0x22153cd396b7f6e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22153cd396b7f6e8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826336.918045:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff90ce01f17000/0x22153cd396b7f6e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x22153cd396b7f6e8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826336.918112:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aaf3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585149696:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787826336.918224:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826336.918272:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf09edc240 going to sleep for 11 seconds 00000100:00100000:1.0:1787826336.918299:0:34492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585149696 00000100:00100000:1.0:1787826336.918355:0:34492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585149696 00000100:00100000:1.0:1787826336.918407:0:34492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787826336.918412:0:34492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf10657050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e3c550b8-2c3c-46c3-ad36-671c284167ea+19:6515:x1874670585149696:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787826336.918426:0:34492:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787826336.918442:0:34492:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787826336.918445:0:34492:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:1.0:1787826336.918447:0:34492:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:1.0:1787826336.918449:0:34492:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:1.0:1787826336.918451:0:34492:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 17 00000100:00100000:1.0:1787826336.918536:0:34492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf10657050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e3c550b8-2c3c-46c3-ad36-671c284167ea+19:6515:x1874670585149696:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 124us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826336.918541:0:34492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787826336.918595:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aaf3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585149696:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787826336.918660:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787826336.918666:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff90ce01f17000/0x22153cd396b7f6e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22153cd396b7f6e8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826336.918672:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff90ce01f17000/0x22153cd396b7f6e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22153cd396b7f6e8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787826336.918678:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1787826336.918680:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:2.0:1787826336.918682:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1787826336.918788:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff90ce02426800/0x22153cd396b7f6ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826336.918797:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff90ce02426800/0x22153cd396b7f6ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826336.918807:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff90ce02426800/0x22153cd396b7f6ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826336.918823:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aaf3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585149824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787826336.919173:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826336.919194:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf09edc240 going to sleep for 11 seconds 00000100:00100000:1.0:1787826336.919253:0:34492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585149824 00000100:00100000:1.0:1787826336.919259:0:34492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585149824 00000100:00100000:1.0:1787826336.919328:0:34492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787826336.919336:0:34492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03b37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e3c550b8-2c3c-46c3-ad36-671c284167ea+19:6515:x1874670585149824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787826336.919345:0:34492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826336.919360:0:34492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90ce01f17200/0x22153cd396b7f6f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x22153cd396b7f6ef expref: -99 pid: 34492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826336.919382:0:34492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ce01f17200/0x22153cd396b7f6f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22153cd396b7f6ef expref: 20 pid: 34492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826336.919395:0:34492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90ce01f17200/0x22153cd396b7f6f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22153cd396b7f6ef expref: 20 pid: 34492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826336.919404:0:34492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01f17200, rc 0) 00000100:00100000:1.0:1787826336.919442:0:34492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03b37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e3c550b8-2c3c-46c3-ad36-671c284167ea+20:6515:x1874670585149824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826336.919447:0:34492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787826336.919594:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aaf3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585149824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787826336.919605:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff90ce02426800/0x22153cd396b7f6ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x22153cd396b7f6f6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826336.919612:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff90ce02426800/0x22153cd396b7f6ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x22153cd396b7f6f6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826336.919667:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aaf3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585149952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787826336.919687:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826336.919701:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf09edc240 going to sleep for 11 seconds 00000100:00100000:2.0:1787826336.919714:0:34485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585149952 00000100:00100000:2.0:1787826336.919717:0:34485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585149952 00000100:00100000:2.0:1787826336.919752:0:34485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787826336.919759:0:34485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03b36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3c550b8-2c3c-46c3-ad36-671c284167ea+20:6515:x1874670585149952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787826336.920081:0:34485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03b36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3c550b8-2c3c-46c3-ad36-671c284167ea+20:6515:x1874670585149952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 321us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826336.920088:0:34485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787826336.920140:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aaf3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585149952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787826336.920176:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab903c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585150080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787826336.920228:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826336.920286:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f568300 going to sleep for 11 seconds 00000100:00100000:2.0:1787826336.920325:0:34492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585150080 00000100:00100000:2.0:1787826336.920330:0:34492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585150080 00000100:00100000:2.0:1787826336.920396:0:34492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787826336.920405:0:34492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03b34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e3c550b8-2c3c-46c3-ad36-671c284167ea+20:6515:x1874670585150080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787826336.921451:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826336.921532:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826336.922008:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563643264 00000100:00100000:2.0:1787826336.922022:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563643264 00000100:00100000:2.0:1787826336.922100:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1468 00000100:00100000:2.0:1787826336.922111:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf2f45f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:2403:x1874670563643264:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1787826336.922169:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826336.922205:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf2f45f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:2403:x1874670563643264:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 94us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826336.922215:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1468 00000100:00080000:2.0:1787826336.922256:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787826336.928531:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826336.928689:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826336.928752:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563643520 00000100:00100000:0.0:1787826336.928762:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563643520 00000100:00100000:0.0:1787826336.928827:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563643392 00000100:00100000:0.0:1787826336.928831:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563643392 00000100:00100000:0.0:1787826336.928861:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 860 00000100:00100000:0.0:1787826336.928873:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf2f45e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670563643520:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1787826336.928941:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf2f45e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670563643520:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 71us (7409us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826336.928948:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 860 00000100:00100000:0.0:1787826336.928965:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 861 00000100:00100000:0.0:1787826336.928971:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf2f45ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670563643392:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1787826336.928993:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf2f45ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670563643392:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 23us (6829us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826336.928999:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 861 00000100:00080000:0.0:1787826336.929018:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787826336.929022:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826336.929170:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563643136 00000100:00100000:3.0:1787826336.929176:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563643136 00000100:00100000:3.0:1787826336.929404:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3298 00000100:00100000:3.0:1787826336.929412:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2400:x1874670563643136:12345-192.168.203.39@tcp:38:kworker.0 00010000:00080000:3.0:1787826336.929436:0:6519:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID '09ed01c7-7b8c-4e06-9d82-a6b70e42014a' at ffff90ce0480f000, cookie 0x22153cd396b7f5c2 00010000:00080000:3.0:1787826336.929444:0:6519:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp recovering/t4294969202 exp ffff90ce0480f000 cur 1282 last 1787826335 00010000:02000400:3.0:1787826336.929454:0:6519:0:(ldlm_lib.c:2062:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00000100:00100000:0.0:1787826336.929808:0:34485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563643648 00000100:00100000:0.0:1787826336.929814:0:34485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563643648 00000100:00100000:0.0:1787826336.929836:0:34485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 53 00000100:00100000:0.0:1787826336.929841:0:34485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03b37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2400:x1874670563643648:12345-192.168.203.39@tcp:250:kworker.0 00010000:00080000:0.0:1787826336.929857:0:34485:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 307626ff-a376-4faf-93e0-9f55b723d964@192.168.203.39@tcp t0 exp 0000000000000000 cur 1282 last 0 00000020:00000080:0.0:1787826336.929887:0:34485:0:(genops.c:1385:class_connect()) connect: client 307626ff-a376-4faf-93e0-9f55b723d964, cookie 0x22153cd396b7f6fd 00000100:00080000:0.0:1787826336.930021:0:34485:0:(import.c:65:import_set_state_nolock()) ffff90ce037f6000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787826336.930845:0:34492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03b34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e3c550b8-2c3c-46c3-ad36-671c284167ea+20:6515:x1874670585150080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 10433us (10607us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826336.930861:0:34492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787826336.931175:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab903c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585150080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787826336.932758:0:34485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03b37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:307626ff-a376-4faf-93e0-9f55b723d964+5:2400:x1874670563643648:12345-192.168.203.39@tcp:250:kworker.0 Request processed in 2902us (4056us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826336.932771:0:34485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 53 00000040:00080000:0.0:1787826336.934186:0:34578:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:1.0:1787826336.934289:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:1.0:1787826336.934343:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1787826336.934358:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff90ce02426800/0x22153cd396b7f6ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x22153cd396b7f6f6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826336.934373:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff90ce02426800/0x22153cd396b7f6ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x22153cd396b7f6f6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826336.934391:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:1.0:1787826336.934394:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff90cf39eb6800 from 1 10000000:01000000:1.0:1787826336.934397:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787826336.934447:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff90ce01f16200/0x22153cd396b7f704 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826336.934455:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff90ce01f16200/0x22153cd396b7f704 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826336.934467:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff90ce01f16200/0x22153cd396b7f704 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826336.934525:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab93840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585150208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787826336.934605:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826336.934652:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f568000 going to sleep for 11 seconds 00000100:00100000:0.0:1787826336.937139:0:34487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585150208 00000100:00100000:0.0:1787826336.937154:0:34487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585150208 00000100:00100000:0.0:1787826336.937282:0:34487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787826336.937294:0:34487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03b37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3c550b8-2c3c-46c3-ad36-671c284167ea+20:6515:x1874670585150208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826336.937312:0:34487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826336.937330:0:34487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90ce0a70ec00/0x22153cd396b7f70b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x22153cd396b7f704 expref: -99 pid: 34487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826336.937362:0:34487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ce0a70ec00/0x22153cd396b7f70b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22153cd396b7f704 expref: 21 pid: 34487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826336.937374:0:34487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90ce0a70ec00/0x22153cd396b7f70b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22153cd396b7f704 expref: 21 pid: 34487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826336.937388:0:34487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0a70ec00, rc 0) 00000100:00100000:0.0:1787826336.937469:0:34487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03b37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3c550b8-2c3c-46c3-ad36-671c284167ea+21:6515:x1874670585150208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (2863us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826336.937499:0:34487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787826336.937879:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab93840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585150208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787826336.938032:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff90ce01f16200/0x22153cd396b7f704 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22153cd396b7f70b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826336.938048:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff90ce01f16200/0x22153cd396b7f704 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x22153cd396b7f70b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826336.938073:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787826336.938079:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff90ce01f16200/0x22153cd396b7f704 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22153cd396b7f70b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826336.938088:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff90ce01f16200/0x22153cd396b7f704 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22153cd396b7f70b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826336.938104:0:6515:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1787826336.938107:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff90cf11698000 from 1 10000000:01000000:1.0:1787826336.938111:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1787826336.938151:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff90ce01f16400/0x22153cd396b7f712 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826336.938160:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff90ce01f16400/0x22153cd396b7f712 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826336.938169:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff90ce01f16400/0x22153cd396b7f712 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826336.938206:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab93840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585150336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787826336.938270:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826336.938319:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f568000 going to sleep for 11 seconds 00000100:00100000:0.0:1787826336.938418:0:34492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585150336 00000100:00100000:0.0:1787826336.938426:0:34492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585150336 00000100:00100000:0.0:1787826336.938498:0:34492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787826336.938507:0:34492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03b34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e3c550b8-2c3c-46c3-ad36-671c284167ea+21:6515:x1874670585150336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826336.938516:0:34492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826336.938530:0:34492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90ce0a70e400/0x22153cd396b7f719 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x22153cd396b7f712 expref: -99 pid: 34492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826336.938561:0:34492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ce0a70e400/0x22153cd396b7f719 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22153cd396b7f712 expref: 22 pid: 34492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826336.938571:0:34492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90ce0a70e400/0x22153cd396b7f719 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22153cd396b7f712 expref: 22 pid: 34492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826336.938578:0:34492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0a70e400, rc 0) 00000100:00100000:0.0:1787826336.938623:0:34492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03b34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e3c550b8-2c3c-46c3-ad36-671c284167ea+22:6515:x1874670585150336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826336.938630:0:34492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787826336.938919:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab93840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585150336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787826336.938938:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff90ce01f16400/0x22153cd396b7f712 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22153cd396b7f719 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826336.938947:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff90ce01f16400/0x22153cd396b7f712 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x22153cd396b7f719 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826336.938965:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1787826336.938970:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff90ce01f16400/0x22153cd396b7f712 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22153cd396b7f719 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826336.938976:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff90ce01f16400/0x22153cd396b7f712 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22153cd396b7f719 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826336.938990:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787826336.938992:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90cf39eb6800 from 7 10000000:01000000:1.0:1787826336.938995:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787826336.939018:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff90ce01f16000/0x22153cd396b7f720 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826336.939026:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff90ce01f16000/0x22153cd396b7f720 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826336.939035:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff90ce01f16000/0x22153cd396b7f720 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826336.939055:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab93840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585150464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787826336.939090:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826336.939127:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f568000 going to sleep for 11 seconds 00010000:00080000:3.0:1787826336.940934:0:6519:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:3.0:1787826336.940962:0:6519:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1787826336.941185:0:34487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585150464 00000100:00100000:0.0:1787826336.941204:0:34487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585150464 00000100:00100000:0.0:1787826336.941259:0:34487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787826336.941269:0:34487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03b35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3c550b8-2c3c-46c3-ad36-671c284167ea+22:6515:x1874670585150464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826336.941283:0:34487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826336.941311:0:34487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90ce0a70e000/0x22153cd396b7f727 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x22153cd396b7f720 expref: -99 pid: 34487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826336.941338:0:34487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ce0a70e000/0x22153cd396b7f727 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22153cd396b7f720 expref: 23 pid: 34487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826336.941348:0:34487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90ce0a70e000/0x22153cd396b7f727 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22153cd396b7f720 expref: 23 pid: 34487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826336.941357:0:34487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0a70e000, rc 0) 00000100:00100000:0.0:1787826336.942009:0:34487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03b35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3c550b8-2c3c-46c3-ad36-671c284167ea+23:6515:x1874670585150464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 740us (2916us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826336.942017:0:34487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1787826336.944886:0:6519:0:(import.c:65:import_set_state_nolock()) ffff90ce07439000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787826336.944981:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+6:2400:x1874670563643136:12345-192.168.203.39@tcp:38:kworker.0 Request processed in 15568us (16459us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826336.944992:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3298 00000100:00100000:1.0:1787826336.945010:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab93840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585150464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787826336.945032:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff90ce01f16000/0x22153cd396b7f720 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22153cd396b7f727 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826336.945043:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff90ce01f16000/0x22153cd396b7f720 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x22153cd396b7f727 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826336.945117:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab93840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585150592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787826336.945165:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826336.945716:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f568000 going to sleep for 11 seconds 00000100:00100000:0.0:1787826336.946843:0:34492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585150592 00000100:00100000:0.0:1787826336.946851:0:34492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585150592 00000100:00100000:1.0:1787826336.946920:0:34485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787826336.946932:0:34485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03b35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3c550b8-2c3c-46c3-ad36-671c284167ea+23:6515:x1874670585150592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787826336.947085:0:34485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03b35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3c550b8-2c3c-46c3-ad36-671c284167ea+23:6515:x1874670585150592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 156us (1918us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826336.947093:0:34485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787826336.949921:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab93840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585150592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787826336.949987:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab93840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585150720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787826336.950062:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826336.950109:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f568000 going to sleep for 11 seconds 00000100:00100000:2.0:1787826336.950236:0:34488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585150720 00000100:00100000:2.0:1787826336.950243:0:34488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585150720 00000100:00100000:2.0:1787826336.950333:0:34488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787826336.950343:0:34488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce086dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3c550b8-2c3c-46c3-ad36-671c284167ea+23:6515:x1874670585150720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787826336.950722:0:34488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce086dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3c550b8-2c3c-46c3-ad36-671c284167ea+23:6515:x1874670585150720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 380us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826336.950742:0:34488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787826336.950846:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab93840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585150720:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787826336.952133:0:34579:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787826336.952221:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787826336.952244:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787826336.952256:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff90ce01f16000/0x22153cd396b7f720 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22153cd396b7f727 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826336.952267:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff90ce01f16000/0x22153cd396b7f720 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22153cd396b7f727 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787826336.952277:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787826336.952280:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff90cf11698000 from 1 10000000:01000000:1.0:1787826336.952283:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787826336.952319:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff90ce01f17800/0x22153cd396b7f72e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826336.952328:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff90ce01f17800/0x22153cd396b7f72e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826336.952338:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff90ce01f17800/0x22153cd396b7f72e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826336.952359:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab93840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585150848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787826336.952547:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826336.956412:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826336.958702:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f568f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826336.958775:0:34487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585150848 00000100:00100000:0.0:1787826336.958786:0:34487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585150848 00000100:00100000:0.0:1787826336.958921:0:34487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787826336.958932:0:34487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce086dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3c550b8-2c3c-46c3-ad36-671c284167ea+23:6515:x1874670585150848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826336.958948:0:34487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826336.958965:0:34487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90ce0a70e200/0x22153cd396b7f735 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x22153cd396b7f72e expref: -99 pid: 34487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826336.958993:0:34487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ce0a70e200/0x22153cd396b7f735 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22153cd396b7f72e expref: 24 pid: 34487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826336.959081:0:34487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90ce0a70e200/0x22153cd396b7f735 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22153cd396b7f72e expref: 24 pid: 34487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826336.959090:0:34487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0a70e200, rc 0) 00000100:00100000:0.0:1787826336.959153:0:34487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce086dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3c550b8-2c3c-46c3-ad36-671c284167ea+24:6515:x1874670585150848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 224us (6606us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826336.959160:0:34487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787826336.959227:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab93840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585150848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826336.959245:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff90ce01f17800/0x22153cd396b7f72e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x22153cd396b7f735 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826336.959266:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff90ce01f17800/0x22153cd396b7f72e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x22153cd396b7f735 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826336.959334:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563573504 00000100:00100000:2.0:1787826336.959340:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563573504 00000100:00100000:2.0:1787826336.959377:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3299 00000100:00100000:0.0:1787826336.959756:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03aec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585150976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787826336.959793:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826336.959892:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce02700e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787826336.959909:0:34487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585150976 00000100:00100000:0.0:1787826336.959914:0:34487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585150976 00000100:00100000:0.0:1787826336.959940:0:34487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787826336.959946:0:34487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce086df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3c550b8-2c3c-46c3-ad36-671c284167ea+24:6515:x1874670585150976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787826336.960008:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f876d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+6:2400:x1874670563573504:12345-192.168.203.39@tcp:101:lfs.0 00010000:00080000:2.0:1787826336.960022:0:32404:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 4294969326, current: 4294969202, replaying 00010000:00010000:2.0:1787826336.960029:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826336.960050:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7f73c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aafd82 expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826336.960094:0:34487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce086df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3c550b8-2c3c-46c3-ad36-671c284167ea+24:6515:x1874670585150976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 145us (298us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787826336.960103:0:34487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787826336.960147:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03aec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3c550b8-2c3c-46c3-ad36-671c284167ea:6515:1874670585150976:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1787826336.960177:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787826336.960184:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff90ce01f17800/0x22153cd396b7f72e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x22153cd396b7f735 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826336.960192:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff90ce01f17800/0x22153cd396b7f72e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x22153cd396b7f735 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787826336.963336:0:32404:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3240us 00000004:00200000:0.0:1787826336.999405:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x3:0x0]: returning size 4096 00000004:00080000:0.0:1787826336.999628:0:32404:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x200000405:0x3:0x0], cookie = 0x22153cd396b7e8e1 00000004:00080000:0.0:1787826336.999631:0:32404:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0x22153cd396b7e8e1 in new mfd 00010000:00010000:0.0:1787826336.999779:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7f73c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafd82 expref: 8 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826336.999798:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cf1859a700) 00010000:00010000:0.0:1787826336.999801:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787826336.999806:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7f73c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafd82 expref: 8 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826336.999826:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce02426200, rc 0) 00000100:00100000:0.0:1787826336.999890:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f876d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2400:x1874670563573504:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 40505us (43486us total) trans 4294969202 rc 301/301 00000100:00100000:0.0:1787826336.999971:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3299 00000100:00100000:0.0:1787826337.033240:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826337.037310:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563579648 00000100:00100000:3.0:1787826337.037324:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563579648 00000100:00100000:3.0:1787826337.037387:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3300 00000100:00100000:3.0:1787826337.037398:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03aec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2400:x1874670563579648:12345-192.168.203.39@tcp:101:lfs.0 00010000:00080000:3.0:1787826337.037418:0:6518:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 4294969326, current: 4294969210, replaying 00010000:00010000:3.0:1787826337.037439:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826337.037465:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7a00/0x22153cd396b7f74a lrc: 2/0,0 mode: --/CR res: [0x200000405:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aafdeb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826337.042208:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x7:0x0]: returning size 4096 00000004:00080000:1.0:1787826337.042239:0:6518:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x200000405:0x7:0x0], cookie = 0x22153cd396b7ea9a 00000004:00080000:1.0:1787826337.042242:0:6518:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0x22153cd396b7ea9a in new mfd 00010000:00010000:1.0:1787826337.042344:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7a00/0x22153cd396b7f74a lrc: 1/0,0 mode: --/CR res: [0x200000405:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafdeb expref: 9 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826337.042360:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x7:0x0].0x0 (ffff90cf11e81c00) 00010000:00010000:1.0:1787826337.042363:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787826337.042368:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7a00/0x22153cd396b7f74a lrc: 0/0,0 mode: --/CR res: [0x200000405:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafdeb expref: 9 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826337.042397:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3abd7a00, rc 0) 00000100:00100000:1.0:1787826337.042500:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03aec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2400:x1874670563579648:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 5102us (9267us total) trans 4294969210 rc 301/301 00000100:00100000:1.0:1787826337.042509:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3300 00000100:00100000:0.0:1787826337.051654:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826337.051967:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563588224 00000100:00100000:1.0:1787826337.051978:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563588224 00000100:00100000:1.0:1787826337.052035:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3301 00000100:00100000:1.0:1787826337.052046:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03aef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2400:x1874670563588224:12345-192.168.203.39@tcp:101:lfs.0 00010000:00080000:1.0:1787826337.052077:0:16564:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 4294969326, current: 4294969231, replaying 00010000:00010000:1.0:1787826337.052087:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826337.052110:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f16e00/0x22153cd396b7f758 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aafe70 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826337.053853:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x8:0x0]: returning size 4096 00000004:00080000:1.0:1787826337.053879:0:16564:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x200000405:0x8:0x0], cookie = 0x22153cd396b7ec45 00000004:00080000:1.0:1787826337.053882:0:16564:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0x22153cd396b7ec45 in new mfd 00010000:00010000:1.0:1787826337.053972:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f16e00/0x22153cd396b7f758 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafe70 expref: 10 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826337.053990:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x8:0x0].0x0 (ffff90cf06894300) 00010000:00010000:1.0:1787826337.053993:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787826337.053998:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce01f16e00/0x22153cd396b7f758 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafe70 expref: 10 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826337.054017:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01f16e00, rc 0) 00000100:00100000:1.0:1787826337.054097:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03aef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2400:x1874670563588224:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 2053us (2451us total) trans 4294969231 rc 301/301 00000100:00100000:1.0:1787826337.054107:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3301 00000100:00100000:2.0:1787826337.064335:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826337.064421:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563630720 00000100:00100000:3.0:1787826337.064439:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563630720 00000100:00100000:2.0:1787826337.064565:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3302 00000100:00100000:2.0:1787826337.064704:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aaf3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2400:x1874670563630720:12345-192.168.203.39@tcp:101:filefrag.0 00010000:00080000:2.0:1787826337.064735:0:6520:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 4294969326, current: 4294969306, replaying 00010000:00010000:2.0:1787826337.064745:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826337.064769:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426600/0x22153cd396b7f766 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab00d8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826337.064953:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0xc:0x0]: returning size 1048576 00000004:00080000:2.0:1787826337.064976:0:6520:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x200000405:0xc:0x0], cookie = 0x22153cd396b7f3b5 00000004:00080000:2.0:1787826337.064979:0:6520:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0x22153cd396b7f3b5 in new mfd 00010000:00010000:2.0:1787826337.065074:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426600/0x22153cd396b7f766 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab00d8 expref: 11 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826337.065090:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cf1859ac00) 00010000:00010000:2.0:1787826337.065093:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787826337.065098:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426600/0x22153cd396b7f766 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab00d8 expref: 11 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826337.066723:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce02426600, rc 0) 00000100:00100000:2.0:1787826337.066810:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aaf3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2400:x1874670563630720:12345-192.168.203.39@tcp:101:filefrag.0 Request processed in 2230us (2480us total) trans 4294969306 rc 301/301 00000100:00100000:2.0:1787826337.066820:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3302 00000100:00100000:3.0:1787826337.089309:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826337.089351:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826337.089385:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826337.089417:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826337.093240:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563643776 00000100:00100000:0.0:1787826337.093256:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563643776 00000100:00100000:0.0:1787826337.093320:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563643904 00000100:00100000:0.0:1787826337.093324:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563643904 00000100:00100000:0.0:1787826337.093343:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563644032 00000100:00100000:0.0:1787826337.093347:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563644032 00000100:00100000:0.0:1787826337.093375:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3303 00000100:00100000:0.0:1787826337.093527:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f874780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2400:x1874670563643776:12345-192.168.203.39@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1787826337.093635:0:32404:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff90cf3f874780 x1874670563643776/t0(0) o101->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:693/0 lens 328/0 e 0 to 0 dl 1787826348 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826337.093661:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f874780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2400:x1874670563643776:12345-192.168.203.39@tcp:101:ldlm_lock_repla.0 Request processed in 139us (4365us total) trans 0 rc 0/-999 00000100:00100000:0.0:1787826337.093669:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3303 00000100:00100000:0.0:1787826337.093682:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3304 00000100:00100000:0.0:1787826337.093690:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2400:x1874670563643904:12345-192.168.203.39@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1787826337.093698:0:32404:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff90cf3ab17480 x1874670563643904/t0(0) o101->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:693/0 lens 328/0 e 0 to 0 dl 1787826348 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826337.093706:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2400:x1874670563643904:12345-192.168.203.39@tcp:101:ldlm_lock_repla.0 Request processed in 19us (4356us total) trans 0 rc 0/-999 00000100:00100000:0.0:1787826337.093712:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3304 00000100:00100000:0.0:1787826337.093719:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3305 00000100:00100000:0.0:1787826337.093724:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2400:x1874670563644032:12345-192.168.203.39@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1787826337.093743:0:32404:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff90cf3ab14000 x1874670563644032/t0(0) o101->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:693/0 lens 328/0 e 0 to 0 dl 1787826348 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826337.093752:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2400:x1874670563644032:12345-192.168.203.39@tcp:101:ldlm_lock_repla.0 Request processed in 29us (4368us total) trans 0 rc 0/-999 00000100:00100000:0.0:1787826337.093757:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3305 00010000:00080000:0.0:1787826337.094631:0:34515:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:3.0:1787826337.101890:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826337.101899:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563644160 00000100:00100000:0.0:1787826337.101912:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563644160 00000100:00100000:3.0:1787826337.101936:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563644288 00000100:00100000:3.0:1787826337.101946:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563644288 00000100:00100000:0.0:1787826337.101975:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3306 00000100:00100000:0.0:1787826337.101989:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2400:x1874670563644160:12345-192.168.203.39@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1787826337.102013:0:6519:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff90cf3ab143c0 x1874670563644160/t0(0) o101->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:693/0 lens 328/0 e 0 to 0 dl 1787826348 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826337.102029:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3307 00000100:00100000:0.0:1787826337.102037:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2400:x1874670563644160:12345-192.168.203.39@tcp:101:ldlm_lock_repla.0 Request processed in 51us (12618us total) trans 0 rc 0/-999 00000100:00100000:3.0:1787826337.102047:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab15e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2400:x1874670563644288:12345-192.168.203.39@tcp:101:ldlm_lock_repla.0 00010000:00080000:3.0:1787826337.102069:0:32404:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff90cf3ab15e00 x1874670563644288/t0(0) o101->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:693/0 lens 328/0 e 0 to 0 dl 1787826348 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826337.102083:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab15e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2400:x1874670563644288:12345-192.168.203.39@tcp:101:ldlm_lock_repla.0 Request processed in 45us (210us total) trans 0 rc 0/-999 00000100:00100000:0.0:1787826337.102110:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3306 00010000:00080000:0.0:1787826337.102132:0:34515:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:3.0:1787826337.102657:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3307 00000100:00100000:3.0:1787826337.102740:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826337.102787:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563644416 00000100:00100000:0.0:1787826337.103044:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563644416 00000100:00100000:0.0:1787826337.103174:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3308 00000100:00100000:0.0:1787826337.103183:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab17c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2400:x1874670563644416:12345-192.168.203.39@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1787826337.103197:0:6518:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff90cf3ab17c00 x1874670563644416/t0(0) o101->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:693/0 lens 328/0 e 0 to 0 dl 1787826348 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787826337.103216:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab17c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2400:x1874670563644416:12345-192.168.203.39@tcp:101:ldlm_lock_repla.0 Request processed in 35us (477us total) trans 0 rc 0/-999 00000100:00100000:0.0:1787826337.103222:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3308 00010000:00080000:0.0:1787826337.103238:0:34515:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00010000:0.0:1787826337.107506:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826338.115750:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826338.640561:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826338.641929:0:34488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563644544 00000100:00100000:2.0:1787826338.641941:0:34488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563644544 00000100:00100000:2.0:1787826338.642007:0:34488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 61 00000100:00100000:2.0:1787826338.642017:0:34488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce086df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:307626ff-a376-4faf-93e0-9f55b723d964+5:42223:x1874670563644544:12345-192.168.203.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787826338.642032:0:34488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826338.642050:0:34488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90ce02426400/0x22153cd396b7f774 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab014f expref: -99 pid: 34488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826338.642250:0:34488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ce02426400/0x22153cd396b7f774 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab014f expref: 6 pid: 34488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826338.642262:0:34488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90ce02426400/0x22153cd396b7f774 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab014f expref: 6 pid: 34488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826338.642271:0:34488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce02426400, rc 0) 00000100:00100000:2.0:1787826338.642335:0:34488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce086df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:307626ff-a376-4faf-93e0-9f55b723d964+6:42223:x1874670563644544:12345-192.168.203.39@tcp:101:ll_cfg_requeue.0 Request processed in 319us (1783us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826338.642342:0:34488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 61 00000100:00100000:0.0:1787826338.649455:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826338.652584:0:34485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563644672 00000100:00100000:1.0:1787826338.652598:0:34485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563644672 00000100:00100000:1.0:1787826338.652704:0:34485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 62 00000100:00100000:1.0:1787826338.652724:0:34485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce086dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:307626ff-a376-4faf-93e0-9f55b723d964+6:42223:x1874670563644672:12345-192.168.203.39@tcp:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787826338.652749:0:34485:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:1.0:1787826338.652766:0:34485:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787826338.652769:0:34485:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:1.0:1787826338.652771:0:34485:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:1.0:1787826338.652774:0:34485:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:1.0:1787826338.652775:0:34485:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 17 00000100:00100000:0.0:1787826338.656541:0:34485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce086dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:307626ff-a376-4faf-93e0-9f55b723d964+6:42223:x1874670563644672:12345-192.168.203.39@tcp:256:ll_cfg_requeue.0 Request processed in 3818us (7084us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826338.656555:0:34485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 62 00000100:00100000:0.0:1787826338.665516:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826338.666153:0:34487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563644800 00000100:00100000:1.0:1787826338.666163:0:34487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563644800 00000100:00100000:1.0:1787826338.666251:0:34487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 63 00000100:00100000:1.0:1787826338.666262:0:34487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce086dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:307626ff-a376-4faf-93e0-9f55b723d964+6:42223:x1874670563644800:12345-192.168.203.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787826338.666279:0:34487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826338.666296:0:34487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90ce01f17c00/0x22153cd396b7f77b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0156 expref: -99 pid: 34487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826338.666324:0:34487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ce01f17c00/0x22153cd396b7f77b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0156 expref: 7 pid: 34487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826338.666335:0:34487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90ce01f17c00/0x22153cd396b7f77b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0156 expref: 7 pid: 34487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826338.666345:0:34487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01f17c00, rc 0) 00000100:00100000:1.0:1787826338.666403:0:34487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce086dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:307626ff-a376-4faf-93e0-9f55b723d964+7:42223:x1874670563644800:12345-192.168.203.39@tcp:101:ll_cfg_requeue.0 Request processed in 143us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826338.666410:0:34487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 63 00000100:00100000:3.0:1787826338.671995:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826338.672172:0:34492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563644928 00000100:00100000:2.0:1787826338.672182:0:34492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563644928 00000100:00100000:2.0:1787826338.672237:0:34492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 64 00000100:00100000:2.0:1787826338.672247:0:34492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce030a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:307626ff-a376-4faf-93e0-9f55b723d964+7:42223:x1874670563644928:12345-192.168.203.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787826338.672394:0:34492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce030a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:307626ff-a376-4faf-93e0-9f55b723d964+8:42223:x1874670563644928:12345-192.168.203.39@tcp:501:ll_cfg_requeue.0 Request processed in 147us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826338.672402:0:34492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 64 00000100:00100000:1.0:1787826338.680657:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826338.680740:0:34488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563645056 00000100:00100000:2.0:1787826338.680750:0:34488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563645056 00000100:00100000:2.0:1787826338.680807:0:34488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 65 00000100:00100000:2.0:1787826338.680817:0:34488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce030a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:307626ff-a376-4faf-93e0-9f55b723d964+8:42223:x1874670563645056:12345-192.168.203.39@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787826338.680957:0:34488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce030a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:307626ff-a376-4faf-93e0-9f55b723d964+8:42223:x1874670563645056:12345-192.168.203.39@tcp:503:ll_cfg_requeue.0 Request processed in 140us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826338.680965:0:34488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 65 00000100:00100000:3.0:1787826338.696791:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826338.697329:0:34485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563645184 00000100:00100000:1.0:1787826338.697338:0:34485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563645184 00000100:00100000:1.0:1787826338.697392:0:34485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 66 00000100:00100000:1.0:1787826338.697401:0:34485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce030aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:307626ff-a376-4faf-93e0-9f55b723d964+8:42223:x1874670563645184:12345-192.168.203.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787826338.697417:0:34485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826338.697435:0:34485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90ce01f16e00/0x22153cd396b7f782 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab015d expref: -99 pid: 34485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826338.697462:0:34485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ce01f16e00/0x22153cd396b7f782 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab015d expref: 9 pid: 34485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826338.697512:0:34485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90ce01f16e00/0x22153cd396b7f782 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab015d expref: 9 pid: 34485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826338.697522:0:34485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce01f16e00, rc 0) 00000100:00100000:1.0:1787826338.697575:0:34485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce030aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:307626ff-a376-4faf-93e0-9f55b723d964+9:42223:x1874670563645184:12345-192.168.203.39@tcp:101:ll_cfg_requeue.0 Request processed in 176us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826338.697582:0:34485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 66 00000100:00100000:3.0:1787826338.699298:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826338.699378:0:34488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563645312 00000100:00100000:0.0:1787826338.699385:0:34488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563645312 00000100:00100000:0.0:1787826338.699433:0:34488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 67 00000100:00100000:0.0:1787826338.699442:0:34488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce030a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:307626ff-a376-4faf-93e0-9f55b723d964+9:42223:x1874670563645312:12345-192.168.203.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787826338.699581:0:34488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce030a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:307626ff-a376-4faf-93e0-9f55b723d964+9:42223:x1874670563645312:12345-192.168.203.39@tcp:501:ll_cfg_requeue.0 Request processed in 140us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826338.699588:0:34488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 67 00000100:00100000:3.0:1787826338.701553:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826338.701724:0:34485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563645440 00000100:00100000:0.0:1787826338.701732:0:34485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563645440 00000100:00100000:0.0:1787826338.701772:0:34485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 68 00000100:00100000:0.0:1787826338.701780:0:34485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce030aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:307626ff-a376-4faf-93e0-9f55b723d964+9:42223:x1874670563645440:12345-192.168.203.39@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787826338.702519:0:34485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce030aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:307626ff-a376-4faf-93e0-9f55b723d964+9:42223:x1874670563645440:12345-192.168.203.39@tcp:503:ll_cfg_requeue.0 Request processed in 113us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826338.702531:0:34485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 68 00000100:00100000:3.0:1787826338.712872:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826338.712967:0:34488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563645568 00000100:00100000:0.0:1787826338.712977:0:34488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563645568 00000100:00100000:0.0:1787826338.713031:0:34488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 69 00000100:00100000:0.0:1787826338.713039:0:34488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce030a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:307626ff-a376-4faf-93e0-9f55b723d964+9:42223:x1874670563645568:12345-192.168.203.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787826338.713055:0:34488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826338.713082:0:34488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90ce0a70ea00/0x22153cd396b7f789 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0164 expref: -99 pid: 34488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826338.713110:0:34488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90ce0a70ea00/0x22153cd396b7f789 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0164 expref: 10 pid: 34488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826338.713122:0:34488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90ce0a70ea00/0x22153cd396b7f789 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0164 expref: 10 pid: 34488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826338.713137:0:34488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0a70ea00, rc 0) 00000100:00100000:0.0:1787826338.713197:0:34488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce030a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:307626ff-a376-4faf-93e0-9f55b723d964+10:42223:x1874670563645568:12345-192.168.203.39@tcp:101:ll_cfg_requeue.0 Request processed in 158us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826338.713205:0:34488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 69 00000100:00100000:3.0:1787826338.719440:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826338.719566:0:34487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563645696 00000100:00100000:0.0:1787826338.719575:0:34487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563645696 00000100:00100000:0.0:1787826338.719620:0:34487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 70 00000100:00100000:0.0:1787826338.719629:0:34487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce030abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:307626ff-a376-4faf-93e0-9f55b723d964+10:42223:x1874670563645696:12345-192.168.203.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787826338.719738:0:34487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce030abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:307626ff-a376-4faf-93e0-9f55b723d964+10:42223:x1874670563645696:12345-192.168.203.39@tcp:501:ll_cfg_requeue.0 Request processed in 110us (306us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787826338.719746:0:34487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 70 00010000:00010000:0.0:1787826339.141202:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826340.167206:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787826340.631338:0:34767:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg339-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:0.0:1787826341.123728:0:33115:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787826341.123736:0:33115:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787826341.123739:0:33115:0:(import.c:65:import_set_state_nolock()) ffff90cf3720f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826341.123747:0:33115:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 1281 00000100:00080000:0.0:1787826341.123752:0:33115:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787826341.123759:0:33115:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff90cf3720f800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:0.0:1787826341.123782:0:33115:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90ce03aec3c0 x1874670585151232/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787826341.123800:0:33115:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787826341.123804:0:33115:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787826341.123806:0:33115:0:(import.c:65:import_set_state_nolock()) ffff90cf264ed800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826341.123809:0:33115:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 1281 00000100:00080000:0.0:1787826341.123811:0:33115:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787826341.123814:0:33115:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff90cf264ed800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:0.0:1787826341.123827:0:33115:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cf3f936580 x1874670585151360/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787826341.123858:0:33115:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787826341.123861:0:33115:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787826341.123862:0:33115:0:(import.c:65:import_set_state_nolock()) ffff90ce02455800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826341.123865:0:33115:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 1281 00000100:00080000:0.0:1787826341.123868:0:33115:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787826341.123887:0:33115:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff90ce02455800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:0.0:1787826341.123899:0:33115:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cf3f88f840 x1874670585151744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787826341.123920:0:33115:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787826341.123924:0:33115:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787826341.123925:0:33115:0:(import.c:65:import_set_state_nolock()) ffff90ce05f9d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826341.123928:0:33115:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 1281 00000100:00080000:0.0:1787826341.123930:0:33115:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787826341.123933:0:33115:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90ce05f9d000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:0.0:1787826341.123943:0:33115:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cf3f88da40 x1874670585152000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787826341.123972:0:33115:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787826341.123975:0:33115:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787826341.123977:0:33115:0:(import.c:65:import_set_state_nolock()) ffff90ce03230000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787826341.123981:0:33115:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff90ce03230000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:0.0:1787826341.123990:0:33115:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cf3f88f480 x1874670585152640/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826341.124020:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03aec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874670585151232:0@lo:38:kworker.0 00000100:00100000:0.0:1787826341.124087:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826341.124144:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f936580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874670585151360:0@lo:38:kworker.0 00000100:00100000:0.0:1787826341.124169:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826341.124196:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f88f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1874670585151744:0@lo:38:kworker.0 00000100:00100000:0.0:1787826341.124220:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826341.124235:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f88da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1874670585152000:0@lo:38:kworker.0 00000100:00100000:0.0:1787826341.124255:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826341.124270:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f88f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874670585152640:0@lo:38:kworker.0 00000100:00100000:0.0:1787826341.124320:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826341.124356:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f88c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585151488:0@lo:400:kworker.0 00000100:00100000:0.0:1787826341.124380:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826341.124403:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f88c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585152256:0@lo:400:kworker.0 00000100:00100000:0.0:1787826341.124422:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826341.124442:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787826341.124447:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f88ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585151616:0@lo:400:kworker.0 00000100:00100000:0.0:1787826341.124467:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826341.124517:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f88e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585152384:0@lo:400:kworker.0 00000100:00100000:0.0:1787826341.124541:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826341.124574:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585151360 00000100:00100000:0.0:1787826341.124580:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585151360 00000100:00100000:0.0:1787826341.124608:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585151744 00000100:00100000:0.0:1787826341.124611:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585151744 00000100:00100000:0.0:1787826341.124622:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585152000 00000100:00100000:0.0:1787826341.124624:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585152000 00000100:00100000:0.0:1787826341.124633:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585152640 00000100:00100000:0.0:1787826341.124635:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585152640 00000100:00100000:0.0:1787826341.124647:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3309 00000100:00100000:0.0:1787826341.124654:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f88fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1874670585151360:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1787826341.124683:0:6519:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 1287 last 0 00000020:00000080:0.0:1787826341.124731:0:6519:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x22153cd396b7f790 00000004:00100000:0.0:1787826341.124748:0:6519:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787826341.124884:0:6519:0:(import.c:65:import_set_state_nolock()) ffff90cf3f6b3000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787826341.124931:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f88fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874670585151360:12345-0@lo:38:kworker.0 Request processed in 276us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826341.124940:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3309 00000100:00100000:0.0:1787826341.124961:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3310 00000100:00100000:0.0:1787826341.124966:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1874670585151744:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1787826341.124977:0:6519:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 1287 last 0 00000020:00000080:0.0:1787826341.125000:0:6519:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x22153cd396b7f797 00000004:00100000:0.0:1787826341.125006:0:6519:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787826341.125022:0:6519:0:(import.c:65:import_set_state_nolock()) ffff90cf3f495800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787826341.125049:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874670585151744:12345-0@lo:38:kworker.0 Request processed in 82us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826341.125055:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3310 00000100:00100000:0.0:1787826341.125067:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3311 00000100:00100000:0.0:1787826341.125071:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1874670585152000:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1787826341.125082:0:6519:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 1287 last 0 00000020:00000080:0.0:1787826341.125103:0:6519:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x22153cd396b7f79e 00000004:00100000:0.0:1787826341.125109:0:6519:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787826341.125125:0:6519:0:(import.c:65:import_set_state_nolock()) ffff90cf39ec7000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787826341.125151:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874670585152000:12345-0@lo:38:kworker.0 Request processed in 78us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826341.125156:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3311 00000100:00100000:0.0:1787826341.125168:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3312 00000100:00100000:0.0:1787826341.125172:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1874670585152640:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1787826341.125184:0:6519:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 1287 last 0 00000020:00000080:0.0:1787826341.125207:0:6519:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x22153cd396b7f7a5 00000004:00100000:0.0:1787826341.125213:0:6519:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787826341.125226:0:6519:0:(import.c:65:import_set_state_nolock()) ffff90cf39ec4000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787826341.125254:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874670585152640:12345-0@lo:38:kworker.0 Request processed in 80us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826341.125260:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3312 00000100:00100000:0.0:1787826341.125296:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585151488 00000100:00100000:0.0:1787826341.125300:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585151488 00000100:00100000:0.0:1787826341.125332:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585151616 00000100:00100000:0.0:1787826341.125335:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585151616 00000100:00100000:0.0:1787826341.125354:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585152384 00000100:00100000:0.0:1787826341.125356:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585152384 00000100:00100000:0.0:1787826341.125375:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 862 00000100:00100000:0.0:1787826341.125382:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874670585151488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826341.125420:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874670585151488:12345-0@lo:400:kworker.0 Request processed in 39us (1039us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826341.125426:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 862 00000100:00100000:0.0:1787826341.125439:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 863 00000100:00100000:0.0:1787826341.125445:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874670585151616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826341.125502:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874670585151616:12345-0@lo:400:kworker.0 Request processed in 57us (1033us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826341.125508:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 863 00000100:00100000:0.0:1787826341.125520:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 864 00000100:00100000:0.0:1787826341.125526:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1874670585152384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826341.125553:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1874670585152384:12345-0@lo:400:kworker.0 Request processed in 28us (1011us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826341.125559:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 864 00000100:00100000:0.0:1787826341.125580:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585151232 00000100:00100000:0.0:1787826341.125583:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585151232 00000100:00100000:0.0:1787826341.125603:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585152256 00000100:00100000:0.0:1787826341.125606:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585152256 00000100:00100000:0.0:1787826341.125620:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1319 00000100:00100000:0.0:1787826341.125624:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f88d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1874670585151232:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1787826341.125638:0:6523:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff90ce0480f800, cookie 0x22153cd396b7f5bb 00010000:00080000:0.0:1787826341.125643:0:6523:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff90ce0480f800 cur 1287 last 1787826335 00000004:00100000:0.0:1787826341.125653:0:6523:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787826341.125669:0:6523:0:(import.c:65:import_set_state_nolock()) ffff90ce03211000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787826341.125719:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f88d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1874670585151232:12345-0@lo:38:kworker.0 Request processed in 93us (1631us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826341.125725:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1319 00000100:00100000:0.0:1787826341.125738:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1320 00000100:00100000:0.0:1787826341.125745:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:3644:x1874670585152256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826341.125779:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:3644:x1874670585152256:12345-0@lo:400:kworker.0 Request processed in 34us (1355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826341.125784:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1320 00000100:00080000:0.0:1787826341.125815:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787826341.125819:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787826341.125837:0:34515:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:0.0:1787826341.125842:0:34515:0:(ldlm_lib.c:2709:replay_request_or_update()) Waiting for transno 4294969326 00000020:00080000:0.0:1787826341.125847:0:34515:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 4294969325 00010000:00080000:0.0:1787826341.125850:0:34515:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 4294969326 00010000:00080000:0.0:1787826341.125852:0:34515:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (4294969326) 00000020:00080000:0.0:1787826341.125856:0:34515:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 4294969325 00000020:00080000:0.0:1787826341.125867:0:34515:0:(update_records.c:53:update_records_dump()) master transno = 4294969325 batchid = 55 flags = 0 ops = 2 params = 4 00000020:00080000:0.0:1787826341.125871:0:34515:0:(update_records.c:72:update_records_dump()) update 0th [0x280000401:0xd4:0x0] xattr_set params_count = 3 00000020:00080000:0.0:1787826341.125874:0:34515:0:(update_records.c:87:update_records_dump()) param = ffff90ce0346d464 0th off = 0 size = 12 00000020:00080000:0.0:1787826341.125876:0:34515:0:(update_records.c:87:update_records_dump()) param = ffff90ce0346d47c 1th off = 1 size = 52 00000020:00080000:0.0:1787826341.125878:0:34515:0:(update_records.c:87:update_records_dump()) param = ffff90ce0346d4bc 2th off = 2 size = 4 00000020:00080000:0.0:1787826341.125879:0:34515:0:(update_records.c:72:update_records_dump()) update 1th [0x2c0000401:0xe0:0x0] xattr_set params_count = 3 00000020:00080000:0.0:1787826341.125881:0:34515:0:(update_records.c:87:update_records_dump()) param = ffff90ce0346d464 0th off = 0 size = 12 00000020:00080000:0.0:1787826341.125883:0:34515:0:(update_records.c:87:update_records_dump()) param = ffff90ce0346d4cc 1th off = 3 size = 52 00000020:00080000:0.0:1787826341.125885:0:34515:0:(update_records.c:87:update_records_dump()) param = ffff90ce0346d4bc 2th off = 2 size = 4 80000000:00020000:0.0:1787826341.125926:0:34515:0:(fld_handler.c:221:fld_local_lookup()) srv-lustre-MDT0000: FLD cache range [0x0000000280000400-0x00000002c0000400]:0:ost does not match requested flag 0: rc = -5 00000100:00100000:1.0:1787826341.127497:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03aef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e3c550b8-2c3c-46c3-ad36-671c284167ea:3647:1874670585151104:0@lo:400:kworker.0 00000100:00100000:1.0:1787826341.127577:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826341.127617:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f88e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1874670585152128:0@lo:400:kworker.0 00000100:00100000:1.0:1787826341.127644:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826341.127673:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787826341.127679:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f88cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874670585151872:0@lo:400:kworker.0 00000100:00100000:1.0:1787826341.127714:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826341.127735:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f88d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585152512:0@lo:400:kworker.0 00000100:00100000:1.0:1787826341.127764:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826341.127793:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585152512 00000100:00100000:1.0:1787826341.127799:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585152512 00000100:00100000:1.0:1787826341.127851:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 865 00000100:00100000:1.0:1787826341.127859:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1874670585152512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826341.127921:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1874670585152512:12345-0@lo:400:kworker.0 Request processed in 63us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826341.127928:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 865 00000100:00100000:1.0:1787826341.127958:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585152128 00000100:00100000:1.0:1787826341.127962:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585152128 00000100:00100000:1.0:1787826341.127985:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585151872 00000100:00100000:1.0:1787826341.127988:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585151872 00000100:00100000:1.0:1787826341.128007:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1469 00000100:00100000:1.0:1787826341.128012:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab92940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874670585152128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826341.128042:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab92940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874670585152128:12345-0@lo:400:kworker.0 Request processed in 30us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826341.128049:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1469 00000100:00100000:1.0:1787826341.128059:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1470 00000100:00100000:1.0:1787826341.128066:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab93840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874670585151872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826341.128090:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab93840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874670585151872:12345-0@lo:400:kworker.0 Request processed in 25us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826341.128095:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1470 00000100:00080000:1.0:1787826341.128114:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787826341.128118:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826341.128146:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f88cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874670585151872:0@lo:400:kworker.0 00000100:00100000:1.0:1787826341.128158:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f88d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585152512:0@lo:400:kworker.0 00000100:00100000:1.0:1787826341.128168:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f88e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1874670585152128:0@lo:400:kworker.0 00000100:00100000:1.0:1787826341.128225:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f88ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585151616:0@lo:400:kworker.0 00000100:00100000:1.0:1787826341.128237:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f88e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585152384:0@lo:400:kworker.0 00000100:00100000:1.0:1787826341.128251:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f88c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585151488:0@lo:400:kworker.0 00000100:00100000:1.0:1787826341.128263:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f88c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585152256:0@lo:400:kworker.0 00000100:00080000:1.0:1787826341.128299:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1787826341.128311:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90cf3720f800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:1.0:1787826341.128317:0:3643:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:1.0:1787826341.128320:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294969178 gen 2 00000100:00080000:1.0:1787826341.128324:0:3643:0:(recover.c:53:ptlrpc_replay_next()) import ffff90cf3720f800 from lustre-MDT0000_UUID committed 4294969178 last 0 00000100:00080000:1.0:1787826341.128327:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90cf3720f800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:2.0:1787826341.128821:0:34488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585151104 00000100:00100000:2.0:1787826341.128827:0:34488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585151104 00000100:00100000:2.0:1787826341.128861:0:34488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787826341.128882:0:34488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce030ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3c550b8-2c3c-46c3-ad36-671c284167ea+24:3647:x1874670585151104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826341.128930:0:34488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce030ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3c550b8-2c3c-46c3-ad36-671c284167ea+24:3647:x1874670585151104:12345-0@lo:400:kworker.0 Request processed in 62us (1353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826341.128936:0:34488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787826341.129047:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03aef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e3c550b8-2c3c-46c3-ad36-671c284167ea:3647:1874670585151104:0@lo:400:kworker.0 00000100:00100000:3.0:1787826341.129492:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab14f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585152768:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787826341.129528:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826341.129579:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585152768 00000100:00100000:3.0:1787826341.129584:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585152768 00000100:00100000:3.0:1787826341.129614:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1321 00000100:00100000:3.0:1787826341.129621:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:3647:x1874670585152768:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787826341.129647:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446240256 avail 1300000768 00000100:00100000:3.0:1787826341.129686:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:3647:x1874670585152768:12345-0@lo:41:osp-pre-1-0.0 Request processed in 65us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826341.129692:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1321 00000100:00100000:3.0:1787826341.129743:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab14f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585152768:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787826341.131160:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03aec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874670585151232:0@lo:38:kworker.0 00010000:00080000:1.0:1787826341.131194:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cf3f936580 x1874670585151360/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787826366 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787826341.131211:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00010000:00080000:2.0:1787826341.131752:0:34789:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:2.0:1787826341.131757:0:34789:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:2.0:1787826341.131762:0:34789:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00010000:00010000:2.0:1787826341.133197:0:34789:0:(ldlm_request.c:2860:replay_one_lock()) ### replaying lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff90cf3a839400/0x22153cd396b6d64b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x22153cd396b6d652 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1787826341.133219:0:34789:0:(ldlm_request.c:2910:lock_can_replay()) check lock replay limit, inflights = 1(512) 00000100:00080000:1.0:1787826341.136189:0:3643:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff90cf3f936580 x1874670585151360/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787826366 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787826341.136203:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90cf264ed800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1787826341.136209:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90cf264ed800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1787826341.136213:0:3643:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1787826341.136220:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f936580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874670585151360:0@lo:38:kworker.0 00010000:00080000:3.0:1787826341.136359:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cf3f88f840 x1874670585151744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787826366 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787826341.136376:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1787826341.137390:0:3643:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff90cf3f88f840 x1874670585151744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787826366 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787826341.137399:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90ce02455800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1787826341.137556:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90ce02455800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1787826341.137560:0:3643:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1787826341.137565:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f88f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1874670585151744:0@lo:38:kworker.0 00010000:00080000:3.0:1787826341.137586:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cf3f88da40 x1874670585152000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787826366 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787826341.137660:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1787826341.139144:0:3643:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff90cf3f88da40 x1874670585152000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787826366 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787826341.139155:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90ce05f9d000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1787826341.139159:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90ce05f9d000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1787826341.139162:0:3643:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1787826341.139168:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f88da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1874670585152000:0@lo:38:kworker.0 00010000:00080000:3.0:1787826341.139194:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cf3f88f480 x1874670585152640/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787826351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787826341.139206:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787826341.139213:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787826341.139216:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787826341.139218:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90ce03230000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787826341.139221:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f88f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874670585152640:0@lo:38:kworker.0 00000100:00100000:3.0:1787826341.139263:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aaf2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874670585152896:0@lo:101:ldlm_lock_repla.0 00000100:00100000:3.0:1787826341.139330:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826341.140149:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585152896 00000100:00100000:1.0:1787826341.140157:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585152896 00000100:00100000:1.0:1787826341.140212:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1322 00000100:00100000:1.0:1787826341.140222:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab14f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3643:x1874670585152896:12345-0@lo:101:ldlm_lock_repla.0 00010000:00080000:1.0:1787826341.140241:0:6524:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff90cf3ab14f00 x1874670585152896/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:697/0 lens 328/0 e 0 to 0 dl 1787826352 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787826341.140252:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab14f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3643:x1874670585152896:12345-0@lo:101:ldlm_lock_repla.0 Request processed in 33us (922us total) trans 0 rc 0/-999 00000100:00100000:1.0:1787826341.140257:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1322 80000000:00020000:0.0:1787826341.162860:0:34515:0:(fld_handler.c:268:fld_server_lookup()) srv-lustre-MDT0000: Cannot find sequence 0x280000401: rc = -2 00010000:00080000:0.0:1787826341.176695:0:34515:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 65 seconds 00000020:00080000:0.0:1787826341.176716:0:34515:0:(update_recovery.c:483:dtrq_destroy()) destroy x0 t4294969325 00000020:00080000:0.0:1787826341.176728:0:34515:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1787826341.176731:0:34515:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969326 00010000:00080000:0.0:1787826341.176733:0:34515:0:(ldlm_lib.c:2288:check_for_next_transno()) waking for completed recovery 00000020:00080000:0.0:1787826341.176736:0:34515:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1787826341.176743:0:34515:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1787826341.176745:0:34515:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1787826341.176760:0:34515:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.203.39@tcp: req@ffff90cf3f874780 x1874670563643776/t0(0) o101->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:693/0 lens 328/0 e 0 to 0 dl 1787826348 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1787826341.176788:0:34515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826341.176820:0:34515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421f2800/0x22153cd396b7f7ac lrc: 2/0,0 mode: --/CR res: [0x200000405:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab00d8 expref: -99 pid: 34515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.176846:0:34515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421f2800/0x22153cd396b7f7ac lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xc:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab00d8 expref: 16 pid: 34515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.176862:0:34515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421f2800/0x22153cd396b7f7ac lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xc:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab00d8 expref: 16 pid: 34515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.178389:0:34515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf421f2800, rc 0) 00010000:00080000:0.0:1787826341.178498:0:34515:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1787826341.178515:0:34515:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1787826341.178630:0:34515:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1787826341.178639:0:34515:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.203.39@tcp: req@ffff90cf3ab17480 x1874670563643904/t0(0) o101->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:693/0 lens 328/0 e 0 to 0 dl 1787826348 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1787826341.178660:0:34515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826341.178682:0:34515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421f3200/0x22153cd396b7f7b3 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aafe70 expref: -99 pid: 34515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.178715:0:34515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421f3200/0x22153cd396b7f7b3 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x8:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafe70 expref: 16 pid: 34515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.178728:0:34515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421f3200/0x22153cd396b7f7b3 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x8:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafe70 expref: 16 pid: 34515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.178734:0:34515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf421f3200, rc 0) 00010000:00080000:0.0:1787826341.178767:0:34515:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1787826341.178774:0:34515:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1787826341.178776:0:34515:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1787826341.178782:0:34515:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.203.39@tcp: req@ffff90cf3ab14000 x1874670563644032/t0(0) o101->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:693/0 lens 328/0 e 0 to 0 dl 1787826348 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1787826341.178792:0:34515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826341.178804:0:34515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421f2e00/0x22153cd396b7f7ba lrc: 2/0,0 mode: --/CR res: [0x200000405:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aafdeb expref: -99 pid: 34515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.178817:0:34515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421f2e00/0x22153cd396b7f7ba lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x7:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafdeb expref: 16 pid: 34515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.178827:0:34515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421f2e00/0x22153cd396b7f7ba lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x7:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafdeb expref: 16 pid: 34515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.178833:0:34515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf421f2e00, rc 0) 00010000:00080000:0.0:1787826341.178851:0:34515:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1787826341.178859:0:34515:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1787826341.178861:0:34515:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1787826341.178866:0:34515:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.203.39@tcp: req@ffff90cf3ab143c0 x1874670563644160/t0(0) o101->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:693/0 lens 328/0 e 0 to 0 dl 1787826348 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1787826341.178875:0:34515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826341.179331:0:34515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421f2400/0x22153cd396b7f7c1 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aafe00 expref: -99 pid: 34515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.179349:0:34515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421f2400/0x22153cd396b7f7c1 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafe00 expref: 16 pid: 34515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.179358:0:34515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421f2400/0x22153cd396b7f7c1 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafe00 expref: 16 pid: 34515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.179364:0:34515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf421f2400, rc 0) 00010000:00080000:0.0:1787826341.179430:0:34515:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1787826341.179438:0:34515:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1787826341.179440:0:34515:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1787826341.179445:0:34515:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.203.39@tcp: req@ffff90cf3ab15e00 x1874670563644288/t0(0) o101->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:693/0 lens 328/0 e 0 to 0 dl 1787826348 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1787826341.179456:0:34515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826341.179466:0:34515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421f2a00/0x22153cd396b7f7c8 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aafdba expref: -99 pid: 34515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.179514:0:34515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421f2a00/0x22153cd396b7f7c8 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafdba expref: 16 pid: 34515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.179523:0:34515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421f2a00/0x22153cd396b7f7c8 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafdba expref: 16 pid: 34515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.179530:0:34515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf421f2a00, rc 0) 00010000:00080000:0.0:1787826341.179548:0:34515:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1787826341.179556:0:34515:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1787826341.179557:0:34515:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1787826341.179561:0:34515:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.203.39@tcp: req@ffff90cf3ab17c00 x1874670563644416/t0(0) o101->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:693/0 lens 328/0 e 0 to 0 dl 1787826348 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1787826341.179571:0:34515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826341.179581:0:34515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421f3c00/0x22153cd396b7f7cf lrc: 2/0,0 mode: --/CR res: [0x200000405:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62aafd82 expref: -99 pid: 34515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.179597:0:34515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421f3c00/0x22153cd396b7f7cf lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafd82 expref: 16 pid: 34515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.179607:0:34515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421f3c00/0x22153cd396b7f7cf lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafd82 expref: 16 pid: 34515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.179613:0:34515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf421f3c00, rc 0) 00010000:00080000:0.0:1787826341.179628:0:34515:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1787826341.179634:0:34515:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1787826341.179635:0:34515:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1787826341.179640:0:34515:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 0@lo: req@ffff90cf3ab14f00 x1874670585152896/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:697/0 lens 328/0 e 0 to 0 dl 1787826352 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1787826341.179650:0:34515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826341.179663:0:34515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421f2000/0x22153cd396b7f7d6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x22153cd396b6d64b expref: -99 pid: 34515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.179675:0:34515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421f2000/0x22153cd396b7f7d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x22153cd396b6d64b expref: 7 pid: 34515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.179683:0:34515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf421f2000/0x22153cd396b7f7d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x22153cd396b6d64b expref: 7 pid: 34515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.179689:0:34515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf421f2000, rc 0) 00010000:00080000:0.0:1787826341.179745:0:34515:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1787826341.179753:0:34515:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00010000:3.0:1787826341.180095:0:3643:0:(ldlm_request.c:2777:replay_lock_interpret()) ### replayed lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff90cf3a839400/0x22153cd396b6d64b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x22153cd396b7f7d6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787826341.180104:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90cf3720f800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:3.0:1787826341.180129:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aaf2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874670585152896:0@lo:101:ldlm_lock_repla.0 00000100:00100000:3.0:1787826341.180152:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874670585153024:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:3.0:1787826341.180189:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826341.180221:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585153024 00000100:00100000:3.0:1787826341.180226:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585153024 00000100:00100000:3.0:1787826341.180268:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1323 00000100:00100000:3.0:1787826341.180278:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab17840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3643:x1874670585153024:12345-0@lo:400:ptlrpcd_rcv.0 00010000:00080000:3.0:1787826341.180292:0:7796:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff90cf3ab17840 x1874670585153024/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:697/0 lens 224/0 e 0 to 0 dl 1787826352 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826341.180306:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab17840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3643:x1874670585153024:12345-0@lo:400:ptlrpcd_rcv.0 Request processed in 30us (118us total) trans 0 rc 0/-999 00000100:00100000:3.0:1787826341.180313:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1323 00010000:00010000:2.0:1787826341.192266:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826341.195529:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826341.195738:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563645824 00000100:00100000:3.0:1787826341.195749:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563645824 00000100:00100000:3.0:1787826341.195815:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1471 00000100:00100000:3.0:1787826341.195826:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aaf30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2400:x1874670563645824:12345-192.168.203.39@tcp:400:ptlrpcd_rcv.0 00010000:00080000:3.0:1787826341.195845:0:6518:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff90cf3aaf30c0 x1874670563645824/t0(0) o400->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:697/0 lens 224/0 e 0 to 0 dl 1787826352 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826341.195879:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aaf30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2400:x1874670563645824:12345-192.168.203.39@tcp:400:ptlrpcd_rcv.0 Request processed in 48us (353us total) trans 0 rc 0/-999 00010000:00080000:1.0:1787826341.195956:0:34515:0:(ldlm_lib.c:2311:check_for_next_lock()) waking for completed lock replay 00000001:00000004:1.0:1787826341.196084:0:34515:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:3.0:1787826341.196203:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1471 00000001:00100000:0.0:1787826341.211649:0:34481:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 09ed01c7-7b8c-4e06-9d82-a6b70e42014a 00000001:00100000:0.0:1787826341.211662:0:34481:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:1.0:1787826341.211789:0:34515:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:1.0:1787826341.211838:0:34515:0:(ldlm_lib.c:2022:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:1.0:1787826341.211854:0:34515:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff90cf3ab17840 x1874670585153024/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:697/0 lens 224/0 e 0 to 0 dl 1787826352 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1787826341.211973:0:34515:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 192.168.203.39@tcp: req@ffff90cf3aaf30c0 x1874670563645824/t0(0) o400->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:697/0 lens 224/0 e 0 to 0 dl 1787826352 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1787826341.212054:0:34515:0:(ldlm_lib.c:1894:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:05, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:3.0:1787826341.213081:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90cf3720f800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:3.0:1787826341.213092:0:3643:0:(client.c:3247:ptlrpc_resend_req()) @@@ going to resend req@ffff90cf3ab161c0 x1874670585153024/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787826357 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787826341.213102:0:3643:0:(client.c:3256:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff90cf3ab161c0 x1874670585153024/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787826357 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787826341.213109:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90cf3720f800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1787826341.213126:0:3643:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:3.0:1787826341.213132:0:3643:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000079a7698c): req@ffff90ce03a18b40 x1874670585128320/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787826319 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787826341.213148:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874670585153024:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:3.0:1787826341.213216:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787826341.213227:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585153152:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826341.213269:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826341.213310:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585153152 00000100:00100000:3.0:1787826341.213316:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585153152 00000100:00100000:3.0:1787826341.213357:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1324 00000100:00100000:3.0:1787826341.213365:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab15680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3645:x1874670585153152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787826341.213392:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445965824 avail 1299726336 00000100:00100000:3.0:1787826341.213436:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab15680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3645:x1874670585153152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826341.213443:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1324 00000100:00100000:3.0:1787826341.213494:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585153152:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826341.214965:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826341.215047:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585128320 00000100:00100000:2.0:1787826341.215053:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585128320 00000100:00100000:2.0:1787826341.215097:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1325 00000100:00100000:2.0:1787826341.215103:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3644:x1874670585128320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787826341.215124:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445965824 avail 1299726336 00000100:00100000:2.0:1787826341.215161:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3644:x1874670585128320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 58us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826341.215166:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1325 00000100:00100000:2.0:1787826341.215199:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03a18b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585128320:0@lo:41:osp-pre-0-1.0 00000004:00000080:0.0:1787826341.270801:0:34515:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9d4cc1de7e10 00100000:10000000:0.0:1787826341.270817:0:34515:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:0.0:1787826341.271386:0:34501:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0xd4:0x0] 00000100:00100000:0.0:1787826341.271430:0:34501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce044d3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:34501:1874670585153280:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1787826341.271522:0:34501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826341.271551:0:34501:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a2ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826341.271572:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585153280 00000100:00100000:0.0:1787826341.271577:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585153280 00000100:00100000:0.0:1787826341.271618:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1683 00000100:00100000:0.0:1787826341.271626:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:34501:x1874670585153280:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1787826341.271651:0:8436:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 257 -> diff = -45 00002000:02000040:0.0:1787826341.271655:0:8436:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:213 to 0x280000401:257) 00000004:00080000:3.0:1787826341.276467:0:34503:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0xe0:0x0] 00000100:00100000:3.0:1787826341.276567:0:34503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab161c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:34503:1874670585153408:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1787826341.276632:0:34503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826341.276674:0:34503:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf01377840 going to sleep for 11 seconds 00000100:00100000:1.0:1787826341.276806:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585153408 00000100:00100000:1.0:1787826341.276813:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585153408 00000100:00100000:1.0:1787826341.276871:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1684 00000100:00100000:1.0:1787826341.276880:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f936580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:34503:x1874670585153408:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1787826341.276907:0:8437:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 257 -> diff = -33 00002000:02000040:1.0:1787826341.276912:0:8437:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:225 to 0x2c0000401:257) 00002000:00010000:0.0:1787826341.293180:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x101:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826341.293192:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027e69aeb/0x22153cd396b7f7dd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x101:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.293208:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x101:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:0.0:1787826341.293213:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x101:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826341.293218:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027e69aeb/0x22153cd396b7f7dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x101:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.293232:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027e69aeb/0x22153cd396b7f7dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x101:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.293241:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027e69aeb/0x22153cd396b7f7dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x101:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.293254:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027e69aeb/0x22153cd396b7f7dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x101:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.293419:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826341.293432:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826341.293437:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027e69aeb/0x22153cd396b7f7dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x101:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.293446:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf421f3600 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826341.293450:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027e69aeb/0x22153cd396b7f7dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x101:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.293459:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027e69aeb/0x22153cd396b7f7dd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x101:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.293495:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027e69aeb/0x22153cd396b7f7dd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x101:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.293503:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027e69aeb/0x22153cd396b7f7dd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x101:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.293520:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.293522:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.293524:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787826341.293628:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x100:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826341.293635:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c2ebfbb/0x22153cd396b7f7e4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x100:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.293642:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x100:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:0.0:1787826341.293645:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x100:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826341.293650:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c2ebfbb/0x22153cd396b7f7e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x100:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.293657:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c2ebfbb/0x22153cd396b7f7e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x100:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.293664:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c2ebfbb/0x22153cd396b7f7e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x100:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.293670:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c2ebfbb/0x22153cd396b7f7e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x100:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.293682:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826341.293689:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826341.293693:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c2ebfbb/0x22153cd396b7f7e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x100:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.293711:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0a066600 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826341.293714:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c2ebfbb/0x22153cd396b7f7e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x100:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.293720:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c2ebfbb/0x22153cd396b7f7e4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x100:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.293731:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c2ebfbb/0x22153cd396b7f7e4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x100:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.293737:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c2ebfbb/0x22153cd396b7f7e4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x100:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.293748:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.293750:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.293752:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787826341.293794:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826341.293799:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1940442/0x22153cd396b7f7eb lrc: 3/0,1 mode: --/PW res: [0x280000401:0xff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.293806:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xff:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:0.0:1787826341.293809:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xff:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826341.293813:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1940442/0x22153cd396b7f7eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.293821:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1940442/0x22153cd396b7f7eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.293830:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1940442/0x22153cd396b7f7eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.293837:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b1940442/0x22153cd396b7f7eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.293856:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787826341.293962:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xfe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826341.293967:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fc1e6d3/0x22153cd396b7f7f2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xfe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.293975:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xfe:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:0.0:1787826341.293978:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xfe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826341.293982:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fc1e6d3/0x22153cd396b7f7f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.293989:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fc1e6d3/0x22153cd396b7f7f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.293996:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fc1e6d3/0x22153cd396b7f7f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.294003:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002fc1e6d3/0x22153cd396b7f7f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.294016:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787826341.294051:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xfd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826341.294056:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003646e797/0x22153cd396b7f7f9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xfd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.294063:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xfd:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:0.0:1787826341.294066:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xfd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826341.294070:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003646e797/0x22153cd396b7f7f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.294077:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003646e797/0x22153cd396b7f7f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.294085:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003646e797/0x22153cd396b7f7f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.294091:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003646e797/0x22153cd396b7f7f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.294105:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1787826341.294112:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787826341.294116:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b1940442/0x22153cd396b7f7eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.294121:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0a067c00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826341.294124:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1940442/0x22153cd396b7f7eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.294132:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1940442/0x22153cd396b7f7eb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.294142:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b1940442/0x22153cd396b7f7eb lrc: 1/0,0 mode: --/PW res: [0x280000401:0xff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.294154:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1940442/0x22153cd396b7f7eb lrc: 0/0,0 mode: --/PW res: [0x280000401:0xff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.294168:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787826341.294171:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002fc1e6d3/0x22153cd396b7f7f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.294177:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0a067e00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826341.294180:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002fc1e6d3/0x22153cd396b7f7f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.294188:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002fc1e6d3/0x22153cd396b7f7f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.294197:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002fc1e6d3/0x22153cd396b7f7f2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.294205:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fc1e6d3/0x22153cd396b7f7f2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.294216:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826341.294218:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003646e797/0x22153cd396b7f7f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.294224:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0a066800 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826341.294228:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003646e797/0x22153cd396b7f7f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.294235:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003646e797/0x22153cd396b7f7f9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.294244:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003646e797/0x22153cd396b7f7f9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.294251:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003646e797/0x22153cd396b7f7f9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.294631:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.294635:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.294637:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787826341.294695:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xfc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826341.294710:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004bbb43ea/0x22153cd396b7f800 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xfc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.294719:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xfc:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:0.0:1787826341.294722:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xfc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826341.294726:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004bbb43ea/0x22153cd396b7f800 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.294735:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004bbb43ea/0x22153cd396b7f800 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.294742:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004bbb43ea/0x22153cd396b7f800 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.294750:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004bbb43ea/0x22153cd396b7f800 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.294764:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826341.294771:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826341.294775:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004bbb43ea/0x22153cd396b7f800 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.294782:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0a067200 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826341.294786:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004bbb43ea/0x22153cd396b7f800 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.294793:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004bbb43ea/0x22153cd396b7f800 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.294805:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004bbb43ea/0x22153cd396b7f800 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.294811:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004bbb43ea/0x22153cd396b7f800 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.294823:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.294825:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.294827:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787826341.294865:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xfb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826341.295246:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787826341.297280:0:26205:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1787826341.298462:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086226fac/0x22153cd396b7f807 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xfb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.298496:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xfb:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:0.0:1787826341.298501:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xfb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826341.298508:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086226fac/0x22153cd396b7f807 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.298524:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086226fac/0x22153cd396b7f807 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.298536:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086226fac/0x22153cd396b7f807 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.298543:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000086226fac/0x22153cd396b7f807 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.298571:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787826341.298686:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xfa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826341.298691:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8b52bb3/0x22153cd396b7f80e lrc: 3/0,1 mode: --/PW res: [0x280000401:0xfa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.298709:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xfa:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:0.0:1787826341.298711:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xfa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826341.298715:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8b52bb3/0x22153cd396b7f80e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.298725:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8b52bb3/0x22153cd396b7f80e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.298734:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8b52bb3/0x22153cd396b7f80e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.298741:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c8b52bb3/0x22153cd396b7f80e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.298757:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787826341.298768:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787826341.298774:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000086226fac/0x22153cd396b7f807 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.298781:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0a066200 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826341.298786:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000086226fac/0x22153cd396b7f807 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.298795:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000086226fac/0x22153cd396b7f807 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.298809:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000086226fac/0x22153cd396b7f807 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.298816:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086226fac/0x22153cd396b7f807 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.298835:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826341.298839:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c8b52bb3/0x22153cd396b7f80e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.298846:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0a067800 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826341.298849:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8b52bb3/0x22153cd396b7f80e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.298856:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8b52bb3/0x22153cd396b7f80e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.298864:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c8b52bb3/0x22153cd396b7f80e lrc: 1/0,0 mode: --/PW res: [0x280000401:0xfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.298870:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8b52bb3/0x22153cd396b7f80e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.298880:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.298882:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.298883:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787826341.298928:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826341.298934:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000375ebdcc/0x22153cd396b7f815 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.298942:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf9:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:0.0:1787826341.298945:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826341.298949:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000375ebdcc/0x22153cd396b7f815 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.298963:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000375ebdcc/0x22153cd396b7f815 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.298971:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000375ebdcc/0x22153cd396b7f815 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.298977:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000375ebdcc/0x22153cd396b7f815 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.298989:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787826341.298997:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826341.299003:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000375ebdcc/0x22153cd396b7f815 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.299010:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0a067a00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826341.299013:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000375ebdcc/0x22153cd396b7f815 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.299021:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000375ebdcc/0x22153cd396b7f815 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826341.299026:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826341.299029:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a27ec96/0x22153cd396b7f81c lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.299032:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000375ebdcc/0x22153cd396b7f815 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.299037:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf8:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:0.0:1787826341.299040:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826341.299040:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000375ebdcc/0x22153cd396b7f815 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.299045:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a27ec96/0x22153cd396b7f81c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.299053:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a27ec96/0x22153cd396b7f81c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.299055:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826341.299057:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826341.299059:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.299060:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a27ec96/0x22153cd396b7f81c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.299064:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.299073:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a27ec96/0x22153cd396b7f81c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.299093:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787826341.299127:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826341.299132:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac666fdd/0x22153cd396b7f823 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.299140:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf7:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:0.0:1787826341.299143:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826341.299147:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac666fdd/0x22153cd396b7f823 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.299155:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac666fdd/0x22153cd396b7f823 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.299162:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac666fdd/0x22153cd396b7f823 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.299170:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac666fdd/0x22153cd396b7f823 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.299179:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787826341.299204:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826341.299209:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000952ff42d/0x22153cd396b7f82a lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.299216:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf6:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:0.0:1787826341.299219:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826341.299223:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000952ff42d/0x22153cd396b7f82a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.299231:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000952ff42d/0x22153cd396b7f82a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.299238:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000952ff42d/0x22153cd396b7f82a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.299246:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000952ff42d/0x22153cd396b7f82a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.299255:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1787826341.299296:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826341.299300:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bd432a2/0x22153cd396b7f831 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.299307:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf5:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:0.0:1787826341.299310:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826341.299315:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003bd432a2/0x22153cd396b7f831 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.299323:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003bd432a2/0x22153cd396b7f831 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.299335:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bd432a2/0x22153cd396b7f831 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.299341:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003bd432a2/0x22153cd396b7f831 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.299350:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1787826341.299375:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787826341.299380:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a27ec96/0x22153cd396b7f81c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826341.299382:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826341.299386:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d39501d2/0x22153cd396b7f838 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.299388:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165f600 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826341.299391:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a27ec96/0x22153cd396b7f81c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.299394:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf4:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:0.0:1787826341.299397:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826341.299401:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d39501d2/0x22153cd396b7f838 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.299409:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d39501d2/0x22153cd396b7f838 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.299409:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a27ec96/0x22153cd396b7f81c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.299418:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d39501d2/0x22153cd396b7f838 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.299421:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a27ec96/0x22153cd396b7f81c lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.299425:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d39501d2/0x22153cd396b7f838 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.299428:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a27ec96/0x22153cd396b7f81c lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.299439:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1787826341.299445:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787826341.299448:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac666fdd/0x22153cd396b7f823 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.299453:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165fe00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826341.299457:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac666fdd/0x22153cd396b7f823 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.299464:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac666fdd/0x22153cd396b7f823 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826341.299469:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826341.299488:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091cba634/0x22153cd396b7f83f lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.299494:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac666fdd/0x22153cd396b7f823 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.299496:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf3:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:0.0:1787826341.299499:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826341.299503:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091cba634/0x22153cd396b7f83f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.299503:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac666fdd/0x22153cd396b7f823 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.299513:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091cba634/0x22153cd396b7f83f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.299516:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787826341.299519:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000952ff42d/0x22153cd396b7f82a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.299521:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091cba634/0x22153cd396b7f83f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.299526:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165e200 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826341.299529:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000091cba634/0x22153cd396b7f83f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.299530:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000952ff42d/0x22153cd396b7f82a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.299537:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1787826341.299537:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000952ff42d/0x22153cd396b7f82a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.299544:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000952ff42d/0x22153cd396b7f82a lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.299551:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000952ff42d/0x22153cd396b7f82a lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.299562:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787826341.299566:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003bd432a2/0x22153cd396b7f831 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826341.299569:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826341.299573:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002972f1b9/0x22153cd396b7f846 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.299573:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165ec00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826341.299576:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003bd432a2/0x22153cd396b7f831 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.299581:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf2:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:0.0:1787826341.299584:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826341.299584:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003bd432a2/0x22153cd396b7f831 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.299588:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002972f1b9/0x22153cd396b7f846 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.299597:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002972f1b9/0x22153cd396b7f846 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.299604:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002972f1b9/0x22153cd396b7f846 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.299611:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002972f1b9/0x22153cd396b7f846 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.299618:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1787826341.299651:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826341.299656:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a06ea081/0x22153cd396b7f84d lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.299664:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf1:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:0.0:1787826341.299666:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826341.299670:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a06ea081/0x22153cd396b7f84d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.299679:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a06ea081/0x22153cd396b7f84d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.299685:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a06ea081/0x22153cd396b7f84d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.299692:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a06ea081/0x22153cd396b7f84d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.299758:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003bd432a2/0x22153cd396b7f831 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.299767:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003bd432a2/0x22153cd396b7f831 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.299781:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787826341.299783:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d39501d2/0x22153cd396b7f838 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.299789:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165e600 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826341.299792:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d39501d2/0x22153cd396b7f838 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.299799:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d39501d2/0x22153cd396b7f838 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.299809:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d39501d2/0x22153cd396b7f838 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.299817:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d39501d2/0x22153cd396b7f838 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.299827:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787826341.299830:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000091cba634/0x22153cd396b7f83f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.299836:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165f400 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826341.299840:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000091cba634/0x22153cd396b7f83f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.299847:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000091cba634/0x22153cd396b7f83f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.299856:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000091cba634/0x22153cd396b7f83f lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.299862:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091cba634/0x22153cd396b7f83f lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.299947:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826341.299951:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002972f1b9/0x22153cd396b7f846 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.299957:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165ea00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826341.299961:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002972f1b9/0x22153cd396b7f846 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.299968:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002972f1b9/0x22153cd396b7f846 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.299977:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002972f1b9/0x22153cd396b7f846 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.299984:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002972f1b9/0x22153cd396b7f846 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.299994:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826341.299996:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826341.299997:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826341.300004:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826341.300008:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826341.302110:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.311239:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787826341.311359:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826341.311367:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004185bcb5/0x22153cd396b7f854 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.311381:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf0:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:0.0:1787826341.311385:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826341.311391:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004185bcb5/0x22153cd396b7f854 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.311404:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004185bcb5/0x22153cd396b7f854 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.311415:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004185bcb5/0x22153cd396b7f854 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.311421:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004185bcb5/0x22153cd396b7f854 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.311435:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787826341.311497:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826341.311503:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a67399c/0x22153cd396b7f85b lrc: 3/0,1 mode: --/PW res: [0x280000401:0xef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.311512:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xef:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:0.0:1787826341.311515:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xef:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826341.311520:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a67399c/0x22153cd396b7f85b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.311528:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a67399c/0x22153cd396b7f85b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.311535:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a67399c/0x22153cd396b7f85b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.311541:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a67399c/0x22153cd396b7f85b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.311557:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1787826341.311566:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787826341.311572:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a06ea081/0x22153cd396b7f84d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.311580:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165e400 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826341.311584:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a06ea081/0x22153cd396b7f84d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.311592:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a06ea081/0x22153cd396b7f84d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.311613:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a06ea081/0x22153cd396b7f84d lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.311622:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a06ea081/0x22153cd396b7f84d lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.311640:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787826341.311643:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004185bcb5/0x22153cd396b7f854 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.311650:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165ee00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826341.311653:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004185bcb5/0x22153cd396b7f854 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.311661:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004185bcb5/0x22153cd396b7f854 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.311670:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004185bcb5/0x22153cd396b7f854 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.311678:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004185bcb5/0x22153cd396b7f854 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.311688:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826341.311692:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a67399c/0x22153cd396b7f85b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.311711:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165fc00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826341.311715:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a67399c/0x22153cd396b7f85b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.311724:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a67399c/0x22153cd396b7f85b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.311733:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a67399c/0x22153cd396b7f85b lrc: 1/0,0 mode: --/PW res: [0x280000401:0xef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.311742:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a67399c/0x22153cd396b7f85b lrc: 0/0,0 mode: --/PW res: [0x280000401:0xef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.311755:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.311756:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.311758:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787826341.311801:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826341.311806:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e32bc9b1/0x22153cd396b7f862 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.311814:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xee:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:0.0:1787826341.311817:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xee:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826341.311821:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e32bc9b1/0x22153cd396b7f862 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.311829:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e32bc9b1/0x22153cd396b7f862 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.311836:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e32bc9b1/0x22153cd396b7f862 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.311842:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e32bc9b1/0x22153cd396b7f862 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.311856:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826341.311863:0:7460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826341.311867:0:7460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e32bc9b1/0x22153cd396b7f862 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.311873:0:7460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165e000 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826341.311877:0:7460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e32bc9b1/0x22153cd396b7f862 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.311884:0:7460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e32bc9b1/0x22153cd396b7f862 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.311893:0:7460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e32bc9b1/0x22153cd396b7f862 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.311901:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e32bc9b1/0x22153cd396b7f862 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.311914:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.311916:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.311918:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787826341.311957:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826341.311962:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b49a3b43/0x22153cd396b7f869 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.311969:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xed:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:0.0:1787826341.311972:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xed:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826341.311976:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b49a3b43/0x22153cd396b7f869 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.311984:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b49a3b43/0x22153cd396b7f869 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.311991:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b49a3b43/0x22153cd396b7f869 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.311997:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b49a3b43/0x22153cd396b7f869 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.312008:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826341.312015:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826341.312019:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b49a3b43/0x22153cd396b7f869 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.312025:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165fa00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826341.312028:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b49a3b43/0x22153cd396b7f869 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.312039:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b49a3b43/0x22153cd396b7f869 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.312047:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b49a3b43/0x22153cd396b7f869 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.312053:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b49a3b43/0x22153cd396b7f869 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.312066:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.312067:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.312068:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787826341.312107:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826341.312112:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039926dae/0x22153cd396b7f870 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.312119:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xec:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:0.0:1787826341.312122:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xec:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826341.312125:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039926dae/0x22153cd396b7f870 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.312133:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039926dae/0x22153cd396b7f870 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.312140:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039926dae/0x22153cd396b7f870 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.312148:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000039926dae/0x22153cd396b7f870 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.312160:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826341.312166:0:7460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826341.312169:0:7460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000039926dae/0x22153cd396b7f870 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.312176:0:7460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf00031400 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826341.312179:0:7460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000039926dae/0x22153cd396b7f870 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.312186:0:7460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000039926dae/0x22153cd396b7f870 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.312197:0:7460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000039926dae/0x22153cd396b7f870 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.312203:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039926dae/0x22153cd396b7f870 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.312215:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.312217:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.312219:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787826341.312257:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xeb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826341.312263:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a5ad7c1/0x22153cd396b7f877 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xeb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.312271:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xeb:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:0.0:1787826341.312274:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xeb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826341.312278:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a5ad7c1/0x22153cd396b7f877 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xeb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.312286:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a5ad7c1/0x22153cd396b7f877 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xeb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.312293:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a5ad7c1/0x22153cd396b7f877 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xeb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.312299:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a5ad7c1/0x22153cd396b7f877 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xeb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.312311:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826341.312316:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826341.312320:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a5ad7c1/0x22153cd396b7f877 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xeb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.312325:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf00031600 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826341.312329:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a5ad7c1/0x22153cd396b7f877 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xeb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.312336:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a5ad7c1/0x22153cd396b7f877 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xeb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.312346:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a5ad7c1/0x22153cd396b7f877 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xeb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.312353:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a5ad7c1/0x22153cd396b7f877 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xeb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.312366:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.312367:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.312369:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787826341.312412:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826341.312417:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c07aa36/0x22153cd396b7f87e lrc: 3/0,1 mode: --/PW res: [0x280000401:0xea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.312423:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xea:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:0.0:1787826341.312426:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826341.312431:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c07aa36/0x22153cd396b7f87e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.312439:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c07aa36/0x22153cd396b7f87e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.312446:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c07aa36/0x22153cd396b7f87e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.312453:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c07aa36/0x22153cd396b7f87e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.312495:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826341.312502:0:7460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826341.312505:0:7460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c07aa36/0x22153cd396b7f87e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.312512:0:7460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf00031800 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826341.312515:0:7460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c07aa36/0x22153cd396b7f87e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.312523:0:7460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c07aa36/0x22153cd396b7f87e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.312534:0:7460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c07aa36/0x22153cd396b7f87e lrc: 1/0,0 mode: --/PW res: [0x280000401:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.312540:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c07aa36/0x22153cd396b7f87e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.312552:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.312554:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.312555:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787826341.312598:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826341.312603:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0ef6980/0x22153cd396b7f885 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.312611:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe9:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:0.0:1787826341.312615:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826341.312619:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0ef6980/0x22153cd396b7f885 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.312628:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0ef6980/0x22153cd396b7f885 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.312635:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0ef6980/0x22153cd396b7f885 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.312642:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f0ef6980/0x22153cd396b7f885 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.312654:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826341.312660:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826341.312664:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f0ef6980/0x22153cd396b7f885 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.312669:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf00030800 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826341.312672:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0ef6980/0x22153cd396b7f885 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.312679:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0ef6980/0x22153cd396b7f885 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.312689:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f0ef6980/0x22153cd396b7f885 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.312713:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0ef6980/0x22153cd396b7f885 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.312727:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.312728:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.312730:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787826341.312770:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826341.312775:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7451d0e/0x22153cd396b7f88c lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.312782:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe8:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:0.0:1787826341.312785:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826341.312789:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7451d0e/0x22153cd396b7f88c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.312796:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7451d0e/0x22153cd396b7f88c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.312804:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7451d0e/0x22153cd396b7f88c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.312811:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a7451d0e/0x22153cd396b7f88c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.312823:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826341.312829:0:7460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826341.312833:0:7460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a7451d0e/0x22153cd396b7f88c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.312839:0:7460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf00031000 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826341.312842:0:7460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7451d0e/0x22153cd396b7f88c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.312848:0:7460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7451d0e/0x22153cd396b7f88c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.312857:0:7460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a7451d0e/0x22153cd396b7f88c lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.312863:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7451d0e/0x22153cd396b7f88c lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.312874:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.312876:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.312878:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787826341.312917:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826341.312922:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc4b298f/0x22153cd396b7f893 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.312929:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe7:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:0.0:1787826341.312931:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826341.312935:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc4b298f/0x22153cd396b7f893 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.312946:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc4b298f/0x22153cd396b7f893 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.312953:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc4b298f/0x22153cd396b7f893 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.312959:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc4b298f/0x22153cd396b7f893 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.312971:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826341.312977:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826341.312980:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc4b298f/0x22153cd396b7f893 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.312986:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf00031c00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826341.312988:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc4b298f/0x22153cd396b7f893 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.312995:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc4b298f/0x22153cd396b7f893 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.313005:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc4b298f/0x22153cd396b7f893 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.313011:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc4b298f/0x22153cd396b7f893 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.313024:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.313026:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.313027:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787826341.313068:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826341.313073:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2aad8a9/0x22153cd396b7f89a lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.313080:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe6:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:0.0:1787826341.313082:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826341.313087:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2aad8a9/0x22153cd396b7f89a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.313095:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2aad8a9/0x22153cd396b7f89a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.313102:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2aad8a9/0x22153cd396b7f89a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.313109:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2aad8a9/0x22153cd396b7f89a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.313121:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826341.313127:0:7460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826341.313130:0:7460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2aad8a9/0x22153cd396b7f89a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.313140:0:7460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf00030200 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826341.313143:0:7460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2aad8a9/0x22153cd396b7f89a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.313149:0:7460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2aad8a9/0x22153cd396b7f89a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.313158:0:7460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2aad8a9/0x22153cd396b7f89a lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.313164:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2aad8a9/0x22153cd396b7f89a lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.313175:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.313177:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.313179:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787826341.313220:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826341.313225:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000595c07c9/0x22153cd396b7f8a1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.313234:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe5:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:0.0:1787826341.313237:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826341.313241:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000595c07c9/0x22153cd396b7f8a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.313249:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000595c07c9/0x22153cd396b7f8a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.313257:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000595c07c9/0x22153cd396b7f8a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.313265:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000595c07c9/0x22153cd396b7f8a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.313277:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826341.313283:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826341.313286:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000595c07c9/0x22153cd396b7f8a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.313293:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400a00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826341.313296:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000595c07c9/0x22153cd396b7f8a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.313304:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000595c07c9/0x22153cd396b7f8a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.313313:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000595c07c9/0x22153cd396b7f8a1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.313320:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000595c07c9/0x22153cd396b7f8a1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.313330:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.313332:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.313334:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787826341.313371:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826341.313376:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d747c98/0x22153cd396b7f8a8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.313384:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe4:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:0.0:1787826341.313386:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826341.313391:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d747c98/0x22153cd396b7f8a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.313400:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d747c98/0x22153cd396b7f8a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.313408:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d747c98/0x22153cd396b7f8a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.313415:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004d747c98/0x22153cd396b7f8a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.313426:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826341.313432:0:7460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826341.313435:0:7460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004d747c98/0x22153cd396b7f8a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.313440:0:7460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401200 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826341.313443:0:7460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004d747c98/0x22153cd396b7f8a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.313454:0:7460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004d747c98/0x22153cd396b7f8a8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.313463:0:7460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004d747c98/0x22153cd396b7f8a8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.313495:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d747c98/0x22153cd396b7f8a8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.313508:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.313510:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.313512:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787826341.313549:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826341.313554:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d612c5b/0x22153cd396b7f8af lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.313563:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe3:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:0.0:1787826341.313566:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826341.313571:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d612c5b/0x22153cd396b7f8af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.313581:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d612c5b/0x22153cd396b7f8af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.313589:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d612c5b/0x22153cd396b7f8af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.313597:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d612c5b/0x22153cd396b7f8af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.313609:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826341.313615:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826341.313618:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d612c5b/0x22153cd396b7f8af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.313625:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400000 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826341.313628:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d612c5b/0x22153cd396b7f8af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.313635:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d612c5b/0x22153cd396b7f8af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.313644:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d612c5b/0x22153cd396b7f8af lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.313650:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d612c5b/0x22153cd396b7f8af lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.313662:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.313664:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.313665:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787826341.313718:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826341.313725:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b33b8f4a/0x22153cd396b7f8b6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.313731:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe2:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:0.0:1787826341.313733:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826341.313736:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b33b8f4a/0x22153cd396b7f8b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.313745:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b33b8f4a/0x22153cd396b7f8b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.313753:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b33b8f4a/0x22153cd396b7f8b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.313760:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b33b8f4a/0x22153cd396b7f8b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.313774:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826341.313781:0:7460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826341.313785:0:7460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b33b8f4a/0x22153cd396b7f8b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.313791:0:7460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401600 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826341.313794:0:7460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b33b8f4a/0x22153cd396b7f8b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.313801:0:7460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b33b8f4a/0x22153cd396b7f8b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.313812:0:7460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b33b8f4a/0x22153cd396b7f8b6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.313818:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b33b8f4a/0x22153cd396b7f8b6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.313829:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.313831:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.313832:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787826341.313867:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826341.313872:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000482bb568/0x22153cd396b7f8bd lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.313879:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe1:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:0.0:1787826341.313882:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826341.313886:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000482bb568/0x22153cd396b7f8bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.313894:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000482bb568/0x22153cd396b7f8bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.313901:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000482bb568/0x22153cd396b7f8bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.313908:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000482bb568/0x22153cd396b7f8bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.313925:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826341.313931:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826341.313934:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000482bb568/0x22153cd396b7f8bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.313940:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400200 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826341.313944:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000482bb568/0x22153cd396b7f8bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.313950:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000482bb568/0x22153cd396b7f8bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.313960:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000482bb568/0x22153cd396b7f8bd lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.313967:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000482bb568/0x22153cd396b7f8bd lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.313979:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.313981:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.313982:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787826341.314023:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826341.314028:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008343e43a/0x22153cd396b7f8c4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.314035:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe0:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:0.0:1787826341.314038:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826341.314042:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008343e43a/0x22153cd396b7f8c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.314051:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008343e43a/0x22153cd396b7f8c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.314058:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008343e43a/0x22153cd396b7f8c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.314064:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008343e43a/0x22153cd396b7f8c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.314076:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826341.314083:0:7460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826341.314086:0:7460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008343e43a/0x22153cd396b7f8c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.314091:0:7460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401000 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826341.314095:0:7460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008343e43a/0x22153cd396b7f8c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.314102:0:7460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008343e43a/0x22153cd396b7f8c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.314111:0:7460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008343e43a/0x22153cd396b7f8c4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.314123:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008343e43a/0x22153cd396b7f8c4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.314134:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.314136:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.314137:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787826341.314176:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xdf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826341.314181:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4014864/0x22153cd396b7f8cb lrc: 3/0,1 mode: --/PW res: [0x280000401:0xdf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.314187:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xdf:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:0.0:1787826341.314190:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xdf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826341.314194:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4014864/0x22153cd396b7f8cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.314202:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4014864/0x22153cd396b7f8cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.314210:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4014864/0x22153cd396b7f8cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.314217:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4014864/0x22153cd396b7f8cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.314229:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826341.314234:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826341.314239:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4014864/0x22153cd396b7f8cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.314246:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400e00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826341.314248:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4014864/0x22153cd396b7f8cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.314255:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4014864/0x22153cd396b7f8cb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.314264:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4014864/0x22153cd396b7f8cb lrc: 1/0,0 mode: --/PW res: [0x280000401:0xdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.314271:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4014864/0x22153cd396b7f8cb lrc: 0/0,0 mode: --/PW res: [0x280000401:0xdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.314282:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.314283:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.314284:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787826341.314320:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xde:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826341.314325:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e843828/0x22153cd396b7f8d2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xde:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.314333:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xde:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:0.0:1787826341.314336:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xde:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826341.314340:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e843828/0x22153cd396b7f8d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.314353:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e843828/0x22153cd396b7f8d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.314360:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e843828/0x22153cd396b7f8d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.314366:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e843828/0x22153cd396b7f8d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.314378:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826341.314384:0:7460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826341.314388:0:7460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e843828/0x22153cd396b7f8d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.314394:0:7460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401a00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826341.314397:0:7460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e843828/0x22153cd396b7f8d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.314405:0:7460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e843828/0x22153cd396b7f8d2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.314416:0:7460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e843828/0x22153cd396b7f8d2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.314422:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e843828/0x22153cd396b7f8d2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.314435:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.314436:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.314438:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787826341.314498:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xdd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826341.314503:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b7f8d9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xdd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.314511:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xdd:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:0.0:1787826341.314514:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xdd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826341.314519:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b7f8d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.314527:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b7f8d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.314534:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b7f8d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.314541:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b7f8d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.314553:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826341.314559:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826341.314562:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b7f8d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.314573:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400c00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826341.314575:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b7f8d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.314583:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b7f8d9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.314591:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b7f8d9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.314598:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b7f8d9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.314610:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.314611:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.314612:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787826341.314653:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xdc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826341.314658:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd505040/0x22153cd396b7f8e0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xdc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.314667:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xdc:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:0.0:1787826341.314670:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xdc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826341.314674:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd505040/0x22153cd396b7f8e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.314683:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd505040/0x22153cd396b7f8e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.314690:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd505040/0x22153cd396b7f8e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.314859:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826341.314865:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.327501:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd505040/0x22153cd396b7f8e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.327539:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826341.327558:0:7460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826341.327565:0:7460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd505040/0x22153cd396b7f8e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.327574:0:7460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401800 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826341.327579:0:7460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd505040/0x22153cd396b7f8e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.327590:0:7460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd505040/0x22153cd396b7f8e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xdc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.327611:0:7460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd505040/0x22153cd396b7f8e0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xdc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.327618:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd505040/0x22153cd396b7f8e0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xdc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.327644:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.327647:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.327649:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787826341.327767:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xdb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826341.327773:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b7f8e7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xdb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.327785:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xdb:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:0.0:1787826341.327790:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xdb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826341.327796:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b7f8e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.327807:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b7f8e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.327815:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b7f8e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xdb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.327821:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b7f8e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.327834:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826341.327841:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826341.327846:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b7f8e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.327852:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401e00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826341.327855:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b7f8e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xdb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.327878:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b7f8e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xdb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.327890:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b7f8e7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xdb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.327896:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b7f8e7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xdb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.327909:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.327911:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.327913:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787826341.327952:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xda:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826341.327957:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021c90a82/0x22153cd396b7f8ee lrc: 3/0,1 mode: --/PW res: [0x280000401:0xda:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.327964:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xda:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:0.0:1787826341.327967:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xda:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826341.327972:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021c90a82/0x22153cd396b7f8ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.327980:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021c90a82/0x22153cd396b7f8ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.327987:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021c90a82/0x22153cd396b7f8ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.327994:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021c90a82/0x22153cd396b7f8ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.328006:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787826341.328045:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826341.328051:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c267dc2/0x22153cd396b7f8f5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.328058:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd9:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:0.0:1787826341.328061:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826341.328064:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c267dc2/0x22153cd396b7f8f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.328073:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c267dc2/0x22153cd396b7f8f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.328080:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c267dc2/0x22153cd396b7f8f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.328087:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c267dc2/0x22153cd396b7f8f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.328102:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787826341.328110:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787826341.328114:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021c90a82/0x22153cd396b7f8ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.328121:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400400 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826341.328124:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021c90a82/0x22153cd396b7f8ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.328131:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021c90a82/0x22153cd396b7f8ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.328141:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021c90a82/0x22153cd396b7f8ee lrc: 1/0,0 mode: --/PW res: [0x280000401:0xda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.328148:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021c90a82/0x22153cd396b7f8ee lrc: 0/0,0 mode: --/PW res: [0x280000401:0xda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.328162:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826341.328165:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c267dc2/0x22153cd396b7f8f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.328171:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400600 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826341.328174:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c267dc2/0x22153cd396b7f8f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.328181:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c267dc2/0x22153cd396b7f8f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.328190:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c267dc2/0x22153cd396b7f8f5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.328198:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c267dc2/0x22153cd396b7f8f5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.328210:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.328212:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.328213:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787826341.328252:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826341.328257:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc2068bb/0x22153cd396b7f8fc lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.329380:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd8:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:0.0:1787826341.329384:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826341.329390:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc2068bb/0x22153cd396b7f8fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.329403:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc2068bb/0x22153cd396b7f8fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.329413:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc2068bb/0x22153cd396b7f8fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.329420:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc2068bb/0x22153cd396b7f8fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.329441:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826341.329453:0:7460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826341.329459:0:7460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc2068bb/0x22153cd396b7f8fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.329466:0:7460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400800 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826341.329484:0:7460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc2068bb/0x22153cd396b7f8fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.329493:0:7460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc2068bb/0x22153cd396b7f8fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.329505:0:7460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc2068bb/0x22153cd396b7f8fc lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.329513:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc2068bb/0x22153cd396b7f8fc lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.329531:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.329532:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.329534:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787826341.329604:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826341.329609:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3d097e2/0x22153cd396b7f903 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.329618:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd7:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:0.0:1787826341.329620:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826341.329624:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3d097e2/0x22153cd396b7f903 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.329638:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3d097e2/0x22153cd396b7f903 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.329646:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3d097e2/0x22153cd396b7f903 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.329653:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3d097e2/0x22153cd396b7f903 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.329665:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826341.329672:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826341.329676:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3d097e2/0x22153cd396b7f903 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.329683:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401c00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826341.329686:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3d097e2/0x22153cd396b7f903 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.329694:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3d097e2/0x22153cd396b7f903 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.329717:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3d097e2/0x22153cd396b7f903 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.329725:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3d097e2/0x22153cd396b7f903 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.329739:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.329741:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.329743:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787826341.329787:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826341.329792:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2cecd7f/0x22153cd396b7f90a lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.329799:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd6:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:0.0:1787826341.329802:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826341.329806:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2cecd7f/0x22153cd396b7f90a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.329815:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2cecd7f/0x22153cd396b7f90a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.329823:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2cecd7f/0x22153cd396b7f90a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.329831:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2cecd7f/0x22153cd396b7f90a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.329845:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826341.329853:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826341.329857:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2cecd7f/0x22153cd396b7f90a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.329870:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05661000 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826341.329873:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2cecd7f/0x22153cd396b7f90a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.329880:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2cecd7f/0x22153cd396b7f90a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.329891:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2cecd7f/0x22153cd396b7f90a lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.329898:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2cecd7f/0x22153cd396b7f90a lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.329911:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.329913:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.329915:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787826341.329952:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826341.329957:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3083a9a/0x22153cd396b7f911 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.329965:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd5:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:0.0:1787826341.329968:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826341.329972:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3083a9a/0x22153cd396b7f911 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.329981:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3083a9a/0x22153cd396b7f911 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.329990:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3083a9a/0x22153cd396b7f911 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.329998:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3083a9a/0x22153cd396b7f911 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.330010:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826341.330017:0:7460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826341.330020:0:7460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3083a9a/0x22153cd396b7f911 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.330027:0:7460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05661c00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826341.330030:0:7460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3083a9a/0x22153cd396b7f911 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.330038:0:7460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3083a9a/0x22153cd396b7f911 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.330048:0:7460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3083a9a/0x22153cd396b7f911 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.330056:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3083a9a/0x22153cd396b7f911 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.330069:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.330071:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.330073:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1787826341.330109:0:8436:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:212 00000100:00100000:0.0:1787826341.330208:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:34501:x1874670585153280:12345-0@lo:5:osp-pre-0-0.0 Request processed in 58578us (58681us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826341.330218:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1683 00000100:00100000:0.0:1787826341.334361:0:34501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce044d3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:34501:1874670585153280:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1787826341.334384:0:34501:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x101:0x0] from OST, last_created [0x280000401:0x101:0x0]last_used is [0x280000401:0xd4:0x0] 00000100:00100000:0.0:1787826341.334463:0:34501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce044d0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:34501:1874670585153664:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1787826341.334546:0:34501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826341.334574:0:34501:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf104c0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787826341.334595:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce044d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585153536:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787826341.334620:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826341.334661:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585153664 00000100:00100000:0.0:1787826341.334667:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585153664 00000100:00100000:0.0:1787826341.334716:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1685 00000100:00100000:0.0:1787826341.334725:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03985a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:34501:x1874670585153664:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1787826341.334764:0:8545:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 258 00002000:00010000:1.0:1787826341.335612:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x101:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826341.335623:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003000710e/0x22153cd396b7f918 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x101:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.335641:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x101:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:1.0:1787826341.335646:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x101:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826341.335653:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003000710e/0x22153cd396b7f918 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x101:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.335668:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003000710e/0x22153cd396b7f918 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x101:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.335679:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003000710e/0x22153cd396b7f918 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x101:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.335693:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003000710e/0x22153cd396b7f918 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x101:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.335722:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787826341.335820:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x100:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826341.335826:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8d36182/0x22153cd396b7f91f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x100:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.335834:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x100:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:1.0:1787826341.335837:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x100:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826341.335841:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8d36182/0x22153cd396b7f91f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x100:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.335850:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e8d36182/0x22153cd396b7f91f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x100:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.335858:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8d36182/0x22153cd396b7f91f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x100:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.335865:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e8d36182/0x22153cd396b7f91f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x100:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.335879:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787826341.335919:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826341.335924:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1d3d067/0x22153cd396b7f926 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.335933:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xff:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:1.0:1787826341.335935:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xff:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826341.335939:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1d3d067/0x22153cd396b7f926 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.335947:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1d3d067/0x22153cd396b7f926 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.335955:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1d3d067/0x22153cd396b7f926 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.335961:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1d3d067/0x22153cd396b7f926 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.335974:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1787826341.336012:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xfe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826341.336017:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c5f1db2/0x22153cd396b7f92d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xfe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.336025:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xfe:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:1.0:1787826341.336027:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xfe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826341.336031:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c5f1db2/0x22153cd396b7f92d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.336039:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c5f1db2/0x22153cd396b7f92d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.336051:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c5f1db2/0x22153cd396b7f92d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.336058:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004c5f1db2/0x22153cd396b7f92d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.336066:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1787826341.336103:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xfd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826341.336108:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e70b617/0x22153cd396b7f934 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xfd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.336115:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xfd:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:1.0:1787826341.336118:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xfd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826341.336123:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e70b617/0x22153cd396b7f934 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.336131:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e70b617/0x22153cd396b7f934 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.336138:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e70b617/0x22153cd396b7f934 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.336145:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007e70b617/0x22153cd396b7f934 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.336158:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1787826341.336193:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xfc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826341.336198:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003cc63869/0x22153cd396b7f93b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xfc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.336206:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xfc:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:1.0:1787826341.336208:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xfc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826341.336212:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003cc63869/0x22153cd396b7f93b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.336219:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003cc63869/0x22153cd396b7f93b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.336226:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003cc63869/0x22153cd396b7f93b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.336232:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003cc63869/0x22153cd396b7f93b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.336239:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:3.0:1787826341.340916:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1787826341.340928:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003000710e/0x22153cd396b7f918 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x101:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.340942:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce01f16800 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826341.340947:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003000710e/0x22153cd396b7f918 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x101:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.340958:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003000710e/0x22153cd396b7f918 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x101:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.340981:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003000710e/0x22153cd396b7f918 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x101:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.340989:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003000710e/0x22153cd396b7f918 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x101:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.341008:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1787826341.341012:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e8d36182/0x22153cd396b7f91f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x100:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.341018:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf181f0200 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826341.341021:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8d36182/0x22153cd396b7f91f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x100:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.341028:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8d36182/0x22153cd396b7f91f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x100:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.341036:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e8d36182/0x22153cd396b7f91f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x100:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.341043:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8d36182/0x22153cd396b7f91f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x100:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.341054:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787826341.341059:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1d3d067/0x22153cd396b7f926 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.341065:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf181f1c00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826341.341068:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1d3d067/0x22153cd396b7f926 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.341075:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1d3d067/0x22153cd396b7f926 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.341083:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1d3d067/0x22153cd396b7f926 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.341089:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1d3d067/0x22153cd396b7f926 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.341099:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787826341.341103:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004c5f1db2/0x22153cd396b7f92d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.341109:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf181f1600 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826341.341112:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004c5f1db2/0x22153cd396b7f92d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.341120:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004c5f1db2/0x22153cd396b7f92d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.341129:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004c5f1db2/0x22153cd396b7f92d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.341137:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c5f1db2/0x22153cd396b7f92d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.341148:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787826341.341152:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007e70b617/0x22153cd396b7f934 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.341157:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf181f0800 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826341.341160:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007e70b617/0x22153cd396b7f934 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.341166:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007e70b617/0x22153cd396b7f934 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.341174:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007e70b617/0x22153cd396b7f934 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.341180:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e70b617/0x22153cd396b7f934 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.341191:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826341.341195:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003cc63869/0x22153cd396b7f93b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.341200:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf181f1200 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826341.341203:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003cc63869/0x22153cd396b7f93b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.341208:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003cc63869/0x22153cd396b7f93b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.341216:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003cc63869/0x22153cd396b7f93b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.341222:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003cc63869/0x22153cd396b7f93b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.341230:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826341.341232:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826341.341233:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826341.341642:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585153536 00000100:00100000:3.0:1787826341.341653:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585153536 00000100:00100000:3.0:1787826341.341793:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 718 00000100:00100000:3.0:1787826341.341804:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03986d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1874670585153536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787826341.341828:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43441856 pending 896 free 3919286272 avail 3687763968 00000100:00100000:3.0:1787826341.341913:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03986d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1874670585153536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (7292us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826341.341920:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 718 00002000:00010000:1.0:1787826341.342399:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xfb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826341.342407:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e83c7adc/0x22153cd396b7f942 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xfb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.342421:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xfb:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:1.0:1787826341.342426:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xfb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826341.342432:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e83c7adc/0x22153cd396b7f942 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.342445:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e83c7adc/0x22153cd396b7f942 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.342454:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e83c7adc/0x22153cd396b7f942 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.342461:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e83c7adc/0x22153cd396b7f942 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.342494:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787826341.342572:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xfa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826341.342577:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a075b92/0x22153cd396b7f949 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xfa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.342583:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xfa:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:1.0:1787826341.342586:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xfa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826341.342590:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a075b92/0x22153cd396b7f949 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.342598:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a075b92/0x22153cd396b7f949 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.342606:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a075b92/0x22153cd396b7f949 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.342613:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004a075b92/0x22153cd396b7f949 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.342621:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787826341.342656:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826341.342661:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005949f1d3/0x22153cd396b7f950 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.342668:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf9:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:1.0:1787826341.342671:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826341.342675:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005949f1d3/0x22153cd396b7f950 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.342683:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005949f1d3/0x22153cd396b7f950 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.342691:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005949f1d3/0x22153cd396b7f950 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.342710:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005949f1d3/0x22153cd396b7f950 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.342718:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1787826341.342749:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826341.342753:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002849f543/0x22153cd396b7f957 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.342760:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf8:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:1.0:1787826341.342763:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826341.342766:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002849f543/0x22153cd396b7f957 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.342774:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002849f543/0x22153cd396b7f957 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.342781:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002849f543/0x22153cd396b7f957 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.342787:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002849f543/0x22153cd396b7f957 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.342793:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1787826341.342824:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826341.342829:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b64ea4a/0x22153cd396b7f95e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.342836:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf7:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:1.0:1787826341.342839:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826341.342843:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b64ea4a/0x22153cd396b7f95e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.342852:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b64ea4a/0x22153cd396b7f95e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.342864:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b64ea4a/0x22153cd396b7f95e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.342870:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007b64ea4a/0x22153cd396b7f95e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.343003:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787826341.343009:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e83c7adc/0x22153cd396b7f942 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.343016:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf181f1000 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826341.343020:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e83c7adc/0x22153cd396b7f942 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.343027:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e83c7adc/0x22153cd396b7f942 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.343041:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e83c7adc/0x22153cd396b7f942 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.343047:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e83c7adc/0x22153cd396b7f942 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.343062:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787826341.343065:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004a075b92/0x22153cd396b7f949 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.343069:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf181f1800 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826341.343072:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004a075b92/0x22153cd396b7f949 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.343078:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004a075b92/0x22153cd396b7f949 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.343084:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004a075b92/0x22153cd396b7f949 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.343091:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a075b92/0x22153cd396b7f949 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.343099:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787826341.343102:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005949f1d3/0x22153cd396b7f950 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.343107:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf181f1a00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826341.343109:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005949f1d3/0x22153cd396b7f950 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.343115:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005949f1d3/0x22153cd396b7f950 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.343122:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005949f1d3/0x22153cd396b7f950 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.343127:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005949f1d3/0x22153cd396b7f950 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.343135:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826341.343138:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002849f543/0x22153cd396b7f957 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.343143:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf181f1400 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826341.343145:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002849f543/0x22153cd396b7f957 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.343155:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002849f543/0x22153cd396b7f957 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.343162:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002849f543/0x22153cd396b7f957 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.343167:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002849f543/0x22153cd396b7f957 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.343175:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826341.343177:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826341.343179:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826341.345673:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03985a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:34501:x1874670585153664:12345-0@lo:5:osp-pre-0-0.0 Request processed in 10942us (11120us total) trans 21474836892 rc 0/0 00000100:00100000:0.0:1787826341.345686:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1685 00010000:00010000:1.0:1787826341.347810:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787826341.348556:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826341.348565:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000adb4f398/0x22153cd396b7f965 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.348582:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf6:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:1.0:1787826341.348587:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826341.348593:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000adb4f398/0x22153cd396b7f965 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.348606:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000adb4f398/0x22153cd396b7f965 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.348615:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000adb4f398/0x22153cd396b7f965 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.348623:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000adb4f398/0x22153cd396b7f965 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.348685:0:7460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787826341.348693:0:7460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007b64ea4a/0x22153cd396b7f95e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.348711:0:7460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf181f0c00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826341.348716:0:7460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007b64ea4a/0x22153cd396b7f95e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.348725:0:7460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007b64ea4a/0x22153cd396b7f95e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.348741:0:7460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007b64ea4a/0x22153cd396b7f95e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.348748:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b64ea4a/0x22153cd396b7f95e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.348768:0:7460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826341.348771:0:7460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000adb4f398/0x22153cd396b7f965 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.348776:0:7460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf181f0e00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826341.348779:0:7460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000adb4f398/0x22153cd396b7f965 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.348785:0:7460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000adb4f398/0x22153cd396b7f965 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.348792:0:7460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000adb4f398/0x22153cd396b7f965 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826341.348799:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.348801:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.348803:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826341.348861:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce044d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585153536:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787826341.348917:0:34501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce044d0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:34501:1874670585153664:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1787826341.348928:0:34501:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x101:0x0]-[0x280000401:0x121:0x0] 00010000:00010000:0.0:1787826341.348944:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826341.348949:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826341.354179:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787826341.354909:0:27651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1787826341.355305:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787826341.355316:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000adb4f398/0x22153cd396b7f965 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826341.355401:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787826341.355621:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826341.355628:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002050a528/0x22153cd396b7f96c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.355641:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf5:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:1.0:1787826341.355646:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826341.355652:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002050a528/0x22153cd396b7f96c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.355665:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002050a528/0x22153cd396b7f96c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.355674:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002050a528/0x22153cd396b7f96c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.355680:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002050a528/0x22153cd396b7f96c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.355706:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787826341.355744:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826341.355749:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ffd29ea/0x22153cd396b7f973 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.355757:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf4:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:1.0:1787826341.355760:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826341.355763:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ffd29ea/0x22153cd396b7f973 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.355772:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ffd29ea/0x22153cd396b7f973 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.355779:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ffd29ea/0x22153cd396b7f973 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.355786:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002ffd29ea/0x22153cd396b7f973 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.355804:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787826341.355844:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826341.355849:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d72e9a4f/0x22153cd396b7f97a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.355857:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf3:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:1.0:1787826341.355860:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826341.355863:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d72e9a4f/0x22153cd396b7f97a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826341.356172:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787826341.356180:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002050a528/0x22153cd396b7f96c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826341.356188:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf181f0600 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826341.356193:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002050a528/0x22153cd396b7f96c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826341.356201:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002050a528/0x22153cd396b7f96c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826341.356217:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002050a528/0x22153cd396b7f96c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826341.356224:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002050a528/0x22153cd396b7f96c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826341.356237:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826341.356240:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ffd29ea/0x22153cd396b7f973 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826341.356247:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf181f0400 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826341.356249:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ffd29ea/0x22153cd396b7f973 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826341.356256:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ffd29ea/0x22153cd396b7f973 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826341.356265:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ffd29ea/0x22153cd396b7f973 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826341.356272:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ffd29ea/0x22153cd396b7f973 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826341.356284:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826341.356285:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826341.356287:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826341.356392:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826341.356966:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d72e9a4f/0x22153cd396b7f97a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.356982:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d72e9a4f/0x22153cd396b7f97a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.356989:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d72e9a4f/0x22153cd396b7f97a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.357010:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787826341.357081:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826341.357087:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000443e7f87/0x22153cd396b7f981 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.357096:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf2:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:1.0:1787826341.357100:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826341.357106:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000443e7f87/0x22153cd396b7f981 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.357116:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000443e7f87/0x22153cd396b7f981 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.357125:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000443e7f87/0x22153cd396b7f981 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.357134:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000443e7f87/0x22153cd396b7f981 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.357155:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787826341.357189:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826341.357193:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001da2532b/0x22153cd396b7f988 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.357201:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf1:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:1.0:1787826341.357204:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826341.357207:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001da2532b/0x22153cd396b7f988 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.357215:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001da2532b/0x22153cd396b7f988 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.357222:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001da2532b/0x22153cd396b7f988 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.357228:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001da2532b/0x22153cd396b7f988 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.357240:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1787826341.357287:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826341.357292:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003cc63869/0x22153cd396b7f98f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.357300:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf0:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:1.0:1787826341.357303:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826341.357307:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003cc63869/0x22153cd396b7f98f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.357316:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003cc63869/0x22153cd396b7f98f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.357322:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003cc63869/0x22153cd396b7f98f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.357329:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003cc63869/0x22153cd396b7f98f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.357340:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1787826341.357377:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826341.357382:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e70b617/0x22153cd396b7f996 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.357389:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xef:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:1.0:1787826341.357391:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xef:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826341.357395:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e70b617/0x22153cd396b7f996 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.357403:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e70b617/0x22153cd396b7f996 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.357410:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e70b617/0x22153cd396b7f996 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.357417:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007e70b617/0x22153cd396b7f996 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.357425:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1787826341.357460:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826341.357464:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c5f1db2/0x22153cd396b7f99d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.357495:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xee:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:1.0:1787826341.357499:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xee:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826341.357502:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c5f1db2/0x22153cd396b7f99d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.357511:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c5f1db2/0x22153cd396b7f99d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826341.357778:0:7460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1787826341.357785:0:7460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d72e9a4f/0x22153cd396b7f97a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826341.357792:0:7460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf181f0a00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826341.357796:0:7460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d72e9a4f/0x22153cd396b7f97a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826341.357805:0:7460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d72e9a4f/0x22153cd396b7f97a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826341.357821:0:7460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d72e9a4f/0x22153cd396b7f97a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826341.357827:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d72e9a4f/0x22153cd396b7f97a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826341.357849:0:7460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787826341.357852:0:7460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000443e7f87/0x22153cd396b7f981 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826341.357858:0:7460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf181f1e00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826341.357862:0:7460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000443e7f87/0x22153cd396b7f981 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826341.357868:0:7460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000443e7f87/0x22153cd396b7f981 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826341.358077:0:7460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000443e7f87/0x22153cd396b7f981 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826341.358085:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000443e7f87/0x22153cd396b7f981 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826341.358099:0:7460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787826341.358103:0:7460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001da2532b/0x22153cd396b7f988 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826341.358108:0:7460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf181f0000 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826341.358112:0:7460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001da2532b/0x22153cd396b7f988 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826341.358120:0:7460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001da2532b/0x22153cd396b7f988 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826341.358150:0:7460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001da2532b/0x22153cd396b7f988 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826341.358157:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001da2532b/0x22153cd396b7f988 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826341.358170:0:7460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787826341.358174:0:7460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003cc63869/0x22153cd396b7f98f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826341.358179:0:7460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf181f1200 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826341.358182:0:7460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003cc63869/0x22153cd396b7f98f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826341.358190:0:7460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003cc63869/0x22153cd396b7f98f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826341.358198:0:7460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003cc63869/0x22153cd396b7f98f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826341.358205:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003cc63869/0x22153cd396b7f98f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826341.358217:0:7460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826341.358220:0:7460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007e70b617/0x22153cd396b7f996 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826341.358226:0:7460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf181f0800 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826341.358229:0:7460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007e70b617/0x22153cd396b7f996 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826341.358238:0:7460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007e70b617/0x22153cd396b7f996 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826341.358246:0:7460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007e70b617/0x22153cd396b7f996 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826341.358252:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e70b617/0x22153cd396b7f996 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826341.358269:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826341.358271:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826341.358273:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826341.358281:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826341.358795:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c5f1db2/0x22153cd396b7f99d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.358804:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004c5f1db2/0x22153cd396b7f99d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.358819:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787826341.358907:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826341.358913:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1d3d067/0x22153cd396b7f9a4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.358924:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xed:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:1.0:1787826341.358927:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xed:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826341.358932:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1d3d067/0x22153cd396b7f9a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.358941:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1d3d067/0x22153cd396b7f9a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.358949:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1d3d067/0x22153cd396b7f9a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.358955:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1d3d067/0x22153cd396b7f9a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.358967:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787826341.359000:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826341.359004:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8d36182/0x22153cd396b7f9ab lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.359011:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xec:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:1.0:1787826341.359013:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xec:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826341.359017:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8d36182/0x22153cd396b7f9ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.359024:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e8d36182/0x22153cd396b7f9ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.359036:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8d36182/0x22153cd396b7f9ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.359042:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e8d36182/0x22153cd396b7f9ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.359049:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1787826341.359105:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xeb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826341.359110:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b608887/0x22153cd396b7f9b2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xeb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.359118:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xeb:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:1.0:1787826341.359121:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xeb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826341.359125:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b608887/0x22153cd396b7f9b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xeb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.359133:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b608887/0x22153cd396b7f9b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xeb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.359140:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b608887/0x22153cd396b7f9b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xeb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.359147:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b608887/0x22153cd396b7f9b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xeb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.359159:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1787826341.359199:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826341.359204:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c6f0c33/0x22153cd396b7f9b9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.359211:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xea:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:1.0:1787826341.359214:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826341.359218:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c6f0c33/0x22153cd396b7f9b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.359226:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c6f0c33/0x22153cd396b7f9b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.359233:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c6f0c33/0x22153cd396b7f9b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.359239:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c6f0c33/0x22153cd396b7f9b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.359246:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1787826341.359278:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826341.359283:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9e5b8b8/0x22153cd396b7f9c0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.359290:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe9:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:1.0:1787826341.359293:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826341.359297:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9e5b8b8/0x22153cd396b7f9c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.359306:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9e5b8b8/0x22153cd396b7f9c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.359313:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9e5b8b8/0x22153cd396b7f9c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.359319:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9e5b8b8/0x22153cd396b7f9c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.359327:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:1.0:1787826341.359361:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826341.359366:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b7f9c7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.359373:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe8:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:1.0:1787826341.359375:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826341.359380:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b7f9c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.359388:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b7f9c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.359396:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b7f9c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.359403:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b7f9c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.359411:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:1.0:1787826341.359446:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826341.359451:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab580749/0x22153cd396b7f9ce lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.359457:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe7:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:1.0:1787826341.359461:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826341.359465:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab580749/0x22153cd396b7f9ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.359494:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab580749/0x22153cd396b7f9ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.359501:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab580749/0x22153cd396b7f9ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.359509:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab580749/0x22153cd396b7f9ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.359517:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:1.0:1787826341.359551:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826341.359556:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aab8d1d7/0x22153cd396b7f9d5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.359563:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe6:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:1.0:1787826341.359566:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826341.359570:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aab8d1d7/0x22153cd396b7f9d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.359578:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aab8d1d7/0x22153cd396b7f9d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.359585:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aab8d1d7/0x22153cd396b7f9d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.359592:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aab8d1d7/0x22153cd396b7f9d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.359600:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:1.0:1787826341.359634:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826341.359638:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c25d1558/0x22153cd396b7f9dc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.359646:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe5:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:1.0:1787826341.359648:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826341.359652:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c25d1558/0x22153cd396b7f9dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.359661:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c25d1558/0x22153cd396b7f9dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.359674:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c25d1558/0x22153cd396b7f9dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.359680:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c25d1558/0x22153cd396b7f9dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.359689:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:1.0:1787826341.359737:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826341.359743:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004da8c6f7/0x22153cd396b7f9e3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.359750:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe4:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:1.0:1787826341.359753:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826341.359758:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004da8c6f7/0x22153cd396b7f9e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.359767:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004da8c6f7/0x22153cd396b7f9e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.359775:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004da8c6f7/0x22153cd396b7f9e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.359781:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004da8c6f7/0x22153cd396b7f9e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.359794:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:1.0:1787826341.359829:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826341.359834:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005de2a530/0x22153cd396b7f9ea lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.359842:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe3:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:1.0:1787826341.359844:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826341.359848:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005de2a530/0x22153cd396b7f9ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.359857:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005de2a530/0x22153cd396b7f9ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.359863:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005de2a530/0x22153cd396b7f9ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.359871:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005de2a530/0x22153cd396b7f9ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.359878:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00002000:00010000:1.0:1787826341.359912:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826341.359916:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c800962/0x22153cd396b7f9f1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.359923:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe2:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:1.0:1787826341.359926:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826341.359929:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c800962/0x22153cd396b7f9f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.359937:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c800962/0x22153cd396b7f9f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.359944:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c800962/0x22153cd396b7f9f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.359950:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c800962/0x22153cd396b7f9f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.359959:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00002000:00010000:1.0:1787826341.359991:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826341.359995:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088c1e0c0/0x22153cd396b7f9f8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.360003:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe1:0x0].0x0 since=1287s v=(0 0) 00010000:00010000:1.0:1787826341.360005:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826341.360008:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088c1e0c0/0x22153cd396b7f9f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.360017:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088c1e0c0/0x22153cd396b7f9f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.360024:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088c1e0c0/0x22153cd396b7f9f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.360030:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088c1e0c0/0x22153cd396b7f9f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826341.360037:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00002000:00080000:1.0:1787826341.360065:0:8437:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:224 00000100:00100000:1.0:1787826341.360157:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f936580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:34503:x1874670585153408:12345-0@lo:5:osp-pre-1-0.0 Request processed in 83274us (83521us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826341.360165:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1684 00000100:00100000:1.0:1787826341.360216:0:34503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab161c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:34503:1874670585153408:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1787826341.360230:0:34503:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x101:0x0] from OST, last_created [0x2c0000401:0x101:0x0]last_used is [0x2c0000401:0xe0:0x0] 00000100:00100000:1.0:1787826341.360292:0:34503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab92580 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:34503:1874670585153920:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787826341.360321:0:34503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826341.360342:0:34503:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce06a860c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826341.360359:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab90b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585153792:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826341.360381:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826341.360418:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585153920 00000100:00100000:1.0:1787826341.360424:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585153920 00000100:00100000:1.0:1787826341.360462:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1686 00000100:00100000:1.0:1787826341.360494:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:34503:x1874670585153920:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1787826341.360530:0:30695:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 258 00010000:00010000:2.0:1787826341.364940:0:7460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00010000:00010000:2.0:1787826341.364953:0:7460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004c5f1db2/0x22153cd396b7f99d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826341.364966:0:7460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf181f1600 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826341.364971:0:7460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004c5f1db2/0x22153cd396b7f99d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826341.364981:0:7460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004c5f1db2/0x22153cd396b7f99d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826341.365000:0:7460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004c5f1db2/0x22153cd396b7f99d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826341.365012:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c5f1db2/0x22153cd396b7f99d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826341.365032:0:7460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:2.0:1787826341.365035:0:7460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1d3d067/0x22153cd396b7f9a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826341.365041:0:7460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf181f1c00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826341.365043:0:7460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1d3d067/0x22153cd396b7f9a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826341.365049:0:7460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1d3d067/0x22153cd396b7f9a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826341.365058:0:7460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1d3d067/0x22153cd396b7f9a4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826341.365064:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1d3d067/0x22153cd396b7f9a4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826341.365073:0:7460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:2.0:1787826341.365077:0:7460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e8d36182/0x22153cd396b7f9ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826341.365082:0:7460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf181f0200 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826341.365085:0:7460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8d36182/0x22153cd396b7f9ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826341.365091:0:7460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8d36182/0x22153cd396b7f9ab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826341.365098:0:7460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e8d36182/0x22153cd396b7f9ab lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826341.365103:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8d36182/0x22153cd396b7f9ab lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.365851:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:3.0:1787826341.365860:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b608887/0x22153cd396b7f9b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xeb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.365877:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834e00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826341.365880:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b608887/0x22153cd396b7f9b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xeb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.365890:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b608887/0x22153cd396b7f9b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xeb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.365904:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b608887/0x22153cd396b7f9b2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xeb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.365913:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b608887/0x22153cd396b7f9b2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xeb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.365933:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:3.0:1787826341.365936:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c6f0c33/0x22153cd396b7f9b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.365942:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834600 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826341.365946:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c6f0c33/0x22153cd396b7f9b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.365953:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c6f0c33/0x22153cd396b7f9b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.365962:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c6f0c33/0x22153cd396b7f9b9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.365969:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c6f0c33/0x22153cd396b7f9b9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.365979:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:3.0:1787826341.365983:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9e5b8b8/0x22153cd396b7f9c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.365989:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834400 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826341.365993:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9e5b8b8/0x22153cd396b7f9c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.366001:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9e5b8b8/0x22153cd396b7f9c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.366009:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9e5b8b8/0x22153cd396b7f9c0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.366015:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9e5b8b8/0x22153cd396b7f9c0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.366025:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1787826341.366028:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b7f9c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.366033:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834a00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826341.366036:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b7f9c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.366044:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b7f9c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.366052:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b7f9c7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.366059:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b7f9c7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.366070:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1787826341.366073:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab580749/0x22153cd396b7f9ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.366079:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835e00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826341.366082:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab580749/0x22153cd396b7f9ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.366089:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab580749/0x22153cd396b7f9ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.366097:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab580749/0x22153cd396b7f9ce lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.366103:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab580749/0x22153cd396b7f9ce lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.366113:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1787826341.366116:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aab8d1d7/0x22153cd396b7f9d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.366121:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834000 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826341.366124:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aab8d1d7/0x22153cd396b7f9d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.366137:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aab8d1d7/0x22153cd396b7f9d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.366144:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aab8d1d7/0x22153cd396b7f9d5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.366151:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aab8d1d7/0x22153cd396b7f9d5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.366161:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1787826341.366164:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c25d1558/0x22153cd396b7f9dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.366169:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834200 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826341.366172:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c25d1558/0x22153cd396b7f9dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.366179:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c25d1558/0x22153cd396b7f9dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.366187:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c25d1558/0x22153cd396b7f9dc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.366193:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c25d1558/0x22153cd396b7f9dc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.366207:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787826341.366210:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004da8c6f7/0x22153cd396b7f9e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.366216:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835c00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826341.366219:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004da8c6f7/0x22153cd396b7f9e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.366225:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004da8c6f7/0x22153cd396b7f9e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.366233:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004da8c6f7/0x22153cd396b7f9e3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.366239:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004da8c6f7/0x22153cd396b7f9e3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.366248:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787826341.366251:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005de2a530/0x22153cd396b7f9ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.366257:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835600 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826341.366260:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005de2a530/0x22153cd396b7f9ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.366271:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005de2a530/0x22153cd396b7f9ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.366280:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005de2a530/0x22153cd396b7f9ea lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.366287:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005de2a530/0x22153cd396b7f9ea lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.366296:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787826341.366299:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c800962/0x22153cd396b7f9f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.366304:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834800 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826341.366307:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c800962/0x22153cd396b7f9f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.366313:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c800962/0x22153cd396b7f9f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.366321:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c800962/0x22153cd396b7f9f1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.366327:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c800962/0x22153cd396b7f9f1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.366342:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826341.366345:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088c1e0c0/0x22153cd396b7f9f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.366351:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835200 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826341.366354:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088c1e0c0/0x22153cd396b7f9f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.366360:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088c1e0c0/0x22153cd396b7f9f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.366368:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088c1e0c0/0x22153cd396b7f9f8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.366375:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088c1e0c0/0x22153cd396b7f9f8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826341.366386:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826341.366388:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826341.366390:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826341.366397:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826341.366905:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826341.370410:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585153792 00000100:00100000:0.0:1787826341.370422:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585153792 00000100:00100000:0.0:1787826341.370543:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 719 00000100:00100000:0.0:1787826341.370553:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f88f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1874670585153792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787826341.370576:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 60260032 pending 896 free 3921387520 avail 3689865216 00000100:00100000:0.0:1787826341.370660:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f88f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1874670585153792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (10278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826341.370667:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 719 00000100:00100000:1.0:1787826341.373858:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:34503:x1874670585153920:12345-0@lo:5:osp-pre-1-0.0 Request processed in 13381us (13528us total) trans 17179869570 rc 0/0 00010000:00010000:2.0:1787826341.374358:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826341.374361:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826341.374363:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826341.374426:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1686 00000100:00100000:1.0:1787826341.374518:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab90b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585153792:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826341.374560:0:34503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab92580 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:34503:1874670585153920:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1787826341.374571:0:34503:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x101:0x0]-[0x2c0000401:0x121:0x0] 00000100:00100000:1.0:1787826341.635706:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787826341.635727:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f88da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585154048:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826341.635789:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826341.635836:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585154048 00000100:00100000:1.0:1787826341.635843:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585154048 00000100:00100000:1.0:1787826341.635890:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 720 00000100:00100000:1.0:1787826341.635898:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f88f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874670585154048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787826341.635920:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 60259136 pending 0 free 3921387520 avail 3689865216 00000100:00100000:1.0:1787826341.635963:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f88f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874670585154048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826341.635970:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 720 00000100:00100000:1.0:1787826341.636014:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f88da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585154048:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826341.636109:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787826341.636119:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03984000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585154176:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826341.636157:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826341.636186:0:12021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585154176 00000100:00100000:0.0:1787826341.636189:0:12021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585154176 00000100:00100000:0.0:1787826341.636214:0:12021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 721 00000100:00100000:0.0:1787826341.636221:0:12021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03986580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874670585154176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787826341.636232:0:12021:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43440960 pending 0 free 3919286272 avail 3687763968 00000100:00100000:0.0:1787826341.636262:0:12021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03986580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874670585154176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 42us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826341.636269:0:12021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 721 00000100:00100000:0.0:1787826341.636300:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03984000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585154176:0@lo:13:osp-pre-0-1.0 00000020:00000004:3.0:1787826341.746676:0:34821:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787826341.748738:0:34821:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787826342.032794:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826342.032827:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826342.032851:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826342.032883:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826342.032905:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826342.032925:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563646080 00000100:00100000:3.0:1787826342.032933:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563646080 00000100:00100000:3.0:1787826342.032971:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563646208 00000100:00100000:3.0:1787826342.032973:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563646208 00000100:00100000:3.0:1787826342.032997:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1472 00000100:00100000:3.0:1787826342.033005:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8f8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563646080:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1787826342.033132:0:34487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563645952 00000100:00100000:0.0:1787826342.033137:0:34487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563645952 00000100:00100000:0.0:1787826342.033172:0:34487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 72 00000100:00100000:0.0:1787826342.033180:0:34487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce030aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:307626ff-a376-4faf-93e0-9f55b723d964+10:2404:x1874670563645952:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1787826342.033229:0:34487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce030aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:307626ff-a376-4faf-93e0-9f55b723d964+10:2404:x1874670563645952:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 50us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826342.033237:0:34487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 72 00000100:00100000:3.0:1787826342.033322:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8f8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563646080:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 316us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826342.033330:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1472 00000100:00100000:3.0:1787826342.033344:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1473 00000100:00100000:3.0:1787826342.033351:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8fa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:2404:x1874670563646208:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1787826342.033376:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8fa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:2404:x1874670563646208:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 26us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826342.033382:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1473 00000100:00100000:3.0:1787826342.033405:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563646464 00000100:00100000:3.0:1787826342.037027:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563646464 00000100:00100000:3.0:1787826342.037219:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563646336 00000100:00100000:3.0:1787826342.037225:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563646336 00000100:00100000:3.0:1787826342.037507:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 866 00000100:00100000:3.0:1787826342.037519:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8fbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563646464:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1787826342.037598:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8fbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563646464:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 83us (4714us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826342.037607:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 866 00000100:00100000:3.0:1787826342.037628:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 867 00000100:00100000:3.0:1787826342.037637:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8fa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670563646336:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1787826342.037665:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8fa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670563646336:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 30us (4759us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826342.037673:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 867 00000100:00080000:3.0:1787826342.038556:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787826342.038562:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787826342.038565:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00080000:3.0:1787826342.162734:0:7449:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967581 is committed 00010000:00010000:1.0:1787826342.219676:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787826342.817323:0:34871:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787826342.819865:0:34871:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787826343.238586:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826344.268394:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826344.821935:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826344.825667:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563646592 00000100:00100000:0.0:1787826344.825691:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563646592 00000100:00100000:0.0:1787826344.825866:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3313 00000100:00100000:0.0:1787826344.825878:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce038903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:51329:x1874670563646592:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826344.825899:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826344.825920:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661200/0x22153cd396b7f9ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab016b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826344.825984:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660e00/0x22153cd396b7fa06 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826344.825999:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660e00/0x22153cd396b7fa06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826344.826010:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660e00/0x22153cd396b7fa06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826344.826061:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787826344.826065:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826344.826086:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660e00/0x22153cd396b7fa06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826344.826112:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661200/0x22153cd396b7f9ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab016b expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826344.826132:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660e00/0x22153cd396b7fa06 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab016b expref: 13 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826344.826141:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ce01f45300) 00010000:00010000:0.0:1787826344.826144:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787826344.826147:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05660e00, rc 0) 00000100:00100000:0.0:1787826344.826233:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce038903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:51329:x1874670563646592:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 357us (4307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826344.826241:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3313 00000100:00080000:3.0:1787826344.830423:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787826344.839798:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826344.840014:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563646720 00000100:00100000:3.0:1787826344.840033:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563646720 00000100:00100000:3.0:1787826344.840129:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3314 00000100:00100000:3.0:1787826344.840143:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03984f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:51329:x1874670563646720:12345-192.168.203.39@tcp:41:lfs.0 00000004:00000024:3.0:1787826344.840211:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445965824 avail 1299726336 00000100:00100000:3.0:1787826344.840329:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03984f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:51329:x1874670563646720:12345-192.168.203.39@tcp:41:lfs.0 Request processed in 179us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826344.840338:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3314 00000100:00100000:1.0:1787826344.843144:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826344.843224:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563646848 00000100:00100000:3.0:1787826344.843234:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563646848 00000100:00100000:3.0:1787826344.843306:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3315 00000100:00100000:3.0:1787826344.843315:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f88da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:51329:x1874670563646848:12345-192.168.203.39@tcp:41:lfs.0 00000004:00000024:3.0:1787826344.843349:0:32404:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446240256 avail 1300000768 00000100:00080000:1.0:1787826344.843549:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787826344.843663:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f88da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:51329:x1874670563646848:12345-192.168.203.39@tcp:41:lfs.0 Request processed in 348us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826344.843681:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3315 00000100:00100000:0.0:1787826344.852940:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826344.853032:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563646976 00000100:00100000:1.0:1787826344.853042:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563646976 00000100:00100000:1.0:1787826344.853122:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 722 00000100:00100000:1.0:1787826344.853133:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03984780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:51329:x1874670563646976:12345-192.168.203.39@tcp:13:lfs.0 00002000:00000024:1.0:1787826344.853161:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43440960 pending 0 free 3919286272 avail 3687763968 00000100:00100000:1.0:1787826344.853240:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03984780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:51329:x1874670563646976:12345-192.168.203.39@tcp:13:lfs.0 Request processed in 109us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826344.853252:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 722 00000100:00080000:3.0:1787826344.853931:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826344.855414:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826344.855745:0:12021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563647104 00000100:00100000:0.0:1787826344.855756:0:12021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563647104 00000100:00100000:0.0:1787826344.855834:0:12021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 723 00000100:00100000:0.0:1787826344.855844:0:12021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aaf1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:51329:x1874670563647104:12345-192.168.203.39@tcp:13:lfs.0 00002000:00000024:0.0:1787826344.855943:0:12021:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 60259136 pending 0 free 3921387520 avail 3689865216 00000100:00100000:0.0:1787826344.856018:0:12021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aaf1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:51329:x1874670563647104:12345-192.168.203.39@tcp:13:lfs.0 Request processed in 175us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826344.856025:0:12021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 723 00000100:00080000:3.0:1787826344.856139:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787826345.284656:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826346.243750:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787826346.243773:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03892580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585154304:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787826346.243871:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826346.244081:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585154304 00000100:00100000:3.0:1787826346.244089:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585154304 00000100:00100000:3.0:1787826346.244140:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1326 00000100:00100000:3.0:1787826346.244150:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aaf0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3644:x1874670585154304:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787826346.244187:0:7796:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445965824 avail 1299726336 00000100:00100000:3.0:1787826346.244239:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aaf0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3644:x1874670585154304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826346.244246:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1326 00000100:00100000:0.0:1787826346.244909:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03985680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585154432:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826346.244943:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826346.244994:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585154432 00000100:00100000:0.0:1787826346.244999:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585154432 00000100:00100000:0.0:1787826346.245028:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1327 00000100:00100000:0.0:1787826346.245035:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03987480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874670585154432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787826346.245055:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446240256 avail 1300000768 00000100:00100000:0.0:1787826346.245090:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03987480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874670585154432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 55us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826346.245096:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1327 00000100:00100000:0.0:1787826346.245129:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967581 gen 2 00000004:00080000:0.0:1787826346.245134:0:3646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967579 committed transno 4294967581 00000004:00080000:0.0:1787826346.245154:0:3646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967580 committed transno 4294967581 00000004:00080000:0.0:1787826346.245166:0:3646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967581 committed transno 4294967581 00000100:00100000:0.0:1787826346.245181:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03985680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585154432:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787826346.246022:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03892580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585154304:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787826346.246208:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aaf21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e3c550b8-2c3c-46c3-ad36-671c284167ea:3647:1874670585154560:0@lo:400:kworker.0 00000100:00100000:2.0:1787826346.246248:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826346.246274:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aaf0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874670585155072:0@lo:400:kworker.0 00000100:00100000:2.0:1787826346.246299:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826346.246316:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aaf2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585155584:0@lo:400:kworker.0 00000100:00100000:2.0:1787826346.246343:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826346.246363:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787826346.246368:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aaf2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585154944:0@lo:400:kworker.0 00000100:00100000:2.0:1787826346.246389:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826346.246406:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aaf0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1874670585155456:0@lo:400:kworker.0 00000100:00100000:2.0:1787826346.246426:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826346.246452:0:34488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585154560 00000100:00100000:2.0:1787826346.246456:0:34488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585154560 00000100:00100000:2.0:1787826346.246509:0:34488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787826346.246517:0:34488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce030aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3c550b8-2c3c-46c3-ad36-671c284167ea+24:3647:x1874670585154560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826346.246551:0:34488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce030aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3c550b8-2c3c-46c3-ad36-671c284167ea+24:3647:x1874670585154560:12345-0@lo:400:kworker.0 Request processed in 35us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826346.246557:0:34488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787826346.246580:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585155072 00000100:00100000:2.0:1787826346.246583:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585155072 00000100:00100000:2.0:1787826346.246609:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585155456 00000100:00100000:2.0:1787826346.246611:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585155456 00000100:00100000:2.0:1787826346.246627:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1474 00000100:00100000:2.0:1787826346.246633:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03aec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874670585155072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826346.246657:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03aec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874670585155072:12345-0@lo:400:kworker.0 Request processed in 25us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826346.246675:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1474 00000100:00100000:2.0:1787826346.246686:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1475 00000100:00100000:2.0:1787826346.246691:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f807840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874670585155456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826346.246712:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f807840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874670585155456:12345-0@lo:400:kworker.0 Request processed in 22us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826346.246721:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1475 00000100:00100000:2.0:1787826346.246736:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585155584 00000100:00100000:2.0:1787826346.246738:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585155584 00000100:00100000:2.0:1787826346.246757:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585154944 00000100:00100000:2.0:1787826346.246759:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585154944 00000100:00100000:2.0:1787826346.246772:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 868 00000100:00100000:2.0:1787826346.246777:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03aef840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3647:x1874670585155584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826346.246800:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03aef840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3647:x1874670585155584:12345-0@lo:400:kworker.0 Request processed in 23us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826346.246805:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 868 00000100:00100000:2.0:1787826346.246813:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 869 00000100:00100000:2.0:1787826346.246818:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f052c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3647:x1874670585154944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826346.246848:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f052c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3647:x1874670585154944:12345-0@lo:400:kworker.0 Request processed in 18us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826346.246854:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 869 00000100:00080000:2.0:1787826346.246876:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787826346.246880:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787826346.246882:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787826346.246884:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787826346.246896:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aaf03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585154816:0@lo:400:kworker.0 00000100:00100000:2.0:1787826346.246917:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826346.246930:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aaf2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1874670585155328:0@lo:400:kworker.0 00000100:00100000:2.0:1787826346.246945:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826346.246957:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03a18b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874670585155840:0@lo:400:kworker.0 00000100:00100000:2.0:1787826346.246976:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826346.246989:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787826346.246995:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aaf3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874670585154688:0@lo:400:kworker.0 00000100:00100000:2.0:1787826346.247011:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826346.247022:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aaf12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1874670585155200:0@lo:400:kworker.0 00000100:00100000:2.0:1787826346.247037:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826346.247046:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aaf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585155712:0@lo:400:kworker.0 00000100:00100000:2.0:1787826346.247063:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826346.247080:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585155328 00000100:00100000:2.0:1787826346.247083:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585155328 00000100:00100000:2.0:1787826346.247103:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585155840 00000100:00100000:2.0:1787826346.247105:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585155840 00000100:00100000:2.0:1787826346.247114:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585154688 00000100:00100000:2.0:1787826346.247116:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585154688 00000100:00100000:2.0:1787826346.247126:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585155200 00000100:00100000:2.0:1787826346.247128:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585155200 00000100:00100000:2.0:1787826346.247139:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1476 00000100:00100000:2.0:1787826346.247144:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f806d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874670585155328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826346.247171:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f806d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874670585155328:12345-0@lo:400:kworker.0 Request processed in 27us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826346.247176:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1476 00000100:00100000:2.0:1787826346.247186:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1477 00000100:00100000:2.0:1787826346.247191:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874670585155840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826346.247209:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874670585155840:12345-0@lo:400:kworker.0 Request processed in 19us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826346.247214:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1477 00000100:00100000:2.0:1787826346.247222:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1478 00000100:00100000:2.0:1787826346.247227:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03b90f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874670585154688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826346.247246:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03b90f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874670585154688:12345-0@lo:400:kworker.0 Request processed in 20us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826346.247252:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1478 00000100:00100000:2.0:1787826346.247260:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1479 00000100:00100000:2.0:1787826346.247265:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03b93c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874670585155200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826346.247282:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03b93c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874670585155200:12345-0@lo:400:kworker.0 Request processed in 17us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826346.247287:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1479 00000100:00080000:2.0:1787826346.247308:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787826346.247310:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787826346.247333:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aaf3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874670585154688:0@lo:400:kworker.0 00000100:00100000:2.0:1787826346.247341:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aaf12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1874670585155200:0@lo:400:kworker.0 00000100:00100000:2.0:1787826346.247348:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aaf2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1874670585155328:0@lo:400:kworker.0 00000100:00100000:2.0:1787826346.247356:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03a18b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874670585155840:0@lo:400:kworker.0 00000100:00100000:2.0:1787826346.247385:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aaf2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585154944:0@lo:400:kworker.0 00000100:00100000:2.0:1787826346.247394:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aaf0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1874670585155456:0@lo:400:kworker.0 00000100:00100000:2.0:1787826346.247400:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aaf21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e3c550b8-2c3c-46c3-ad36-671c284167ea:3647:1874670585154560:0@lo:400:kworker.0 00000100:00100000:2.0:1787826346.247408:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aaf0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874670585155072:0@lo:400:kworker.0 00000100:00100000:2.0:1787826346.247415:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aaf2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585155584:0@lo:400:kworker.0 00000100:00100000:1.0:1787826346.247611:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585154816 00000100:00100000:1.0:1787826346.247616:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585154816 00000100:00100000:1.0:1787826346.247650:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585155712 00000100:00100000:1.0:1787826346.247653:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585155712 00000100:00100000:1.0:1787826346.247680:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 870 00000100:00100000:1.0:1787826346.247686:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f806580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3645:x1874670585154816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826346.247720:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f806580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3645:x1874670585154816:12345-0@lo:400:kworker.0 Request processed in 35us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826346.247725:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 870 00000100:00100000:1.0:1787826346.247735:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 871 00000100:00100000:1.0:1787826346.247740:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03b93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3645:x1874670585155712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826346.247759:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03b93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3645:x1874670585155712:12345-0@lo:400:kworker.0 Request processed in 19us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826346.247764:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 871 00000100:00100000:1.0:1787826346.247794:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aaf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585155712:0@lo:400:kworker.0 00000100:00100000:1.0:1787826346.247802:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aaf03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585154816:0@lo:400:kworker.0 00000100:00080000:2.0:1787826346.250163:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787826346.250171:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787826346.310144:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826346.756165:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f88c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585155968:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826346.756235:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826346.756293:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585155968 00000100:00100000:1.0:1787826346.756301:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585155968 00000100:00100000:1.0:1787826346.756351:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 724 00000100:00100000:1.0:1787826346.756360:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f88e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874670585155968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787826346.756391:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 60259136 pending 0 free 3921387520 avail 3689865216 00000100:00100000:1.0:1787826346.756435:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f88e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874670585155968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826346.756442:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 724 00000100:00100000:1.0:1787826346.756513:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f88c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585155968:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826346.757292:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03893840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585156096:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787826346.757327:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826346.759144:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03985680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585156224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787826346.759192:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826346.759233:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787826346.759240:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03b92d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585156352:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826346.759261:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826346.759290:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585156096 00000100:00100000:2.0:1787826346.759296:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585156096 00000100:00100000:2.0:1787826346.759331:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585156224 00000100:00100000:2.0:1787826346.759334:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585156224 00000100:00100000:2.0:1787826346.759345:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585156352 00000100:00100000:2.0:1787826346.759347:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585156352 00000100:00100000:2.0:1787826346.759360:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 725 00000100:00100000:2.0:1787826346.759367:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03b903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1874670585156096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787826346.759387:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 60259136 pending 0 free 3921387520 avail 3689865216 00000100:00100000:2.0:1787826346.759427:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03b903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1874670585156096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (2098us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826346.759433:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 725 00000100:00100000:2.0:1787826346.759449:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 726 00000100:00100000:2.0:1787826346.759455:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03b93840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1874670585156224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787826346.759494:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43440960 pending 0 free 3919286272 avail 3687763968 00000100:00100000:2.0:1787826346.759526:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03b93840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1874670585156224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826346.759532:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 726 00000100:00100000:2.0:1787826346.759544:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 727 00000100:00100000:2.0:1787826346.759550:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03b90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874670585156352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787826346.759560:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43440960 pending 0 free 3919286272 avail 3687763968 00000100:00100000:2.0:1787826346.759583:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03b90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874670585156352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 34us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826346.759590:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 727 00000100:00100000:2.0:1787826346.759633:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03893840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585156096:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787826346.759676:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03b92d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585156352:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826346.759690:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03985680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585156224:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1787826346.761571:0:27651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179869570 is committed 00000001:00080000:2.0:1787826346.765501:0:26205:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836892 is committed 00000100:00100000:0.0:1787826347.164054:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826347.164100:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826347.164129:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826347.164153:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826347.164181:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826347.164208:0:34487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563647232 00000100:00100000:0.0:1787826347.164217:0:34487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563647232 00000100:00100000:0.0:1787826347.164261:0:34487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 74 00000100:00100000:0.0:1787826347.164270:0:34487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03573050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:307626ff-a376-4faf-93e0-9f55b723d964+10:2403:x1874670563647232:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1787826347.164334:0:34487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03573050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:307626ff-a376-4faf-93e0-9f55b723d964+10:2403:x1874670563647232:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 64us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826347.164341:0:34487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 74 00000100:00100000:0.0:1787826347.164375:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563647488 00000100:00100000:0.0:1787826347.164379:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563647488 00000100:00100000:0.0:1787826347.164416:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563647360 00000100:00100000:0.0:1787826347.164419:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563647360 00000100:00100000:0.0:1787826347.164442:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1480 00000100:00100000:0.0:1787826347.164449:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03987c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:2403:x1874670563647488:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1787826347.164499:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03987c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:2403:x1874670563647488:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 51us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826347.164506:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1480 00000100:00100000:0.0:1787826347.164517:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1481 00000100:00100000:0.0:1787826347.164522:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03984000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2403:x1874670563647360:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1787826347.164542:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03984000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2403:x1874670563647360:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 19us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826347.164547:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1481 00000100:00100000:0.0:1787826347.164562:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563647744 00000100:00100000:0.0:1787826347.164565:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563647744 00000100:00100000:0.0:1787826347.164585:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563647616 00000100:00100000:0.0:1787826347.164587:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563647616 00000100:00100000:0.0:1787826347.164604:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 872 00000100:00100000:0.0:1787826347.164609:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03985680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670563647744:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1787826347.164632:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03985680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670563647744:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 22us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826347.164638:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 872 00000100:00100000:0.0:1787826347.164648:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 873 00000100:00100000:0.0:1787826347.164653:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf2f45c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670563647616:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1787826347.164692:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf2f45c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670563647616:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 38us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826347.164701:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 873 00000100:00080000:0.0:1787826347.164846:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787826347.164851:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787826347.164854:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787826347.164856:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1787826347.335589:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826348.360924:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826349.379689:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826350.404229:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826351.363916:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03891680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585156480:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826351.363989:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826351.364046:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787826351.364052:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf2f45c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e3c550b8-2c3c-46c3-ad36-671c284167ea:3646:1874670585156608:0@lo:400:kworker.0 00000100:00100000:1.0:1787826351.364080:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826351.364115:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585156480 00000100:00100000:1.0:1787826351.364122:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585156480 00000100:00100000:1.0:1787826351.364165:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1328 00000100:00100000:1.0:1787826351.364174:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f88ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3646:x1874670585156480:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787826351.364203:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445965824 avail 1299726336 00000100:00100000:1.0:1787826351.364255:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f88ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3646:x1874670585156480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826351.364266:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1328 00000100:00100000:1.0:1787826351.364286:0:34488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585156608 00000100:00100000:1.0:1787826351.364290:0:34488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585156608 00000100:00100000:1.0:1787826351.364325:0:34488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787826351.364334:0:34488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03572050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3c550b8-2c3c-46c3-ad36-671c284167ea+24:3646:x1874670585156608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826351.364374:0:34488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03572050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3c550b8-2c3c-46c3-ad36-671c284167ea+24:3646:x1874670585156608:12345-0@lo:400:kworker.0 Request processed in 42us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826351.364380:0:34488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787826351.364424:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf2f45c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e3c550b8-2c3c-46c3-ad36-671c284167ea:3646:1874670585156608:0@lo:400:kworker.0 00000100:00100000:1.0:1787826351.364441:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03891680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585156480:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787826351.364683:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03b930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585156736:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787826351.364712:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826351.364741:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585156736 00000100:00100000:2.0:1787826351.364745:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585156736 00000100:00100000:2.0:1787826351.364769:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1329 00000100:00100000:2.0:1787826351.364775:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03b92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874670585156736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787826351.364793:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446240256 avail 1300000768 00000100:00100000:2.0:1787826351.364826:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03b92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874670585156736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 51us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826351.364832:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1329 00000100:00100000:2.0:1787826351.364861:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03b930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585156736:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787826351.365140:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf2f45fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585156864:0@lo:400:kworker.0 00000100:00100000:1.0:1787826351.365168:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826351.365198:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585156864 00000100:00100000:1.0:1787826351.365201:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585156864 00000100:00100000:1.0:1787826351.365237:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1330 00000100:00100000:1.0:1787826351.365244:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f88e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3645:x1874670585156864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826351.365278:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f88e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3645:x1874670585156864:12345-0@lo:400:kworker.0 Request processed in 35us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826351.365285:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1330 00000100:00100000:1.0:1787826351.365320:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf2f45fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585156864:0@lo:400:kworker.0 00000100:00100000:1.0:1787826351.365341:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf2f45c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874670585156992:0@lo:400:kworker.0 00000100:00100000:1.0:1787826351.365375:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826351.365640:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585156992 00000100:00100000:2.0:1787826351.365645:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585156992 00000100:00100000:2.0:1787826351.365686:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1482 00000100:00100000:2.0:1787826351.365693:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f88d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874670585156992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826351.365730:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f88d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874670585156992:12345-0@lo:400:kworker.0 Request processed in 38us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826351.365740:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1482 00000100:00100000:2.0:1787826351.365771:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf2f45c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874670585156992:0@lo:400:kworker.0 00000100:00100000:2.0:1787826351.379646:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf2f45fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585157248:0@lo:400:kworker.0 00000100:00100000:0.0:1787826351.379749:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce04f40b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874670585157504:0@lo:400:kworker.0 00000100:00100000:2.0:1787826351.379763:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826351.379962:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826351.379999:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0300cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874670585157760:0@lo:400:kworker.0 00000100:00100000:0.0:1787826351.380014:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0300e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585158016:0@lo:400:kworker.0 00000100:00100000:2.0:1787826351.380045:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826351.380047:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585157504 00000100:00100000:3.0:1787826351.380059:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585157504 00000100:00100000:0.0:1787826351.380072:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826351.380093:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787826351.380105:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce044d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874670585157376:0@lo:400:kworker.0 00000100:00100000:0.0:1787826351.380112:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787826351.380124:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf2f45c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585157120:0@lo:400:kworker.0 00000100:00100000:2.0:1787826351.380148:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826351.380165:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826351.380184:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0300c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585157888:0@lo:400:kworker.0 00000100:00100000:0.0:1787826351.380196:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce04f41e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874670585157632:0@lo:400:kworker.0 00000100:00100000:2.0:1787826351.380228:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826351.380239:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826351.380276:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0300f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874670585158144:0@lo:400:kworker.0 00000100:00100000:2.0:1787826351.380279:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585157760 00000100:00100000:2.0:1787826351.380285:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585157760 00000100:00100000:1.0:1787826351.380388:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585157248 00000100:00100000:1.0:1787826351.380396:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585157248 00000100:00100000:1.0:1787826351.380459:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585158016 00000100:00100000:1.0:1787826351.380463:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585158016 00000100:00100000:3.0:1787826351.380501:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585157376 00000100:00100000:3.0:1787826351.380507:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585157376 00000100:00100000:1.0:1787826351.380533:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585157120 00000100:00100000:1.0:1787826351.380539:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585157120 00000100:00100000:3.0:1787826351.380543:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585157632 00000100:00100000:3.0:1787826351.380550:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585157632 00000100:00100000:1.0:1787826351.380579:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585157888 00000100:00100000:1.0:1787826351.380586:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585157888 00000100:00100000:3.0:1787826351.380593:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1483 00000100:00100000:1.0:1787826351.380643:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 874 00000100:00100000:1.0:1787826351.380653:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03b930c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3644:x1874670585157248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826351.380711:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03b930c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3644:x1874670585157248:12345-0@lo:400:kworker.0 Request processed in 59us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826351.380718:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 874 00000100:00100000:1.0:1787826351.380734:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 875 00000100:00100000:1.0:1787826351.380740:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3646:x1874670585158016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826351.380767:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3646:x1874670585158016:12345-0@lo:400:kworker.0 Request processed in 28us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826351.380773:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 875 00000100:00100000:1.0:1787826351.380783:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 876 00000100:00100000:1.0:1787826351.380788:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3646:x1874670585157120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826351.380847:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3646:x1874670585157120:12345-0@lo:400:kworker.0 Request processed in 58us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826351.380853:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 876 00000100:00100000:1.0:1787826351.380864:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 877 00000100:00100000:1.0:1787826351.380869:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03986940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3644:x1874670585157888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826351.380891:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03986940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3644:x1874670585157888:12345-0@lo:400:kworker.0 Request processed in 23us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826351.380897:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 877 00000100:00080000:1.0:1787826351.380931:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787826351.380936:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787826351.380938:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787826351.381321:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826351.381724:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869570 gen 2 00000100:00100000:0.0:1787826351.381743:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0300e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585158016:0@lo:400:kworker.0 00000100:00100000:0.0:1787826351.381766:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf2f45c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585157120:0@lo:400:kworker.0 00000100:00100000:0.0:1787826351.382438:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585158144 00000100:00100000:0.0:1787826351.382444:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585158144 00000100:00100000:0.0:1787826351.382504:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1484 00000100:00100000:0.0:1787826351.382514:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03b92d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874670585157376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826351.382572:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03b92d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874670585157376:12345-0@lo:400:kworker.0 Request processed in 61us (2429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826351.382579:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1484 00000100:00100000:0.0:1787826351.382594:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1485 00000100:00100000:0.0:1787826351.382600:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874670585157632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826351.382646:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874670585157632:12345-0@lo:400:kworker.0 Request processed in 46us (2408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826351.382652:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1485 00000100:00100000:0.0:1787826351.382664:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1486 00000100:00100000:0.0:1787826351.382670:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874670585158144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826351.382695:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874670585158144:12345-0@lo:400:kworker.0 Request processed in 26us (2392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826351.382700:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1486 00000100:00100000:0.0:1787826351.382741:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce04f41e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874670585157632:0@lo:400:kworker.0 00000100:00100000:0.0:1787826351.382752:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0300f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874670585158144:0@lo:400:kworker.0 00000100:00100000:2.0:1787826351.393705:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1487 00000100:00100000:2.0:1787826351.393789:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03b90780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874670585157760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826351.393891:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03b90780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874670585157760:12345-0@lo:400:kworker.0 Request processed in 174us (13847us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826351.393898:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1487 00000100:00100000:2.0:1787826351.393952:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce044d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874670585157376:0@lo:400:kworker.0 00000100:00100000:2.0:1787826351.393967:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836892 gen 2 00000100:00100000:2.0:1787826351.393985:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0300c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585157888:0@lo:400:kworker.0 00000100:00100000:2.0:1787826351.394010:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf2f45fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585157248:0@lo:400:kworker.0 00000100:00100000:2.0:1787826351.394023:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0300cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874670585157760:0@lo:400:kworker.0 00000100:00100000:3.0:1787826351.401347:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874670585157504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826351.401645:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce04f40b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874670585157504:0@lo:400:kworker.0 00000100:00100000:3.0:1787826351.403593:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874670585157504:12345-0@lo:400:kworker.0 Request processed in 20909us (21552us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826351.403612:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1483 00000100:00080000:1.0:1787826351.405498:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787826351.439263:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826351.875661:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce044d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585158272:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826351.875725:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826351.875774:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787826351.875780:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce044d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585158400:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787826351.875809:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826351.875836:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585158272 00000100:00100000:2.0:1787826351.875842:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585158272 00000100:00100000:2.0:1787826351.875880:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585158400 00000100:00100000:2.0:1787826351.875883:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585158400 00000100:00100000:2.0:1787826351.875901:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 728 00000100:00100000:2.0:1787826351.875909:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a18b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874670585158272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787826351.875936:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43440960 pending 0 free 3919286272 avail 3687763968 00000100:00100000:2.0:1787826351.875989:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a18b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874670585158272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826351.875996:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 728 00000100:00100000:2.0:1787826351.876012:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 729 00000100:00100000:2.0:1787826351.876018:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aaf03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874670585158400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787826351.876034:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 60259136 pending 0 free 3921387520 avail 3689865216 00000100:00100000:2.0:1787826351.876057:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aaf03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874670585158400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826351.876063:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 729 00000100:00100000:2.0:1787826351.876104:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce044d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585158400:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787826351.876117:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce044d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585158272:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826351.876394:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787826351.876404:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce04f40b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585158528:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787826351.876431:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826351.876454:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585158528 00000100:00100000:0.0:1787826351.876457:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585158528 00000100:00100000:0.0:1787826351.876500:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 730 00000100:00100000:0.0:1787826351.876506:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f41e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874670585158528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787826351.876517:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43440960 pending 0 free 3919286272 avail 3687763968 00000100:00100000:0.0:1787826351.876545:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f41e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874670585158528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 40us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826351.876552:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 730 00000100:00100000:0.0:1787826351.876582:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce04f40b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585158528:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826351.888588:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f88c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585158656:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826351.888666:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826351.888722:0:12021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585158656 00000100:00100000:1.0:1787826351.888728:0:12021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585158656 00000100:00100000:1.0:1787826351.888811:0:12021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 731 00000100:00100000:1.0:1787826351.888821:0:12021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f88c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874670585158656:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787826351.888844:0:12021:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 60259136 pending 0 free 3921387520 avail 3689865216 00000100:00100000:1.0:1787826351.888888:0:12021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f88c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874670585158656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826351.888898:0:12021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 731 00000100:00100000:1.0:1787826351.888941:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f88c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585158656:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826352.278050:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826352.278094:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826352.278122:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826352.278141:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826352.278164:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826352.278194:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563648128 00000100:00100000:0.0:1787826352.278202:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563648128 00000100:00100000:0.0:1787826352.278271:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563648000 00000100:00100000:0.0:1787826352.278275:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563648000 00000100:00100000:0.0:1787826352.278300:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1488 00000100:00100000:0.0:1787826352.278309:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf2f45fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:2404:x1874670563648128:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1787826352.278394:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf2f45fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:2404:x1874670563648128:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 85us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826352.278402:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1488 00000100:00100000:0.0:1787826352.278420:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1489 00000100:00100000:0.0:1787826352.278426:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2404:x1874670563648000:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1787826352.278448:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2404:x1874670563648000:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 23us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826352.278454:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1489 00000100:00100000:0.0:1787826352.278497:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563648384 00000100:00100000:0.0:1787826352.278501:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563648384 00000100:00100000:0.0:1787826352.278527:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563648256 00000100:00100000:0.0:1787826352.278531:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563648256 00000100:00100000:0.0:1787826352.278550:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 878 00000100:00100000:0.0:1787826352.278556:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf2f45c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563648384:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1787826352.278580:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf2f45c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563648384:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 24us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826352.278586:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 878 00000100:00100000:0.0:1787826352.278597:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 879 00000100:00100000:0.0:1787826352.278603:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563648256:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1787826352.278635:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563648256:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 31us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826352.278641:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 879 00000100:00100000:3.0:1787826352.286018:0:34487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563647872 00000100:00100000:3.0:1787826352.286032:0:34487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563647872 00000100:00100000:3.0:1787826352.286101:0:34487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 76 00000100:00100000:3.0:1787826352.286112:0:34487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03570850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:307626ff-a376-4faf-93e0-9f55b723d964+10:2404:x1874670563647872:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1787826352.286178:0:34487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03570850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:307626ff-a376-4faf-93e0-9f55b723d964+10:2404:x1874670563647872:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 67us (8138us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826352.286184:0:34487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 76 00000100:00080000:3.0:1787826352.286393:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787826352.286399:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787826352.286402:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787826352.286405:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1787826352.453526:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787826352.510913:0:35067:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg339-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 00010000:00010000:2.0:1787826353.475710:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787826354.268023:0:35115:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:2.0:1787826354.505387:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826355.523899:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826356.201374:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826356.201501:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563648512 00000100:00100000:2.0:1787826356.201511:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563648512 00000100:00100000:2.0:1787826356.201605:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3316 00000100:00100000:2.0:1787826356.201616:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f88cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:51796:x1874670563648512:12345-192.168.203.39@tcp:41:lfs.0 00000004:00000024:2.0:1787826356.201654:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445965824 avail 1299726336 00000100:00100000:2.0:1787826356.201721:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f88cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:51796:x1874670563648512:12345-192.168.203.39@tcp:41:lfs.0 Request processed in 107us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826356.201729:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3316 00000100:00080000:3.0:1787826356.201901:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787826356.214437:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826356.214697:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563648640 00000100:00100000:2.0:1787826356.214707:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563648640 00000100:00100000:2.0:1787826356.214784:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3317 00000100:00100000:2.0:1787826356.214795:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03891a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:51796:x1874670563648640:12345-192.168.203.39@tcp:41:lfs.0 00000004:00000024:2.0:1787826356.214834:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446240256 avail 1300000768 00000100:00100000:2.0:1787826356.214958:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03891a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:51796:x1874670563648640:12345-192.168.203.39@tcp:41:lfs.0 Request processed in 164us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826356.214966:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3317 00000100:00080000:3.0:1787826356.215228:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787826356.222034:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826356.222784:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563648768 00000100:00100000:2.0:1787826356.222794:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563648768 00000100:00100000:2.0:1787826356.222862:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 732 00000100:00100000:2.0:1787826356.222871:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:51796:x1874670563648768:12345-192.168.203.39@tcp:13:lfs.0 00002000:00000024:2.0:1787826356.222903:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43440960 pending 0 free 3919286272 avail 3687763968 00000100:00100000:2.0:1787826356.222964:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:51796:x1874670563648768:12345-192.168.203.39@tcp:13:lfs.0 Request processed in 93us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826356.222970:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 732 00000100:00080000:3.0:1787826356.223672:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826356.234178:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826356.234824:0:12021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563648896 00000100:00100000:2.0:1787826356.234834:0:12021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563648896 00000100:00100000:2.0:1787826356.234908:0:12021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 733 00000100:00100000:2.0:1787826356.234920:0:12021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f88c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:51796:x1874670563648896:12345-192.168.203.39@tcp:13:lfs.0 00002000:00000024:2.0:1787826356.234952:0:12021:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 60259136 pending 0 free 3921387520 avail 3689865216 00000100:00100000:2.0:1787826356.235022:0:12021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f88c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:51796:x1874670563648896:12345-192.168.203.39@tcp:13:lfs.0 Request processed in 105us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826356.235030:0:12021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 733 00000100:00080000:3.0:1787826356.235330:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826356.321588:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826356.321653:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563649024 00000100:00100000:0.0:1787826356.321664:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563649024 00000100:00100000:0.0:1787826356.321736:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3318 00000100:00100000:0.0:1787826356.321748:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:51813:x1874670563649024:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826356.321783:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826356.321805:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661000/0x22153cd396b7fa0d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0172 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.321882:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661a00/0x22153cd396b7fa14 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.321897:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661a00/0x22153cd396b7fa14 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.321914:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661a00/0x22153cd396b7fa14 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.321928:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660c00/0x22153cd396b7fa1b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.321936:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660c00/0x22153cd396b7fa1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.321942:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660c00/0x22153cd396b7fa1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.323225:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660400/0x22153cd396b7fa22 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.323242:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660400/0x22153cd396b7fa22 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.323250:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660400/0x22153cd396b7fa22 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826356.323280:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0xe:0x0]: returning size 4096 00000004:00200000:0.0:1787826356.323284:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826356.323306:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660400/0x22153cd396b7fa22 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.323321:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661a00/0x22153cd396b7fa14 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.323328:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661a00/0x22153cd396b7fa14 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.323338:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661a00/0x22153cd396b7fa14 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.323345:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661a00/0x22153cd396b7fa14 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.323351:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05661a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826356.323355:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661a00/0x22153cd396b7fa14 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.323362:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661a00/0x22153cd396b7fa14 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.323374:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ce01f45300) 00010000:00010000:0.0:1787826356.323377:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826356.323548:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661a00/0x22153cd396b7fa14 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.323557:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661a00/0x22153cd396b7fa14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.323572:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660c00/0x22153cd396b7fa1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.323577:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660c00/0x22153cd396b7fa1b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.323583:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660c00/0x22153cd396b7fa1b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.323588:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05660c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826356.323602:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660c00/0x22153cd396b7fa1b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.323609:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660c00/0x22153cd396b7fa1b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.323617:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfe7a1a38 (ffff90cf371d2000) 00010000:00010000:0.0:1787826356.323620:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826356.323623:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660c00/0x22153cd396b7fa1b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.323628:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660c00/0x22153cd396b7fa1b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.323666:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661000/0x22153cd396b7fa0d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0172 expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.323681:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660400/0x22153cd396b7fa22 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0172 expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.323688:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0x0 (ffff90cf371d2b00) 00010000:00010000:0.0:1787826356.323691:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787826356.323694:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05660400, rc 0) 00000100:00100000:0.0:1787826356.324073:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:51813:x1874670563649024:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 2318us (2484us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826356.324083:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3318 00000100:00100000:0.0:1787826356.336602:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826356.336675:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563649280 00000100:00100000:2.0:1787826356.336684:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563649280 00000100:00100000:2.0:1787826356.336799:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3319 00000100:00100000:2.0:1787826356.336819:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:51813:x1874670563649280:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826356.336841:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826356.336862:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427400/0x22153cd396b7fa29 lrc: 2/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0179 expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.336933:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426600/0x22153cd396b7fa30 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.336948:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426600/0x22153cd396b7fa30 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.336959:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426600/0x22153cd396b7fa30 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.336975:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427000/0x22153cd396b7fa37 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.336981:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427000/0x22153cd396b7fa37 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.336987:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427000/0x22153cd396b7fa37 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.337953:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7fa3e lrc: 3/1,0 mode: --/PR res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.337965:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7fa3e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.337974:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7fa3e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826356.337985:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0xf:0x0]: returning size 0 00010000:00010000:2.0:1787826356.338081:0:8247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426600/0x22153cd396b7fa30 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.338088:0:8247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426600/0x22153cd396b7fa30 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.338095:0:8247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426600/0x22153cd396b7fa30 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.338101:0:8247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce02426600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826356.338105:0:8247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426600/0x22153cd396b7fa30 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.338112:0:8247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426600/0x22153cd396b7fa30 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.338123:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0x0 (ffff90cf371d2b00) 00010000:00010000:2.0:1787826356.338126:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826356.338131:0:8247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426600/0x22153cd396b7fa30 lrc: 2/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.338141:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426600/0x22153cd396b7fa30 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.338153:0:8247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427000/0x22153cd396b7fa37 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.338159:0:8247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427000/0x22153cd396b7fa37 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.338165:0:8247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427000/0x22153cd396b7fa37 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.338170:0:8247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce02427000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826356.338173:0:8247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427000/0x22153cd396b7fa37 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.338179:0:8247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427000/0x22153cd396b7fa37 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.338187:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0xaf1e71b4 (ffff90cf1988e700) 00010000:00010000:2.0:1787826356.338190:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826356.338192:0:8247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427000/0x22153cd396b7fa37 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.338197:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427000/0x22153cd396b7fa37 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.338242:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427400/0x22153cd396b7fa29 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0179 expref: 17 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.338255:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7fa3e lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0179 expref: 16 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.338262:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff90cf1988e600) 00010000:00010000:2.0:1787826356.338264:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826356.338267:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce02426200, rc 0) 00000100:00100000:2.0:1787826356.338336:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:51813:x1874670563649280:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1527us (1753us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787826356.338344:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3319 00000100:00100000:1.0:1787826356.342787:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826356.342934:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563649536 00000100:00100000:2.0:1787826356.342944:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563649536 00000100:00100000:2.0:1787826356.343025:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 970 00000100:00100000:2.0:1787826356.343035:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab90b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:51813:x1874670563649536:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:2.0:1787826356.343260:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab90b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+17:51813:x1874670563649536:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 226us (482us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1787826356.343268:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 970 00000100:00100000:3.0:1787826356.347648:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826356.347802:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563649792 00000100:00100000:1.0:1787826356.347809:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563649792 00000100:00100000:1.0:1787826356.347859:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3320 00000100:00100000:1.0:1787826356.347866:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03890b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+17:51813:x1874670563649792:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826356.347885:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826356.347901:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b7fa4c lrc: 2/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0180 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826356.347993:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834e00/0x22153cd396b7fa53 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826356.348004:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834e00/0x22153cd396b7fa53 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xf:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826356.348015:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834e00/0x22153cd396b7fa53 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xf:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826356.348025:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0xf:0x0]: returning size 0 00010000:00010000:1.0:1787826356.348138:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b7fa4c lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0180 expref: 20 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826356.348160:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834e00/0x22153cd396b7fa53 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xf:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0180 expref: 19 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826356.348169:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff90cf1988e600) 00010000:00010000:1.0:1787826356.348172:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787826356.348176:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834e00, rc 0) 00000100:00100000:1.0:1787826356.348233:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03890b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:51813:x1874670563649792:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 367us (591us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1787826356.348241:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3320 00000100:00100000:0.0:1787826356.356758:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826356.362821:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563650048 00000100:00100000:2.0:1787826356.362838:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563650048 00000100:00100000:2.0:1787826356.362925:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3321 00000100:00100000:2.0:1787826356.362936:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03975680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:51813:x1874670563650048:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826356.362959:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826356.362979:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427400/0x22153cd396b7fa61 lrc: 2/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0187 expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.363085:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427000/0x22153cd396b7fa68 lrc: 3/0,1 mode: --/CW res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.363101:0:9966:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7fa3e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0179 expref: 20 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.363111:0:9966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427000/0x22153cd396b7fa68 lrc: 4/0,1 mode: --/CW res: [0x200000405:0xf:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.363145:0:9966:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7fa3e lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0179 expref: 20 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.363159:0:9966:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7fa3e lrc: 4/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0179 expref: 20 pid: 8247 timeout: 1402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826356.363173:0:9966:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aaf0b40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9966:1874670585158784:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826356.363273:0:9966:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f67e900 going to sleep for 11 seconds 00000100:00100000:0.0:1787826356.368863:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826356.369148:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563650176 00000100:00100000:3.0:1787826356.369156:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563650176 00010000:00010000:3.0:1787826356.369186:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7fa3e lrc: 5/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0179 expref: 21 pid: 8247 timeout: 1402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826356.369258:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 908 00000100:00100000:3.0:1787826356.369265:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03975a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:2403:x1874670563650176:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826356.369277:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826356.369282:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7fa3e lrc: 5/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0179 expref: 21 pid: 8247 timeout: 1402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826356.369291:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7fa3e lrc: 4/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0179 expref: 21 pid: 8247 timeout: 1402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826356.369315:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff90cf1988e600) 00010000:00010000:3.0:1787826356.369319:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427000/0x22153cd396b7fa68 lrc: 3/0,1 mode: --/CW res: [0x200000405:0xf:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826356.369326:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427000/0x22153cd396b7fa68 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xf:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826356.369331:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427000/0x22153cd396b7fa68 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0xf:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826356.369344:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826356.369389:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03975a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:2403:x1874670563650176:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 125us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826356.369394:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 908 00010000:00010000:2.0:1787826356.370401:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7fa3e lrc: 0/0,0 mode: --/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0179 expref: 20 pid: 8247 timeout: 1402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826356.370417:0:9966:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aaf0b40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9966:1874670585158784:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826356.370439:0:9966:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427000/0x22153cd396b7fa68 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xf:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.372055:0:9966:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427000/0x22153cd396b7fa68 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xf:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.372072:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427000/0x22153cd396b7fa68 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xf:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826356.372093:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0xf:0x0]: returning size 0 00010000:00010000:2.0:1787826356.372231:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427400/0x22153cd396b7fa61 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0187 expref: 21 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.372257:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427000/0x22153cd396b7fa68 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0xf:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0187 expref: 20 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.372267:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff90cf1988e600) 00010000:00010000:2.0:1787826356.372270:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787826356.372274:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce02427000, rc 0) 00000100:00100000:2.0:1787826356.372348:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03975680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:51813:x1874670563650048:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 9412us (15598us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1787826356.372357:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3321 00000100:00100000:0.0:1787826356.378037:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826356.378339:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563650304 00000100:00100000:1.0:1787826356.378349:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563650304 00000100:00100000:1.0:1787826356.378429:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 971 00000100:00100000:1.0:1787826356.378440:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03977c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:51813:x1874670563650304:12345-192.168.203.39@tcp:33:lfs.0 00000100:00100000:1.0:1787826356.378664:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03977c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:51813:x1874670563650304:12345-192.168.203.39@tcp:33:lfs.0 Request processed in 225us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826356.378672:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 971 00000100:00100000:1.0:1787826356.381250:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826356.381332:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563650560 00000100:00100000:2.0:1787826356.381342:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563650560 00000100:00100000:2.0:1787826356.381398:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 972 00000100:00100000:2.0:1787826356.381408:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a98a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:51813:x1874670563650560:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:2.0:1787826356.382443:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a98a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:51813:x1874670563650560:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 1031us (1197us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1787826356.382454:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 972 00000100:00100000:3.0:1787826356.387995:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826356.388215:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563650816 00000100:00100000:0.0:1787826356.388225:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563650816 00000100:00100000:0.0:1787826356.388293:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3322 00000100:00100000:0.0:1787826356.388303:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03891680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:51813:x1874670563650816:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826356.388326:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826356.388329:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:0.0:1787826356.388354:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427000/0x22153cd396b7fa68 lrc: 0/0,0 mode: --/CW res: [0x200000405:0xf:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0187 expref: 21 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.388376:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834e00/0x22153cd396b7fa53 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xf:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0180 expref: 20 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.388388:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff90cf1988e600) 00010000:00010000:0.0:1787826356.388398:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826356.388412:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661a00/0x22153cd396b7fa76 lrc: 2/0,0 mode: --/CR res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab018e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.388558:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661200/0x22153cd396b7fa7d lrc: 3/0,1 mode: --/PW res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.388572:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661200/0x22153cd396b7fa7d lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xf:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.388582:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661200/0x22153cd396b7fa7d lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xf:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826356.388603:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0xf:0x0]: returning size 0 00010000:00010000:0.0:1787826356.388700:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661a00/0x22153cd396b7fa76 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab018e expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.388721:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661200/0x22153cd396b7fa7d lrc: 3/0,0 mode: PW/PW res: [0x200000405:0xf:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab018e expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.388729:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff90cf371d2000) 00010000:00010000:0.0:1787826356.388732:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787826356.388734:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05661200, rc 0) 00000100:00100000:0.0:1787826356.388800:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03891680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:51813:x1874670563650816:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 498us (814us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1787826356.388808:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3322 00000100:00100000:0.0:1787826356.402228:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826356.406448:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563651072 00000100:00100000:1.0:1787826356.406461:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563651072 00000100:00100000:1.0:1787826356.406785:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 973 00000100:00100000:1.0:1787826356.406796:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf10475050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:51813:x1874670563651072:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:1.0:1787826356.406867:0:14257:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000405:0xf:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661200/0x22153cd396b7fa7d lrc: 3/0,0 mode: PW/PW res: [0x200000405:0xf:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab018e expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826356.406905:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835e00/0x22153cd396b7fa8b lrc: 3/0,1 mode: --/EX res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826356.406919:0:14257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835e00/0x22153cd396b7fa8b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826356.406930:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835e00/0x22153cd396b7fa8b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826356.407059:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835e00/0x22153cd396b7fa8b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826356.407068:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835e00/0x22153cd396b7fa8b lrc: 2/0,0 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826356.407076:0:14257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835e00/0x22153cd396b7fa8b lrc: 3/0,0 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826356.407082:0:14257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835e00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826356.407087:0:14257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835e00/0x22153cd396b7fa8b lrc: 3/0,0 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826356.407095:0:14257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835e00/0x22153cd396b7fa8b lrc: 4/0,0 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826356.407104:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff90cf371d2000) 00010000:00010000:1.0:1787826356.407108:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787826356.407112:0:14257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835e00/0x22153cd396b7fa8b lrc: 2/0,0 mode: --/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826356.407119:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835e00/0x22153cd396b7fa8b lrc: 0/0,0 mode: --/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826356.407129:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff90cf371d2000) 00010000:00010000:1.0:1787826356.407132:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787826356.407137:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661200/0x22153cd396b7fa7d lrc: 0/0,0 mode: --/PW res: [0x200000405:0xf:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab018e expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826356.407298:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf10475050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:51813:x1874670563651072:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 502us (5078us total) trans 8589934599 rc -22/-22 00000100:00100000:1.0:1787826356.407308:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 973 00000100:00100000:1.0:1787826356.439347:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826356.439451:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563651200 00000100:00100000:2.0:1787826356.439460:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563651200 00000100:00100000:2.0:1787826356.439554:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3323 00000100:00100000:2.0:1787826356.439563:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a98a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:51813:x1874670563651200:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826356.439585:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826356.439616:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427400/0x22153cd396b7fa92 lrc: 2/0,0 mode: --/CR res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0195 expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.439679:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427400/0x22153cd396b7fa92 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0195 expref: 22 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.439693:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427400/0x22153cd396b7fa92 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0195 expref: 22 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.439712:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff90cf1988e700) 00010000:00010000:2.0:1787826356.439715:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826356.439718:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce02427400, rc 0) 00000100:00100000:2.0:1787826356.439781:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a98a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:51813:x1874670563651200:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 205us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826356.439788:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3323 00000100:00100000:3.0:1787826356.447438:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826356.447585:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563651456 00000100:00100000:2.0:1787826356.447606:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563651456 00000100:00100000:2.0:1787826356.447656:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3324 00000100:00100000:2.0:1787826356.447667:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03893840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:51813:x1874670563651456:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826356.447687:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826356.447691:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787826356.447719:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660400/0x22153cd396b7fa22 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0172 expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.447738:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0x0 (ffff90cf371d2b00) 00010000:00010000:2.0:1787826356.447749:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826356.447790:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7fa99 lrc: 2/0,0 mode: --/CW res: [0x200000405:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab019c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.450630:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426600/0x22153cd396b7faa0 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.450656:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426600/0x22153cd396b7faa0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.450669:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426600/0x22153cd396b7faa0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826356.450680:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x11:0x0]: returning size 0 00010000:00010000:2.0:1787826356.450733:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7fa99 lrc: 0/0,0 mode: --/CW res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab019c expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.450754:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426600/0x22153cd396b7faa0 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab019c expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.450784:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x11:0x0].0x0 (ffff90cf1988ed00) 00010000:00010000:2.0:1787826356.450787:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826356.450791:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce02426600, rc 0) 00000100:00100000:2.0:1787826356.450863:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03893840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+23:51813:x1874670563651456:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 3197us (3434us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1787826356.450872:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3324 00000100:00100000:0.0:1787826356.459456:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826356.459633:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563651712 00000100:00100000:2.0:1787826356.459643:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563651712 00000100:00100000:2.0:1787826356.459705:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3325 00000100:00100000:2.0:1787826356.459715:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03977c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+23:51813:x1874670563651712:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826356.459738:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826356.459779:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7faae lrc: 2/0,0 mode: --/CR res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab01a3 expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.459886:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426c00/0x22153cd396b7fab5 lrc: 3/0,1 mode: --/PW res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.459899:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426c00/0x22153cd396b7fab5 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xf:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.459910:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426c00/0x22153cd396b7fab5 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xf:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826356.459920:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0xf:0x0]: returning size 0 00010000:00010000:2.0:1787826356.460014:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7faae lrc: 0/0,0 mode: --/CR res: [0x200000405:0xf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab01a3 expref: 26 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.460035:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426c00/0x22153cd396b7fab5 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0xf:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab01a3 expref: 25 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.460045:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff90cf1988e700) 00010000:00010000:2.0:1787826356.460048:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787826356.460051:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce02426c00, rc 0) 00000100:00100000:2.0:1787826356.460298:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03977c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:51813:x1874670563651712:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 584us (861us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1787826356.460306:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3325 00000100:00100000:1.0:1787826356.469045:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826356.469283:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563651968 00000100:00100000:3.0:1787826356.469292:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563651968 00000100:00100000:3.0:1787826356.469350:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 974 00000100:00100000:3.0:1787826356.469360:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a988780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:51813:x1874670563651968:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:3.0:1787826356.469436:0:6522:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000405:0xf:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426c00/0x22153cd396b7fab5 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0xf:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab01a3 expref: 25 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826356.469618:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6000/0x22153cd396b7fac3 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826356.469632:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427400/0x22153cd396b7fa92 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0195 expref: 25 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826356.469646:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6000/0x22153cd396b7fac3 lrc: 4/0,1 mode: --/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826356.469684:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427400/0x22153cd396b7fa92 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0195 expref: 25 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826356.469697:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427400/0x22153cd396b7fa92 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0195 expref: 25 pid: 8247 timeout: 1402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826356.469710:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03892580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585158912:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826356.469893:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce05b56a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787826356.474514:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826356.474607:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563652096 00000100:00100000:2.0:1787826356.474616:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563652096 00010000:00010000:2.0:1787826356.474655:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427400/0x22153cd396b7fa92 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0195 expref: 26 pid: 8247 timeout: 1402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826356.474696:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 909 00000100:00100000:2.0:1787826356.474706:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a988000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:2403:x1874670563652096:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826356.474721:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826356.474727:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427400/0x22153cd396b7fa92 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0195 expref: 26 pid: 8247 timeout: 1402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.474739:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427400/0x22153cd396b7fa92 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0195 expref: 26 pid: 8247 timeout: 1402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.474778:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff90cf1988e700) 00010000:00010000:2.0:1787826356.474784:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6000/0x22153cd396b7fac3 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.474793:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6000/0x22153cd396b7fac3 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.474800:0:10340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6000/0x22153cd396b7fac3 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.474819:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826356.474875:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a988000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:2403:x1874670563652096:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 170us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826356.474883:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 909 00010000:00010000:0.0:1787826356.475039:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427400/0x22153cd396b7fa92 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0195 expref: 25 pid: 8247 timeout: 1402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826356.475051:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03892580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585158912:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826356.475067:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6000/0x22153cd396b7fac3 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.475074:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6000/0x22153cd396b7fac3 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.475078:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6000/0x22153cd396b7fac3 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.475092:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661e00/0x22153cd396b7faca lrc: 3/0,1 mode: --/EX res: [0x200000405:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.475102:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426600/0x22153cd396b7faa0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab019c expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.475107:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661e00/0x22153cd396b7faca lrc: 4/0,1 mode: --/EX res: [0x200000405:0x11:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.475129:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426600/0x22153cd396b7faa0 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab019c expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.475138:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426600/0x22153cd396b7faa0 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab019c expref: 24 pid: 6519 timeout: 1402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826356.475149:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03afe580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585159040:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826356.475198:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a2f840 going to sleep for 11 seconds 00000100:00100000:0.0:1787826356.478070:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03afe580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585159040:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826356.478102:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661e00/0x22153cd396b7faca lrc: 3/0,1 mode: --/EX res: [0x200000405:0x11:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826356.479502:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826356.480136:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563652224 00000100:00100000:2.0:1787826356.480148:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563652224 00010000:00010000:2.0:1787826356.480188:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426600/0x22153cd396b7faa0 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab019c expref: 25 pid: 6519 timeout: 1402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826356.480270:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 910 00000100:00100000:2.0:1787826356.480279:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8743c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:2403:x1874670563652224:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826356.480294:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826356.480301:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426600/0x22153cd396b7faa0 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab019c expref: 25 pid: 6519 timeout: 1402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.480314:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426600/0x22153cd396b7faa0 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab019c expref: 25 pid: 6519 timeout: 1402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.480337:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426600/0x22153cd396b7faa0 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab019c expref: 25 pid: 6519 timeout: 1402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.480353:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x11:0x0].0x0 (ffff90cf1988ed00) 00010000:00010000:2.0:1787826356.480358:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661e00/0x22153cd396b7faca lrc: 3/0,1 mode: --/EX res: [0x200000405:0x11:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.480368:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661e00/0x22153cd396b7faca lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x11:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.480376:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661e00/0x22153cd396b7faca lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x11:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.480407:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826356.480530:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8743c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:2403:x1874670563652224:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 251us (1066us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826356.480538:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 910 00010000:00010000:0.0:1787826356.480588:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661e00/0x22153cd396b7faca lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x11:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.480606:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661e00/0x22153cd396b7faca lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x11:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826356.480919:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03afe580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1874670585159168:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787826356.480965:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826356.480995:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a2f840 going to sleep for 11 seconds 00000100:00100000:0.0:1787826356.481015:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585159168 00000100:00100000:0.0:1787826356.481019:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585159168 00000100:00100000:0.0:1787826356.481061:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1331 00000100:00100000:0.0:1787826356.481068:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03afc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6522:x1874670585159168:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787826356.481141:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03afc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6522:x1874670585159168:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 74us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826356.481148:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1331 00000100:00100000:0.0:1787826356.481183:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03afe580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1874670585159168:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787826356.481225:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934602 00000001:00080000:0.0:1787826356.481269:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934603 00010000:00010000:0.0:1787826356.481287:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661e00/0x22153cd396b7faca lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x11:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.481296:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661e00/0x22153cd396b7faca lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x11:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.481302:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661e00/0x22153cd396b7faca lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x11:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.481308:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05661e00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826356.481311:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661e00/0x22153cd396b7faca lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x11:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.481318:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661e00/0x22153cd396b7faca lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x11:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.481329:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x11:0x0].0x0 (ffff90cf1988ed00) 00010000:00010000:0.0:1787826356.481332:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787826356.481336:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661e00/0x22153cd396b7faca lrc: 2/0,0 mode: --/EX res: [0x200000405:0x11:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.481347:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661e00/0x22153cd396b7faca lrc: 0/0,0 mode: --/EX res: [0x200000405:0x11:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.481365:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6000/0x22153cd396b7fac3 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.481372:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6000/0x22153cd396b7fac3 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.481377:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6000/0x22153cd396b7fac3 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.481383:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3abd6000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826356.481385:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6000/0x22153cd396b7fac3 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.481392:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6000/0x22153cd396b7fac3 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.481399:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff90cf1988e700) 00010000:00010000:0.0:1787826356.481402:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787826356.481404:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6000/0x22153cd396b7fac3 lrc: 2/0,0 mode: --/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.481410:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6000/0x22153cd396b7fac3 lrc: 0/0,0 mode: --/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.481422:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff90cf1988e700) 00010000:00010000:0.0:1787826356.481424:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787826356.481430:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426c00/0x22153cd396b7fab5 lrc: 0/0,0 mode: --/PW res: [0x200000405:0xf:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab01a3 expref: 26 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826356.481527:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a988780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:51813:x1874670563651968:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 12168us (12490us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1787826356.481535:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 974 00000020:00080000:0.0:1787826356.481539:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00080000:3.0:1787826356.482048:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826356.485649:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826356.485684:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563652352 00000100:00100000:1.0:1787826356.485691:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563652352 00000100:00100000:1.0:1787826356.485738:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3326 00000100:00100000:1.0:1787826356.485746:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f874b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:51813:x1874670563652352:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826356.485949:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826356.485974:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834000/0x22153cd396b7fad1 lrc: 2/0,0 mode: --/CR res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab01aa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826356.486025:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834000/0x22153cd396b7fad1 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab01aa expref: 26 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826356.486038:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834000/0x22153cd396b7fad1 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab01aa expref: 26 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826356.486053:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff90cf3abc6100) 00010000:00010000:1.0:1787826356.486056:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826356.486059:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834000, rc 0) 00000100:00100000:1.0:1787826356.486110:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f874b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:51813:x1874670563652352:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 364us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826356.486116:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3326 00000100:00100000:0.0:1787826356.486689:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03afcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585159424:0@lo:400:kworker.0 00000100:00100000:0.0:1787826356.486733:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826356.486862:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f808000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874670585159936:0@lo:400:kworker.0 00000100:00100000:0.0:1787826356.486889:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826356.486906:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f808b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585160448:0@lo:400:kworker.0 00000100:00100000:0.0:1787826356.486923:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826356.486943:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787826356.486948:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03afe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e3c550b8-2c3c-46c3-ad36-671c284167ea:3645:1874670585159296:0@lo:400:kworker.0 00000100:00100000:0.0:1787826356.486972:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826356.486994:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f80b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585159808:0@lo:400:kworker.0 00000100:00100000:0.0:1787826356.487012:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826356.487024:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f80b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874670585160320:0@lo:400:kworker.0 00000100:00100000:0.0:1787826356.487040:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826356.487063:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03aff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874670585159552:0@lo:400:kworker.0 00000100:00100000:0.0:1787826356.487082:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826356.487095:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f80a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874670585160064:0@lo:400:kworker.0 00000100:00100000:0.0:1787826356.487110:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826356.487120:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f809680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585160576:0@lo:400:kworker.0 00000100:00100000:0.0:1787826356.487136:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826356.487227:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787826356.487233:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f809a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585159680:0@lo:400:kworker.0 00000100:00100000:0.0:1787826356.487254:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826356.487268:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f808f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874670585160192:0@lo:400:kworker.0 00000100:00100000:0.0:1787826356.487285:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826356.487298:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f8083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874670585160704:0@lo:400:kworker.0 00000100:00100000:0.0:1787826356.487315:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826356.487346:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585159424 00000100:00100000:0.0:1787826356.487351:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585159424 00000100:00100000:0.0:1787826356.487383:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585160448 00000100:00100000:0.0:1787826356.487385:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585160448 00000100:00100000:0.0:1787826356.487398:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1332 00000100:00100000:0.0:1787826356.487406:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3645:x1874670585159424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826356.487447:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3645:x1874670585159424:12345-0@lo:400:kworker.0 Request processed in 42us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826356.487453:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1332 00000100:00100000:0.0:1787826356.487467:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1333 00000100:00100000:0.0:1787826356.487503:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f80b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874670585160448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826356.487528:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f80b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874670585160448:12345-0@lo:400:kworker.0 Request processed in 27us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826356.487534:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1333 00000100:00100000:0.0:1787826356.487550:0:34488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585159296 00000100:00100000:0.0:1787826356.487553:0:34488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585159296 00000100:00100000:0.0:1787826356.487577:0:34488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787826356.487582:0:34488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf39ccc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3c550b8-2c3c-46c3-ad36-671c284167ea+24:3645:x1874670585159296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826356.487955:0:34488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf39ccc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3c550b8-2c3c-46c3-ad36-671c284167ea+24:3645:x1874670585159296:12345-0@lo:400:kworker.0 Request processed in 371us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826356.487964:0:34488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787826356.487996:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585159936 00000100:00100000:0.0:1787826356.488000:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585159936 00000100:00100000:0.0:1787826356.488037:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585160320 00000100:00100000:0.0:1787826356.488041:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585160320 00000100:00100000:0.0:1787826356.488052:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585159552 00000100:00100000:0.0:1787826356.488054:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585159552 00000100:00100000:0.0:1787826356.488063:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585160064 00000100:00100000:0.0:1787826356.488066:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585160064 00000100:00100000:0.0:1787826356.488077:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585160192 00000100:00100000:0.0:1787826356.488079:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585160192 00000100:00100000:0.0:1787826356.488089:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585160704 00000100:00100000:0.0:1787826356.488091:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585160704 00000100:00100000:0.0:1787826356.488102:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1490 00000100:00100000:0.0:1787826356.488108:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f80a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874670585159936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826356.488142:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f80a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874670585159936:12345-0@lo:400:kworker.0 Request processed in 34us (1252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826356.488249:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1490 00000100:00100000:0.0:1787826356.488265:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1491 00000100:00100000:0.0:1787826356.488272:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f809e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874670585160320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826356.488306:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f809e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874670585160320:12345-0@lo:400:kworker.0 Request processed in 35us (1264us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826356.488311:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1491 00000100:00100000:0.0:1787826356.488322:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1492 00000100:00100000:0.0:1787826356.488328:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874670585159552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826356.488365:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874670585159552:12345-0@lo:400:kworker.0 Request processed in 36us (1280us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826356.488372:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1492 00000100:00100000:0.0:1787826356.488385:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1493 00000100:00100000:0.0:1787826356.488392:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136ccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874670585160064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826356.488420:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136ccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874670585160064:12345-0@lo:400:kworker.0 Request processed in 29us (1309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826356.488426:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1493 00000100:00100000:0.0:1787826356.488437:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1494 00000100:00100000:0.0:1787826356.488445:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136ce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874670585160192:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787826356.488450:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787826356.488455:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787826356.488520:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1495 00000100:00100000:2.0:1787826356.488531:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874670585160704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826356.488618:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aaf0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585160832:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826356.488654:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826356.488690:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787826356.488696:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aaf21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585160960:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787826356.488718:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826356.488742:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585159808 00000100:00100000:1.0:1787826356.488746:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585159808 00000100:00100000:0.0:1787826356.489113:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136ce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874670585160192:12345-0@lo:400:kworker.0 Request processed in 668us (1824us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826356.489120:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1494 00000100:00100000:0.0:1787826356.489142:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585160576 00000100:00100000:0.0:1787826356.489206:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585160576 00000100:00100000:2.0:1787826356.489420:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874670585160704:12345-0@lo:400:kworker.0 Request processed in 891us (2101us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826356.489441:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1495 00000100:00100000:2.0:1787826356.489530:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585160832 00000100:00100000:2.0:1787826356.489535:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585160832 00000100:00100000:3.0:1787826356.489549:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585160960 00000100:00100000:3.0:1787826356.489555:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585160960 00000100:00100000:2.0:1787826356.489565:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1334 00000100:00100000:2.0:1787826356.489575:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab90b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3644:x1874670585160832:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826356.489582:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1335 00000100:00100000:3.0:1787826356.489600:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874670585160960:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787826356.489608:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445965824 avail 1299726336 00000004:00000024:3.0:1787826356.489617:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446240256 avail 1300000768 00000100:00100000:2.0:1787826356.489667:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab90b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3644:x1874670585160832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826356.489674:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1334 00000100:00100000:2.0:1787826356.489695:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585159680 00000100:00100000:2.0:1787826356.489699:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585159680 00000100:00100000:1.0:1787826356.489883:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 880 00000100:00100000:1.0:1787826356.489890:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f80bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874670585159808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826356.489928:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f80bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874670585159808:12345-0@lo:400:kworker.0 Request processed in 38us (2914us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826356.489934:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 880 00000100:00100000:0.0:1787826356.490029:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 881 00000100:00100000:0.0:1787826356.490036:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136cfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874670585160576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826356.490069:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136cfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874670585160576:12345-0@lo:400:kworker.0 Request processed in 35us (2932us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826356.490074:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 881 00000100:00100000:0.0:1787826356.490111:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03afe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e3c550b8-2c3c-46c3-ad36-671c284167ea:3645:1874670585159296:0@lo:400:kworker.0 00000100:00100000:0.0:1787826356.490125:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f80b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585159808:0@lo:400:kworker.0 00000100:00100000:0.0:1787826356.490136:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f80b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874670585160320:0@lo:400:kworker.0 00000100:00100000:0.0:1787826356.490214:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03afcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585159424:0@lo:400:kworker.0 00000100:00100000:0.0:1787826356.490229:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f808000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874670585159936:0@lo:400:kworker.0 00000100:00100000:0.0:1787826356.490239:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f808b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585160448:0@lo:400:kworker.0 00000100:00100000:0.0:1787826356.490285:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f808f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874670585160192:0@lo:400:kworker.0 00000100:00100000:0.0:1787826356.490297:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f8083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874670585160704:0@lo:400:kworker.0 00000100:00100000:0.0:1787826356.490306:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03aff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874670585159552:0@lo:400:kworker.0 00000100:00100000:0.0:1787826356.490315:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f80a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874670585160064:0@lo:400:kworker.0 00000100:00100000:0.0:1787826356.490324:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f809680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585160576:0@lo:400:kworker.0 00000100:00100000:3.0:1787826356.490443:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874670585160960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 853us (1722us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826356.490451:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1335 00000100:00100000:2.0:1787826356.490510:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 882 00000100:00100000:2.0:1787826356.490519:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136ced00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3646:x1874670585159680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826356.490571:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136ced00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3646:x1874670585159680:12345-0@lo:400:kworker.0 Request processed in 54us (3315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826356.490577:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 882 00000100:00100000:3.0:1787826356.490642:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f809a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585159680:0@lo:400:kworker.0 00000100:00100000:3.0:1787826356.491442:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826356.491505:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563652608 00000100:00100000:0.0:1787826356.491512:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563652608 00000100:00100000:0.0:1787826356.491549:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 975 00000100:00100000:0.0:1787826356.491557:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03892580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:51813:x1874670563652608:12345-192.168.203.39@tcp:35:lfs.0 00000004:00080000:0.0:1787826356.491897:0:6521:0:(mdd_object.c:4014:mdd_close()) Object [0x200000405:0x11:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787826356.491955:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 64 off8320 00000004:00080000:0.0:1787826356.491964:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1302503492626ns, next at 1303503490663ns, rc = 0 00000001:00080000:0.0:1787826356.491970:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934605 00010000:00010000:0.0:1787826356.492004:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661800/0x22153cd396b7fad8 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.492018:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661800/0x22153cd396b7fad8 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.492028:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661800/0x22153cd396b7fad8 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.492035:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661800/0x22153cd396b7fad8 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.492041:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661800/0x22153cd396b7fad8 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.492047:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661800/0x22153cd396b7fad8 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.492071:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787826356.492152:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03892580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+28:51813:x1874670563652608:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 590us (705us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1787826356.492159:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 975 00000020:00080000:0.0:1787826356.492163:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787826356.492194:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826356.492202:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661800/0x22153cd396b7fad8 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.492210:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05661800 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826356.492214:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661800/0x22153cd396b7fad8 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.492223:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661800/0x22153cd396b7fad8 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.492234:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x11:0x0].0x0 (ffff90cf371d2e00) 00010000:00010000:2.0:1787826356.492238:0:8451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787826356.492243:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661800/0x22153cd396b7fad8 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.492249:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661800/0x22153cd396b7fad8 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.492267:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826356.492268:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826356.492270:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787826356.492876:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787826356.492883:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826356.492926:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aaf21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585160960:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787826356.492943:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aaf0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585160832:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826356.495973:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826356.496041:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563652864 00000100:00100000:0.0:1787826356.496049:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563652864 00000100:00100000:0.0:1787826356.496098:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 976 00000100:00100000:0.0:1787826356.496110:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+28:51813:x1874670563652864:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:0.0:1787826356.496329:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+29:51813:x1874670563652864:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 222us (363us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1787826356.496336:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 976 00000100:00100000:3.0:1787826356.524444:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826356.524579:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563652992 00000100:00100000:2.0:1787826356.524599:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563652992 00000100:00100000:2.0:1787826356.524654:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3327 00000100:00100000:2.0:1787826356.524664:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+29:51824:x1874670563652992:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826356.524686:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826356.524705:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426600/0x22153cd396b7fadf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab01b1 expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.524782:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7fae6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.524796:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7fae6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.524806:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7fae6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.524822:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426c00/0x22153cd396b7faed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.524828:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426c00/0x22153cd396b7faed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.524834:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426c00/0x22153cd396b7faed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.524919:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427400/0x22153cd396b7faf4 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.524928:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427400/0x22153cd396b7faf4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.524935:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427400/0x22153cd396b7faf4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826356.524966:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0xe:0x0]: returning size 4096 00000004:00200000:2.0:1787826356.524970:0:8247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826356.524987:0:8247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427400/0x22153cd396b7faf4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.524999:0:8247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7fae6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.525005:0:8247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7fae6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.525012:0:8247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7fae6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.525017:0:8247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce02426200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826356.525020:0:8247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7fae6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.525025:0:8247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7fae6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.525035:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ce01f45300) 00010000:00010000:2.0:1787826356.525037:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826356.525040:0:8247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7fae6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.525044:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7fae6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.525052:0:8247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426c00/0x22153cd396b7faed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.525056:0:8247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426c00/0x22153cd396b7faed lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.525059:0:8247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426c00/0x22153cd396b7faed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.525062:0:8247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce02426c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826356.525064:0:8247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426c00/0x22153cd396b7faed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.525067:0:8247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426c00/0x22153cd396b7faed lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.525071:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfe7a1a38 (ffff90cf1988ea00) 00010000:00010000:2.0:1787826356.525072:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826356.525073:0:8247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426c00/0x22153cd396b7faed lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.525076:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426c00/0x22153cd396b7faed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.525099:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426600/0x22153cd396b7fadf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab01b1 expref: 31 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.525107:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427400/0x22153cd396b7faf4 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab01b1 expref: 30 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.525112:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0x0 (ffff90cf1988e500) 00010000:00010000:2.0:1787826356.525114:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787826356.525115:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce02427400, rc 0) 00000100:00100000:2.0:1787826356.525174:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:51824:x1874670563652992:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 512us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826356.525181:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3327 00000100:00100000:3.0:1787826356.528039:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826356.528113:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563653248 00000100:00100000:0.0:1787826356.528121:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563653248 00000100:00100000:0.0:1787826356.528206:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3328 00000100:00100000:0.0:1787826356.528213:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:51824:x1874670563653248:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826356.528230:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826356.528245:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661e00/0x22153cd396b7fafb lrc: 2/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab01b8 expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.528315:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660000/0x22153cd396b7fb02 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.528325:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660000/0x22153cd396b7fb02 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.528333:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660000/0x22153cd396b7fb02 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.528343:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660600/0x22153cd396b7fb09 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.528347:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660600/0x22153cd396b7fb09 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.528351:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660600/0x22153cd396b7fb09 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.528422:0:32404:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660000/0x22153cd396b7fb02 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.528429:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660000/0x22153cd396b7fb02 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.528447:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660000/0x22153cd396b7fb02 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.528454:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660000/0x22153cd396b7fb02 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.528458:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05660000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826356.528461:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660000/0x22153cd396b7fb02 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.528466:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660000/0x22153cd396b7fb02 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.528493:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0x0 (ffff90cf1988e500) 00010000:00010000:0.0:1787826356.528496:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826356.528499:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660000/0x22153cd396b7fb02 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.528503:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660000/0x22153cd396b7fb02 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.528512:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660600/0x22153cd396b7fb09 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.528516:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660600/0x22153cd396b7fb09 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.528520:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660600/0x22153cd396b7fb09 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.528523:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05660600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826356.528524:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660600/0x22153cd396b7fb09 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.528527:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660600/0x22153cd396b7fb09 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.528531:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0xaf1e71b4 (ffff90cf371d2600) 00010000:00010000:0.0:1787826356.528532:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826356.528534:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660600/0x22153cd396b7fb09 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.528537:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660600/0x22153cd396b7fb09 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.528559:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661e00/0x22153cd396b7fafb lrc: 1/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab01b8 expref: 31 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.528567:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0x0 (ffff90cf1988e500) 00010000:00010000:0.0:1787826356.528568:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787826356.528570:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661e00/0x22153cd396b7fafb lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab01b8 expref: 31 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.528576:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05661e00, rc 0) 00000100:00100000:0.0:1787826356.528646:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:51824:x1874670563653248:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 432us (612us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826356.528653:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3328 00000100:00100000:1.0:1787826356.531388:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826356.531575:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563653504 00000100:00100000:3.0:1787826356.531583:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563653504 00000100:00100000:3.0:1787826356.531680:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3329 00000100:00100000:3.0:1787826356.531689:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:51824:x1874670563653504:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826356.531708:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826356.531724:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b7fb10 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab01bf expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826356.531830:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0xe:0x0]: returning size 4096 00010000:00010000:3.0:1787826356.531933:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b7fb10 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab01bf expref: 32 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826356.531947:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ce01f45300) 00010000:00010000:3.0:1787826356.531949:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787826356.531954:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b7fb10 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab01bf expref: 32 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826356.531967:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3abd6600, rc 0) 00000100:00100000:3.0:1787826356.532024:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:51824:x1874670563653504:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 336us (649us total) trans 8589934608 rc 301/301 00000100:00100000:3.0:1787826356.532031:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3329 00000100:00100000:3.0:1787826356.533904:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826356.534087:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563653632 00000100:00100000:2.0:1787826356.534094:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563653632 00000100:00100000:2.0:1787826356.534160:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3330 00000100:00100000:2.0:1787826356.534167:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:51824:x1874670563653632:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:2.0:1787826356.534224:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426600/0x22153cd396b7fb1e lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.534236:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426600/0x22153cd396b7fb1e lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.534244:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426600/0x22153cd396b7fb1e lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.534252:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426c00/0x22153cd396b7fb25 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.534260:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426c00/0x22153cd396b7fb25 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.534264:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426c00/0x22153cd396b7fb25 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.534315:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7fb2c lrc: 3/1,0 mode: --/PR res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.534320:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7fb2c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.534324:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7fb2c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826356.534349:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0xf:0x0]: returning size 0 00000004:00200000:2.0:1787826356.534352:0:16564:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826356.534362:0:16564:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7fb2c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.534373:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426600/0x22153cd396b7fb1e lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.534380:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426600/0x22153cd396b7fb1e lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.534387:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426600/0x22153cd396b7fb1e lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.534392:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce02426600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826356.534396:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426600/0x22153cd396b7fb1e lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.534404:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426600/0x22153cd396b7fb1e lrc: 4/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.534415:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0x0 (ffff90cf1988e500) 00010000:00010000:2.0:1787826356.534418:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826356.534422:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426600/0x22153cd396b7fb1e lrc: 2/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.534428:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426600/0x22153cd396b7fb1e lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.534438:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426c00/0x22153cd396b7fb25 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.534445:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426c00/0x22153cd396b7fb25 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.534450:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426c00/0x22153cd396b7fb25 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.534455:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce02426c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826356.534458:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426c00/0x22153cd396b7fb25 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.534464:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426c00/0x22153cd396b7fb25 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.534503:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0xaf1e71b4 (ffff90cf1988ea00) 00010000:00010000:2.0:1787826356.534505:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826356.534508:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426c00/0x22153cd396b7fb25 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.534518:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426c00/0x22153cd396b7fb25 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.534532:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7fb2c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.534538:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7fb2c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.534544:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7fb2c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.534549:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce02426200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826356.534551:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7fb2c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.534557:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7fb2c lrc: 4/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.534565:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff90cf3abc6100) 00010000:00010000:2.0:1787826356.534567:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826356.534571:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7fb2c lrc: 2/0,0 mode: --/PR res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.534577:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7fb2c lrc: 0/0,0 mode: --/PR res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826356.534649:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:51824:x1874670563653632:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 481us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826356.534657:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3330 00000100:00100000:0.0:1787826356.537419:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826356.537682:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563653888 00000100:00100000:3.0:1787826356.537692:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563653888 00000100:00100000:3.0:1787826356.537780:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 977 00000100:00100000:3.0:1787826356.537791:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:51824:x1874670563653888:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:3.0:1787826356.538001:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+32:51824:x1874670563653888:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 211us (589us total) trans 8589934609 rc 0/0 00000100:00100000:3.0:1787826356.538010:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 977 00010000:00010000:2.0:1787826356.547604:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826356.554313:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826356.554362:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563654144 00000100:00100000:3.0:1787826356.554372:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563654144 00000100:00100000:3.0:1787826356.554519:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3331 00000100:00100000:3.0:1787826356.554530:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa85e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+32:51826:x1874670563654144:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:3.0:1787826356.554553:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826356.554557:0:9966:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787826356.554584:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427400/0x22153cd396b7faf4 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab01b1 expref: 32 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826356.554616:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0x0 (ffff90cf1988e500) 00010000:00010000:3.0:1787826356.554625:0:9966:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826356.554640:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b7fb33 lrc: 2/0,0 mode: --/CW res: [0x200000405:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab01c6 expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826356.554788:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7000/0x22153cd396b7fb3a lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826356.554801:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7000/0x22153cd396b7fb3a lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826356.554812:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7000/0x22153cd396b7fb3a lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826356.554825:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7400/0x22153cd396b7fb41 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826356.554833:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7400/0x22153cd396b7fb41 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826356.554842:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7400/0x22153cd396b7fb41 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826356.554899:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6400/0x22153cd396b7fb48 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826356.554907:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6400/0x22153cd396b7fb48 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826356.554914:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6400/0x22153cd396b7fb48 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826356.554923:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0xf:0x0]: returning size 0 00010000:00010000:3.0:1787826356.554996:0:9966:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7000/0x22153cd396b7fb3a lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826356.555003:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7000/0x22153cd396b7fb3a lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826356.555009:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7000/0x22153cd396b7fb3a lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826356.555017:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7000/0x22153cd396b7fb3a lrc: 4/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826356.555023:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3abd7000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826356.555027:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7000/0x22153cd396b7fb3a lrc: 4/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826356.555034:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7000/0x22153cd396b7fb3a lrc: 5/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826356.555047:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0x0 (ffff90cf06894000) 00010000:00010000:3.0:1787826356.555049:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826356.555052:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7000/0x22153cd396b7fb3a lrc: 3/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826356.555058:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7000/0x22153cd396b7fb3a lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826356.555068:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7400/0x22153cd396b7fb41 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826356.555075:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7400/0x22153cd396b7fb41 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826356.555081:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7400/0x22153cd396b7fb41 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826356.555086:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3abd7400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826356.555088:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7400/0x22153cd396b7fb41 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826356.555094:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7400/0x22153cd396b7fb41 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826356.555101:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0xaf1e71b4 (ffff90cf06894b00) 00010000:00010000:3.0:1787826356.555103:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826356.555106:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7400/0x22153cd396b7fb41 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826356.555111:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7400/0x22153cd396b7fb41 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826356.555168:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b7fb33 lrc: 0/0,0 mode: --/CW res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab01c6 expref: 34 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826356.555183:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6400/0x22153cd396b7fb48 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab01c6 expref: 33 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826356.555190:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff90cf3abc6100) 00010000:00010000:3.0:1787826356.555192:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826356.555194:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3abd6400, rc 0) 00000100:00100000:3.0:1787826356.555313:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa85e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:51826:x1874670563654144:12345-192.168.203.39@tcp:101:dd.0 Request processed in 784us (1016us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1787826356.555321:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3331 00000100:00100000:1.0:1787826356.558341:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826356.558600:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563654272 00000100:00100000:0.0:1787826356.558610:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563654272 00000100:00100000:0.0:1787826356.558674:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3332 00000100:00100000:0.0:1787826356.558684:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:51826:x1874670563654272:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:0.0:1787826356.558705:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826356.558725:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660600/0x22153cd396b7fb56 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab01cd expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.558773:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660000/0x22153cd396b7fb5d lrc: 3/1,0 mode: --/PR res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.558795:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660000/0x22153cd396b7fb5d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.558806:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660000/0x22153cd396b7fb5d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.558967:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660600/0x22153cd396b7fb56 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab01cd expref: 35 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.558980:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660000/0x22153cd396b7fb5d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab01cd expref: 34 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.558986:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff90cf3abc6100) 00010000:00010000:0.0:1787826356.558988:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787826356.558990:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05660000, rc 0) 00000100:00100000:0.0:1787826356.559041:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:51826:x1874670563654272:12345-192.168.203.39@tcp:101:dd.0 Request processed in 359us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826356.559048:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3332 00000100:00100000:0.0:1787826356.562607:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826356.562694:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563654528 00000100:00100000:3.0:1787826356.562704:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563654528 00000100:00100000:3.0:1787826356.562783:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3333 00000100:00100000:3.0:1787826356.562794:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f809a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:51826:x1874670563654528:12345-192.168.203.39@tcp:36:dd.0 00010000:00010000:3.0:1787826356.562845:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826356.562871:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6400/0x22153cd396b7fb48 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab01c6 expref: 34 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826356.562902:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff90cf3abc6100) 00010000:00010000:3.0:1787826356.562908:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826356.563068:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b7fb64 lrc: 3/0,1 mode: --/PW res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826356.563083:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b7fb64 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826356.563093:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b7fb64 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787826356.563138:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934611 00000004:00010000:3.0:1787826356.563161:0:6518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006a9679f4 reply state 00000000de7aec01 transno 8589934612 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b7fb64 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826356.563172:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b7fb64 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826356.563179:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff90cf3abc6100) 00010000:00010000:3.0:1787826356.563181:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826356.563184:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826356.563266:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f809a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:51826:x1874670563654528:12345-192.168.203.39@tcp:36:dd.0 Request processed in 473us (676us total) trans 8589934612 rc 0/0 00000100:00100000:3.0:1787826356.563272:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3333 00000020:00080000:3.0:1787826356.563277:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787826356.567277:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826356.567837:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563654656 00000100:00100000:0.0:1787826356.567847:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563654656 00000100:00100000:0.0:1787826356.567906:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1687 00000100:00100000:0.0:1787826356.567915:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aaf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:51826:x1874670563654656:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:0.0:1787826356.567932:0:28853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826356.567949:0:28853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003299944/0x22153cd396b7fb6b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xe0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab01d4 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.567981:0:28853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000061e22549/0x22153cd396b7f49c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xe0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0125 expref: 10 pid: 30694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.567991:0:28853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe0:0x0].0x0 since=55s v=(0 0) 00010000:00010000:0.0:1787826356.567995:0:28853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826356.568001:0:28853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003299944/0x22153cd396b7fb6b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xe0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab01d4 expref: 10 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.568033:0:28853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000061e22549/0x22153cd396b7f49c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xe0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0125 expref: 10 pid: 30694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.568045:0:28853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000061e22549/0x22153cd396b7f49c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xe0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0125 expref: 10 pid: 30694 timeout: 1402 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826356.568057:0:28853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f809680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28853:1874670585161088:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826356.568135:0:28853:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce05f8ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826356.571611:0:28853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f809680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28853:1874670585161088:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826356.571649:0:28853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000003299944/0x22153cd396b7fb6b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xe0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab01d4 expref: 10 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.571670:0:28853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05660600, rc 0) 00000100:00100000:0.0:1787826356.571920:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aaf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:51826:x1874670563654656:12345-192.168.203.39@tcp:101:dd.0 Request processed in 4005us (4651us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826356.571929:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1687 00000100:00100000:1.0:1787826356.573195:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826356.573604:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563654784 00000100:00100000:3.0:1787826356.573613:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563654784 00010000:00010000:3.0:1787826356.573650:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000061e22549/0x22153cd396b7f49c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xe0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0125 expref: 10 pid: 30694 timeout: 1402 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826356.573744:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 911 00000100:00100000:3.0:1787826356.573754:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf181fd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563654784:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826356.573789:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826356.573795:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000061e22549/0x22153cd396b7f49c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xe0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0125 expref: 10 pid: 30694 timeout: 1402 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826356.573815:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000061e22549/0x22153cd396b7f49c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xe0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0125 expref: 10 pid: 30694 timeout: 1402 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826356.573840:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061e22549/0x22153cd396b7f49c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xe0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0125 expref: 10 pid: 30694 timeout: 1402 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826356.573857:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826356.573862:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826356.573869:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000003299944/0x22153cd396b7fb6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab01d4 expref: 9 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826356.573877:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003299944/0x22153cd396b7fb6b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab01d4 expref: 9 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826356.573924:0:6503:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000003299944/0x22153cd396b7fb6b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab01d4 expref: 9 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826356.573935:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a8ae580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6503:1874670585161216:192.168.203.39@tcp:105: 00000100:00100000:3.0:1787826356.574073:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce05b56000 going to sleep for 11 seconds 00000100:00100000:3.0:1787826356.577326:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a8ae580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6503:1874670585161216:192.168.203.39@tcp:105: 00010000:00010000:3.0:1787826356.577352:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826356.578390:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf181fd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563654784:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4631us (5195us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826356.578407:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 911 00000100:00100000:2.0:1787826356.580360:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826356.580550:0:20692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563654912 00000100:00100000:1.0:1787826356.580560:0:20692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563654912 00002000:00010000:1.0:1787826356.580608:0:20692:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/224 (0->18446744073709551615) 00002000:00100000:1.0:1787826356.580613:0:20692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf3aaf2580 with x1874670563654912 ext(0->18446744073709551615) 00002000:00010000:1.0:1787826356.580625:0:20692:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90cf3aaf2580. 00000100:00100000:1.0:1787826356.580705:0:20692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 642 00000100:00100000:1.0:1787826356.580715:0:20692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aaf2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670563654912:12345-192.168.203.39@tcp:10:dd.0 00002000:00010000:1.0:1787826356.581071:0:20692:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xe0:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787826356.581074:0:20692:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xe0:0x0] updating lvb mtime from disk: 1787826301 -> 1787826357 00002000:00010000:1.0:1787826356.581076:0:20692:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xe0:0x0] updating lvb atime from disk: 1787826301 -> 1787826301 00002000:00010000:1.0:1787826356.581077:0:20692:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xe0:0x0] updating lvb ctime from disk: 1787826301 -> 1787826357 00002000:00010000:1.0:1787826356.581078:0:20692:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xe0:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1787826356.581126:0:20692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aaf2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670563654912:12345-192.168.203.39@tcp:10:dd.0 Request processed in 412us (772us total) trans 17179869571 rc 0/0 00000100:00100000:1.0:1787826356.581133:0:20692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 642 00002000:00010000:1.0:1787826356.581137:0:20692:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/224 (0->18446744073709551615) 00002000:00100000:1.0:1787826356.581140:0:20692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf3aaf2580 with x1874670563654912 ext(0->18446744073709551615) 00002000:00010000:1.0:1787826356.581144:0:20692:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90cf3aaf2580. 00000100:00100000:1.0:1787826356.612451:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826356.612559:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563655168 00000100:00100000:2.0:1787826356.612568:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563655168 00000100:00100000:2.0:1787826356.612682:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 978 00000100:00100000:2.0:1787826356.612693:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf10474c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:51826:x1874670563655168:12345-192.168.203.39@tcp:35:dd.0 00000100:00100000:2.0:1787826356.615902:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf10474c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:51826:x1874670563655168:12345-192.168.203.39@tcp:35:dd.0 Request processed in 3202us (3450us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1787826356.615916:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 978 00000100:00100000:3.0:1787826356.640442:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826356.640601:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563655296 00000100:00100000:2.0:1787826356.640611:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563655296 00000100:00100000:2.0:1787826356.640680:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3334 00000100:00100000:2.0:1787826356.640690:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8ae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:51827:x1874670563655296:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826356.640715:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826356.640735:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427000/0x22153cd396b7fb72 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab01db expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.640808:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7fb79 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.640823:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7fb79 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.640835:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7fb79 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.640849:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426600/0x22153cd396b7fb80 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.640860:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426600/0x22153cd396b7fb80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.640866:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426600/0x22153cd396b7fb80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.640945:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426c00/0x22153cd396b7fb87 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.640954:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426c00/0x22153cd396b7fb87 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.640960:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426c00/0x22153cd396b7fb87 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826356.640994:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0xe:0x0]: returning size 4096 00000004:00200000:2.0:1787826356.640998:0:16564:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826356.641016:0:16564:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426c00/0x22153cd396b7fb87 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.641028:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7fb79 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.641034:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7fb79 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.641041:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7fb79 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.641046:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce02426200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826356.641049:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7fb79 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.641056:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7fb79 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.641068:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ce01f45300) 00010000:00010000:2.0:1787826356.641071:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826356.641076:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7fb79 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.641082:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426200/0x22153cd396b7fb79 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.641094:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426600/0x22153cd396b7fb80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.641100:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426600/0x22153cd396b7fb80 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.641106:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426600/0x22153cd396b7fb80 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.641112:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce02426600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826356.641119:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426600/0x22153cd396b7fb80 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.641125:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426600/0x22153cd396b7fb80 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.641132:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfe7a1a38 (ffff90cf1988ea00) 00010000:00010000:2.0:1787826356.641134:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826356.641137:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426600/0x22153cd396b7fb80 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.641147:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426600/0x22153cd396b7fb80 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.641176:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427000/0x22153cd396b7fb72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab01db expref: 39 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.641190:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02426c00/0x22153cd396b7fb87 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab01db expref: 38 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.641197:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0x0 (ffff90cf1988ef00) 00010000:00010000:2.0:1787826356.641199:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787826356.641202:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce02426c00, rc 0) 00000100:00100000:2.0:1787826356.641267:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8ae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:51827:x1874670563655296:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 579us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826356.641275:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3334 00000100:00100000:3.0:1787826356.649805:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826356.649895:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563655552 00000100:00100000:2.0:1787826356.649904:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563655552 00000100:00100000:2.0:1787826356.649953:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3335 00000100:00100000:2.0:1787826356.649962:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8afc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:51827:x1874670563655552:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826356.649982:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826356.650005:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427400/0x22153cd396b7fb8e lrc: 2/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab01e2 expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.650096:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a833a00/0x22153cd396b7fb95 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.650109:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a833a00/0x22153cd396b7fb95 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.650121:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a833a00/0x22153cd396b7fb95 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.650135:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a833400/0x22153cd396b7fb9c lrc: 3/1,0 mode: --/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.650142:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a833400/0x22153cd396b7fb9c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.650148:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a833400/0x22153cd396b7fb9c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.650221:0:9966:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a833a00/0x22153cd396b7fb95 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.650229:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a833a00/0x22153cd396b7fb95 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.650235:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a833a00/0x22153cd396b7fb95 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.650242:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a833a00/0x22153cd396b7fb95 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.650248:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a833a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826356.650252:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a833a00/0x22153cd396b7fb95 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.650260:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a833a00/0x22153cd396b7fb95 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.650271:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0x0 (ffff90cf1988ef00) 00010000:00010000:2.0:1787826356.650275:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826356.650279:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a833a00/0x22153cd396b7fb95 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.650286:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a833a00/0x22153cd396b7fb95 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.650299:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a833400/0x22153cd396b7fb9c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.650305:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a833400/0x22153cd396b7fb9c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.650311:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a833400/0x22153cd396b7fb9c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.650316:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a833400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826356.650319:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a833400/0x22153cd396b7fb9c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.650324:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a833400/0x22153cd396b7fb9c lrc: 4/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.650331:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0xaf1e71b4 (ffff90cf1988e500) 00010000:00010000:2.0:1787826356.650333:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826356.650336:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a833400/0x22153cd396b7fb9c lrc: 2/0,0 mode: --/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.650342:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a833400/0x22153cd396b7fb9c lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.650370:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427400/0x22153cd396b7fb8e lrc: 1/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab01e2 expref: 39 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.650386:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0x0 (ffff90cf1988ef00) 00010000:00010000:2.0:1787826356.650388:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787826356.650392:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce02427400/0x22153cd396b7fb8e lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab01e2 expref: 39 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.650401:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce02427400, rc 0) 00000100:00100000:2.0:1787826356.650462:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8afc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:51827:x1874670563655552:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 501us (667us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826356.650505:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3335 00000100:00100000:1.0:1787826356.656224:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826356.656313:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563655808 00000100:00100000:0.0:1787826356.656323:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563655808 00000100:00100000:0.0:1787826356.656378:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3336 00000100:00100000:0.0:1787826356.656386:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:51827:x1874670563655808:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826356.656404:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826356.656424:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661400/0x22153cd396b7fba3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab01e9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826356.656555:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0xe:0x0]: returning size 4096 00010000:00010000:0.0:1787826356.656663:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661400/0x22153cd396b7fba3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab01e9 expref: 40 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.656677:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ce01f45300) 00010000:00010000:0.0:1787826356.656679:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787826356.656683:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661400/0x22153cd396b7fba3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab01e9 expref: 40 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826356.656696:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05661400, rc 0) 00000100:00100000:0.0:1787826356.656753:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+39:51827:x1874670563655808:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 367us (539us total) trans 8589934614 rc 301/301 00000100:00100000:0.0:1787826356.656760:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3336 00000100:00100000:3.0:1787826356.661064:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826356.662131:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563655936 00000100:00100000:2.0:1787826356.662143:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563655936 00000100:00100000:2.0:1787826356.662274:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3337 00000100:00100000:2.0:1787826356.662284:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8acb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+39:51827:x1874670563655936:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:2.0:1787826356.662359:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a833400/0x22153cd396b7fbb1 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.662375:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a833400/0x22153cd396b7fbb1 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.662387:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a833400/0x22153cd396b7fbb1 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.662402:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a833a00/0x22153cd396b7fbb8 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.662410:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a833a00/0x22153cd396b7fbb8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.662419:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a833a00/0x22153cd396b7fbb8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.662576:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a832e00/0x22153cd396b7fbbf lrc: 3/1,0 mode: --/PR res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.662587:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a832e00/0x22153cd396b7fbbf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.662610:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a832e00/0x22153cd396b7fbbf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826356.662652:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0xf:0x0]: returning size 1048576 00000004:00200000:2.0:1787826356.662656:0:8247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826356.662669:0:8247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a832e00/0x22153cd396b7fbbf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.662681:0:8247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a833400/0x22153cd396b7fbb1 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.662688:0:8247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a833400/0x22153cd396b7fbb1 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.662695:0:8247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a833400/0x22153cd396b7fbb1 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.662701:0:8247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a833400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826356.662717:0:8247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a833400/0x22153cd396b7fbb1 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.662725:0:8247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a833400/0x22153cd396b7fbb1 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.662737:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0x0 (ffff90cf1988ef00) 00010000:00010000:2.0:1787826356.662741:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826356.662745:0:8247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a833400/0x22153cd396b7fbb1 lrc: 2/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.662752:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a833400/0x22153cd396b7fbb1 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.663055:0:8247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a833a00/0x22153cd396b7fbb8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.663062:0:8247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a833a00/0x22153cd396b7fbb8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.663068:0:8247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a833a00/0x22153cd396b7fbb8 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.663073:0:8247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a833a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826356.663076:0:8247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a833a00/0x22153cd396b7fbb8 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.663082:0:8247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a833a00/0x22153cd396b7fbb8 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.663090:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0xaf1e71b4 (ffff90cf1988e500) 00010000:00010000:2.0:1787826356.663093:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826356.663096:0:8247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a833a00/0x22153cd396b7fbb8 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.663102:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a833a00/0x22153cd396b7fbb8 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.663119:0:8247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a832e00/0x22153cd396b7fbbf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.663125:0:8247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a832e00/0x22153cd396b7fbbf lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.663130:0:8247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a832e00/0x22153cd396b7fbbf lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.663135:0:8247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a832e00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826356.663138:0:8247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a832e00/0x22153cd396b7fbbf lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.663156:0:8247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a832e00/0x22153cd396b7fbbf lrc: 4/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.663164:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff90cf3abc6100) 00010000:00010000:2.0:1787826356.663167:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826356.663170:0:8247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a832e00/0x22153cd396b7fbbf lrc: 2/0,0 mode: --/PR res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826356.663176:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a832e00/0x22153cd396b7fbbf lrc: 0/0,0 mode: --/PR res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826356.663258:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8acb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+39:51827:x1874670563655936:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 974us (2201us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826356.663267:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3337 00000100:00100000:2.0:1787826356.666061:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826356.666132:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563656192 00000100:00100000:3.0:1787826356.666139:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563656192 00000100:00100000:3.0:1787826356.666260:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 979 00000100:00100000:3.0:1787826356.666267:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aaf2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+39:51827:x1874670563656192:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:3.0:1787826356.666459:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aaf2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:51827:x1874670563656192:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 191us (404us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1787826356.666467:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 979 00000100:00100000:3.0:1787826356.995800:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f809680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585161344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787826356.995872:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826356.995964:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585161344 00000100:00100000:3.0:1787826356.995977:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585161344 00000100:00100000:3.0:1787826356.996034:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 734 00000100:00100000:3.0:1787826356.996044:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f936940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874670585161344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787826356.996065:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43440960 pending 0 free 3919286272 avail 3687763968 00000100:00100000:3.0:1787826356.996126:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f936940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874670585161344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826356.996135:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 734 00000100:00100000:3.0:1787826356.996193:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f809680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585161344:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787826356.999129:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aaf12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585161472:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787826356.999195:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826356.999310:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787826356.999325:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aaf3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585161600:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826356.999492:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826356.999752:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787826356.999763:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f9352c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585161728:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787826357.000204:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826357.000253:0:12021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585161472 00000100:00100000:1.0:1787826357.000260:0:12021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585161472 00000100:00100000:0.0:1787826357.000565:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585161600 00000100:00100000:0.0:1787826357.000570:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585161600 00000100:00100000:0.0:1787826357.000599:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585161728 00000100:00100000:0.0:1787826357.000602:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585161728 00000100:00100000:0.0:1787826357.000618:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 735 00000100:00100000:0.0:1787826357.000626:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f80a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874670585161472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787826357.000651:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 60259136 pending 0 free 3921387520 avail 3689865216 00000100:00100000:0.0:1787826357.000702:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f80a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874670585161472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (1507us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826357.000710:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 735 00000100:00100000:0.0:1787826357.000727:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 736 00000100:00100000:0.0:1787826357.000733:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aaf0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874670585161600:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787826357.000744:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 60259136 pending 0 free 3921387520 avail 3689865216 00000100:00100000:0.0:1787826357.000773:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aaf0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874670585161600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 41us (1304us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826357.000779:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 736 00000100:00100000:0.0:1787826357.000801:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 737 00000100:00100000:0.0:1787826357.000808:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb94780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874670585161728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787826357.000817:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43440960 pending 0 free 3919286272 avail 3687763968 00000100:00100000:0.0:1787826357.000858:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb94780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874670585161728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826357.000864:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 737 00000100:00100000:0.0:1787826357.000914:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aaf12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585161472:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787826357.001202:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aaf3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585161600:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826357.001237:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f9352c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585161728:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826357.394091:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826357.394137:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826357.394188:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826357.394201:0:34487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563656320 00000100:00100000:1.0:1787826357.394213:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826357.394213:0:34487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563656320 00000100:00100000:1.0:1787826357.394252:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826357.394343:0:34487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 78 00000100:00100000:3.0:1787826357.394353:0:34487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf39ccf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:307626ff-a376-4faf-93e0-9f55b723d964+10:2402:x1874670563656320:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1787826357.394418:0:34487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf39ccf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:307626ff-a376-4faf-93e0-9f55b723d964+10:2402:x1874670563656320:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 67us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826357.394427:0:34487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 78 00000100:00100000:0.0:1787826357.394897:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563656832 00000100:00100000:0.0:1787826357.394903:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563656832 00000100:00100000:0.0:1787826357.394949:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563656704 00000100:00100000:0.0:1787826357.394952:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563656704 00000100:00100000:0.0:1787826357.394980:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 883 00000100:00100000:0.0:1787826357.394989:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1366a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2402:x1874670563656832:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1787826357.395022:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1366a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2402:x1874670563656832:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 35us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826357.395028:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 883 00000100:00100000:0.0:1787826357.395043:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 884 00000100:00100000:0.0:1787826357.395049:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf13668780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2402:x1874670563656704:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1787826357.395071:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf13668780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2402:x1874670563656704:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 23us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826357.395078:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 884 00000100:00100000:2.0:1787826357.397565:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563656576 00000100:00100000:2.0:1787826357.397579:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563656576 00000100:00100000:2.0:1787826357.397635:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563656448 00000100:00100000:2.0:1787826357.397639:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563656448 00000100:00100000:2.0:1787826357.397677:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1496 00000100:00100000:2.0:1787826357.397687:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:2402:x1874670563656576:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1787826357.397762:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:2402:x1874670563656576:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 77us (3625us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826357.397770:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1496 00000100:00100000:2.0:1787826357.397787:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1497 00000100:00100000:2.0:1787826357.397793:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf13668f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:2402:x1874670563656448:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1787826357.397824:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf13668f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:2402:x1874670563656448:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 31us (3611us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826357.397830:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1497 00010000:00010000:2.0:1787826357.571782:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826358.603909:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826359.619591:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826360.643649:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826361.607673:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a988780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585161984:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787826361.607745:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826361.607829:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787826361.607837:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf13669e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585161856:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787826361.607862:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826361.607901:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585161984 00000100:00100000:2.0:1787826361.607909:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585161984 00000100:00100000:2.0:1787826361.607949:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585161856 00000100:00100000:2.0:1787826361.607952:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585161856 00000100:00100000:2.0:1787826361.607969:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1336 00000100:00100000:2.0:1787826361.607976:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aaf3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3647:x1874670585161984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787826361.608008:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445965824 avail 1299726336 00000100:00100000:2.0:1787826361.608053:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aaf3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3647:x1874670585161984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826361.608059:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1336 00000100:00100000:2.0:1787826361.608076:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1337 00000100:00100000:2.0:1787826361.608083:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aaf21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874670585161856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787826361.608098:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446240256 avail 1300000768 00000100:00100000:2.0:1787826361.608125:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aaf21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874670585161856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 42us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826361.608131:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1337 00000100:00100000:2.0:1787826361.608250:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf13669e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585161856:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787826361.608263:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a988780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585161984:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826361.612832:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f8083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e3c550b8-2c3c-46c3-ad36-671c284167ea:3644:1874670585162112:0@lo:400:kworker.0 00000100:00100000:3.0:1787826361.612904:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826361.612951:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f80b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874670585162624:0@lo:400:kworker.0 00000100:00100000:3.0:1787826361.612987:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826361.613007:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03afcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585163136:0@lo:400:kworker.0 00000100:00100000:3.0:1787826361.613030:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826361.613065:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787826361.613070:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f808f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874670585162240:0@lo:400:kworker.0 00000100:00100000:3.0:1787826361.613092:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826361.613113:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f80b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874670585162752:0@lo:400:kworker.0 00000100:00100000:3.0:1787826361.613133:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826361.613148:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03afe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585163264:0@lo:400:kworker.0 00000100:00100000:3.0:1787826361.613166:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826361.613193:0:34488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585162112 00000100:00100000:3.0:1787826361.613200:0:34488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585162112 00000100:00100000:3.0:1787826361.613242:0:34488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787826361.613251:0:34488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf39ccec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3c550b8-2c3c-46c3-ad36-671c284167ea+24:3644:x1874670585162112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826361.613296:0:34488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf39ccec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3c550b8-2c3c-46c3-ad36-671c284167ea+24:3644:x1874670585162112:12345-0@lo:400:kworker.0 Request processed in 45us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826361.613302:0:34488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787826361.613332:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585162624 00000100:00100000:3.0:1787826361.613335:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585162624 00000100:00100000:3.0:1787826361.613368:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585162240 00000100:00100000:3.0:1787826361.613371:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585162240 00000100:00100000:3.0:1787826361.613386:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585162752 00000100:00100000:3.0:1787826361.613388:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585162752 00000100:00100000:3.0:1787826361.613406:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1498 00000100:00100000:3.0:1787826361.613413:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a988000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874670585162624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826361.613443:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a988000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874670585162624:12345-0@lo:400:kworker.0 Request processed in 31us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826361.613449:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1498 00000100:00100000:3.0:1787826361.613461:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1499 00000100:00100000:3.0:1787826361.613467:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874670585162240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826361.613515:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874670585162240:12345-0@lo:400:kworker.0 Request processed in 48us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826361.613520:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1499 00000100:00100000:3.0:1787826361.613532:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1500 00000100:00100000:3.0:1787826361.613538:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf07964b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874670585162752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826361.613576:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf07964b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874670585162752:12345-0@lo:400:kworker.0 Request processed in 38us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826361.613582:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1500 00000100:00100000:3.0:1787826361.613601:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585163136 00000100:00100000:3.0:1787826361.613605:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585163136 00000100:00100000:3.0:1787826361.613628:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585163264 00000100:00100000:3.0:1787826361.613631:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585163264 00000100:00100000:3.0:1787826361.613648:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 885 00000100:00100000:3.0:1787826361.613653:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a988780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3644:x1874670585163136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826361.613682:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a988780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3644:x1874670585163136:12345-0@lo:400:kworker.0 Request processed in 28us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826361.613687:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 885 00000100:00100000:3.0:1787826361.613698:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 886 00000100:00100000:3.0:1787826361.613704:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf07966d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3644:x1874670585163264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826361.613741:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf07966d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3644:x1874670585163264:12345-0@lo:400:kworker.0 Request processed in 25us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826361.613747:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 886 00000100:00100000:3.0:1787826361.613789:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f808f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874670585162240:0@lo:400:kworker.0 00000100:00100000:3.0:1787826361.613799:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f80b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874670585162752:0@lo:400:kworker.0 00000100:00100000:3.0:1787826361.613807:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03afe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585163264:0@lo:400:kworker.0 00000100:00100000:3.0:1787826361.613815:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f8083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e3c550b8-2c3c-46c3-ad36-671c284167ea:3644:1874670585162112:0@lo:400:kworker.0 00000100:00100000:3.0:1787826361.613824:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f80b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874670585162624:0@lo:400:kworker.0 00000100:00100000:3.0:1787826361.613832:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03afcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585163136:0@lo:400:kworker.0 00000100:00100000:3.0:1787826361.613900:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f808b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585162368:0@lo:400:kworker.0 00000100:00100000:3.0:1787826361.613925:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826361.613943:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f809680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874670585162880:0@lo:400:kworker.0 00000100:00100000:3.0:1787826361.613963:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826361.613981:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3abc0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874670585163392:0@lo:400:kworker.0 00000100:00100000:3.0:1787826361.613999:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826361.614016:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787826361.614023:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f808000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585162496:0@lo:400:kworker.0 00000100:00100000:3.0:1787826361.614042:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826361.614060:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03aff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1874670585163008:0@lo:400:kworker.0 00000100:00100000:3.0:1787826361.614081:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826361.614102:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585162880 00000100:00100000:3.0:1787826361.614105:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585162880 00000100:00100000:3.0:1787826361.614127:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585163392 00000100:00100000:3.0:1787826361.614130:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585163392 00000100:00100000:3.0:1787826361.614141:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585163008 00000100:00100000:3.0:1787826361.614143:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585163008 00000100:00100000:3.0:1787826361.614155:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1501 00000100:00100000:3.0:1787826361.614160:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf07967840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874670585162880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826361.614195:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf07967840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874670585162880:12345-0@lo:400:kworker.0 Request processed in 34us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826361.614201:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1501 00000100:00100000:3.0:1787826361.614212:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1502 00000100:00100000:3.0:1787826361.614218:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf07965a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874670585163392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826361.614243:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf07965a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874670585163392:12345-0@lo:400:kworker.0 Request processed in 26us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826361.614248:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1502 00000100:00100000:3.0:1787826361.614259:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1503 00000100:00100000:3.0:1787826361.614265:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03afe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874670585163008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826361.614290:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03afe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874670585163008:12345-0@lo:400:kworker.0 Request processed in 26us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826361.614295:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1503 00000100:00100000:3.0:1787826361.614311:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585162368 00000100:00100000:3.0:1787826361.614314:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585162368 00000100:00100000:3.0:1787826361.614335:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585162496 00000100:00100000:3.0:1787826361.614337:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585162496 00000100:00100000:3.0:1787826361.614354:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 887 00000100:00100000:3.0:1787826361.614360:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf07966580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3646:x1874670585162368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826361.614391:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf07966580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3646:x1874670585162368:12345-0@lo:400:kworker.0 Request processed in 30us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826361.614396:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 887 00000100:00100000:3.0:1787826361.614406:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 888 00000100:00100000:3.0:1787826361.614412:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03afcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3646:x1874670585162496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826361.614436:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03afcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3646:x1874670585162496:12345-0@lo:400:kworker.0 Request processed in 24us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826361.614441:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 888 00000100:00100000:3.0:1787826361.614499:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f808000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585162496:0@lo:400:kworker.0 00000100:00100000:3.0:1787826361.614511:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03aff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1874670585163008:0@lo:400:kworker.0 00000100:00100000:3.0:1787826361.614519:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f808b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585162368:0@lo:400:kworker.0 00000100:00100000:3.0:1787826361.614527:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f809680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874670585162880:0@lo:400:kworker.0 00000100:00100000:3.0:1787826361.614534:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3abc0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874670585163392:0@lo:400:kworker.0 00000100:00080000:0.0:1787826361.615722:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787826361.615729:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787826361.615731:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787826361.615734:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787826361.671149:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826362.115660:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aaf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585163520:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826362.115726:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826362.115782:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585163520 00000100:00100000:2.0:1787826362.115789:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585163520 00000100:00100000:2.0:1787826362.115831:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 738 00000100:00100000:2.0:1787826362.115840:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aaf2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874670585163520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787826362.115869:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 60259136 pending 0 free 3921387520 avail 3689865216 00000100:00100000:2.0:1787826362.115911:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aaf2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874670585163520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826362.115918:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 738 00000100:00100000:2.0:1787826362.115959:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aaf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585163520:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826362.116077:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03aff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585163648:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787826362.116104:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826362.116136:0:12021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585163648 00000100:00100000:3.0:1787826362.116140:0:12021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585163648 00000100:00100000:3.0:1787826362.116165:0:12021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 739 00000100:00100000:3.0:1787826362.116171:0:12021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f809680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874670585163648:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787826362.116186:0:12021:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43440960 pending 0 free 3919286272 avail 3687763968 00000100:00100000:3.0:1787826362.116219:0:12021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f809680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874670585163648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 48us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826362.116228:0:12021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 739 00000100:00100000:3.0:1787826362.116264:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03aff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585163648:0@lo:13:osp-pre-0-1.0 00000004:00080000:2.0:1787826362.116364:0:34501:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1308127891626ns, next at 1309127889395ns, rc = 0 00000100:00100000:2.0:1787826362.116398:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787826362.116406:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aaf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585163776:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787826362.116433:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826362.116456:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585163776 00000100:00100000:2.0:1787826362.116460:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585163776 00000100:00100000:2.0:1787826362.120901:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787826362.120920:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f9352c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585163904:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787826362.120982:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:1.0:1787826362.124742:0:27651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179869571 is committed 00000001:00080000:1.0:1787826362.124810:0:34481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934615 is committed 00000004:00080000:1.0:1787826362.124830:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:0.0:1787826362.129054:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b7fb64 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826362.129068:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b7fb64 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826362.129075:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b7fb64 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826362.129081:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3abd6600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826362.129087:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b7fb64 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826362.129095:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b7fb64 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826362.129114:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff90cf3abc6100) 00010000:00010000:0.0:1787826362.129117:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826362.129122:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b7fb64 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826362.129793:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b7fb64 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826362.130061:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585163904 00000100:00100000:3.0:1787826362.130070:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585163904 00000100:00100000:3.0:1787826362.130136:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 740 00000100:00100000:3.0:1787826362.130146:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aaf12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874670585163776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787826362.130167:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43440960 pending 0 free 3919286272 avail 3687763968 00000100:00100000:3.0:1787826362.130248:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aaf12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874670585163776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (13813us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826362.130255:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 740 00000100:00100000:3.0:1787826362.130269:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 741 00000100:00100000:3.0:1787826362.130275:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03892580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874670585163904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787826362.130286:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 60259136 pending 0 free 3921387520 avail 3689865216 00000100:00100000:3.0:1787826362.130324:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03892580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874670585163904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (9342us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826362.130330:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 741 00000100:00100000:3.0:1787826362.130368:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3abc30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585164032:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787826362.132634:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aaf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585163776:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787826362.134814:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826362.134881:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f9352c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585163904:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787826362.137595:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585164032 00000100:00100000:2.0:1787826362.137609:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585164032 00000100:00100000:2.0:1787826362.137678:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1688 00000100:00100000:2.0:1787826362.137688:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f808b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874670585164032:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787826362.137717:0:8436:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:212 count 1 00010000:00010000:2.0:1787826362.137742:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b41f3642/0x22153cd396b7fbc6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826362.137764:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9f7375/0x22153cd396b7f487 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0117 expref: 8 pid: 30695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826362.137773:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd4:0x0].0x0 since=61s v=(0 0) 00010000:00010000:2.0:1787826362.137778:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826362.137783:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b41f3642/0x22153cd396b7fbc6 lrc: 4/0,1 mode: --/PW res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826362.137819:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fa9f7375/0x22153cd396b7f487 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0117 expref: 8 pid: 30695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826362.137833:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fa9f7375/0x22153cd396b7f487 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0117 expref: 8 pid: 30695 timeout: 1408 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826362.137848:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aaf3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1874670585164160:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826362.137939:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3ab7ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826362.155580:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826362.156046:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aaf3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1874670585164160:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826362.156076:0:8436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b41f3642/0x22153cd396b7fbc6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826362.158106:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563656960 00000100:00100000:1.0:1787826362.158119:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563656960 00010000:00010000:1.0:1787826362.158216:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9f7375/0x22153cd396b7f487 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0117 expref: 9 pid: 30695 timeout: 1408 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826362.158324:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 912 00000100:00100000:1.0:1787826362.158334:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2402:x1874670563656960:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826362.158349:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826362.158355:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fa9f7375/0x22153cd396b7f487 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0117 expref: 9 pid: 30695 timeout: 1408 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826362.158370:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fa9f7375/0x22153cd396b7f487 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0117 expref: 9 pid: 30695 timeout: 1408 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826362.158394:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9f7375/0x22153cd396b7f487 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xd4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0117 expref: 9 pid: 30695 timeout: 1408 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826362.158408:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826362.158413:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826362.158419:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b41f3642/0x22153cd396b7fbc6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826362.158429:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b41f3642/0x22153cd396b7fbc6 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826362.158461:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826362.158538:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2402:x1874670563656960:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 205us (2968us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826362.158545:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 912 00010000:00010000:1.0:1787826362.158586:0:8436:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b41f3642/0x22153cd396b7fbc6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826362.158596:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b41f3642/0x22153cd396b7fbc6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826362.158605:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b41f3642/0x22153cd396b7fbc6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826362.158612:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b41f3642/0x22153cd396b7fbc6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826362.158628:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826362.158834:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826362.158841:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b41f3642/0x22153cd396b7fbc6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826362.158849:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a833000 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826362.158853:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b41f3642/0x22153cd396b7fbc6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826362.158861:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b41f3642/0x22153cd396b7fbc6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826362.158872:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b41f3642/0x22153cd396b7fbc6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826362.158879:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b41f3642/0x22153cd396b7fbc6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826362.158895:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826362.158897:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826362.158899:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826362.160658:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f808b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1874670585164032:12345-0@lo:6:osp-syn-0-0.0 Request processed in 22967us (25845us total) trans 21474836893 rc 0/0 00000100:00100000:1.0:1787826362.160684:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1688 00000004:00080000:2.0:1787826362.162056:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3abc30c0/2, rc 0, transno 21474836893 00000100:00100000:2.0:1787826362.162069:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3abc30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585164032:0@lo:6:osp-syn-0-0.0 00000100:00080000:3.0:1787826362.173347:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826362.514045:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826362.514083:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826362.514107:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826362.514135:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826362.514180:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826362.514205:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563657344 00000100:00100000:1.0:1787826362.514214:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563657344 00000100:00100000:1.0:1787826362.514259:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563657216 00000100:00100000:1.0:1787826362.514262:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563657216 00000100:00100000:1.0:1787826362.514279:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1504 00000100:00100000:1.0:1787826362.514299:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf13669e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:2404:x1874670563657344:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1787826362.514362:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf13669e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:2404:x1874670563657344:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 75us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826362.514369:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1504 00000100:00100000:1.0:1787826362.514384:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1505 00000100:00100000:1.0:1787826362.514390:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf13668b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2404:x1874670563657216:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1787826362.514409:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf13668b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2404:x1874670563657216:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 20us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826362.514415:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1505 00000100:00100000:0.0:1787826362.514768:0:34485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563657088 00000100:00100000:0.0:1787826362.514773:0:34485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563657088 00000100:00100000:0.0:1787826362.514810:0:34485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 80 00000100:00100000:0.0:1787826362.514816:0:34485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf39ccd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:307626ff-a376-4faf-93e0-9f55b723d964+10:2404:x1874670563657088:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1787826362.514846:0:34485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf39ccd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:307626ff-a376-4faf-93e0-9f55b723d964+10:2404:x1874670563657088:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 31us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826362.514856:0:34485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 80 00000100:00080000:0.0:1787826362.514879:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787826362.514883:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787826362.514960:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563657600 00000100:00100000:2.0:1787826362.514964:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563657600 00000100:00100000:2.0:1787826362.514999:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563657472 00000100:00100000:2.0:1787826362.515002:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563657472 00000100:00100000:2.0:1787826362.515018:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 889 00000100:00100000:2.0:1787826362.515024:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1366a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563657600:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1787826362.515051:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1366a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563657600:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 28us (943us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826362.515057:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 889 00000100:00100000:2.0:1787826362.515067:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 890 00000100:00100000:2.0:1787826362.515072:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2404:x1874670563657472:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1787826362.515091:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2404:x1874670563657472:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 19us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826362.515096:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 890 00000100:00080000:0.0:1787826362.515150:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787826362.691678:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787826363.627393:0:35310:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 50a: mirror extend/copy preserves sparseness ========================================================== 06:26:03 (1787826363) 00010000:00010000:3.0:1787826363.723603:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826363.749246:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826363.749362:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563657856 00000100:00100000:3.0:1787826363.749376:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563657856 00000100:00100000:3.0:1787826363.749455:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3338 00000100:00100000:3.0:1787826363.749467:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:52407:x1874670563657856:12345-192.168.203.39@tcp:36:mkdir.0 00000100:00100000:3.0:1787826363.749667:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f808000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6519:1874670585164288:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787826363.749979:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826363.750029:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f611780 going to sleep for 11 seconds 00000100:00100000:2.0:1787826363.750086:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585164288 00000100:00100000:2.0:1787826363.750092:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585164288 00000100:00100000:2.0:1787826363.750134:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1338 00000100:00100000:2.0:1787826363.750142:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f80b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:6519:x1874670585164288:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787826363.750227:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f80b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:6519:x1874670585164288:12345-0@lo:1000:mdt00_001.0 Request processed in 85us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826363.750235:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1338 00000100:00100000:3.0:1787826363.750573:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f808000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6519:1874670585164288:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787826363.750639:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f808000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6519:1874670585164416:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787826363.750666:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826363.750688:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f611780 going to sleep for 11 seconds 00000100:00100000:2.0:1787826363.750927:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585164416 00000100:00100000:2.0:1787826363.750933:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585164416 00000100:00100000:2.0:1787826363.750968:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1339 00000100:00100000:2.0:1787826363.750976:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:6519:x1874670585164416:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787826363.751059:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:6519:x1874670585164416:12345-0@lo:1000:mdt00_001.0 Request processed in 84us (391us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787826363.751067:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1339 00000100:00100000:3.0:1787826363.751507:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f808000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6519:1874670585164416:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1787826363.751585:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff90cf3abd6e00/0x22153cd396b7fbcd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.751597:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff90cf3abd6e00/0x22153cd396b7fbcd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.751607:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff90cf3abd6e00/0x22153cd396b7fbcd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826363.751622:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f808000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6519:1874670585164544:0@lo:101:mdt00_001.0 00000100:00100000:3.0:1787826363.751901:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826363.751990:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f611e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787826363.755934:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585164544 00000100:00100000:2.0:1787826363.755954:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585164544 00000100:00100000:3.0:1787826363.756104:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1340 00000100:00100000:3.0:1787826363.756118:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f80b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:6519:x1874670585164544:12345-0@lo:101:mdt00_001.0 00010000:00010000:3.0:1787826363.756145:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826363.756174:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7000/0x22153cd396b7fbd4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x22153cd396b7fbcd expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.756213:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660e00/0x22153cd396b7fa06 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab016b expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.756226:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7000/0x22153cd396b7fbd4 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x22153cd396b7fbcd expref: 8 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.756462:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660e00/0x22153cd396b7fa06 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab016b expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.757013:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660e00/0x22153cd396b7fa06 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab016b expref: 15 pid: 6520 timeout: 1409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826363.757033:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f808f00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:6523:1874670585164672:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826363.757286:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f611780 going to sleep for 11 seconds 00000100:00100000:1.0:1787826363.772143:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826363.772342:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563657984 00000100:00100000:0.0:1787826363.772354:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563657984 00010000:00010000:0.0:1787826363.772409:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660e00/0x22153cd396b7fa06 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab016b expref: 16 pid: 6520 timeout: 1409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826363.772462:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 913 00000100:00100000:0.0:1787826363.772498:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2402:x1874670563657984:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826363.772519:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826363.772528:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660e00/0x22153cd396b7fa06 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab016b expref: 16 pid: 6520 timeout: 1409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826363.772556:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660e00/0x22153cd396b7fa06 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab016b expref: 16 pid: 6520 timeout: 1409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826363.772562:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f808f00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:6523:1874670585164672:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826363.772593:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660e00/0x22153cd396b7fa06 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab016b expref: 16 pid: 6520 timeout: 1409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826363.772604:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7000/0x22153cd396b7fbd4 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x22153cd396b7fbcd expref: 8 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826363.772613:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ce01f45300) 00010000:00010000:0.0:1787826363.772622:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7000/0x22153cd396b7fbd4 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x22153cd396b7fbcd expref: 8 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826363.773528:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7000/0x22153cd396b7fbd4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x22153cd396b7fbcd expref: 8 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826363.773561:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7000/0x22153cd396b7fbd4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x22153cd396b7fbcd expref: 8 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826363.780843:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ce01f45300) 00010000:00010000:2.0:1787826363.781127:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826363.781136:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3abd7000, rc 0) 00010000:00010000:1.0:1787826363.781271:0:10341:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7000/0x22153cd396b7fbd4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x22153cd396b7fbcd expref: 8 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826363.781298:0:10341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf361e61c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:10341:1874670585164800:0@lo:105: 00000100:00100000:1.0:1787826363.781345:0:10341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826363.781397:0:10341:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a2d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826363.781426:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585164800 00000100:00100000:1.0:1787826363.781435:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585164800 00000100:00100000:1.0:1787826363.781568:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787826363.781580:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:10341:x1874670585164800:12345-0@lo:105: 00010000:00010000:1.0:1787826363.781593:0:6502:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff90cf3abd6e00/0x22153cd396b7fbcd lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x22153cd396b7fbd4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826363.781606:0:6502:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff90cf3abd6e00/0x22153cd396b7fbcd lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x22153cd396b7fbd4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826363.781617:0:6502:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff90cf3abd6e00/0x22153cd396b7fbcd lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x22153cd396b7fbd4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826363.781628:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff90cf3abd6e00/0x22153cd396b7fbcd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x22153cd396b7fbd4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826363.781639:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff90cf3abd6e00/0x22153cd396b7fbcd lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x22153cd396b7fbd4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826363.781650:0:6502:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff90cf3abd6e00/0x22153cd396b7fbcd lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x22153cd396b7fbd4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826363.781732:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f80b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:6519:x1874670585164544:12345-0@lo:101:mdt00_001.0 Request processed in 25615us (29829us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826363.781741:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1340 00010000:00010000:1.0:1787826363.781858:0:6502:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff90cf3abd6e00) 00000100:00100000:1.0:1787826363.781906:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:10341:x1874670585164800:12345-0@lo:105: Request processed in 329us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826363.781914:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787826363.781980:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f808000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6519:1874670585164544:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1787826363.782004:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff90cf3abd6e00/0x22153cd396b7fbcd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x22153cd396b7fbd4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787826363.782033:0:6519:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1787826363.782081:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff90ce05661200/0x22153cd396b7fbdb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826363.782090:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff90ce05661200/0x22153cd396b7fbdb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826363.782100:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff90ce05661200/0x22153cd396b7fbdb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826363.782117:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3abc3840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6519:1874670585164928:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1787826363.782157:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826363.782188:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf013703c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826363.782595:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585164928 00000100:00100000:1.0:1787826363.782601:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585164928 00000100:00100000:1.0:1787826363.782652:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1341 00000100:00100000:1.0:1787826363.782661:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:6519:x1874670585164928:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1787826363.782681:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826363.782702:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835e00/0x22153cd396b7fbe2 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x22153cd396b7fbdb expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826363.782737:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835e00/0x22153cd396b7fbe2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x22153cd396b7fbdb expref: 9 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826363.782753:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835e00/0x22153cd396b7fbe2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x22153cd396b7fbdb expref: 9 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826363.782762:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7dfb9607 (ffff90cf04f8b100) 00010000:00010000:1.0:1787826363.782766:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826363.782769:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835e00, rc 0) 00000100:00100000:2.0:1787826363.782810:0:10341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf361e61c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:10341:1874670585164800:0@lo:105: 00010000:00010000:2.0:1787826363.782834:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826363.782881:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:6519:x1874670585164928:12345-0@lo:101:mdt00_001.0 Request processed in 220us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826363.782888:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1341 00000100:00100000:2.0:1787826363.782901:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2402:x1874670563657984:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 10426us (10772us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826363.782914:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 913 00000100:00100000:0.0:1787826363.783051:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3abc3840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6519:1874670585164928:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1787826363.783064:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff90ce05661200/0x22153cd396b7fbdb lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x22153cd396b7fbe2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826363.783074:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff90ce05661200/0x22153cd396b7fbdb lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x22153cd396b7fbe2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787826363.783095:0:6519:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:0.0:1787826363.783136:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3abc3840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6519:1874670585165056:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787826363.783168:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826363.783590:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585165056 00000100:00100000:1.0:1787826363.783595:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585165056 00000100:00100000:1.0:1787826363.783628:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1342 00000100:00100000:1.0:1787826363.783636:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:6519:x1874670585165056:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787826363.783721:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:6519:x1874670585165056:12345-0@lo:1000:mdt00_001.0 Request processed in 86us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826363.783729:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1342 00000100:00100000:0.0:1787826363.783776:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a2f600 going to sleep for 11 seconds 00000100:00100000:0.0:1787826363.783790:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3abc3840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6519:1874670585165056:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787826363.783845:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3abc3840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6519:1874670585165184:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787826363.783870:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826363.783926:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a2f240 going to sleep for 11 seconds 00000100:00100000:1.0:1787826363.784004:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585165184 00000100:00100000:1.0:1787826363.784009:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585165184 00000100:00100000:1.0:1787826363.784031:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1343 00000100:00100000:1.0:1787826363.784037:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:6519:x1874670585165184:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787826363.784114:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:6519:x1874670585165184:12345-0@lo:1000:mdt00_001.0 Request processed in 76us (242us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787826363.784121:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1343 00000100:00100000:0.0:1787826363.784436:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3abc3840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6519:1874670585165184:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787826363.784613:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3abc3840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6519:1874670585165312:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787826363.784640:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826363.784702:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a2f240 going to sleep for 11 seconds 00000100:00100000:1.0:1787826363.784736:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585165312 00000100:00100000:1.0:1787826363.784741:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585165312 00000100:00100000:1.0:1787826363.784851:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1344 00000100:00100000:1.0:1787826363.784861:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:6519:x1874670585165312:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787826363.784922:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:6519:x1874670585165312:12345-0@lo:1000:mdt00_001.0 Request processed in 63us (280us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787826363.784928:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1344 00000100:00100000:0.0:1787826363.784978:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3abc3840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6519:1874670585165312:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787826363.785029:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3abc3840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6519:1874670585165440:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787826363.785053:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826363.785066:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a2f240 going to sleep for 11 seconds 00000100:00100000:0.0:1787826363.785079:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585165440 00000100:00100000:0.0:1787826363.785082:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585165440 00000100:00100000:0.0:1787826363.785108:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1345 00000100:00100000:0.0:1787826363.785113:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:6519:x1874670585165440:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787826363.785185:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:6519:x1874670585165440:12345-0@lo:1000:mdt00_001.0 Request processed in 71us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826363.785192:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1345 00000100:00100000:0.0:1787826363.785661:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3abc3840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6519:1874670585165440:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787826363.785733:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3abc3840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6519:1874670585165568:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787826363.785770:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826363.785797:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a2f600 going to sleep for 11 seconds 00000100:00100000:1.0:1787826363.785913:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585165568 00000100:00100000:1.0:1787826363.785918:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585165568 00000100:00100000:1.0:1787826363.785979:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1346 00000100:00100000:1.0:1787826363.785987:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecaf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:6519:x1874670585165568:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787826363.786058:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecaf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:6519:x1874670585165568:12345-0@lo:1000:mdt00_001.0 Request processed in 71us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826363.786065:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1346 00000100:00100000:3.0:1787826363.786125:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3abc3840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6519:1874670585165568:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787826363.786184:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f808000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6519:1874670585165696:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787826363.786218:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826363.786235:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f611e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826363.786616:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585165696 00000100:00100000:1.0:1787826363.786621:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585165696 00000100:00100000:1.0:1787826363.786651:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1347 00000100:00100000:1.0:1787826363.786659:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f808f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:6519:x1874670585165696:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787826363.786718:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f808f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:6519:x1874670585165696:12345-0@lo:1000:mdt00_001.0 Request processed in 59us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826363.786725:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1347 00000100:00100000:3.0:1787826363.787007:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f808000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6519:1874670585165696:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787826363.787058:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f808000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6519:1874670585165824:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787826363.787096:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826363.787125:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f611e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787826363.787140:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585165824 00000100:00100000:3.0:1787826363.787144:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585165824 00000100:00100000:3.0:1787826363.787172:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1348 00000100:00100000:3.0:1787826363.787181:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:6519:x1874670585165824:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787826363.787235:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:6519:x1874670585165824:12345-0@lo:1000:mdt00_001.0 Request processed in 56us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826363.787242:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1348 00000100:00100000:3.0:1787826363.787279:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f808000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6519:1874670585165824:0@lo:1000:mdt00_001.0 00000040:00080000:2.0:1787826363.797018:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].17, 992 off51112 00000040:00080000:2.0:1787826363.797136:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x2:0x0].15, 1144 off52648 00000004:00080000:2.0:1787826363.797147:0:6519:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff90cf013703c0 with version 32 00000004:00080000:0.0:1787826363.797567:0:7464:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff90cf076a8cc0 version 32 rpc_version 32 00000020:00100000:0.0:1787826363.797614:0:7464:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826363.797626:0:7464:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff90cf1ecae580 x1874670585166080/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2424/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826363.797651:0:7464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf1ecae580 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7464:1874670585166080:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787826363.797905:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826363.797943:0:7464:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a2f840 going to sleep for 11 seconds 00000100:00100000:3.0:1787826363.799700:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585166080 00000100:00100000:3.0:1787826363.799718:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585166080 00000100:00100000:3.0:1787826363.799785:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1349 00000100:00100000:3.0:1787826363.799798:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecaed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:7464:x1874670585166080:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787826363.805078:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecaed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:7464:x1874670585166080:12345-0@lo:1000:osp_up0-1.0 Request processed in 5275us (7166us total) trans 8589934616 rc 0/0 00000100:00100000:1.0:1787826363.805093:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1349 00000100:00100000:0.0:1787826363.805208:0:7464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf1ecae580 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7464:1874670585166080:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1787826363.806116:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832800/0x22153cd396b7fbe9 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826363.806137:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832800/0x22153cd396b7fbe9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826363.806214:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832800/0x22153cd396b7fbe9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826363.806252:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001e172e5b reply state 000000002249a630 transno 4294967582 ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832800/0x22153cd396b7fbe9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826363.806274:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832800/0x22153cd396b7fbe9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826363.806284:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x0 (ffff90cf1988e500) 00010000:00010000:2.0:1787826363.806288:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826363.806292:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787826363.806298:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0x8:0x0]: returning size 4096 00000004:00080000:2.0:1787826363.806309:0:6519:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1787826363.806323:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff90cf3abd6e00/0x22153cd396b7fbcd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x22153cd396b7fbd4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826363.806333:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff90cf3abd6e00/0x22153cd396b7fbcd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x22153cd396b7fbd4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826363.806342:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff90cf3abd6e00/0x22153cd396b7fbcd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x22153cd396b7fbd4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826363.806371:0:6519:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1787826363.806375:0:6519:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1787826363.806435:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff90ce05661200/0x22153cd396b7fbdb lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x22153cd396b7fbe2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826363.806445:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826363.806447:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff90ce05661200/0x22153cd396b7fbdb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x22153cd396b7fbe2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826363.806460:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff90cf3abd6e00/0x22153cd396b7fbcd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x22153cd396b7fbd4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826363.806495:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3abd6e00 already unused, calling callback (ffffffffc18ffee0) 00010000:00010000:0.0:1787826363.806505:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff90cf3abd6e00/0x22153cd396b7fbcd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x22153cd396b7fbd4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826363.806515:0:6506:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff90cf3abd6e00/0x22153cd396b7fbcd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x22153cd396b7fbd4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826363.806574:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff90cf3abd6e00/0x22153cd396b7fbcd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x22153cd396b7fbd4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826363.806583:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787826363.806609:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:52407:x1874670563657856:12345-192.168.203.39@tcp:36:mkdir.0 Request processed in 57139us (57373us total) trans 4294967582 rc 0/0 00010000:00010000:0.0:1787826363.806619:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff90cf3abd6e00/0x22153cd396b7fbcd lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x22153cd396b7fbd4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826363.806625:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3338 00010000:00010000:0.0:1787826363.806642:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff90cf3abd6e00/0x22153cd396b7fbcd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x22153cd396b7fbd4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826363.806660:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826363.806664:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826363.806667:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826363.806690:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf1ecade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585166208:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787826363.806786:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826363.807537:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585166208 00000100:00100000:2.0:1787826363.807557:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585166208 00000100:00100000:2.0:1787826363.807628:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1787826363.807640:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecaf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+10:3644:x1874670585166208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787826363.807656:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826363.807680:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7000/0x22153cd396b7fbd4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x22153cd396b7fbcd expref: 10 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826363.807700:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ce01f45300) 00010000:00010000:2.0:1787826363.807725:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826363.807776:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecaf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+9:3644:x1874670585166208:12345-0@lo:103:ldlm_bl.0 Request processed in 137us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826363.807786:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1787826363.807975:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf1ecade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585166208:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826363.837463:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826363.837538:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563658112 00000100:00100000:1.0:1787826363.837559:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563658112 00000100:00100000:1.0:1787826363.837633:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3339 00000100:00100000:1.0:1787826363.837645:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:52410:x1874670563658112:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826363.837675:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826363.837701:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835600/0x22153cd396b7fbf0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab01f0 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826363.837785:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b7fbf7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826363.837804:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b7fbf7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826363.837818:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b7fbf7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826363.837877:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787826363.837882:0:16564:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826363.837918:0:16564:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b7fbf7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826363.837953:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835600/0x22153cd396b7fbf0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab01f0 expref: 17 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826363.837973:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b7fbf7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab01f0 expref: 16 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826363.837984:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ce01f45300) 00010000:00010000:1.0:1787826363.837987:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787826363.837992:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834800, rc 0) 00000100:00100000:1.0:1787826363.838063:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:52410:x1874670563658112:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 420us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826363.838072:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3339 00000100:00100000:3.0:1787826363.845583:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826363.845639:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563658240 00000100:00100000:3.0:1787826363.845652:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563658240 00000100:00100000:3.0:1787826363.845895:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3340 00000100:00100000:3.0:1787826363.845953:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f808000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:52410:x1874670563658240:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826363.845983:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826363.846012:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7400/0x22153cd396b7fbfe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab01f7 expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.846276:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7e00/0x22153cd396b7fc05 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.846295:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7e00/0x22153cd396b7fc05 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.846310:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7e00/0x22153cd396b7fc05 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.846324:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6400/0x22153cd396b7fc0c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.846336:0:32404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835e00/0x22153cd396b7fbe2 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x22153cd396b7fbdb expref: 8 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.846346:0:32404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6400/0x22153cd396b7fc0c lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.846391:0:32404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835e00/0x22153cd396b7fbe2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x22153cd396b7fbdb expref: 8 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826363.846409:0:32404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03975a40 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:32404:1874670585166336:0@lo:104: 00000100:00100000:3.0:1787826363.846581:0:32404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826363.846637:0:32404:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3aaf5cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826363.846671:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585166336 00000100:00100000:3.0:1787826363.846676:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585166336 00000100:00100000:3.0:1787826363.847580:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787826363.847595:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:32404:x1874670585166336:12345-0@lo:104: 00010000:00010000:3.0:1787826363.847615:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff90ce05661200/0x22153cd396b7fbdb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x22153cd396b7fbe2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.847689:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787826363.847696:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:32404:x1874670585166336:12345-0@lo:104: Request processed in 106us (1115us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826363.847707:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787826363.848144:0:32404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03975a40 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:32404:1874670585166336:0@lo:104: 00010000:00010000:3.0:1787826363.848173:0:32404:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6400/0x22153cd396b7fc0c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.848196:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826363.848204:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff90ce05661200/0x22153cd396b7fbdb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x22153cd396b7fbe2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.848214:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05661200 already unused, calling callback (ffffffffc18ffee0) 00010000:00010000:3.0:1787826363.848221:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff90ce05661200/0x22153cd396b7fbdb lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x22153cd396b7fbe2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826363.848232:0:6507:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff90ce05661200/0x22153cd396b7fbdb lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x22153cd396b7fbe2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.848272:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff90ce05661200/0x22153cd396b7fbdb lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x22153cd396b7fbe2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.848279:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787826363.848305:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff90ce05661200/0x22153cd396b7fbdb lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x22153cd396b7fbe2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.848314:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff90ce05661200/0x22153cd396b7fbdb lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x22153cd396b7fbe2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.848338:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826363.848340:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826363.848342:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826363.848358:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0373de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585166464:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787826363.848401:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826363.851063:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585166464 00000100:00100000:3.0:1787826363.851083:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585166464 00010000:00010000:3.0:1787826363.851124:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835e00/0x22153cd396b7fbe2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x22153cd396b7fbdb expref: 9 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826363.851178:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 914 00000100:00100000:3.0:1787826363.851188:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+9:3645:x1874670585166464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787826363.851206:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:2.0:1787826363.860287:0:34481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934616 is committed 00000004:00080000:2.0:1787826363.860313:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00010000:00010000:2.0:1787826363.861556:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835e00/0x22153cd396b7fbe2 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x22153cd396b7fbdb expref: 8 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826363.861583:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7dfb9607 (ffff90cf04f8b100) 00010000:00010000:2.0:1787826363.861591:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6400/0x22153cd396b7fc0c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826363.861604:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6400/0x22153cd396b7fc0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826363.861612:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6400/0x22153cd396b7fc0c lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826363.861654:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826363.861664:0:32404:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6400/0x22153cd396b7fc0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.861677:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6400/0x22153cd396b7fc0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826363.861835:0:32404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0373f480 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-mdtlov_UUID:32404:1874670585166592:0@lo:1000:mdt00_006.0 00000100:00100000:3.0:1787826363.864986:0:32404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826363.865041:0:32404:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3aaf5cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826363.865090:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585166592 00000100:00100000:3.0:1787826363.865100:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585166592 00000100:00100000:3.0:1787826363.865167:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1350 00000100:00100000:3.0:1787826363.865177:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:32404:x1874670585166592:12345-0@lo:1000:mdt00_006.0 00000100:00100000:3.0:1787826363.865284:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:32404:x1874670585166592:12345-0@lo:1000:mdt00_006.0 Request processed in 108us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826363.865291:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1350 00000100:00100000:3.0:1787826363.865339:0:32404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0373f480 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-mdtlov_UUID:32404:1874670585166592:0@lo:1000:mdt00_006.0 00010000:00010000:3.0:1787826363.865417:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7600/0x22153cd396b7fc13 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.869622:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7600/0x22153cd396b7fc13 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.869642:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7600/0x22153cd396b7fc13 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826363.869686:0:32404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7600/0x22153cd396b7fc13 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.869708:0:32404:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7e00/0x22153cd396b7fc05 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.869724:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7e00/0x22153cd396b7fc05 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.869732:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7e00/0x22153cd396b7fc05 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.869738:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7e00/0x22153cd396b7fc05 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.869745:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3abd7e00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826363.869750:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7e00/0x22153cd396b7fc05 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.869758:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7e00/0x22153cd396b7fc05 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.869774:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ce01f45300) 00010000:00010000:3.0:1787826363.869778:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826363.869784:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7e00/0x22153cd396b7fc05 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.869791:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7e00/0x22153cd396b7fc05 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.869809:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6400/0x22153cd396b7fc0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.869816:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6400/0x22153cd396b7fc0c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.869822:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6400/0x22153cd396b7fc0c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.869827:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3abd6400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826363.869830:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6400/0x22153cd396b7fc0c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.869835:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6400/0x22153cd396b7fc0c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.869843:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7dfb9607 (ffff90cf04f8b100) 00010000:00010000:3.0:1787826363.869846:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826363.869849:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6400/0x22153cd396b7fc0c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.869855:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6400/0x22153cd396b7fc0c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.869909:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7400/0x22153cd396b7fbfe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab01f7 expref: 18 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.869931:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7600/0x22153cd396b7fc13 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab01f7 expref: 17 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.869939:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x0 (ffff90cf06894000) 00010000:00010000:3.0:1787826363.869941:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787826363.869944:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3abd7600, rc 0) 00000100:00100000:3.0:1787826363.870163:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f808000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+17:52410:x1874670563658240:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 24213us (24596us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826363.870175:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3340 00000100:00100000:2.0:1787826363.872014:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+7:3645:x1874670585166464:12345-0@lo:103:ldlm_bl.0 Request processed in 20817us (23602us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826363.872031:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 914 00000100:00100000:3.0:1787826363.875719:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0373de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585166464:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787826363.880072:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826363.880115:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563658368 00000100:00100000:3.0:1787826363.880127:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563658368 00000100:00100000:3.0:1787826363.880190:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3341 00000100:00100000:3.0:1787826363.880200:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:52410:x1874670563658368:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826363.880229:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826363.880254:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6800/0x22153cd396b7fc1a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab01fe expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.880334:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6e00/0x22153cd396b7fc21 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.880353:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6e00/0x22153cd396b7fc21 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.880366:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6e00/0x22153cd396b7fc21 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826363.880437:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0x8:0x0]: returning size 4096 00000004:00200000:3.0:1787826363.880442:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1787826363.880512:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6800/0x22153cd396b7fc1a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab01fe expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.880532:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6e00/0x22153cd396b7fc21 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab01fe expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.880550:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x0 (ffff90cf1988e500) 00010000:00010000:3.0:1787826363.880553:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1787826363.880558:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3abd6e00, rc 0) 00000100:00100000:3.0:1787826363.880630:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:52410:x1874670563658368:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 430us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826363.880638:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3341 00000100:00100000:0.0:1787826363.887790:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826363.887850:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563658496 00000100:00100000:0.0:1787826363.887862:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563658496 00000100:00100000:0.0:1787826363.887937:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3342 00000100:00100000:0.0:1787826363.887949:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:52410:x1874670563658496:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826363.887976:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826363.888002:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660e00/0x22153cd396b7fc28 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0205 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826363.888094:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660c00/0x22153cd396b7fc2f lrc: 3/1,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826363.888114:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660c00/0x22153cd396b7fc2f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826363.888128:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660c00/0x22153cd396b7fc2f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826363.888149:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b7fc36 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826363.888155:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b7fc36 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826363.888161:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b7fc36 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826363.888217:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660c00/0x22153cd396b7fc2f lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826363.888224:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660c00/0x22153cd396b7fc2f lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826363.888231:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660c00/0x22153cd396b7fc2f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826363.888237:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660c00/0x22153cd396b7fc2f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826363.888243:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05660c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826363.888248:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660c00/0x22153cd396b7fc2f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826363.888256:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660c00/0x22153cd396b7fc2f lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826363.888269:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x0 (ffff90cf1988e500) 00010000:00010000:0.0:1787826363.888273:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826363.888278:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660c00/0x22153cd396b7fc2f lrc: 3/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826363.888285:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660c00/0x22153cd396b7fc2f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826363.888301:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b7fc36 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826363.888307:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b7fc36 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826363.888312:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b7fc36 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826363.888316:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05661000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826363.888319:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b7fc36 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826363.888324:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b7fc36 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826363.888331:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x5675640f (ffff90cf371d2100) 00010000:00010000:0.0:1787826363.888333:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826363.888336:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b7fc36 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826363.888341:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b7fc36 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826363.888378:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660e00/0x22153cd396b7fc28 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0205 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826363.888393:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x0 (ffff90cf1988e500) 00010000:00010000:0.0:1787826363.888395:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826363.888399:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660e00/0x22153cd396b7fc28 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0205 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826363.888408:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05660e00, rc 0) 00000100:00100000:0.0:1787826363.888513:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:52410:x1874670563658496:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 566us (738us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826363.888521:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3342 00000100:00100000:3.0:1787826363.893239:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826363.894854:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563658752 00000100:00100000:1.0:1787826363.894873:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563658752 00000100:00100000:1.0:1787826363.894957:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3343 00000100:00100000:1.0:1787826363.894968:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:52410:x1874670563658752:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826363.894995:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826363.895022:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b7fc3d lrc: 2/0,0 mode: --/CW res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab020c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826363.895175:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835800/0x22153cd396b7fc44 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826363.895192:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835800/0x22153cd396b7fc44 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826363.895205:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835800/0x22153cd396b7fc44 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826363.895221:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835a00/0x22153cd396b7fc4b lrc: 3/0,1 mode: --/PW res: [0x240000404:0x8:0x0].0x5675640f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826363.895227:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835a00/0x22153cd396b7fc4b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826363.895232:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835a00/0x22153cd396b7fc4b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826363.895411:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf361e52c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6518:1874670585166720:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787826363.895577:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826363.895621:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce06a860c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826363.895836:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585166720 00000100:00100000:2.0:1787826363.895843:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585166720 00000100:00100000:2.0:1787826363.895887:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1351 00000100:00100000:2.0:1787826363.895894:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:6518:x1874670585166720:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787826363.895980:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:6518:x1874670585166720:12345-0@lo:1000:mdt00_000.0 Request processed in 86us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826363.895988:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1351 00000100:00100000:1.0:1787826363.896705:0:6518:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 8589934616 gen 2 00000004:00080000:1.0:1787826363.896722:0:6518:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934616 committed transno 8589934616 00000100:00100000:1.0:1787826363.896754:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf361e52c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6518:1874670585166720:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1787826363.897208:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835400/0x22153cd396b7fc52 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826363.897226:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835400/0x22153cd396b7fc52 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826363.897237:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835400/0x22153cd396b7fc52 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826363.897251:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0x9:0x0]: returning size 0 00010000:00010000:1.0:1787826363.897283:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835800/0x22153cd396b7fc44 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826363.897291:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835800/0x22153cd396b7fc44 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826363.897298:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835800/0x22153cd396b7fc44 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826363.897305:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826363.897310:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835800/0x22153cd396b7fc44 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826363.897318:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835800/0x22153cd396b7fc44 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826363.897335:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x0 (ffff90cf1988e500) 00010000:00010000:1.0:1787826363.897339:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826363.897345:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835800/0x22153cd396b7fc44 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826363.897352:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835800/0x22153cd396b7fc44 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826363.897368:0:6518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000032f667f9 reply state 00000000aeb437d1 transno 4294967583 ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835a00/0x22153cd396b7fc4b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826363.897380:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835a00/0x22153cd396b7fc4b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826363.897387:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x5675640f (ffff90cf04f8b800) 00010000:00010000:1.0:1787826363.897389:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826363.897392:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787826363.897443:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b7fc3d lrc: 0/0,0 mode: --/CW res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab020c expref: 25 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826363.897461:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835400/0x22153cd396b7fc52 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab020c expref: 24 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826363.897507:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf04f8b900) 00010000:00010000:1.0:1787826363.897510:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826363.897513:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835400, rc 0) 00000100:00100000:1.0:1787826363.897600:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:52410:x1874670563658752:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 2633us (4376us total) trans 4294967583 rc 0/0 00000100:00100000:1.0:1787826363.897608:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3343 00000100:00100000:0.0:1787826363.904645:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826363.904773:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563659008 00000100:00100000:3.0:1787826363.904787:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563659008 00000100:00100000:3.0:1787826363.904867:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3344 00000100:00100000:3.0:1787826363.904880:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:52410:x1874670563659008:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826363.904912:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826363.904939:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6800/0x22153cd396b7fc60 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0213 expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.905086:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7400/0x22153cd396b7fc67 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.905104:0:32404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835400/0x22153cd396b7fc52 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab020c expref: 26 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.905115:0:32404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7400/0x22153cd396b7fc67 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.905159:0:32404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835400/0x22153cd396b7fc52 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab020c expref: 26 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.905173:0:32404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835400/0x22153cd396b7fc52 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab020c expref: 26 pid: 6518 timeout: 1409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826363.905189:0:32404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0373d680 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001_UUID:32404:1874670585166848:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826363.905294:0:32404:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3aaf5e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787826363.911973:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826363.912103:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563659136 00000100:00100000:1.0:1787826363.912115:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563659136 00010000:00010000:1.0:1787826363.912180:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835400/0x22153cd396b7fc52 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab020c expref: 27 pid: 6518 timeout: 1409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826363.912269:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 915 00000100:00100000:1.0:1787826363.912282:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:2404:x1874670563659136:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826363.912308:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826363.912316:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835400/0x22153cd396b7fc52 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab020c expref: 27 pid: 6518 timeout: 1409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826363.912327:0:32404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0373d680 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001_UUID:32404:1874670585166848:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826363.912349:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835400/0x22153cd396b7fc52 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab020c expref: 27 pid: 6518 timeout: 1409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.912365:0:32404:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7400/0x22153cd396b7fc67 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826363.912382:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835400/0x22153cd396b7fc52 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab020c expref: 27 pid: 6518 timeout: 1409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826363.912403:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf04f8b900) 00010000:00010000:1.0:1787826363.912408:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7400/0x22153cd396b7fc67 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826363.912419:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7400/0x22153cd396b7fc67 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826363.912440:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7400/0x22153cd396b7fc67 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826363.912468:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826363.912579:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:2404:x1874670563659136:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 299us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826363.912589:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 915 00010000:00010000:3.0:1787826363.912650:0:32404:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7400/0x22153cd396b7fc67 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.912659:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7400/0x22153cd396b7fc67 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826363.912680:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0x9:0x0]: returning size 0 00000004:00080000:3.0:1787826363.912914:0:32404:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x21:0x0], index 0: 0 00010000:00010000:3.0:1787826363.913052:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7400/0x22153cd396b7fc67 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.913061:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7400/0x22153cd396b7fc67 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.913074:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7400/0x22153cd396b7fc67 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.913081:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3abd7400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826363.913087:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7400/0x22153cd396b7fc67 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.913096:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7400/0x22153cd396b7fc67 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.913108:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf04f8b900) 00010000:00010000:3.0:1787826363.913112:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826363.913116:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7400/0x22153cd396b7fc67 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.913123:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7400/0x22153cd396b7fc67 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.913187:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6800/0x22153cd396b7fc60 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0213 expref: 26 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.913200:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x0 (ffff90cf1988e500) 00010000:00010000:3.0:1787826363.913202:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787826363.913207:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6800/0x22153cd396b7fc60 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0213 expref: 26 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.913218:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3abd6800, rc 0) 00000100:00100000:3.0:1787826363.913264:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:52410:x1874670563659008:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 8387us (8635us total) trans 4294967584 rc 301/301 00000100:00100000:3.0:1787826363.913277:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3344 00000100:00100000:2.0:1787826363.923922:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826363.925229:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563659392 00000100:00100000:1.0:1787826363.925249:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563659392 00000100:00100000:1.0:1787826363.925331:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 980 00000100:00100000:1.0:1787826363.925345:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:52410:x1874670563659392:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:1.0:1787826363.926071:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:52410:x1874670563659392:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 724us (2160us total) trans 4294967585 rc 0/0 00000100:00100000:1.0:1787826363.926081:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 980 00000100:00100000:2.0:1787826363.933370:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826363.934417:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563659648 00000100:00100000:1.0:1787826363.934689:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563659648 00000100:00100000:1.0:1787826363.934771:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 981 00000100:00100000:1.0:1787826363.934784:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf36203840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:52410:x1874670563659648:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:1.0:1787826363.936024:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf36203840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:52410:x1874670563659648:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 1233us (2659us total) trans 4294967586 rc 0/0 00000100:00100000:1.0:1787826363.936036:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 981 00000100:00100000:0.0:1787826363.960745:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826363.961050:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563659904 00000100:00100000:3.0:1787826363.961064:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563659904 00000100:00100000:3.0:1787826363.961141:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3345 00000100:00100000:3.0:1787826363.961152:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecafc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:52411:x1874670563659904:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:3.0:1787826363.961184:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826363.961210:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6800/0x22153cd396b7fc75 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab021a expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.961392:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7400/0x22153cd396b7fc7c lrc: 3/1,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.961409:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7400/0x22153cd396b7fc7c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.961423:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7400/0x22153cd396b7fc7c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.961435:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6400/0x22153cd396b7fc83 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.961442:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6400/0x22153cd396b7fc83 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.961449:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6400/0x22153cd396b7fc83 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826363.962961:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a833e00/0x22153cd396b7fc8a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826363.963053:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a833e00/0x22153cd396b7fc8a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826363.963067:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a833e00/0x22153cd396b7fc8a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826363.963082:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0x9:0x0]: returning size 0 00010000:00010000:2.0:1787826363.963999:0:9966:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7400/0x22153cd396b7fc7c lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826363.964012:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7400/0x22153cd396b7fc7c lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826363.964019:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7400/0x22153cd396b7fc7c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826363.964027:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7400/0x22153cd396b7fc7c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826363.964034:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3abd7400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826363.964040:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7400/0x22153cd396b7fc7c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826363.964054:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7400/0x22153cd396b7fc7c lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826363.964072:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x0 (ffff90cf1988e500) 00010000:00010000:2.0:1787826363.964076:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826363.964081:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7400/0x22153cd396b7fc7c lrc: 3/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826363.964089:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7400/0x22153cd396b7fc7c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826363.964112:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6400/0x22153cd396b7fc83 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826363.964129:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6400/0x22153cd396b7fc83 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826363.964137:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6400/0x22153cd396b7fc83 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826363.964142:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3abd6400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826363.964145:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6400/0x22153cd396b7fc83 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826363.964151:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6400/0x22153cd396b7fc83 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826363.964160:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x5675640f (ffff90cf04f8b800) 00010000:00010000:2.0:1787826363.964163:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826363.964166:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6400/0x22153cd396b7fc83 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826363.964179:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6400/0x22153cd396b7fc83 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826363.964247:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6800/0x22153cd396b7fc75 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab021a expref: 30 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826363.964265:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a833e00/0x22153cd396b7fc8a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab021a expref: 29 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826363.964272:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:2.0:1787826363.964274:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826363.964276:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a833e00, rc 0) 00000100:00100000:2.0:1787826363.964749:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecafc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+29:52411:x1874670563659904:12345-192.168.203.39@tcp:101:dd.0 Request processed in 3477us (3899us total) trans 4294967587 rc 0/0 00000100:00100000:2.0:1787826363.964760:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3345 00000100:00100000:2.0:1787826363.968613:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826363.969788:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563660032 00000100:00100000:0.0:1787826363.969804:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563660032 00000100:00100000:0.0:1787826363.969883:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3346 00000100:00100000:0.0:1787826363.969895:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf362030c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+29:52411:x1874670563660032:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:0.0:1787826363.969925:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826363.969951:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660c00/0x22153cd396b7fc98 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0221 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826363.969995:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b7fc9f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826363.970010:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b7fc9f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826363.970023:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b7fc9f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826363.970181:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660c00/0x22153cd396b7fc98 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0221 expref: 31 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826363.970203:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b7fc9f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0221 expref: 30 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826363.970213:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:0.0:1787826363.970216:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787826363.970220:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05661000, rc 0) 00000100:00100000:0.0:1787826363.970303:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf362030c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:52411:x1874670563660032:12345-192.168.203.39@tcp:101:dd.0 Request processed in 409us (1705us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826363.970311:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3346 00000100:00100000:0.0:1787826363.973804:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826363.973952:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563660288 00000100:00100000:2.0:1787826363.973966:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563660288 00000100:00100000:2.0:1787826363.974119:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3347 00000100:00100000:2.0:1787826363.974132:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecacf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:52411:x1874670563660288:12345-192.168.203.39@tcp:36:dd.0 00010000:00010000:2.0:1787826363.974202:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826363.974241:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a833e00/0x22153cd396b7fc8a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab021a expref: 30 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826363.974265:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:2.0:1787826363.974271:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826363.974880:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832400/0x22153cd396b7fca6 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826363.974910:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832400/0x22153cd396b7fca6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826363.974922:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832400/0x22153cd396b7fca6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787826363.974974:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967588 00000004:00010000:3.0:1787826363.981191:0:6518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c3b4f8e1 reply state 00000000544b1f68 transno 4294967589 ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832400/0x22153cd396b7fca6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.981280:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832400/0x22153cd396b7fca6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.981291:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:3.0:1787826363.981295:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826363.981301:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826363.981810:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecacf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+32:52411:x1874670563660288:12345-192.168.203.39@tcp:36:dd.0 Request processed in 7673us (8013us total) trans 4294967589 rc 0/0 00000100:00100000:3.0:1787826363.981822:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3347 00000020:00080000:3.0:1787826363.981830:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787826363.986037:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826363.986112:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563660416 00000100:00100000:3.0:1787826363.986124:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563660416 00000100:00100000:3.0:1787826363.986192:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3348 00000100:00100000:3.0:1787826363.986201:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf36202580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+32:52411:x1874670563660416:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:3.0:1787826363.986228:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826363.986250:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7e00/0x22153cd396b7fcad lrc: 2/0,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0228 expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.986314:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7e00/0x22153cd396b7fcad lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0228 expref: 33 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.986326:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7e00/0x22153cd396b7fcad lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0228 expref: 33 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826363.986343:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:3.0:1787826363.986346:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826363.986350:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3abd7e00, rc 0) 00000100:00100000:3.0:1787826363.986425:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf36202580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:52411:x1874670563660416:12345-192.168.203.39@tcp:101:dd.0 Request processed in 224us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826363.986433:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3348 00000100:00100000:0.0:1787826363.989289:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826363.989349:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563660544 00000100:00100000:3.0:1787826363.989361:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563660544 00000100:00100000:3.0:1787826363.989431:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1689 00000100:00100000:3.0:1787826363.989443:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aad5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:52411:x1874670563660544:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:3.0:1787826363.989464:0:30695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826363.989536:0:30695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb167c78/0x22153cd396b7fcb4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab022f expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826363.990392:0:30695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826363.990424:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=1310s v=(0 0) 00010000:00010000:1.0:1787826363.990430:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826363.990445:0:30695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb167c78/0x22153cd396b7fcb4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab022f expref: 9 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826363.990579:0:30695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000eb167c78/0x22153cd396b7fcb4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab022f expref: 9 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826363.990597:0:30695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3abd7000, rc 0) 00000100:00100000:1.0:1787826363.990694:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aad5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:52411:x1874670563660544:12345-192.168.203.39@tcp:101:dd.0 Request processed in 1252us (1415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826363.990704:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1689 00000100:00100000:1.0:1787826363.993530:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826363.993964:0:25425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563660672 00000100:00100000:3.0:1787826363.993977:0:25425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563660672 00002000:00010000:3.0:1787826363.994033:0:25425:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/33 (1045504->18446744073709551615) 00002000:00100000:3.0:1787826363.994039:0:25425:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf361e7c00 with x1874670563660672 ext(1045504->18446744073709551615) 00002000:00010000:3.0:1787826363.994054:0:25425:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf361e7c00. 00000100:00100000:3.0:1787826363.994135:0:25425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 643 00000100:00100000:3.0:1787826363.994147:0:25425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563660672:12345-192.168.203.39@tcp:10:dd.0 00002000:00010000:3.0:1787826363.994457:0:25425:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb size from disk: 0 -> 1045504 00002000:00010000:3.0:1787826363.994462:0:25425:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb mtime from disk: 0 -> 1787826364 00002000:00010000:3.0:1787826363.994464:0:25425:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787826363.994466:0:25425:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb ctime from disk: 0 -> 1787826364 00002000:00010000:3.0:1787826363.994521:0:25425:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1787826363.994602:0:25425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563660672:12345-192.168.203.39@tcp:10:dd.0 Request processed in 457us (1083us total) trans 21474836894 rc 0/0 00000100:00100000:3.0:1787826363.994611:0:25425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 643 00002000:00010000:3.0:1787826363.994616:0:25425:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/33 (1045504->18446744073709551615) 00002000:00100000:3.0:1787826363.994632:0:25425:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf361e7c00 with x1874670563660672 ext(1045504->18446744073709551615) 00002000:00010000:3.0:1787826363.994646:0:25425:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf361e7c00. 00000100:00100000:2.0:1787826363.998179:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826363.998290:0:30188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563660800 00000100:00100000:3.0:1787826363.998304:0:30188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563660800 00002000:00100000:3.0:1787826363.998369:0:30188:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_017: refresh rw locks for [0x280000400:0x21:0x0] (1044480->1048575) req@ffff90cf36202d00 x1874670563660800/t0(0) o3->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:719/0 lens 488/0 e 0 to 0 dl 1787826374 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826363.998383:0:30188:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf36202d00 with x1874670563660800 ext(1044480->1048575) 00002000:00010000:3.0:1787826363.998391:0:30188:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf36202d00 00000100:00100000:3.0:1787826363.998430:0:30188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 644 00000100:00100000:3.0:1787826363.998441:0:30188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf36202d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670563660800:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:3.0:1787826363.999227:0:30188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf36202d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670563660800:12345-192.168.203.39@tcp:3:dd.0 Request processed in 784us (1058us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787826363.999237:0:30188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 644 00002000:00100000:3.0:1787826363.999245:0:30188:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_017: refresh rw locks for [0x280000400:0x21:0x0] (1044480->1048575) req@ffff90cf36202d00 x1874670563660800/t0(0) o3->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:719/0 lens 488/4536 e 0 to 0 dl 1787826374 ref 1 fl Complete:/600/0 rc 4096/4096 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826363.999255:0:30188:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf36202d00 with x1874670563660800 ext(1044480->1048575) 00002000:00010000:3.0:1787826363.999259:0:30188:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf36202d00 00000100:00100000:2.0:1787826364.002433:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826364.002650:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563661056 00000100:00100000:0.0:1787826364.002661:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563661056 00000100:00100000:0.0:1787826364.002766:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3349 00000100:00100000:0.0:1787826364.002779:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf36201e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:52411:x1874670563661056:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:0.0:1787826364.002805:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826364.002809:0:9966:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787826364.002850:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7e00/0x22153cd396b7fcad lrc: 0/0,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0228 expref: 33 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.002875:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:0.0:1787826364.002881:0:9966:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826364.002899:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660c00/0x22153cd396b7fcbb lrc: 2/0,0 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0236 expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.002968:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661c00/0x22153cd396b7fcc2 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.002985:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661c00/0x22153cd396b7fcc2 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.002997:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661c00/0x22153cd396b7fcc2 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787826364.003181:0:9966:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x20:0x0], index 1: 0 00000004:00080000:0.0:1787826364.003188:0:9966:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x22:0x0], index 0: 0 00010000:00010000:0.0:1787826364.003300:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661c00/0x22153cd396b7fcc2 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0236 expref: 35 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.003309:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:0.0:1787826364.003313:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1787826364.003323:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660c00/0x22153cd396b7fcbb lrc: 0/0,0 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0236 expref: 35 pid: 9966 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.003336:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661c00/0x22153cd396b7fcc2 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0236 expref: 34 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.003360:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:0.0:1787826364.003363:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1787826364.003366:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05661c00, rc 0) 00000100:00100000:0.0:1787826364.003451:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf36201e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:52411:x1874670563661056:12345-192.168.203.39@tcp:101:dd.0 Request processed in 674us (1039us total) trans 4294967590 rc 0/0 00000100:00100000:0.0:1787826364.003460:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3349 00000100:00080000:1.0:1787826364.004840:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826364.007343:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826364.007534:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563661184 00000100:00100000:2.0:1787826364.007559:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563661184 00002000:00100000:2.0:1787826364.007641:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x21:0x0] (1044480->1048575) req@ffff90cf361e52c0 x1874670563661184/t0(0) o4->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:720/0 lens 4584/0 e 0 to 0 dl 1787826375 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826364.007654:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf361e52c0 with x1874670563661184 ext(1044480->1048575) 00002000:00010000:2.0:1787826364.007661:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf361e52c0 00000100:00100000:2.0:1787826364.007697:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 645 00000100:00100000:2.0:1787826364.007711:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563661184:12345-192.168.203.39@tcp:4:dd.0 00000100:00080000:0.0:1787826364.007817:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826364.013143:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563661184:12345-192.168.203.39@tcp:4:dd.0 Request processed in 5425us (5804us total) trans 21474836895 rc 0/0 00000100:00100000:2.0:1787826364.013163:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 645 00002000:00100000:2.0:1787826364.013178:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x21:0x0] (1044480->1048575) req@ffff90cf361e52c0 x1874670563661184/t21474836895(0) o4->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:720/0 lens 4584/448 e 0 to 0 dl 1787826375 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826364.013189:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf361e52c0 with x1874670563661184 ext(1044480->1048575) 00002000:00010000:2.0:1787826364.013197:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf361e52c0 00000100:00100000:3.0:1787826364.017457:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826364.017904:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563661312 00000100:00100000:2.0:1787826364.017918:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563661312 00000100:00100000:2.0:1787826364.018033:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1690 00000100:00100000:2.0:1787826364.018045:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:52411:x1874670563661312:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:2.0:1787826364.018069:0:30398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826364.018096:0:30398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ef375d7/0x22153cd396b7fcc9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab023d expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787826364.019871:0:30398:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826364.019922:0:30398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=1310s v=(0 0) 00010000:00010000:2.0:1787826364.019930:0:30398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826364.019948:0:30398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ef375d7/0x22153cd396b7fcc9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab023d expref: 13 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.019974:0:30398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008ef375d7/0x22153cd396b7fcc9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab023d expref: 13 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.019990:0:30398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a833a00, rc 0) 00000100:00100000:2.0:1787826364.020089:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:52411:x1874670563661312:12345-192.168.203.39@tcp:101:dd.0 Request processed in 2045us (2645us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826364.020099:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1690 00000100:00100000:0.0:1787826364.028305:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826364.028558:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563661568 00000100:00100000:3.0:1787826364.028571:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563661568 00000100:00100000:3.0:1787826364.028654:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 982 00000100:00100000:3.0:1787826364.028668:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:52411:x1874670563661568:12345-192.168.203.39@tcp:35:dd.0 00000100:00100000:3.0:1787826364.029857:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:52411:x1874670563661568:12345-192.168.203.39@tcp:35:dd.0 Request processed in 1183us (1559us total) trans 4294967591 rc 0/0 00000100:00100000:3.0:1787826364.029875:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 982 00000100:00100000:1.0:1787826364.043344:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826364.043615:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563661824 00000100:00100000:3.0:1787826364.043702:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563661824 00000100:00100000:3.0:1787826364.043905:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3350 00000100:00100000:3.0:1787826364.043919:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:52412:x1874670563661824:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:3.0:1787826364.043950:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826364.043976:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6600/0x22153cd396b7fcd0 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0244 expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.044145:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6000/0x22153cd396b7fcd7 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.044163:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6000/0x22153cd396b7fcd7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.044177:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6000/0x22153cd396b7fcd7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.044189:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7a00/0x22153cd396b7fcde lrc: 3/1,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.044197:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7a00/0x22153cd396b7fcde lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.044203:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7a00/0x22153cd396b7fcde lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.044278:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6a00/0x22153cd396b7fce5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.044292:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6a00/0x22153cd396b7fce5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.044300:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6a00/0x22153cd396b7fce5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826364.044311:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0x9:0x0]: returning size 1065984 00010000:00010000:3.0:1787826364.044409:0:8247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6000/0x22153cd396b7fcd7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.044417:0:8247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6000/0x22153cd396b7fcd7 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.044434:0:8247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6000/0x22153cd396b7fcd7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.044441:0:8247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3abd6000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826364.044446:0:8247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6000/0x22153cd396b7fcd7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.044549:0:8247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6000/0x22153cd396b7fcd7 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.044566:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x0 (ffff90cf1988e500) 00010000:00010000:3.0:1787826364.044570:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826364.044576:0:8247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6000/0x22153cd396b7fcd7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.044583:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6000/0x22153cd396b7fcd7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.044599:0:8247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7a00/0x22153cd396b7fcde lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.044607:0:8247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7a00/0x22153cd396b7fcde lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.044613:0:8247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7a00/0x22153cd396b7fcde lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.044618:0:8247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3abd7a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826364.044621:0:8247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7a00/0x22153cd396b7fcde lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.044955:0:8247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7a00/0x22153cd396b7fcde lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.044966:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x5675640f (ffff90cf04f8b800) 00010000:00010000:3.0:1787826364.044969:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826364.044973:0:8247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7a00/0x22153cd396b7fcde lrc: 2/0,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.044980:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7a00/0x22153cd396b7fcde lrc: 0/0,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.045287:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6600/0x22153cd396b7fcd0 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0244 expref: 38 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.045308:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6a00/0x22153cd396b7fce5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0244 expref: 37 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.045317:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:0.0:1787826364.045320:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826364.045323:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3abd6a00, rc 0) 00000100:00100000:0.0:1787826364.045429:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:52412:x1874670563661824:12345-192.168.203.39@tcp:101:dd.0 Request processed in 1513us (2100us total) trans 4294967592 rc 0/0 00000100:00100000:0.0:1787826364.045438:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3350 00000100:00100000:2.0:1787826364.051317:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826364.051381:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563662080 00000100:00100000:3.0:1787826364.051394:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563662080 00000100:00100000:3.0:1787826364.051520:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3351 00000100:00100000:3.0:1787826364.051532:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf36203480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:52412:x1874670563662080:12345-192.168.203.39@tcp:36:dd.0 00010000:00010000:2.0:1787826364.052037:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1787826364.052078:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661c00/0x22153cd396b7fcc2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0236 expref: 37 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.052115:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6a00/0x22153cd396b7fce5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0244 expref: 36 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.052129:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:2.0:1787826364.052136:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826364.052369:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832c00/0x22153cd396b7fcf3 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.052387:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832c00/0x22153cd396b7fcf3 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.052399:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832c00/0x22153cd396b7fcf3 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787826364.052451:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967593 00000004:00010000:2.0:1787826364.053502:0:6518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005482f954 reply state 00000000f9e0a333 transno 4294967594 ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832c00/0x22153cd396b7fcf3 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.053546:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832c00/0x22153cd396b7fcf3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.053556:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:2.0:1787826364.053559:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826364.053564:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826364.053754:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf36203480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:52412:x1874670563662080:12345-192.168.203.39@tcp:36:dd.0 Request processed in 2220us (2448us total) trans 4294967594 rc 0/0 00000100:00100000:2.0:1787826364.053774:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3351 00000020:00080000:2.0:1787826364.053781:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787826364.058968:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826364.061271:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563662208 00000100:00100000:0.0:1787826364.061291:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563662208 00000100:00100000:0.0:1787826364.061387:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3352 00000100:00100000:0.0:1787826364.061399:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf36200780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:52412:x1874670563662208:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:0.0:1787826364.061433:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826364.061463:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661200/0x22153cd396b7fcfa lrc: 2/0,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab024b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.062060:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661200/0x22153cd396b7fcfa lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab024b expref: 39 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.062081:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661200/0x22153cd396b7fcfa lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab024b expref: 39 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.062104:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:1.0:1787826364.062108:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826364.062113:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05661200, rc 0) 00000100:00100000:1.0:1787826364.062208:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf36200780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+39:52412:x1874670563662208:12345-192.168.203.39@tcp:101:dd.0 Request processed in 810us (3252us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826364.062216:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3352 00000100:00100000:1.0:1787826364.065446:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826364.065922:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563662336 00000100:00100000:2.0:1787826364.065935:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563662336 00000100:00100000:2.0:1787826364.066061:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1691 00000100:00100000:2.0:1787826364.066073:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:52412:x1874670563662336:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:2.0:1787826364.066097:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826364.066126:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000782e234f/0x22153cd396b7fd01 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0252 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787826364.072022:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:2.0:1787826364.072868:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826364.072914:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x20:0x0].0x0 since=1310s v=(0 0) 00010000:00010000:2.0:1787826364.072920:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826364.072941:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000782e234f/0x22153cd396b7fd01 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0252 expref: 10 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.072971:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000782e234f/0x22153cd396b7fd01 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0252 expref: 10 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.072988:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a832e00, rc 0) 00000100:00100000:2.0:1787826364.073082:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:52412:x1874670563662336:12345-192.168.203.39@tcp:101:dd.0 Request processed in 7009us (7646us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826364.073092:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1691 00000100:00100000:2.0:1787826364.084989:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826364.085038:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826364.085151:0:30172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563662464 00000100:00100000:1.0:1787826364.085165:0:30172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563662464 00002000:00010000:1.0:1787826364.085215:0:30172:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/32 (1048576->18446744073709551615) 00002000:00100000:1.0:1787826364.085220:0:30172:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf36203c00 with x1874670563662464 ext(1048576->18446744073709551615) 00002000:00010000:1.0:1787826364.085236:0:30172:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90cf36203c00. 00000100:00100000:1.0:1787826364.085270:0:30172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563662592 00000100:00100000:1.0:1787826364.085274:0:30172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563662592 00002000:00010000:1.0:1787826364.085287:0:30172:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/34 (1041408->18446744073709551615) 00002000:00100000:1.0:1787826364.085290:0:30172:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf36200f00 with x1874670563662592 ext(1041408->18446744073709551615) 00002000:00010000:1.0:1787826364.085297:0:30172:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf36200f00. 00000100:00100000:1.0:1787826364.085315:0:30172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 646 00000100:00100000:1.0:1787826364.085327:0:30172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf36203c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670563662464:12345-192.168.203.39@tcp:10:dd.0 00002000:00010000:1.0:1787826364.085644:0:30172:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:1.0:1787826364.085649:0:30172:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb mtime from disk: 0 -> 1787826364 00002000:00010000:1.0:1787826364.085652:0:30172:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787826364.085654:0:30172:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb ctime from disk: 0 -> 1787826364 00002000:00010000:1.0:1787826364.085656:0:30172:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1787826364.085727:0:30172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf36203c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2403:x1874670563662464:12345-192.168.203.39@tcp:10:dd.0 Request processed in 401us (752us total) trans 17179869572 rc 0/0 00000100:00100000:1.0:1787826364.085736:0:30172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 646 00002000:00010000:1.0:1787826364.085740:0:30172:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/32 (1048576->18446744073709551615) 00002000:00100000:1.0:1787826364.085743:0:30172:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf36203c00 with x1874670563662464 ext(1048576->18446744073709551615) 00002000:00010000:1.0:1787826364.085747:0:30172:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90cf36203c00. 00000100:00100000:1.0:1787826364.085768:0:30172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 647 00000100:00100000:1.0:1787826364.085775:0:30172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf36200f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2403:x1874670563662592:12345-192.168.203.39@tcp:10:dd.0 00002000:00010000:1.0:1787826364.085940:0:30172:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 1041408 00002000:00010000:1.0:1787826364.085944:0:30172:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787826364 00002000:00010000:1.0:1787826364.085946:0:30172:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787826364.085948:0:30172:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 0 -> 1787826364 00002000:00010000:1.0:1787826364.085950:0:30172:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1787826364.085974:0:30172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf36200f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2403:x1874670563662592:12345-192.168.203.39@tcp:10:dd.0 Request processed in 200us (935us total) trans 21474836896 rc 0/0 00000100:00100000:1.0:1787826364.085982:0:30172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 647 00002000:00010000:1.0:1787826364.085985:0:30172:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/34 (1041408->18446744073709551615) 00002000:00100000:1.0:1787826364.085988:0:30172:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf36200f00 with x1874670563662592 ext(1041408->18446744073709551615) 00002000:00010000:1.0:1787826364.085992:0:30172:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf36200f00. 00000100:00100000:0.0:1787826364.090603:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826364.090765:0:25426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563662720 00000100:00100000:3.0:1787826364.090778:0:25426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563662720 00002000:00100000:3.0:1787826364.090842:0:25426:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000400:0x22:0x0] (1040384->1044479) req@ffff90cf1ecae1c0 x1874670563662720/t0(0) o3->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:720/0 lens 488/0 e 0 to 0 dl 1787826375 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826364.090862:0:25426:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf1ecae1c0 with x1874670563662720 ext(1040384->1044479) 00002000:00010000:3.0:1787826364.090868:0:25426:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf1ecae1c0 00000100:00100000:3.0:1787826364.091982:0:25426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 648 00000100:00100000:3.0:1787826364.092001:0:25426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2403:x1874670563662720:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:3.0:1787826364.092268:0:25426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2403:x1874670563662720:12345-192.168.203.39@tcp:3:dd.0 Request processed in 274us (1680us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787826364.092277:0:25426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 648 00002000:00100000:3.0:1787826364.092286:0:25426:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000400:0x22:0x0] (1040384->1044479) req@ffff90cf1ecae1c0 x1874670563662720/t0(0) o3->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:720/0 lens 488/4536 e 0 to 0 dl 1787826375 ref 1 fl Complete:/600/0 rc 4096/4096 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826364.092295:0:25426:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf1ecae1c0 with x1874670563662720 ext(1040384->1044479) 00002000:00010000:3.0:1787826364.092300:0:25426:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf1ecae1c0 00000100:00100000:1.0:1787826364.107211:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826364.108564:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563662976 00000100:00100000:2.0:1787826364.108580:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563662976 00000100:00100000:2.0:1787826364.108668:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 983 00000100:00100000:2.0:1787826364.108678:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+39:52412:x1874670563662976:12345-192.168.203.39@tcp:35:dd.0 00000100:00100000:2.0:1787826364.110334:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:52412:x1874670563662976:12345-192.168.203.39@tcp:35:dd.0 Request processed in 1644us (3125us total) trans 4294967595 rc 0/0 00000100:00100000:2.0:1787826364.110350:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 983 00000100:00100000:0.0:1787826364.127669:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826364.127908:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563663104 00000100:00100000:2.0:1787826364.127922:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563663104 00000100:00100000:2.0:1787826364.128009:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3353 00000100:00100000:2.0:1787826364.128022:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:52413:x1874670563663104:12345-192.168.203.39@tcp:101:truncate.0 00010000:00010000:2.0:1787826364.128053:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826364.128209:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a833e00/0x22153cd396b7fd08 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0259 expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.128325:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a833400/0x22153cd396b7fd0f lrc: 3/1,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.128343:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a833400/0x22153cd396b7fd0f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.128357:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a833400/0x22153cd396b7fd0f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.128369:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832a00/0x22153cd396b7fd16 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.128377:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832a00/0x22153cd396b7fd16 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.129351:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832a00/0x22153cd396b7fd16 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.129492:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832000/0x22153cd396b7fd1d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.129507:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832000/0x22153cd396b7fd1d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.129515:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832000/0x22153cd396b7fd1d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826364.129581:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0x9:0x0]: returning size 2110464 00000004:00200000:2.0:1787826364.129588:0:9966:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826364.129656:0:9966:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832000/0x22153cd396b7fd1d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.129671:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832000/0x22153cd396b7fd1d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.129683:0:9966:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a833400/0x22153cd396b7fd0f lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.129691:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a833400/0x22153cd396b7fd0f lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.129698:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a833400/0x22153cd396b7fd0f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.129706:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a833400/0x22153cd396b7fd0f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.132720:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a833400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826364.132731:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a833400/0x22153cd396b7fd0f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.132745:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a833400/0x22153cd396b7fd0f lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.132775:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x0 (ffff90cf1988e500) 00010000:00010000:2.0:1787826364.132779:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826364.132785:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a833400/0x22153cd396b7fd0f lrc: 3/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.132794:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a833400/0x22153cd396b7fd0f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.132821:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832a00/0x22153cd396b7fd16 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.132829:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832a00/0x22153cd396b7fd16 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.132836:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832a00/0x22153cd396b7fd16 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.132842:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a832a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826364.132845:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832a00/0x22153cd396b7fd16 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.132852:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832a00/0x22153cd396b7fd16 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.132861:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x5675640f (ffff90cf04f8b800) 00010000:00010000:2.0:1787826364.132863:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826364.132867:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832a00/0x22153cd396b7fd16 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.132873:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832a00/0x22153cd396b7fd16 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.132943:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a833e00/0x22153cd396b7fd08 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0259 expref: 42 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.132962:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832000/0x22153cd396b7fd1d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0259 expref: 41 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.132970:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:2.0:1787826364.132971:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826364.132974:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a832000, rc 0) 00000100:00100000:2.0:1787826364.133080:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+41:52413:x1874670563663104:12345-192.168.203.39@tcp:101:truncate.0 Request processed in 5058us (5425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826364.133091:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3353 00000100:00100000:0.0:1787826364.140639:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826364.140801:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563663360 00000100:00100000:3.0:1787826364.140816:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563663360 00000100:00100000:3.0:1787826364.140895:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3354 00000100:00100000:3.0:1787826364.140907:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecacb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+41:52413:x1874670563663360:12345-192.168.203.39@tcp:36:truncate.0 00010000:00010000:3.0:1787826364.140991:0:8247:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826364.141029:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832000/0x22153cd396b7fd1d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0259 expref: 41 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.141054:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:3.0:1787826364.141061:0:8247:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826364.141315:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7a00/0x22153cd396b7fd24 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.141340:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7a00/0x22153cd396b7fd24 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.141351:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7a00/0x22153cd396b7fd24 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787826364.141404:0:8247:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967596 00000004:00010000:3.0:1787826364.141448:0:8247:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000239515df reply state 000000009979b702 transno 4294967597 ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7a00/0x22153cd396b7fd24 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.141462:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7a00/0x22153cd396b7fd24 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.141549:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:3.0:1787826364.141554:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826364.141558:0:8247:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826364.141683:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecacb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:52413:x1874670563663360:12345-192.168.203.39@tcp:36:truncate.0 Request processed in 777us (1058us total) trans 4294967597 rc 0/0 00000100:00100000:3.0:1787826364.141693:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3354 00000020:00080000:3.0:1787826364.141699:0:8247:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787826364.144447:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826364.144651:0:30177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563663488 00000100:00100000:2.0:1787826364.144664:0:30177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563663488 00002000:00010000:2.0:1787826364.144712:0:30177:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/32 (2097152->18446744073709551615) 00002000:00100000:2.0:1787826364.144717:0:30177:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf1ecad2c0 with x1874670563663488 ext(2097152->18446744073709551615) 00002000:00010000:2.0:1787826364.144746:0:30177:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90cf1ecad2c0. 00000100:00100000:2.0:1787826364.144783:0:30177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 649 00000100:00100000:2.0:1787826364.144794:0:30177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2404:x1874670563663488:12345-192.168.203.39@tcp:10:truncate.0 00002000:00010000:2.0:1787826364.145021:0:30177:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb size from disk: 1048576 -> 2097152 00002000:00010000:2.0:1787826364.145026:0:30177:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb mtime from disk: 1787826364 -> 1787826364 00002000:00010000:2.0:1787826364.145029:0:30177:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787826364.145031:0:30177:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb ctime from disk: 1787826364 -> 1787826364 00002000:00010000:2.0:1787826364.145034:0:30177:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1787826364.152340:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826364.152550:0:30173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563663616 00000100:00100000:2.0:1787826364.152564:0:30173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563663616 00002000:00010000:2.0:1787826364.152614:0:30173:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/34 (1602848->18446744073709551615) 00002000:00100000:2.0:1787826364.152620:0:30173:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce0373c3c0 with x1874670563663616 ext(1602848->18446744073709551615) 00002000:00010000:2.0:1787826364.152636:0:30173:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90ce0373c3c0. 00000100:00100000:2.0:1787826364.152675:0:30173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 650 00000100:00100000:2.0:1787826364.152685:0:30173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563663616:12345-192.168.203.39@tcp:10:truncate.0 00002000:00010000:2.0:1787826364.152953:0:30173:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 1041408 -> 1602848 00002000:00010000:2.0:1787826364.152958:0:30173:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1787826364 -> 1787826364 00002000:00010000:2.0:1787826364.152961:0:30173:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787826364.152964:0:30173:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787826364 -> 1787826364 00002000:00010000:2.0:1787826364.152967:0:30173:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1787826364.153040:0:30173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2404:x1874670563663616:12345-192.168.203.39@tcp:10:truncate.0 Request processed in 354us (713us total) trans 21474836897 rc 0/0 00000100:00100000:2.0:1787826364.153048:0:30173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 650 00002000:00010000:2.0:1787826364.153052:0:30173:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/34 (1602848->18446744073709551615) 00002000:00100000:2.0:1787826364.153055:0:30173:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce0373c3c0 with x1874670563663616 ext(1602848->18446744073709551615) 00002000:00010000:2.0:1787826364.153059:0:30173:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90ce0373c3c0. 00000100:00100000:0.0:1787826364.159377:0:30177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563663488:12345-192.168.203.39@tcp:10:truncate.0 Request processed in 14565us (14923us total) trans 17179869573 rc 0/0 00000100:00100000:0.0:1787826364.159397:0:30177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 649 00002000:00010000:0.0:1787826364.159407:0:30177:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/32 (2097152->18446744073709551615) 00002000:00100000:0.0:1787826364.159422:0:30177:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf1ecad2c0 with x1874670563663488 ext(2097152->18446744073709551615) 00002000:00010000:0.0:1787826364.159439:0:30177:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90cf1ecad2c0. 00000100:00100000:3.0:1787826364.192169:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826364.192356:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563663872 00000100:00100000:2.0:1787826364.192368:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563663872 00000100:00100000:2.0:1787826364.192432:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3355 00000100:00100000:2.0:1787826364.192441:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:52414:x1874670563663872:12345-192.168.203.39@tcp:101:lseek_test.0 00010000:00010000:2.0:1787826364.192802:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826364.192832:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832200/0x22153cd396b7fd2b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0260 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.192928:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a833c00/0x22153cd396b7fd32 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.192946:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a833c00/0x22153cd396b7fd32 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.192960:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a833c00/0x22153cd396b7fd32 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.192971:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a833600/0x22153cd396b7fd39 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.192979:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a833600/0x22153cd396b7fd39 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.192986:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a833600/0x22153cd396b7fd39 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.193119:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a833200/0x22153cd396b7fd40 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.193129:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a833200/0x22153cd396b7fd40 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.193136:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a833200/0x22153cd396b7fd40 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826364.193149:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0x9:0x0]: returning size 3700000 00010000:00010000:2.0:1787826364.193247:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a833c00/0x22153cd396b7fd32 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.193256:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a833c00/0x22153cd396b7fd32 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.193264:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a833c00/0x22153cd396b7fd32 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.193272:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a833c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826364.193278:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a833c00/0x22153cd396b7fd32 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.193286:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a833c00/0x22153cd396b7fd32 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.193300:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x0 (ffff90cf1988e500) 00010000:00010000:2.0:1787826364.193303:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826364.193309:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a833c00/0x22153cd396b7fd32 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.193316:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a833c00/0x22153cd396b7fd32 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.193334:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a833600/0x22153cd396b7fd39 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.193340:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a833600/0x22153cd396b7fd39 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.193347:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a833600/0x22153cd396b7fd39 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.193353:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a833600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826364.193356:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a833600/0x22153cd396b7fd39 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.193362:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a833600/0x22153cd396b7fd39 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.193374:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x5675640f (ffff90cf04f8b800) 00010000:00010000:2.0:1787826364.193377:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826364.193380:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a833600/0x22153cd396b7fd39 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.193387:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a833600/0x22153cd396b7fd39 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.194175:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832200/0x22153cd396b7fd2b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0260 expref: 46 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.194205:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a833200/0x22153cd396b7fd40 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0260 expref: 45 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.194214:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:2.0:1787826364.194217:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826364.194220:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a833200, rc 0) 00000100:00100000:2.0:1787826364.194317:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+45:52414:x1874670563663872:12345-192.168.203.39@tcp:101:lseek_test.0 Request processed in 1875us (2161us total) trans 4294967598 rc 0/0 00000100:00100000:2.0:1787826364.194328:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3355 00000100:00100000:2.0:1787826364.199632:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826364.200177:0:20692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563664128 00000100:00100000:1.0:1787826364.200191:0:20692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563664128 00002000:00100000:1.0:1787826364.200253:0:20692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x22:0x0] (0->1048575) req@ffff90cf36200000 x1874670563664128/t0(0) o4->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:720/0 lens 504/0 e 0 to 0 dl 1787826375 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826364.200266:0:20692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf36200000 with x1874670563664128 ext(0->1048575) 00002000:00010000:1.0:1787826364.200272:0:20692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf36200000 00000100:00100000:1.0:1787826364.200307:0:20692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 651 00000100:00100000:1.0:1787826364.200318:0:20692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf36200000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2402:x1874670563664128:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1787826364.202225:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826364.205683:0:20692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf36200000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+17:2402:x1874670563664128:12345-192.168.203.39@tcp:4:dd.0 Request processed in 5350us (6050us total) trans 21474836898 rc 0/0 00000100:00100000:1.0:1787826364.205700:0:20692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 651 00002000:00100000:1.0:1787826364.205729:0:20692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x22:0x0] (0->1048575) req@ffff90cf36200000 x1874670563664128/t21474836898(0) o4->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:720/0 lens 504/448 e 0 to 0 dl 1787826375 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826364.205742:0:20692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf36200000 with x1874670563664128 ext(0->1048575) 00002000:00010000:1.0:1787826364.205749:0:20692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf36200000 00000100:00100000:1.0:1787826364.205786:0:20692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563664000 00000100:00100000:1.0:1787826364.205794:0:20692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563664000 00002000:00100000:1.0:1787826364.205834:0:20692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0x20:0x0] (1048576->1064959) req@ffff90cf362021c0 x1874670563664000/t0(0) o4->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:720/0 lens 16872/0 e 0 to 0 dl 1787826375 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826364.205843:0:20692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf362021c0 with x1874670563664000 ext(1048576->1064959) 00002000:00010000:1.0:1787826364.205847:0:20692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90cf362021c0 00000100:00100000:0.0:1787826364.205915:0:30174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 652 00000100:00100000:0.0:1787826364.205927:0:30174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf362021c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2401:x1874670563664000:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1787826364.206920:0:30174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf362021c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2401:x1874670563664000:12345-192.168.203.39@tcp:4:dd.0 Request processed in 991us (4704us total) trans 17179869574 rc 0/0 00000100:00100000:0.0:1787826364.206931:0:30174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 652 00002000:00100000:0.0:1787826364.206940:0:30174:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x2c0000400:0x20:0x0] (1048576->1064959) req@ffff90cf362021c0 x1874670563664000/t17179869574(0) o4->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:720/0 lens 16872/448 e 0 to 0 dl 1787826375 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826364.206950:0:30174:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf362021c0 with x1874670563664000 ext(1048576->1064959) 00002000:00010000:0.0:1787826364.206955:0:30174:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90cf362021c0 00000100:00100000:3.0:1787826364.209744:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826364.209783:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826364.209819:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826364.209892:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563664256 00000100:00100000:1.0:1787826364.209904:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563664256 00000100:00100000:1.0:1787826364.209959:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563664384 00000100:00100000:1.0:1787826364.209963:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563664384 00000100:00100000:1.0:1787826364.209981:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563664512 00000100:00100000:1.0:1787826364.209983:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563664512 00000100:00100000:1.0:1787826364.210003:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1692 00000100:00100000:1.0:1787826364.210013:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+18:2403:x1874670563664256:12345-192.168.203.39@tcp:23:lseek_test.0 00000100:00100000:0.0:1787826364.210171:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1693 00000100:00100000:0.0:1787826364.210181:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563664384:12345-192.168.203.39@tcp:23:lseek_test.0 00000100:00100000:1.0:1787826364.210393:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+18:2403:x1874670563664256:12345-192.168.203.39@tcp:23:lseek_test.0 Request processed in 380us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826364.210402:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1692 00000100:00100000:1.0:1787826364.210423:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1694 00000100:00100000:1.0:1787826364.210430:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03975a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+17:2403:x1874670563664512:12345-192.168.203.39@tcp:23:lseek_test.0 00000100:00100000:0.0:1787826364.210527:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563664384:12345-192.168.203.39@tcp:23:lseek_test.0 Request processed in 348us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826364.210534:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1693 00000100:00100000:1.0:1787826364.212101:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03975a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+17:2403:x1874670563664512:12345-192.168.203.39@tcp:23:lseek_test.0 Request processed in 1657us (2267us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826364.212116:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1694 00000100:00100000:3.0:1787826364.214214:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826364.214279:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563664768 00000100:00100000:0.0:1787826364.214574:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563664768 00000100:00100000:0.0:1787826364.214656:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 984 00000100:00100000:0.0:1787826364.214669:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf10477450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+45:52414:x1874670563664768:12345-192.168.203.39@tcp:35:lseek_test.0 00000100:00100000:0.0:1787826364.217200:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf10477450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+46:52414:x1874670563664768:12345-192.168.203.39@tcp:35:lseek_test.0 Request processed in 2516us (2981us total) trans 4294967599 rc 0/0 00000100:00100000:0.0:1787826364.217218:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 984 00000100:00100000:3.0:1787826364.227459:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826364.228235:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563665024 00000100:00100000:1.0:1787826364.228250:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563665024 00000100:00100000:1.0:1787826364.228581:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3356 00000100:00100000:1.0:1787826364.228594:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03afcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+46:52415:x1874670563665024:12345-192.168.203.39@tcp:101:lseek_test.0 00010000:00010000:1.0:1787826364.228632:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826364.228663:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b7fd4e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0267 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.228814:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835400/0x22153cd396b7fd55 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.228834:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835400/0x22153cd396b7fd55 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.228847:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835400/0x22153cd396b7fd55 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826364.228862:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0x9:0x0]: returning size 3700000 00010000:00010000:1.0:1787826364.229065:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b7fd4e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0267 expref: 49 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.229089:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835400/0x22153cd396b7fd55 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0267 expref: 48 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.229098:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:1.0:1787826364.229101:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787826364.229105:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835400, rc 0) 00000100:00100000:1.0:1787826364.229195:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03afcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:52415:x1874670563665024:12345-192.168.203.39@tcp:101:lseek_test.0 Request processed in 603us (1751us total) trans 4294967600 rc 0/0 00000100:00100000:1.0:1787826364.229204:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3356 00000100:00100000:1.0:1787826364.234388:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826364.234517:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563665152 00000100:00100000:0.0:1787826364.234530:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563665152 00000100:00100000:2.0:1787826364.234708:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1695 00000100:00100000:2.0:1787826364.234724:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+17:2401:x1874670563665152:12345-192.168.203.39@tcp:23:lseek_test.0 00000100:00100000:2.0:1787826364.234859:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+17:2401:x1874670563665152:12345-192.168.203.39@tcp:23:lseek_test.0 Request processed in 141us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826364.234870:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1695 00000100:00100000:2.0:1787826364.250633:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826364.250983:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563665408 00000100:00100000:0.0:1787826364.250998:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563665408 00000100:00100000:0.0:1787826364.251292:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3357 00000100:00100000:0.0:1787826364.251305:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf36201680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:52416:x1874670563665408:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826364.251337:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826364.251365:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b7fd63 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab026e expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.251564:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661400/0x22153cd396b7fd6a lrc: 3/0,1 mode: --/CW res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.256312:0:9966:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a833200/0x22153cd396b7fd40 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0260 expref: 49 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.256330:0:9966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661400/0x22153cd396b7fd6a lrc: 4/0,1 mode: --/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.256403:0:9966:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a833200/0x22153cd396b7fd40 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0260 expref: 49 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.256426:0:9966:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a833200/0x22153cd396b7fd40 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0260 expref: 49 pid: 6518 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826364.256446:0:9966:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf1ecac000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9966:1874670585166976:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826364.256599:0:9966:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a2f600 going to sleep for 11 seconds 00000100:00100000:3.0:1787826364.270405:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826364.270901:0:9966:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf1ecac000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9966:1874670585166976:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826364.270937:0:9966:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661400/0x22153cd396b7fd6a lrc: 3/0,1 mode: --/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826364.270986:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563665536 00000100:00100000:2.0:1787826364.271003:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563665536 00010000:00010000:2.0:1787826364.271085:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a833200/0x22153cd396b7fd40 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0260 expref: 50 pid: 6518 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826364.271332:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 916 00000100:00100000:2.0:1787826364.271353:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03aff840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+50:2403:x1874670563665536:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826364.271394:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826364.271408:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a833200/0x22153cd396b7fd40 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0260 expref: 50 pid: 6518 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.271433:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a833200/0x22153cd396b7fd40 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0260 expref: 50 pid: 6518 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.271561:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a833200/0x22153cd396b7fd40 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0260 expref: 50 pid: 6518 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.271595:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:2.0:1787826364.271659:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661400/0x22153cd396b7fd6a lrc: 3/0,1 mode: --/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.271682:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661400/0x22153cd396b7fd6a lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.271697:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661400/0x22153cd396b7fd6a lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.272238:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826364.272329:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03aff840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:2403:x1874670563665536:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 981us (1936us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826364.272339:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 916 00010000:00010000:0.0:1787826364.274653:0:9966:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661400/0x22153cd396b7fd6a lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.274672:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661400/0x22153cd396b7fd6a lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826364.274701:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0x9:0x0]: returning size 3700000 00010000:00010000:0.0:1787826364.274902:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b7fd63 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab026e expref: 50 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.274937:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661400/0x22153cd396b7fd6a lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab026e expref: 49 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.274947:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:0.0:1787826364.274950:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787826364.274954:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05661400, rc 0) 00000100:00100000:0.0:1787826364.275046:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf36201680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:52416:x1874670563665408:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 23742us (24451us total) trans 4294967601 rc 0/0 00000100:00100000:0.0:1787826364.275054:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3357 00000100:00100000:3.0:1787826364.279280:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826364.279520:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563665792 00000100:00100000:0.0:1787826364.279533:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563665792 00000100:00100000:0.0:1787826364.279618:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3358 00000100:00100000:0.0:1787826364.279631:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f937480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:52416:x1874670563665792:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826364.279665:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826364.279692:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661e00/0x22153cd396b7fd78 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0275 expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.282366:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835600/0x22153cd396b7fd7f lrc: 3/1,0 mode: --/PR res: [0x240000404:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.282392:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835600/0x22153cd396b7fd7f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.282407:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835600/0x22153cd396b7fd7f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826364.282421:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0xc:0x0]: returning size 0 00010000:00010000:1.0:1787826364.282686:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661e00/0x22153cd396b7fd78 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0275 expref: 52 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.282713:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835600/0x22153cd396b7fd7f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0275 expref: 51 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.282725:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xc:0x0].0x0 (ffff90cf04f8b500) 00010000:00010000:1.0:1787826364.282728:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826364.282732:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835600, rc 0) 00000100:00100000:1.0:1787826364.282929:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f937480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+51:52416:x1874670563665792:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 3297us (3660us total) trans 4294967602 rc 0/0 00000100:00100000:1.0:1787826364.282940:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3358 00000100:00100000:1.0:1787826364.289753:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826364.291509:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563666048 00000100:00100000:2.0:1787826364.291526:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563666048 00000100:00100000:2.0:1787826364.292219:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3359 00000100:00100000:2.0:1787826364.292339:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+51:52416:x1874670563666048:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826364.292373:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826364.292403:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a833200/0x22153cd396b7fd8d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab027c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.292588:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832200/0x22153cd396b7fd94 lrc: 3/0,1 mode: --/EX res: [0x240000404:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.292615:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835600/0x22153cd396b7fd7f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0275 expref: 52 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.292627:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832200/0x22153cd396b7fd94 lrc: 4/0,1 mode: --/EX res: [0x240000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.292672:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835600/0x22153cd396b7fd7f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0275 expref: 52 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.292687:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835600/0x22153cd396b7fd7f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0275 expref: 52 pid: 32404 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826364.292704:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf36200b40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6518:1874670585167104:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826364.292828:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce05f8e780 going to sleep for 11 seconds 00000100:00100000:3.0:1787826364.298958:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826364.299361:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563666176 00000100:00100000:1.0:1787826364.299386:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563666176 00010000:00010000:1.0:1787826364.299441:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835600/0x22153cd396b7fd7f lrc: 5/0,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0275 expref: 53 pid: 32404 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826364.299547:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 917 00000100:00100000:1.0:1787826364.299558:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf181fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:2403:x1874670563666176:12345-192.168.203.39@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787826364.299568:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf36200b40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6518:1874670585167104:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826364.299578:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826364.299586:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835600/0x22153cd396b7fd7f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0275 expref: 53 pid: 32404 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.299599:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835600/0x22153cd396b7fd7f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0275 expref: 53 pid: 32404 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.303393:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835600/0x22153cd396b7fd7f lrc: 0/0,0 mode: --/PR res: [0x240000404:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0275 expref: 53 pid: 32404 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.303430:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xc:0x0].0x0 (ffff90cf04f8b500) 00010000:00010000:1.0:1787826364.303439:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832200/0x22153cd396b7fd94 lrc: 3/0,1 mode: --/EX res: [0x240000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.303449:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832200/0x22153cd396b7fd94 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.303458:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832200/0x22153cd396b7fd94 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.303596:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832200/0x22153cd396b7fd94 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.303836:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826364.303941:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf181fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+52:2403:x1874670563666176:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4380us (4995us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826364.303954:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 917 00010000:00010000:3.0:1787826364.304835:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832200/0x22153cd396b7fd94 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.304849:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832200/0x22153cd396b7fd94 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826364.304878:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0xc:0x0]: returning size 0 00000004:00080000:3.0:1787826364.305643:0:6518:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x21:0x0], index 1: 0 00010000:00010000:3.0:1787826364.305862:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832200/0x22153cd396b7fd94 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.305873:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832200/0x22153cd396b7fd94 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.305881:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832200/0x22153cd396b7fd94 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.305888:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a832200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826364.305893:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832200/0x22153cd396b7fd94 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.305901:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832200/0x22153cd396b7fd94 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.306285:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xc:0x0].0x0 (ffff90cf04f8b500) 00010000:00010000:3.0:1787826364.306290:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826364.306296:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832200/0x22153cd396b7fd94 lrc: 2/0,0 mode: --/EX res: [0x240000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.306303:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832200/0x22153cd396b7fd94 lrc: 0/0,0 mode: --/EX res: [0x240000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.306881:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a833200/0x22153cd396b7fd8d lrc: 1/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab027c expref: 52 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.306899:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x0 (ffff90cf1988e500) 00010000:00010000:3.0:1787826364.306902:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787826364.306978:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a833200/0x22153cd396b7fd8d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab027c expref: 52 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.307243:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a833200, rc 0) 00000100:00100000:3.0:1787826364.307353:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+51:52416:x1874670563666048:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 15120us (17613us total) trans 4294967603 rc 301/301 00000100:00100000:3.0:1787826364.307365:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3359 00000100:00100000:3.0:1787826364.314453:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826364.314612:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563666432 00000100:00100000:2.0:1787826364.314626:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563666432 00000100:00100000:2.0:1787826364.314702:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 985 00000100:00100000:2.0:1787826364.314713:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f934780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+51:52416:x1874670563666432:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:2.0:1787826364.315194:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f934780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+52:52416:x1874670563666432:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 480us (761us total) trans 4294967604 rc 0/0 00000100:00100000:2.0:1787826364.315203:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 985 00000100:00100000:0.0:1787826364.319665:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826364.320011:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563666560 00000100:00100000:1.0:1787826364.320024:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563666560 00000100:00100000:1.0:1787826364.320103:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3360 00000100:00100000:1.0:1787826364.320115:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+52:52416:x1874670563666560:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826364.320157:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826364.320381:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835600/0x22153cd396b7fda2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0283 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.320528:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835200/0x22153cd396b7fda9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.320558:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661400/0x22153cd396b7fd6a lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab026e expref: 53 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.320569:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835200/0x22153cd396b7fda9 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.320614:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661400/0x22153cd396b7fd6a lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab026e expref: 53 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.320626:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661400/0x22153cd396b7fd6a lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab026e expref: 53 pid: 9966 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826364.320640:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf361e4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6519:1874670585167232:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826364.320743:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce06a86240 going to sleep for 11 seconds 00000100:00100000:1.0:1787826364.323636:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf361e4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6519:1874670585167232:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826364.323676:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835200/0x22153cd396b7fda9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826364.323943:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826364.324138:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563666688 00000100:00100000:1.0:1787826364.324147:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563666688 00010000:00010000:1.0:1787826364.324197:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661400/0x22153cd396b7fd6a lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab026e expref: 54 pid: 9966 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826364.324285:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 918 00000100:00100000:1.0:1787826364.324297:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f937840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+54:2403:x1874670563666688:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826364.324318:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826364.324327:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661400/0x22153cd396b7fd6a lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab026e expref: 54 pid: 9966 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.324341:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661400/0x22153cd396b7fd6a lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab026e expref: 54 pid: 9966 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.324375:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661400/0x22153cd396b7fd6a lrc: 0/0,0 mode: --/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab026e expref: 54 pid: 9966 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.324394:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:1.0:1787826364.324400:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835200/0x22153cd396b7fda9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.324412:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835200/0x22153cd396b7fda9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.324421:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835200/0x22153cd396b7fda9 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.324460:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826364.324694:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f937840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:2403:x1874670563666688:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 398us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826364.324703:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 918 00010000:00010000:3.0:1787826364.324786:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835200/0x22153cd396b7fda9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.324796:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835200/0x22153cd396b7fda9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826364.324863:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0x9:0x0]: returning size 3700000 00000004:00200000:3.0:1787826364.324869:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826364.324892:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835200/0x22153cd396b7fda9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.324927:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835600/0x22153cd396b7fda2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0283 expref: 53 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.324949:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835200/0x22153cd396b7fda9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0283 expref: 52 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.324957:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:3.0:1787826364.324960:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826364.324963:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835200, rc 0) 00000100:00100000:3.0:1787826364.325002:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+52:52416:x1874670563666560:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 4890us (5350us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826364.325019:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3360 00000100:00100000:3.0:1787826364.333385:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826364.333627:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563666816 00000100:00100000:0.0:1787826364.333641:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563666816 00000100:00100000:0.0:1787826364.333740:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3361 00000100:00100000:0.0:1787826364.333753:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f936580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+52:52416:x1874670563666816:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826364.333782:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826364.333812:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660200/0x22153cd396b7fdb0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab028a expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.333900:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b7fdb7 lrc: 3/1,0 mode: --/PR res: [0x240000404:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.333917:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b7fdb7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.333931:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b7fdb7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826364.333990:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0xc:0x0]: returning size 0 00000004:00200000:0.0:1787826364.333995:0:9966:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826364.334029:0:9966:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b7fdb7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.334061:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660200/0x22153cd396b7fdb0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab028a expref: 54 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.334086:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b7fdb7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab028a expref: 53 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.334096:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xc:0x0].0x0 (ffff90cf371d2100) 00010000:00010000:0.0:1787826364.334099:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787826364.334103:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05660400, rc 0) 00000100:00100000:0.0:1787826364.334195:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f936580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:52416:x1874670563666816:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 445us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826364.334203:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3361 00000100:00100000:0.0:1787826364.338087:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826364.338524:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563666944 00000100:00100000:1.0:1787826364.338551:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563666944 00000100:00100000:1.0:1787826364.338644:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1696 00000100:00100000:1.0:1787826364.338657:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecac3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563666944:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826364.338684:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826364.338730:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c25d1558/0x22153cd396b7fdbe lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0291 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826364.339603:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826364.339638:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x21:0x0].0x0 since=1310s v=(0 0) 00010000:00010000:1.0:1787826364.339646:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826364.339663:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c25d1558/0x22153cd396b7fdbe lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0291 expref: 15 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.339690:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c25d1558/0x22153cd396b7fdbe lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0291 expref: 15 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.339707:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834200, rc 0) 00000100:00100000:1.0:1787826364.340176:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecac3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2404:x1874670563666944:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1518us (2099us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826364.340187:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1696 00000100:00100000:2.0:1787826364.345321:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826364.345405:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563667200 00000100:00100000:3.0:1787826364.345419:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563667200 00000100:00100000:3.0:1787826364.345547:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3362 00000100:00100000:3.0:1787826364.345561:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf36200b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:52416:x1874670563667200:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826364.345592:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826364.345625:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6000/0x22153cd396b7fdc5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0298 expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.345806:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6600/0x22153cd396b7fdcc lrc: 3/0,1 mode: --/PW res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.345827:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6600/0x22153cd396b7fdcc lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x9:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.345841:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6600/0x22153cd396b7fdcc lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x9:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826364.345862:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0x9:0x0]: returning size 3700000 00010000:00010000:3.0:1787826364.345996:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6000/0x22153cd396b7fdc5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0298 expref: 56 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.346019:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6600/0x22153cd396b7fdcc lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0298 expref: 55 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.346029:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:3.0:1787826364.346032:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787826364.346035:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3abd6600, rc 0) 00000100:00100000:3.0:1787826364.346604:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf36200b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+55:52416:x1874670563667200:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1042us (1294us total) trans 4294967605 rc 0/0 00000100:00100000:3.0:1787826364.346613:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3362 00000100:00100000:2.0:1787826364.350833:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826364.350926:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826364.351015:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826364.351084:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563667328 00000100:00100000:0.0:1787826364.351096:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563667328 00000100:00100000:0.0:1787826364.351164:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563667584 00000100:00100000:0.0:1787826364.351167:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563667584 00000100:00100000:0.0:1787826364.351195:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1697 00000100:00100000:0.0:1787826364.351205:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf362012c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+18:2403:x1874670563667328:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:0.0:1787826364.351264:0:30694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c6b1b26e/0x22153cd396b7fdda lrc: 3/1,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.351287:0:30694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000eb167c78/0x22153cd396b7fcb4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab022f expref: 18 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.351296:0:30694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826364.351302:0:30694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826364.351306:0:30694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6b1b26e/0x22153cd396b7fdda lrc: 4/1,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.351350:0:30694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000eb167c78/0x22153cd396b7fcb4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab022f expref: 18 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.351372:0:30694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000eb167c78/0x22153cd396b7fcb4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab022f expref: 18 pid: 30695 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826364.351388:0:30694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf1ecae940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:30694:1874670585167360:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826364.351513:0:30694:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a2f600 going to sleep for 11 seconds 00000100:00100000:0.0:1787826364.351547:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1698 00000100:00100000:0.0:1787826364.351556:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf362003c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+18:2403:x1874670563667584:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:0.0:1787826364.351576:0:28853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005cb54982/0x22153cd396b7fde1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.351589:0:28853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008ef375d7/0x22153cd396b7fcc9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab023d expref: 18 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.351597:0:28853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826364.351600:0:28853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826364.351603:0:28853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cb54982/0x22153cd396b7fde1 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.351625:0:28853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008ef375d7/0x22153cd396b7fcc9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab023d expref: 18 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.351633:0:28853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008ef375d7/0x22153cd396b7fcc9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab023d expref: 18 pid: 30398 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826364.351650:0:28853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf1ecada40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28853:1874670585167488:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826364.351674:0:28853:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a2f840 going to sleep for 11 seconds 00000100:00100000:1.0:1787826364.356144:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563667456 00000100:00100000:1.0:1787826364.356165:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563667456 00000100:00100000:1.0:1787826364.356248:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1699 00000100:00100000:1.0:1787826364.356260:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf36202940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2403:x1874670563667456:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:1.0:1787826364.356318:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000005c6f0c33/0x22153cd396b7fde8 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.356343:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000782e234f/0x22153cd396b7fd01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0252 expref: 15 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.356354:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826364.356358:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x20:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826364.356363:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c6f0c33/0x22153cd396b7fde8 lrc: 4/1,0 mode: --/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.356406:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000782e234f/0x22153cd396b7fd01 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0252 expref: 15 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.356422:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000782e234f/0x22153cd396b7fd01 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0252 expref: 15 pid: 8437 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826364.356438:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf361e4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1874670585167616:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826364.356580:0:8435:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce06a86600 going to sleep for 11 seconds 00000100:00100000:1.0:1787826364.359782:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826364.359823:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826364.359865:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826364.359927:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf361e4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1874670585167616:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826364.359961:0:8435:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005c6f0c33/0x22153cd396b7fde8 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826364.360000:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563667840 00000100:00100000:1.0:1787826364.360008:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563667840 00010000:00010000:1.0:1787826364.360054:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008ef375d7/0x22153cd396b7fcc9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab023d expref: 19 pid: 30398 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826364.360085:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563667712 00000100:00100000:1.0:1787826364.360088:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563667712 00010000:00010000:1.0:1787826364.360101:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000eb167c78/0x22153cd396b7fcb4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab022f expref: 20 pid: 30695 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826364.360125:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563667968 00000100:00100000:1.0:1787826364.360128:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563667968 00010000:00010000:1.0:1787826364.360143:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000782e234f/0x22153cd396b7fd01 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0252 expref: 16 pid: 8437 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826364.360162:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 919 00000100:00100000:1.0:1787826364.360172:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:2403:x1874670563667840:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826364.360193:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787826364.360218:0:10341:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 0 -> 56 00010000:00010000:1.0:1787826364.360227:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008ef375d7/0x22153cd396b7fcc9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab023d expref: 20 pid: 30398 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.360240:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008ef375d7/0x22153cd396b7fcc9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab023d expref: 20 pid: 30398 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.360276:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826364.360283:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826364.360290:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005cb54982/0x22153cd396b7fde1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.360302:0:10341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cb54982/0x22153cd396b7fde1 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.360324:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826364.360383:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:2403:x1874670563667840:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 211us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826364.360391:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 919 00000100:00100000:1.0:1787826364.360411:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 920 00000100:00100000:1.0:1787826364.360417:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:2403:x1874670563667712:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826364.360425:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787826364.360434:0:10341:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb size from disk: 1045504 -> 1048576 00002000:00010000:1.0:1787826364.360437:0:10341:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1787826364.360442:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000eb167c78/0x22153cd396b7fcb4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab022f expref: 19 pid: 30695 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.360453:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000eb167c78/0x22153cd396b7fcb4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab022f expref: 19 pid: 30695 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.360466:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826364.360502:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826364.360508:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c6b1b26e/0x22153cd396b7fdda lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.360516:0:10341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6b1b26e/0x22153cd396b7fdda lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.360530:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826364.360562:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:2403:x1874670563667712:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 145us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826364.360569:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 920 00000100:00100000:1.0:1787826364.360581:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 921 00000100:00100000:1.0:1787826364.360587:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2403:x1874670563667968:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826364.360596:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787826364.360607:0:10341:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb blocks from disk: 0 -> 32 00010000:00010000:1.0:1787826364.360612:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000782e234f/0x22153cd396b7fd01 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0252 expref: 16 pid: 8437 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.360624:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000782e234f/0x22153cd396b7fd01 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0252 expref: 16 pid: 8437 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.360638:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000782e234f/0x22153cd396b7fd01 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0252 expref: 16 pid: 8437 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.360652:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x20:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826364.360654:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x20:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826364.360658:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005c6f0c33/0x22153cd396b7fde8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.360665:0:10341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c6f0c33/0x22153cd396b7fde8 lrc: 4/1,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.360681:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826364.360701:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2403:x1874670563667968:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 114us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826364.360707:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 921 00010000:00010000:1.0:1787826364.360729:0:8435:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005c6f0c33/0x22153cd396b7fde8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.360738:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c6f0c33/0x22153cd396b7fde8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.360760:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000005c6f0c33/0x22153cd396b7fde8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.360770:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c6f0c33/0x22153cd396b7fde8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.360779:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c6f0c33/0x22153cd396b7fde8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.360787:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834600 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:1.0:1787826364.360792:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c6f0c33/0x22153cd396b7fde8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.360802:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c6f0c33/0x22153cd396b7fde8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.360814:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c6f0c33/0x22153cd396b7fde8 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.360823:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c6f0c33/0x22153cd396b7fde8 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826364.360872:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf36202940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2403:x1874670563667456:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 4614us (9855us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826364.360880:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1699 00010000:00010000:2.0:1787826364.361114:0:28853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ef375d7/0x22153cd396b7fcc9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab023d expref: 18 pid: 30398 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826364.361129:0:28853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf1ecada40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28853:1874670585167488:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826364.361150:0:28853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005cb54982/0x22153cd396b7fde1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.361159:0:28853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005cb54982/0x22153cd396b7fde1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.361172:0:28853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cb54982/0x22153cd396b7fde1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.361189:0:28853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005cb54982/0x22153cd396b7fde1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.361197:0:28853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cb54982/0x22153cd396b7fde1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.361205:0:28853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cb54982/0x22153cd396b7fde1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.361213:0:28853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05661a00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826364.361216:0:28853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cb54982/0x22153cd396b7fde1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.361224:0:28853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cb54982/0x22153cd396b7fde1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.361237:0:28853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cb54982/0x22153cd396b7fde1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.361245:0:28853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cb54982/0x22153cd396b7fde1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826364.361296:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf362003c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+17:2403:x1874670563667584:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 9741us (10370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826364.361304:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1698 00010000:00010000:0.0:1787826364.363253:0:30694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb167c78/0x22153cd396b7fcb4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab022f expref: 16 pid: 30695 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826364.363281:0:30694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf1ecae940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:30694:1874670585167360:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826364.363308:0:30694:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c6b1b26e/0x22153cd396b7fdda lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.363322:0:30694:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c6b1b26e/0x22153cd396b7fdda lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.363330:0:30694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6b1b26e/0x22153cd396b7fdda lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.363363:0:30694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c6b1b26e/0x22153cd396b7fdda lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.363373:0:30694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c6b1b26e/0x22153cd396b7fdda lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.363382:0:30694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c6b1b26e/0x22153cd396b7fdda lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.363396:0:30694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05660200 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826364.363400:0:30694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6b1b26e/0x22153cd396b7fdda lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.363409:0:30694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6b1b26e/0x22153cd396b7fdda lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.363430:0:30694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c6b1b26e/0x22153cd396b7fdda lrc: 2/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.363439:0:30694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6b1b26e/0x22153cd396b7fdda lrc: 0/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826364.363916:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf362012c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2403:x1874670563667328:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 12709us (13204us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826364.363928:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1697 00000100:00100000:3.0:1787826364.368986:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826364.369029:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826364.369063:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826364.369091:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563668096 00000100:00100000:3.0:1787826364.369105:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563668096 00000100:00100000:3.0:1787826364.369166:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563668352 00000100:00100000:3.0:1787826364.369169:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563668352 00000100:00100000:3.0:1787826364.369187:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563668224 00000100:00100000:3.0:1787826364.369189:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563668224 00000100:00100000:3.0:1787826364.369215:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1700 00000100:00100000:3.0:1787826364.369225:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f9352c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2403:x1874670563668096:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826364.369249:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826364.369275:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ada17ba/0x22153cd396b7fdef lrc: 2/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab029f expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826364.369315:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 1048576, mtime: 0x6a9010bc, atime: 0x0, ctime: 0x6a9010bc, blocks: 0x8 00010000:00010000:3.0:1787826364.369341:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=1310s v=(0 0) 00010000:00010000:3.0:1787826364.369346:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826364.369360:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ada17ba/0x22153cd396b7fdef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab029f expref: 17 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.369382:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009ada17ba/0x22153cd396b7fdef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab029f expref: 17 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.369399:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3abd6000, rc 0) 00000100:00100000:3.0:1787826364.369465:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f9352c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+17:2403:x1874670563668096:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 241us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826364.369503:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1700 00000100:00100000:3.0:1787826364.369523:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1701 00000100:00100000:3.0:1787826364.369530:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aaf2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2403:x1874670563668352:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826364.369547:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826364.369558:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000944f0deb/0x22153cd396b7fdf6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab02ad expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826364.369572:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 1602848, mtime: 0x6a9010bc, atime: 0x0, ctime: 0x6a9010bc, blocks: 0x38 00010000:00010000:3.0:1787826364.369581:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=1310s v=(0 0) 00010000:00010000:3.0:1787826364.369584:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826364.369590:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000944f0deb/0x22153cd396b7fdf6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02ad expref: 17 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.369607:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000944f0deb/0x22153cd396b7fdf6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02ad expref: 17 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.369617:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3abd6a00, rc 0) 00000100:00100000:3.0:1787826364.369641:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aaf2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+17:2403:x1874670563668352:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 111us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826364.369647:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1701 00000100:00100000:3.0:1787826364.369661:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1702 00000100:00100000:3.0:1787826364.369668:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aaf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2403:x1874670563668224:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826364.369675:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826364.369688:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061e22549/0x22153cd396b7fdfd lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab02a6 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826364.369703:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x20:0x0] initial LVB size: 2097152, mtime: 0x6a9010bc, atime: 0x0, ctime: 0x6a9010bc, blocks: 0x20 00010000:00010000:3.0:1787826364.369712:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x20:0x0].0x0 since=1310s v=(0 0) 00010000:00010000:3.0:1787826364.369715:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826364.369721:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061e22549/0x22153cd396b7fdfd lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02a6 expref: 15 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.369733:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000061e22549/0x22153cd396b7fdfd lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02a6 expref: 15 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.369742:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3abd7e00, rc 0) 00000100:00100000:3.0:1787826364.369764:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aaf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2403:x1874670563668224:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 96us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826364.369770:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1702 00000100:00100000:2.0:1787826364.419746:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826364.419943:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826364.422528:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563668480 00000100:00100000:0.0:1787826364.422554:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563668480 00000100:00100000:0.0:1787826364.422637:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563668736 00000100:00100000:0.0:1787826364.422643:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563668736 00000100:00100000:2.0:1787826364.422651:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826364.422692:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563668608 00000100:00100000:0.0:1787826364.422697:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563668608 00000100:00100000:0.0:1787826364.422740:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1703 00000100:00100000:0.0:1787826364.422760:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf36201a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+18:2402:x1874670563668480:12345-192.168.203.39@tcp:23:lfs.0 00000100:00100000:2.0:1787826364.422771:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1704 00000100:00100000:2.0:1787826364.422790:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf36203840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+18:2402:x1874670563668736:12345-192.168.203.39@tcp:23:lfs.0 00000100:00100000:2.0:1787826364.422924:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf36203840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+18:2402:x1874670563668736:12345-192.168.203.39@tcp:23:lfs.0 Request processed in 141us (2981us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826364.423049:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1704 00000100:00100000:2.0:1787826364.423080:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1705 00000100:00100000:2.0:1787826364.423089:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2402:x1874670563668608:12345-192.168.203.39@tcp:23:lfs.0 00000100:00100000:0.0:1787826364.423112:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf36201a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+17:2402:x1874670563668480:12345-192.168.203.39@tcp:23:lfs.0 Request processed in 358us (3377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826364.423122:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1703 00000100:00100000:2.0:1787826364.423156:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2402:x1874670563668608:12345-192.168.203.39@tcp:23:lfs.0 Request processed in 66us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826364.423167:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1705 00000100:00100000:2.0:1787826364.434380:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826364.434503:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563668864 00000100:00100000:3.0:1787826364.434516:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563668864 00000100:00100000:3.0:1787826364.434595:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3363 00000100:00100000:3.0:1787826364.434608:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03b93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+55:52416:x1874670563668864:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826364.434642:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826364.434670:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6800/0x22153cd396b7fe04 lrc: 2/0,0 mode: --/PR res: [0x240000404:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab02b4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.434885:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6400/0x22153cd396b7fe0b lrc: 3/1,0 mode: --/PR res: [0x240000404:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.434902:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6400/0x22153cd396b7fe0b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.434915:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6400/0x22153cd396b7fe0b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.435066:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6800/0x22153cd396b7fe04 lrc: 0/0,0 mode: --/PR res: [0x240000404:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02b4 expref: 57 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.435091:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6400/0x22153cd396b7fe0b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02b4 expref: 56 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.435101:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xc:0x0].0x0 (ffff90cf371d2100) 00010000:00010000:3.0:1787826364.435104:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787826364.435108:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3abd6400, rc 0) 00000100:00100000:3.0:1787826364.435243:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03b93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+56:52416:x1874670563668864:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 637us (876us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826364.435252:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3363 00000100:00100000:0.0:1787826364.442379:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826364.442616:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563669120 00000100:00100000:3.0:1787826364.442629:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563669120 00000100:00100000:3.0:1787826364.442709:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3364 00000100:00100000:3.0:1787826364.442727:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+56:52416:x1874670563669120:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:3.0:1787826364.443035:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826364.443071:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b7fdb7 lrc: 0/0,0 mode: --/PR res: [0x240000404:0xc:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab028a expref: 56 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.443094:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xc:0x0].0x0 (ffff90cf371d2100) 00010000:00010000:3.0:1787826364.443100:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826364.443310:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7400/0x22153cd396b7fe12 lrc: 3/0,1 mode: --/PW res: [0x240000404:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.443327:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7400/0x22153cd396b7fe12 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.443339:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7400/0x22153cd396b7fe12 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787826364.443394:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967606 00000004:00010000:3.0:1787826364.443423:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001072c040 reply state 00000000e18dc5f6 transno 4294967607 ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7400/0x22153cd396b7fe12 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.443437:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7400/0x22153cd396b7fe12 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.443443:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xc:0x0].0x0 (ffff90cf371d2100) 00010000:00010000:3.0:1787826364.443447:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826364.443450:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826364.443666:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:52416:x1874670563669120:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 946us (1299us total) trans 4294967607 rc 0/0 00000100:00100000:3.0:1787826364.443675:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3364 00000020:00080000:3.0:1787826364.443681:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787826364.452704:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826364.453010:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563669248 00000100:00100000:3.0:1787826364.453022:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563669248 00000100:00100000:3.0:1787826364.453100:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3365 00000100:00100000:3.0:1787826364.453113:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03b930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:52416:x1874670563669248:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826364.453145:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826364.453172:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6800/0x22153cd396b7fe19 lrc: 2/0,0 mode: --/CR res: [0x240000404:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab02bb expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.453245:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6800/0x22153cd396b7fe19 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02bb expref: 59 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.453261:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6800/0x22153cd396b7fe19 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02bb expref: 59 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.453282:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xc:0x0].0x0 (ffff90cf371d2100) 00010000:00010000:3.0:1787826364.453286:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826364.453291:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3abd6800, rc 0) 00000100:00100000:3.0:1787826364.453372:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03b930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:52416:x1874670563669248:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 262us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826364.453380:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3365 00000100:00100000:2.0:1787826364.458246:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826364.458353:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563669376 00000100:00100000:3.0:1787826364.458367:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563669376 00000100:00100000:3.0:1787826364.458447:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1706 00000100:00100000:3.0:1787826364.458458:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f806580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:52416:x1874670563669376:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826364.458524:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826364.458556:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb167c78/0x22153cd396b7fe20 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab02c2 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.458599:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c25d1558/0x22153cd396b7fdbe lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0291 expref: 16 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.458609:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826364.458614:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826364.458620:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb167c78/0x22153cd396b7fe20 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50000080000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02c2 expref: 16 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.458662:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c25d1558/0x22153cd396b7fdbe lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000000010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0291 expref: 16 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.458678:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c25d1558/0x22153cd396b7fdbe lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x70000400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0291 expref: 16 pid: 8436 timeout: 1410 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826364.458693:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aaf3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1874670585167744:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826364.459951:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3aaf5cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826364.463104:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aaf3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1874670585167744:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826364.463157:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000eb167c78/0x22153cd396b7fe20 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40000080020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02c2 expref: 16 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.463192:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3abd7000, rc 0) 00000100:00100000:2.0:1787826364.463268:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f806580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:52416:x1874670563669376:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 4811us (5035us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826364.463279:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1706 00000100:00100000:1.0:1787826364.463375:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826364.464606:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563669504 00000100:00100000:0.0:1787826364.464619:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563669504 00010000:00010000:0.0:1787826364.464667:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c25d1558/0x22153cd396b7fdbe lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0291 expref: 16 pid: 8436 timeout: 1410 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826364.464725:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 922 00000100:00100000:0.0:1787826364.464736:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2403:x1874670563669504:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826364.464765:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826364.464773:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c25d1558/0x22153cd396b7fdbe lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0291 expref: 16 pid: 8436 timeout: 1410 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.464790:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c25d1558/0x22153cd396b7fdbe lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0291 expref: 16 pid: 8436 timeout: 1410 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.464821:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c25d1558/0x22153cd396b7fdbe lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0291 expref: 16 pid: 8436 timeout: 1410 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.464845:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826364.464850:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826364.464860:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eb167c78/0x22153cd396b7fe20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40080080020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02c2 expref: 15 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.464874:0:10341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb167c78/0x22153cd396b7fe20 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40080080020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02c2 expref: 15 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.464922:0:10341:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000eb167c78/0x22153cd396b7fe20 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000080020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02c2 expref: 15 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826364.464940:0:10341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf1ecaf840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10341:1874670585167872:192.168.203.39@tcp:105: 00000100:00100000:0.0:1787826364.465050:0:10341:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a2f600 going to sleep for 11 seconds 00000100:00100000:1.0:1787826364.467882:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826364.468041:0:30175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563669632 00000100:00100000:2.0:1787826364.468051:0:30175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563669632 00002000:00010000:2.0:1787826364.468112:0:30175:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/33 (0->18446744073709551615) 00002000:00100000:2.0:1787826364.468118:0:30175:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf361e4780 with x1874670563669632 ext(0->18446744073709551615) 00002000:00010000:2.0:1787826364.468133:0:30175:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90cf361e4780. 00000100:00100000:2.0:1787826364.468214:0:30175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 653 00000100:00100000:2.0:1787826364.468226:0:30175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2404:x1874670563669632:12345-192.168.203.39@tcp:10:lfs.0 00002000:00010000:2.0:1787826364.468453:0:30175:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x21:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787826364.468458:0:30175:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x21:0x0] updating lvb mtime from disk: 0 -> 1787826365 00002000:00010000:2.0:1787826364.468461:0:30175:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x21:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787826364.468464:0:30175:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x21:0x0] updating lvb ctime from disk: 0 -> 1787826365 00002000:00010000:2.0:1787826364.468466:0:30175:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x21:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1787826364.468592:0:30175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+17:2404:x1874670563669632:12345-192.168.203.39@tcp:10:lfs.0 Request processed in 367us (723us total) trans 17179869575 rc 0/0 00000100:00100000:2.0:1787826364.468601:0:30175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 653 00002000:00010000:2.0:1787826364.468605:0:30175:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/33 (0->18446744073709551615) 00002000:00100000:2.0:1787826364.468608:0:30175:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf361e4780 with x1874670563669632 ext(0->18446744073709551615) 00002000:00010000:2.0:1787826364.468613:0:30175:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90cf361e4780. 00000100:00100000:0.0:1787826364.468877:0:10341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf1ecaf840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10341:1874670585167872:192.168.203.39@tcp:105: 00010000:00010000:0.0:1787826364.468902:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826364.468929:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2403:x1874670563669504:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4195us (5555us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826364.468939:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 922 00000100:00100000:2.0:1787826364.475445:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826364.475577:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826364.475758:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826364.475817:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563669760 00000100:00100000:0.0:1787826364.475828:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563669760 00000100:00100000:3.0:1787826364.476016:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563669888 00000100:00100000:3.0:1787826364.476022:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563669888 00000100:00100000:3.0:1787826364.476120:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1707 00000100:00100000:3.0:1787826364.476132:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f052c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+17:2401:x1874670563669760:12345-192.168.203.39@tcp:23:lfs.0 00000100:00100000:3.0:1787826364.476280:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f052c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+17:2401:x1874670563669760:12345-192.168.203.39@tcp:23:lfs.0 Request processed in 150us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826364.476289:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1707 00000100:00100000:3.0:1787826364.476312:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1708 00000100:00100000:3.0:1787826364.476319:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03aef840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2401:x1874670563669888:12345-192.168.203.39@tcp:23:lfs.0 00000100:00100000:3.0:1787826364.476363:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03aef840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2401:x1874670563669888:12345-192.168.203.39@tcp:23:lfs.0 Request processed in 45us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826364.476370:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1708 00000100:00100000:3.0:1787826364.476400:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563670016 00000100:00100000:3.0:1787826364.476404:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563670016 00000100:00100000:3.0:1787826364.476429:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1709 00000100:00100000:3.0:1787826364.476438:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8fbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+17:2401:x1874670563670016:12345-192.168.203.39@tcp:23:lfs.0 00000100:00100000:3.0:1787826364.476600:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8fbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+17:2401:x1874670563670016:12345-192.168.203.39@tcp:23:lfs.0 Request processed in 163us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826364.476607:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1709 00000100:00100000:1.0:1787826364.481868:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826364.481918:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826364.481960:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563670272 00000100:00100000:1.0:1787826364.481969:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826364.481974:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563670272 00000100:00100000:1.0:1787826364.486221:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563670144 00000100:00100000:3.0:1787826364.486221:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563670400 00000100:00100000:1.0:1787826364.486246:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563670144 00000100:00100000:3.0:1787826364.486246:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563670400 00000100:00100000:1.0:1787826364.486327:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1710 00000100:00100000:1.0:1787826364.486336:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2403:x1874670563670272:12345-192.168.203.39@tcp:23:lfs.0 00000100:00100000:1.0:1787826364.486495:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2403:x1874670563670272:12345-192.168.203.39@tcp:23:lfs.0 Request processed in 160us (4645us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826364.486510:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1710 00000100:00100000:1.0:1787826364.486530:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1711 00000100:00100000:1.0:1787826364.486548:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+18:2403:x1874670563670144:12345-192.168.203.39@tcp:23:lfs.0 00000100:00100000:1.0:1787826364.486591:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+18:2403:x1874670563670144:12345-192.168.203.39@tcp:23:lfs.0 Request processed in 55us (4674us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826364.486598:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1711 00000100:00100000:1.0:1787826364.486615:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1712 00000100:00100000:1.0:1787826364.486622:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+17:2403:x1874670563670400:12345-192.168.203.39@tcp:23:lfs.0 00000100:00100000:1.0:1787826364.486659:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+17:2403:x1874670563670400:12345-192.168.203.39@tcp:23:lfs.0 Request processed in 37us (4689us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826364.486665:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1712 00000100:00100000:2.0:1787826364.496748:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826364.496837:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826364.497012:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563670528 00000100:00100000:3.0:1787826364.497027:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563670528 00000100:00100000:3.0:1787826364.497113:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563670656 00000100:00100000:3.0:1787826364.497116:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563670656 00000100:00100000:3.0:1787826364.497156:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 654 00000100:00100000:3.0:1787826364.497168:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8fa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+18:2403:x1874670563670528:12345-192.168.203.39@tcp:3:lfs.0 00010000:00010000:3.0:1787826364.497241:0:8440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e8d36182/0x22153cd396b7fe27 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.497271:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826364.497277:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826364.497286:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8d36182/0x22153cd396b7fe27 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.497304:0:8440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8d36182/0x22153cd396b7fe27 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.497427:0:8440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e8d36182/0x22153cd396b7fe27 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.497438:0:8440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e8d36182/0x22153cd396b7fe27 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.497447:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8d36182/0x22153cd396b7fe27 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.497455:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf181f0200 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826364.497460:0:8440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8d36182/0x22153cd396b7fe27 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.497503:0:8440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8d36182/0x22153cd396b7fe27 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.497524:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8d36182/0x22153cd396b7fe27 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.497547:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8d36182/0x22153cd396b7fe27 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826364.497718:0:30172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 655 00000100:00100000:2.0:1787826364.497730:0:30172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03985a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+18:2403:x1874670563670656:12345-192.168.203.39@tcp:3:lfs.0 00010000:00010000:2.0:1787826364.497752:0:30172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008ef375d7/0x22153cd396b7fe2e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.497762:0:30172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826364.497765:0:30172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826364.497769:0:30172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ef375d7/0x22153cd396b7fe2e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.497780:0:30172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ef375d7/0x22153cd396b7fe2e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826364.497980:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8fa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:2403:x1874670563670528:12345-192.168.203.39@tcp:3:lfs.0 Request processed in 813us (1247us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787826364.497990:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 654 00010000:00010000:1.0:1787826364.501463:0:30172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008ef375d7/0x22153cd396b7fe2e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.501526:0:30172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ef375d7/0x22153cd396b7fe2e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.501554:0:30172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ef375d7/0x22153cd396b7fe2e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.501563:0:30172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a833a00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:1.0:1787826364.501569:0:30172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ef375d7/0x22153cd396b7fe2e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.501580:0:30172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ef375d7/0x22153cd396b7fe2e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.501604:0:30172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ef375d7/0x22153cd396b7fe2e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.501614:0:30172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ef375d7/0x22153cd396b7fe2e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826364.501846:0:30172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03985a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+17:2403:x1874670563670656:12345-192.168.203.39@tcp:3:lfs.0 Request processed in 4112us (5001us total) trans 0 rc 20480/20480 00000100:00100000:1.0:1787826364.501858:0:30172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 655 00000100:00100000:1.0:1787826364.503877:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826364.504089:0:25424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563670784 00000100:00100000:3.0:1787826364.504101:0:25424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563670784 00000100:00100000:3.0:1787826364.504243:0:25424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 656 00000100:00100000:3.0:1787826364.504256:0:25424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2403:x1874670563670784:12345-192.168.203.39@tcp:4:lfs.0 00010000:00010000:3.0:1787826364.504302:0:25424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1d3d067/0x22153cd396b7fe35 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.504327:0:25424:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000eb167c78/0x22153cd396b7fe20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000080020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02c2 expref: 16 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.504335:0:25424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826364.504339:0:25424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x21:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826364.504342:0:25424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1d3d067/0x22153cd396b7fe35 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [1044480->1069055] (req 1044480->1069055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.504380:0:25424:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000eb167c78/0x22153cd396b7fe20 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000080020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02c2 expref: 16 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.504393:0:25424:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000eb167c78/0x22153cd396b7fe20 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x70000480020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02c2 expref: 16 pid: 8436 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826364.504407:0:25424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aaf3480 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_007:lustre-OST0001_UUID:25424:1874670585168000:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826364.504557:0:25424:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3aaf59c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826364.508266:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826364.508468:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563670912 00000100:00100000:0.0:1787826364.508496:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563670912 00010000:00010000:0.0:1787826364.508552:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000eb167c78/0x22153cd396b7fe20 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000480020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02c2 expref: 17 pid: 8436 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826364.508622:0:25424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aaf3480 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_007:lustre-OST0001_UUID:25424:1874670585168000:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826364.508651:0:25424:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f1d3d067/0x22153cd396b7fe35 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [1044480->1069055] (req 1044480->1069055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826364.508891:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 923 00000100:00100000:0.0:1787826364.508901:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03985680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+17:2403:x1874670563670912:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826364.508919:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826364.508948:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000eb167c78/0x22153cd396b7fe20 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000480020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02c2 expref: 17 pid: 8436 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.508963:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000eb167c78/0x22153cd396b7fe20 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000480020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02c2 expref: 17 pid: 8436 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.508997:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb167c78/0x22153cd396b7fe20 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801480020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02c2 expref: 17 pid: 8436 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.509015:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x21:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826364.509019:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x21:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826364.509024:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f1d3d067/0x22153cd396b7fe35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [1044480->1069055] (req 1044480->1069055) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.509032:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1d3d067/0x22153cd396b7fe35 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [1044480->1069055] (req 1044480->1069055) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.509056:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826364.509083:0:25424:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f1d3d067/0x22153cd396b7fe35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [1044480->1069055] (req 1044480->1069055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.509090:0:25424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1d3d067/0x22153cd396b7fe35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [1044480->1069055] (req 1044480->1069055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826364.509130:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03985680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2403:x1874670563670912:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 230us (874us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826364.509138:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 923 00000001:00080000:1.0:1787826364.514121:0:27651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179869576 is committed 00002000:00010000:0.0:1787826364.514373:0:25424:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x21:0x0] updating lvb size from disk: 0 -> 1069056 00002000:00010000:0.0:1787826364.514378:0:25424:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x21:0x0] updating lvb blocks from disk: 0 -> 48 00010000:00010000:0.0:1787826364.514393:0:25424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1d3d067/0x22153cd396b7fe35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [1044480->1069055] (req 1044480->1069055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.514404:0:25424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1d3d067/0x22153cd396b7fe35 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [1044480->1069055] (req 1044480->1069055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.514411:0:25424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1d3d067/0x22153cd396b7fe35 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [1044480->1069055] (req 1044480->1069055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.514421:0:25424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf181f1c00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826364.514425:0:25424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1d3d067/0x22153cd396b7fe35 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [1044480->1069055] (req 1044480->1069055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.514432:0:25424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1d3d067/0x22153cd396b7fe35 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [1044480->1069055] (req 1044480->1069055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.514452:0:25424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1d3d067/0x22153cd396b7fe35 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [1044480->1069055] (req 1044480->1069055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.514457:0:25424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1d3d067/0x22153cd396b7fe35 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [1044480->1069055] (req 1044480->1069055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826364.514764:0:25424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670563670784:12345-192.168.203.39@tcp:4:lfs.0 Request processed in 10502us (10889us total) trans 17179869576 rc 0/0 00000100:00100000:1.0:1787826364.514777:0:25424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 656 00000100:00100000:2.0:1787826364.517304:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826364.517344:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826364.517406:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563671168 00000100:00100000:0.0:1787826364.517408:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563671040 00000100:00100000:0.0:1787826364.517418:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563671040 00000100:00100000:1.0:1787826364.517418:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563671168 00000100:00100000:1.0:1787826364.517507:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1713 00000100:00100000:1.0:1787826364.517518:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03986940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+17:2404:x1874670563671168:12345-192.168.203.39@tcp:23:lfs.0 00000100:00100000:0.0:1787826364.517551:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1714 00000100:00100000:0.0:1787826364.517558:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf2f45de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563671040:12345-192.168.203.39@tcp:23:lfs.0 00000100:00100000:1.0:1787826364.517776:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03986940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+17:2404:x1874670563671168:12345-192.168.203.39@tcp:23:lfs.0 Request processed in 259us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826364.517777:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf2f45de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563671040:12345-192.168.203.39@tcp:23:lfs.0 Request processed in 217us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826364.517785:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1713 00000100:00100000:0.0:1787826364.517788:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1714 00000100:00100000:2.0:1787826364.520455:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826364.520523:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563671296 00000100:00100000:1.0:1787826364.520547:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563671296 00000100:00100000:1.0:1787826364.520609:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1715 00000100:00100000:1.0:1787826364.520619:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf2f45e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670563671296:12345-192.168.203.39@tcp:23:lfs.0 00000100:00100000:1.0:1787826364.520747:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf2f45e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670563671296:12345-192.168.203.39@tcp:23:lfs.0 Request processed in 128us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826364.520755:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1715 00000100:00100000:2.0:1787826364.521528:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826364.521630:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563671424 00000100:00100000:1.0:1787826364.521637:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563671424 00000100:00100000:1.0:1787826364.521677:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1716 00000100:00100000:1.0:1787826364.521686:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf2f45ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+17:2403:x1874670563671424:12345-192.168.203.39@tcp:23:lfs.0 00000100:00100000:1.0:1787826364.521778:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf2f45ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+17:2403:x1874670563671424:12345-192.168.203.39@tcp:23:lfs.0 Request processed in 93us (1240us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826364.521786:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1716 00000100:00100000:3.0:1787826364.525099:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826364.525180:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826364.525299:0:30178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563671680 00000100:00100000:1.0:1787826364.525305:0:25426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563671552 00000100:00100000:1.0:1787826364.525312:0:25426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563671552 00000100:00100000:2.0:1787826364.525312:0:30178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563671680 00000100:00100000:2.0:1787826364.525413:0:30178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 657 00000100:00100000:2.0:1787826364.525424:0:30178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aaf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563671680:12345-192.168.203.39@tcp:3:lfs.0 00000100:00100000:1.0:1787826364.525522:0:25426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 658 00000100:00100000:1.0:1787826364.525531:0:25426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+17:2403:x1874670563671552:12345-192.168.203.39@tcp:3:lfs.0 00010000:00010000:2.0:1787826364.525545:0:30178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000076bba0fb/0x22153cd396b7fe3c lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.525575:0:25426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b7fe43 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.525575:0:30178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826364.525581:0:30178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826364.525588:0:30178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076bba0fb/0x22153cd396b7fe3c lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [1048576->1064959] (req 1048576->1064959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.525590:0:25426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826364.525593:0:25426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826364.525597:0:25426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b7fe43 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1040384->1048575] (req 1040384->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.525606:0:30178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076bba0fb/0x22153cd396b7fe3c lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [1048576->1064959] (req 1048576->1064959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.525607:0:25426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b7fe43 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1040384->1048575] (req 1040384->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.525766:0:25426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b7fe43 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1040384->1048575] (req 1040384->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.525776:0:25426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b7fe43 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1040384->1048575] (req 1040384->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.525786:0:25426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b7fe43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1040384->1048575] (req 1040384->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.525794:0:25426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834a00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:1.0:1787826364.525799:0:25426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b7fe43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1040384->1048575] (req 1040384->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.525809:0:25426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b7fe43 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1040384->1048575] (req 1040384->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.525829:0:25426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b7fe43 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1040384->1048575] (req 1040384->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.525844:0:25426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b7fe43 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1040384->1048575] (req 1040384->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826364.525940:0:25426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+17:2403:x1874670563671552:12345-192.168.203.39@tcp:3:lfs.0 Request processed in 410us (760us total) trans 0 rc 8192/8192 00000100:00100000:1.0:1787826364.525948:0:25426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 658 00010000:00010000:2.0:1787826364.525993:0:30178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000076bba0fb/0x22153cd396b7fe3c lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [1048576->1064959] (req 1048576->1064959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.526002:0:30178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000076bba0fb/0x22153cd396b7fe3c lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [1048576->1064959] (req 1048576->1064959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.526009:0:30178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000076bba0fb/0x22153cd396b7fe3c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [1048576->1064959] (req 1048576->1064959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.526016:0:30178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a833e00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826364.526020:0:30178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000076bba0fb/0x22153cd396b7fe3c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [1048576->1064959] (req 1048576->1064959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.526028:0:30178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000076bba0fb/0x22153cd396b7fe3c lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [1048576->1064959] (req 1048576->1064959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.526042:0:30178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000076bba0fb/0x22153cd396b7fe3c lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [1048576->1064959] (req 1048576->1064959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.526056:0:30178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076bba0fb/0x22153cd396b7fe3c lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [1048576->1064959] (req 1048576->1064959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826364.526087:0:30178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aaf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563671680:12345-192.168.203.39@tcp:3:lfs.0 Request processed in 666us (1039us total) trans 0 rc 16384/16384 00000100:00100000:2.0:1787826364.526094:0:30178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 657 00000100:00100000:3.0:1787826364.529293:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826364.529397:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563671936 00000100:00100000:1.0:1787826364.529408:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563671936 00000100:00100000:1.0:1787826364.529465:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3366 00000100:00100000:1.0:1787826364.529508:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:52416:x1874670563671936:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826364.529549:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826364.529553:0:32404:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787826364.529590:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6800/0x22153cd396b7fe19 lrc: 0/0,0 mode: --/CR res: [0x240000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02bb expref: 59 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.529612:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xc:0x0].0x0 (ffff90cf371d2100) 00010000:00010000:1.0:1787826364.529689:0:32404:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826364.529704:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835600/0x22153cd396b7fe4a lrc: 2/0,0 mode: --/EX res: [0x240000404:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab02c9 expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.529807:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835c00/0x22153cd396b7fe51 lrc: 3/0,1 mode: --/EX res: [0x240000404:0xc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.529822:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835c00/0x22153cd396b7fe51 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0xc:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.529892:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835c00/0x22153cd396b7fe51 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0xc:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787826364.530053:0:32404:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x23:0x0], index 0: 0 00010000:00010000:1.0:1787826364.530164:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835c00/0x22153cd396b7fe51 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0xc:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02c9 expref: 61 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.530174:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xc:0x0].0x0 (ffff90cf371d2100) 00010000:00010000:1.0:1787826364.530177:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1787826364.530187:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835600/0x22153cd396b7fe4a lrc: 0/0,0 mode: --/EX res: [0x240000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02c9 expref: 61 pid: 32404 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.530201:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835c00/0x22153cd396b7fe51 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0xc:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02c9 expref: 60 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.530225:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xc:0x0].0x0 (ffff90cf371d2100) 00010000:00010000:1.0:1787826364.530228:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1787826364.530230:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835c00, rc 0) 00000100:00100000:1.0:1787826364.530423:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:52416:x1874670563671936:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 917us (1140us total) trans 4294967608 rc 0/0 00000100:00100000:1.0:1787826364.530431:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3366 00000100:00100000:2.0:1787826364.535078:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826364.535253:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826364.535949:0:30176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563672064 00000100:00100000:3.0:1787826364.535963:0:30176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563672064 00000100:00100000:0.0:1787826364.536005:0:30177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563672192 00000100:00100000:0.0:1787826364.536009:0:30177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563672192 00000100:00100000:2.0:1787826364.536198:0:30176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 659 00000100:00100000:2.0:1787826364.536210:0:30176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf2f45c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2401:x1874670563672064:12345-192.168.203.39@tcp:4:lfs.0 00000100:00100000:1.0:1787826364.536222:0:30177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 660 00000100:00100000:1.0:1787826364.536230:0:30177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf2f45c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+17:2401:x1874670563672192:12345-192.168.203.39@tcp:4:lfs.0 00002000:00010000:2.0:1787826364.536278:0:30176:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x21:0x0] initial LVB size: 1069056, mtime: 0x6a9010bd, atime: 0x0, ctime: 0x6a9010bd, blocks: 0x30 00010000:00010000:2.0:1787826364.536297:0:30176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009451c029/0x22153cd396b7fe5f lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.536316:0:30176:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x21:0x0].0x0 since=1310s v=(0 0) 00010000:00010000:2.0:1787826364.536321:0:30176:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826364.536329:0:30176:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009451c029/0x22153cd396b7fe5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [2088960->2097151] (req 2088960->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.536346:0:30176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009451c029/0x22153cd396b7fe5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [2088960->2097151] (req 2088960->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826364.536798:0:30177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826364.536807:0:30177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab580749/0x22153cd396b7fe58 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.536817:0:30177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=1310s v=(0 0) 00010000:00010000:1.0:1787826364.536821:0:30177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826364.536826:0:30177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab580749/0x22153cd396b7fe58 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [2097152->2113535] (req 2097152->2113535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.536836:0:30177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab580749/0x22153cd396b7fe58 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [2097152->2113535] (req 2097152->2113535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787826364.538466:0:26205:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836899 is committed 00000001:00080000:2.0:1787826364.538558:0:26205:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836893 is committed 00002000:00010000:1.0:1787826364.538689:0:30177:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb size from disk: 0 -> 2113536 00002000:00010000:1.0:1787826364.538693:0:30177:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb mtime from disk: 0 -> 1787826365 00002000:00010000:1.0:1787826364.538695:0:30177:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb ctime from disk: 0 -> 1787826365 00002000:00010000:1.0:1787826364.538697:0:30177:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb blocks from disk: 0 -> 32 00010000:00010000:1.0:1787826364.538877:0:30177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab580749/0x22153cd396b7fe58 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [2097152->2113535] (req 2097152->2113535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.538891:0:30177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab580749/0x22153cd396b7fe58 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [2097152->2113535] (req 2097152->2113535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.538901:0:30177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab580749/0x22153cd396b7fe58 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [2097152->2113535] (req 2097152->2113535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.538909:0:30177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835e00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:1.0:1787826364.538914:0:30177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab580749/0x22153cd396b7fe58 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [2097152->2113535] (req 2097152->2113535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.538924:0:30177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab580749/0x22153cd396b7fe58 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [2097152->2113535] (req 2097152->2113535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.538947:0:30177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab580749/0x22153cd396b7fe58 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [2097152->2113535] (req 2097152->2113535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.538957:0:30177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab580749/0x22153cd396b7fe58 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [2097152->2113535] (req 2097152->2113535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826364.539058:0:30177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf2f45c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2401:x1874670563672192:12345-192.168.203.39@tcp:4:lfs.0 Request processed in 2822us (3799us total) trans 21474836899 rc 0/0 00000100:00100000:1.0:1787826364.539068:0:30177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 660 00000001:00080000:1.0:1787826364.545166:0:27651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179869577 is committed 00002000:00010000:2.0:1787826364.545621:0:30176:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x21:0x0] updating lvb size from disk: 1069056 -> 2097152 00002000:00010000:2.0:1787826364.545627:0:30176:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x21:0x0] updating lvb blocks from disk: 48 -> 64 00010000:00010000:2.0:1787826364.545641:0:30176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009451c029/0x22153cd396b7fe5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [2088960->2097151] (req 2088960->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.545656:0:30176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009451c029/0x22153cd396b7fe5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [2088960->2097151] (req 2088960->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.545666:0:30176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009451c029/0x22153cd396b7fe5f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [2088960->2097151] (req 2088960->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.545675:0:30176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a832600 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826364.545680:0:30176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009451c029/0x22153cd396b7fe5f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [2088960->2097151] (req 2088960->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.545691:0:30176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009451c029/0x22153cd396b7fe5f lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [2088960->2097151] (req 2088960->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.545723:0:30176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009451c029/0x22153cd396b7fe5f lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [2088960->2097151] (req 2088960->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.545733:0:30176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009451c029/0x22153cd396b7fe5f lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [2088960->2097151] (req 2088960->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826364.546207:0:30176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf2f45c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2401:x1874670563672064:12345-192.168.203.39@tcp:4:lfs.0 Request processed in 9730us (10872us total) trans 17179869577 rc 0/0 00000100:00100000:2.0:1787826364.546219:0:30176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 659 00000100:00100000:2.0:1787826364.548520:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826364.548597:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563672320 00000100:00100000:0.0:1787826364.548607:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563672320 00000100:00100000:0.0:1787826364.548664:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1717 00000100:00100000:0.0:1787826364.548674:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf07966d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670563672320:12345-192.168.203.39@tcp:23:lfs.0 00000100:00100000:0.0:1787826364.548779:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf07966d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670563672320:12345-192.168.203.39@tcp:23:lfs.0 Request processed in 106us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826364.548787:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1717 00000100:00100000:0.0:1787826364.552021:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826364.552680:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563672448 00000100:00100000:3.0:1787826364.552696:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563672448 00000100:00100000:3.0:1787826364.552782:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1718 00000100:00100000:3.0:1787826364.552794:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecaf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563672448:12345-192.168.203.39@tcp:23:lfs.0 00000100:00100000:3.0:1787826364.553006:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecaf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563672448:12345-192.168.203.39@tcp:23:lfs.0 Request processed in 213us (1587us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826364.553016:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1718 00000100:00100000:2.0:1787826364.566418:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826364.566731:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563672704 00000100:00100000:3.0:1787826364.566745:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563672704 00000100:00100000:3.0:1787826364.566822:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3367 00000100:00100000:3.0:1787826364.566833:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf07966580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:52416:x1874670563672704:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:3.0:1787826364.566909:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826364.566940:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835c00/0x22153cd396b7fe51 lrc: 0/0,0 mode: --/CR res: [0x240000404:0xc:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02c9 expref: 60 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.566961:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xc:0x0].0x0 (ffff90cf371d2100) 00010000:00010000:3.0:1787826364.566967:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826364.567169:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f1600/0x22153cd396b7fe66 lrc: 3/0,1 mode: --/PW res: [0x240000404:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.567187:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f1600/0x22153cd396b7fe66 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.567198:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f1600/0x22153cd396b7fe66 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787826364.567250:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967609 00000004:00010000:3.0:1787826364.567270:0:6518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000034e067d reply state 0000000062f73757 transno 4294967610 ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f1600/0x22153cd396b7fe66 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.567283:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f1600/0x22153cd396b7fe66 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.567290:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xc:0x0].0x0 (ffff90cf371d2100) 00010000:00010000:3.0:1787826364.567293:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826364.567296:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826364.567406:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf07966580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+62:52416:x1874670563672704:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 573us (1001us total) trans 4294967610 rc 0/0 00000100:00100000:3.0:1787826364.567419:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3367 00000020:00080000:3.0:1787826364.567425:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787826364.570859:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826364.570938:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563672832 00000100:00100000:3.0:1787826364.570949:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563672832 00000100:00100000:3.0:1787826364.571023:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3368 00000100:00100000:3.0:1787826364.571035:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03aff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+62:52416:x1874670563672832:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826364.571066:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826364.571094:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f0800/0x22153cd396b7fe6d lrc: 2/0,0 mode: --/CR res: [0x240000404:0xc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab02d0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.571170:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f0800/0x22153cd396b7fe6d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02d0 expref: 63 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.571189:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f0800/0x22153cd396b7fe6d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02d0 expref: 63 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.571211:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xc:0x0].0x0 (ffff90cf371d2100) 00010000:00010000:3.0:1787826364.571215:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826364.571219:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf181f0800, rc 0) 00000100:00100000:3.0:1787826364.571291:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03aff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+63:52416:x1874670563672832:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 258us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826364.571299:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3368 00000100:00100000:1.0:1787826364.574346:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826364.574445:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563672960 00000100:00100000:0.0:1787826364.574456:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563672960 00000100:00100000:0.0:1787826364.574559:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1719 00000100:00100000:0.0:1787826364.574571:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f825a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:52416:x1874670563672960:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826364.574591:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826364.574616:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c55e1152/0x22153cd396b7fe74 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab02d7 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826364.574648:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x21:0x0] initial LVB size: 2097152, mtime: 0x6a9010bd, atime: 0x0, ctime: 0x6a9010bd, blocks: 0x40 00010000:00010000:0.0:1787826364.574675:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x21:0x0].0x0 since=1310s v=(0 0) 00010000:00010000:0.0:1787826364.574681:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826364.574694:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c55e1152/0x22153cd396b7fe74 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02d7 expref: 11 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.574962:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c55e1152/0x22153cd396b7fe74 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02d7 expref: 11 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.574979:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05660400, rc 0) 00000100:00100000:0.0:1787826364.575101:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f825a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:52416:x1874670563672960:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 531us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826364.575110:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1719 00000100:00100000:2.0:1787826364.577345:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826364.577441:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563673088 00000100:00100000:1.0:1787826364.577453:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563673088 00000100:00100000:1.0:1787826364.577589:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1720 00000100:00100000:1.0:1787826364.577600:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1366a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:52416:x1874670563673088:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826364.577622:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826364.577647:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b7fe7b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab02de expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826364.577680:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x23:0x0] initial LVB size: 2113536, mtime: 0x6a9010bd, atime: 0x0, ctime: 0x6a9010bd, blocks: 0x20 00010000:00010000:1.0:1787826364.577777:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=1310s v=(0 0) 00010000:00010000:1.0:1787826364.577794:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826364.577811:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b7fe7b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02de expref: 11 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.577837:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b7fe7b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02de expref: 11 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.577860:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834a00, rc 0) 00000100:00100000:1.0:1787826364.577952:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1366a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:52416:x1874670563673088:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 353us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826364.577961:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1720 00000100:00100000:2.0:1787826364.581516:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826364.581622:0:20692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563673216 00000100:00100000:3.0:1787826364.581636:0:20692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563673216 00002000:00010000:3.0:1787826364.581694:0:20692:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/35 (3700000->18446744073709551615) 00002000:00100000:3.0:1787826364.581699:0:20692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf13668780 with x1874670563673216 ext(3700000->18446744073709551615) 00002000:00010000:3.0:1787826364.581726:0:20692:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf13668780. 00000100:00100000:3.0:1787826364.581763:0:20692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 661 00000100:00100000:3.0:1787826364.581775:0:20692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf13668780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2404:x1874670563673216:12345-192.168.203.39@tcp:10:lfs.0 00002000:00010000:3.0:1787826364.582048:0:20692:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb size from disk: 2113536 -> 3700000 00002000:00010000:3.0:1787826364.582052:0:20692:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb mtime from disk: 1787826365 -> 1787826365 00002000:00010000:3.0:1787826364.582055:0:20692:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787826364.582057:0:20692:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb ctime from disk: 1787826365 -> 1787826365 00002000:00010000:3.0:1787826364.582060:0:20692:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb blocks from disk: 32 -> 32 00000100:00100000:3.0:1787826364.582143:0:20692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf13668780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563673216:12345-192.168.203.39@tcp:10:lfs.0 Request processed in 371us (674us total) trans 21474836900 rc 0/0 00000100:00100000:3.0:1787826364.582152:0:20692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 661 00002000:00010000:3.0:1787826364.582156:0:20692:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/35 (3700000->18446744073709551615) 00002000:00100000:3.0:1787826364.582159:0:20692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf13668780 with x1874670563673216 ext(3700000->18446744073709551615) 00002000:00010000:3.0:1787826364.582164:0:20692:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf13668780. 00000100:00100000:2.0:1787826364.588750:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826364.589038:0:30188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563673344 00000100:00100000:3.0:1787826364.589051:0:30188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563673344 00000100:00100000:3.0:1787826364.589151:0:30188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 662 00000100:00100000:3.0:1787826364.589163:0:30188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1366a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2402:x1874670563673344:12345-192.168.203.39@tcp:3:lfs.0 00010000:00010000:3.0:1787826364.589208:0:30188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e8d36182/0x22153cd396b7fe82 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.589231:0:30188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826364.589236:0:30188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826364.589244:0:30188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8d36182/0x22153cd396b7fe82 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1601536->1605631] (req 1601536->1605631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.589261:0:30188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8d36182/0x22153cd396b7fe82 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1601536->1605631] (req 1601536->1605631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.589415:0:30188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e8d36182/0x22153cd396b7fe82 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1601536->1605631] (req 1601536->1605631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.589425:0:30188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e8d36182/0x22153cd396b7fe82 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1601536->1605631] (req 1601536->1605631) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.589434:0:30188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8d36182/0x22153cd396b7fe82 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1601536->1605631] (req 1601536->1605631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.589442:0:30188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf181f0200 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826364.589447:0:30188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8d36182/0x22153cd396b7fe82 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1601536->1605631] (req 1601536->1605631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.589458:0:30188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8d36182/0x22153cd396b7fe82 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1601536->1605631] (req 1601536->1605631) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.589505:0:30188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8d36182/0x22153cd396b7fe82 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1601536->1605631] (req 1601536->1605631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.589514:0:30188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8d36182/0x22153cd396b7fe82 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1601536->1605631] (req 1601536->1605631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826364.589618:0:30188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1366a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2402:x1874670563673344:12345-192.168.203.39@tcp:3:lfs.0 Request processed in 456us (884us total) trans 0 rc 1312/1312 00000100:00100000:3.0:1787826364.589627:0:30188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 662 00000100:00100000:2.0:1787826364.592613:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826364.592701:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563673472 00000100:00100000:0.0:1787826364.592714:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563673472 00000100:00100000:0.0:1787826364.592800:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 663 00000100:00100000:0.0:1787826364.592811:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f80bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563673472:12345-192.168.203.39@tcp:4:lfs.0 00010000:00010000:0.0:1787826364.592854:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6b1b26e/0x22153cd396b7fe89 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.592880:0:8442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b7fe7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02de expref: 12 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.592890:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826364.592896:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826364.592902:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6b1b26e/0x22153cd396b7fe89 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [3698688->3702783] (req 3698688->3702783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.592948:0:8442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b7fe7b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02de expref: 12 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.592964:0:8442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b7fe7b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02de expref: 12 pid: 8435 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826364.592981:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf1ecada40 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0000_UUID:8442:1874670585168128:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826364.593096:0:8442:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a2f600 going to sleep for 11 seconds 00000100:00100000:0.0:1787826364.597370:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf1ecada40 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0000_UUID:8442:1874670585168128:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826364.597410:0:8442:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c6b1b26e/0x22153cd396b7fe89 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [3698688->3702783] (req 3698688->3702783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826364.598946:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826364.599451:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563673600 00000100:00100000:0.0:1787826364.599462:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563673600 00010000:00010000:0.0:1787826364.599947:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b7fe7b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02de expref: 13 pid: 8435 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826364.600329:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 924 00000100:00100000:0.0:1787826364.600342:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf04e59c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2404:x1874670563673600:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826364.600364:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826364.600393:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b7fe7b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02de expref: 13 pid: 8435 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.600408:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b7fe7b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02de expref: 13 pid: 8435 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.600437:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b7fe7b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02de expref: 13 pid: 8435 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.600459:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826364.600465:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826364.600524:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c6b1b26e/0x22153cd396b7fe89 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [3698688->3702783] (req 3698688->3702783) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.600547:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6b1b26e/0x22153cd396b7fe89 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [3698688->3702783] (req 3698688->3702783) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.600597:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826364.600679:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf04e59c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563673600:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 339us (1743us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826364.600689:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 924 00010000:00010000:2.0:1787826364.600814:0:8442:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c6b1b26e/0x22153cd396b7fe89 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [3698688->3702783] (req 3698688->3702783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.600826:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6b1b26e/0x22153cd396b7fe89 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [3698688->3702783] (req 3698688->3702783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787826364.604358:0:26205:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836901 is committed 00002000:00010000:2.0:1787826364.604532:0:8442:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb blocks from disk: 32 -> 40 00010000:00010000:2.0:1787826364.604559:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6b1b26e/0x22153cd396b7fe89 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [3698688->3702783] (req 3698688->3702783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.604575:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c6b1b26e/0x22153cd396b7fe89 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [3698688->3702783] (req 3698688->3702783) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.604586:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c6b1b26e/0x22153cd396b7fe89 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [3698688->3702783] (req 3698688->3702783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.604595:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05660200 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826364.604601:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6b1b26e/0x22153cd396b7fe89 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [3698688->3702783] (req 3698688->3702783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.604612:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6b1b26e/0x22153cd396b7fe89 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [3698688->3702783] (req 3698688->3702783) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.604639:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c6b1b26e/0x22153cd396b7fe89 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [3698688->3702783] (req 3698688->3702783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.604648:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6b1b26e/0x22153cd396b7fe89 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [3698688->3702783] (req 3698688->3702783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826364.604785:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f80bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563673472:12345-192.168.203.39@tcp:4:lfs.0 Request processed in 11966us (12315us total) trans 21474836901 rc 0/0 00000100:00100000:2.0:1787826364.604799:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 663 00000100:00100000:2.0:1787826364.610723:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826364.610938:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563673728 00000100:00100000:0.0:1787826364.610951:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563673728 00000100:00100000:0.0:1787826364.611031:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3369 00000100:00100000:0.0:1787826364.611043:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f808b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+63:52416:x1874670563673728:12345-192.168.203.39@tcp:44:lfs.0 00000001:00080000:2.0:1787826364.612748:0:7449:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967610 is committed 00000020:00080000:2.0:1787826364.612835:0:7449:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff90cf2f6119c0 refcount 2 committed 0 result 0 batchid 20 00000020:00080000:2.0:1787826364.612842:0:7449:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cf3f612d00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff90cf013703c0 00000020:00080000:2.0:1787826364.612847:0:7449:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000401:0x2:0x0].15 00000020:00080000:2.0:1787826364.612851:0:7449:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cf3f612f00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90ce03b4c200 00000020:00080000:2.0:1787826364.612854:0:7449:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].17 00000020:00080000:1.0:1787826364.612914:0:7472:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 20 committed batchid 19 00000020:00080000:1.0:1787826364.612998:0:7472:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 19 00000100:00100000:0.0:1787826364.613295:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f808b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:52416:x1874670563673728:12345-192.168.203.39@tcp:44:lfs.0 Request processed in 2249us (2590us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826364.613307:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3369 00010000:00010000:2.0:1787826364.614311:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832800/0x22153cd396b7fbe9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.614328:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832800/0x22153cd396b7fbe9 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.614337:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832800/0x22153cd396b7fbe9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.614344:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a832800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826364.614350:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832800/0x22153cd396b7fbe9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.614360:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832800/0x22153cd396b7fbe9 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.614380:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x0 (ffff90cf1988e500) 00010000:00010000:2.0:1787826364.614383:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826364.614389:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832800/0x22153cd396b7fbe9 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.614396:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832800/0x22153cd396b7fbe9 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.614418:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835a00/0x22153cd396b7fc4b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.614424:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835a00/0x22153cd396b7fc4b lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.614430:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835a00/0x22153cd396b7fc4b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.614436:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826364.614439:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835a00/0x22153cd396b7fc4b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.614445:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835a00/0x22153cd396b7fc4b lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.614453:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x5675640f (ffff90cf04f8b800) 00010000:00010000:2.0:1787826364.614456:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826364.614459:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835a00/0x22153cd396b7fc4b lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.614466:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835a00/0x22153cd396b7fc4b lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.614616:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832400/0x22153cd396b7fca6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.614623:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832400/0x22153cd396b7fca6 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.614629:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832400/0x22153cd396b7fca6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.614635:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a832400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826364.614638:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832400/0x22153cd396b7fca6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.614644:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832400/0x22153cd396b7fca6 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.614652:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:2.0:1787826364.614655:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826364.614658:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832400/0x22153cd396b7fca6 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.614664:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832400/0x22153cd396b7fca6 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.614673:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832c00/0x22153cd396b7fcf3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.614679:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832c00/0x22153cd396b7fcf3 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.614685:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832c00/0x22153cd396b7fcf3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.614691:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a832c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826364.614693:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832c00/0x22153cd396b7fcf3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.614699:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832c00/0x22153cd396b7fcf3 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.614706:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:2.0:1787826364.614717:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826364.614720:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832c00/0x22153cd396b7fcf3 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.614726:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832c00/0x22153cd396b7fcf3 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.614737:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7a00/0x22153cd396b7fd24 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.614743:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7a00/0x22153cd396b7fd24 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.614749:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7a00/0x22153cd396b7fd24 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.614754:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3abd7a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826364.614756:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7a00/0x22153cd396b7fd24 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.614766:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7a00/0x22153cd396b7fd24 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.614774:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:2.0:1787826364.614776:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826364.614779:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7a00/0x22153cd396b7fd24 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.614784:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7a00/0x22153cd396b7fd24 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.614795:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7400/0x22153cd396b7fe12 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.614801:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7400/0x22153cd396b7fe12 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.614807:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7400/0x22153cd396b7fe12 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.614811:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3abd7400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826364.614813:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7400/0x22153cd396b7fe12 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.614819:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7400/0x22153cd396b7fe12 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.614825:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xc:0x0].0x0 (ffff90cf371d2100) 00010000:00010000:2.0:1787826364.614827:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826364.614830:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7400/0x22153cd396b7fe12 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.614840:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7400/0x22153cd396b7fe12 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.614849:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f1600/0x22153cd396b7fe66 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.614855:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f1600/0x22153cd396b7fe66 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.614861:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f1600/0x22153cd396b7fe66 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.614866:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf181f1600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826364.614869:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f1600/0x22153cd396b7fe66 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.614874:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f1600/0x22153cd396b7fe66 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.614880:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xc:0x0].0x0 (ffff90cf371d2100) 00010000:00010000:2.0:1787826364.614883:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826364.614885:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f1600/0x22153cd396b7fe66 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.614891:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f1600/0x22153cd396b7fe66 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826364.621125:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826364.621214:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563673856 00000100:00100000:2.0:1787826364.621226:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563673856 00000100:00100000:2.0:1787826364.621292:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1721 00000100:00100000:2.0:1787826364.621314:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb961c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2404:x1874670563673856:12345-192.168.203.39@tcp:16:lfs.0 00000100:00100000:2.0:1787826364.621461:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb961c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2404:x1874670563673856:12345-192.168.203.39@tcp:16:lfs.0 Request processed in 158us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826364.621469:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1721 00000100:00100000:2.0:1787826364.622842:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826364.622913:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563673984 00000100:00100000:0.0:1787826364.622922:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563673984 00000100:00100000:0.0:1787826364.622976:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1722 00000100:00100000:0.0:1787826364.622986:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf39f82940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563673984:12345-192.168.203.39@tcp:16:lfs.0 00000100:00100000:0.0:1787826364.623162:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf39f82940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563673984:12345-192.168.203.39@tcp:16:lfs.0 Request processed in 176us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826364.623170:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1722 00000100:00100000:3.0:1787826364.657705:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826364.657789:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826364.657938:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826364.658002:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563674112 00000100:00100000:2.0:1787826364.658014:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563674112 00000100:00100000:2.0:1787826364.658078:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563674368 00000100:00100000:2.0:1787826364.658081:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563674368 00000100:00100000:2.0:1787826364.658101:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1723 00000100:00100000:2.0:1787826364.658113:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2404:x1874670563674112:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:2.0:1787826364.658173:0:30694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000026acacfd/0x22153cd396b7fe90 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.658196:0:30694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826364.658201:0:30694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826364.658208:0:30694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026acacfd/0x22153cd396b7fe90 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.658225:0:30694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026acacfd/0x22153cd396b7fe90 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.658265:0:30694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000026acacfd/0x22153cd396b7fe90 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.658275:0:30694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000026acacfd/0x22153cd396b7fe90 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.658290:0:30694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000026acacfd/0x22153cd396b7fe90 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.658299:0:30694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a832c00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826364.658303:0:30694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000026acacfd/0x22153cd396b7fe90 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.658314:0:30694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000026acacfd/0x22153cd396b7fe90 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.658331:0:30694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000026acacfd/0x22153cd396b7fe90 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.658340:0:30694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026acacfd/0x22153cd396b7fe90 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826364.658436:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2404:x1874670563674112:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 325us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826364.658445:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1723 00000100:00100000:2.0:1787826364.658468:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1724 00000100:00100000:2.0:1787826364.658530:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a988780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563674368:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:2.0:1787826364.658565:0:30694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006cf44f1d/0x22153cd396b7fe97 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.658579:0:30694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826364.658581:0:30694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826364.658586:0:30694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006cf44f1d/0x22153cd396b7fe97 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.658595:0:30694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006cf44f1d/0x22153cd396b7fe97 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.658609:0:30694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006cf44f1d/0x22153cd396b7fe97 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.658616:0:30694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006cf44f1d/0x22153cd396b7fe97 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.658623:0:30694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006cf44f1d/0x22153cd396b7fe97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.658629:0:30694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a832400 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826364.658632:0:30694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006cf44f1d/0x22153cd396b7fe97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.658639:0:30694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006cf44f1d/0x22153cd396b7fe97 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.658648:0:30694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006cf44f1d/0x22153cd396b7fe97 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.658656:0:30694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006cf44f1d/0x22153cd396b7fe97 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826364.658688:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a988780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563674368:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 161us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826364.658696:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1724 00000100:00100000:1.0:1787826364.659798:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563674240 00000100:00100000:1.0:1787826364.659811:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563674240 00000100:00100000:1.0:1787826364.659868:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1725 00000100:00100000:1.0:1787826364.659876:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2404:x1874670563674240:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:1.0:1787826364.659917:0:30695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000382351a4/0x22153cd396b7fe9e lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.659937:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826364.659942:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826364.659949:0:30695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000382351a4/0x22153cd396b7fe9e lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.659964:0:30695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000382351a4/0x22153cd396b7fe9e lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.659988:0:30695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000382351a4/0x22153cd396b7fe9e lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.660004:0:30695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000382351a4/0x22153cd396b7fe9e lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.660013:0:30695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000382351a4/0x22153cd396b7fe9e lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.660021:0:30695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834c00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:1.0:1787826364.660026:0:30695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000382351a4/0x22153cd396b7fe9e lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.660035:0:30695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000382351a4/0x22153cd396b7fe9e lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.660050:0:30695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000382351a4/0x22153cd396b7fe9e lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.660059:0:30695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000382351a4/0x22153cd396b7fe9e lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826364.660136:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2404:x1874670563674240:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 260us (2197us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826364.660145:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1725 00000100:00100000:2.0:1787826364.668960:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826364.669049:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563674624 00000100:00100000:1.0:1787826364.669062:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563674624 00000100:00100000:1.0:1787826364.669135:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3370 00000100:00100000:1.0:1787826364.669147:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf39f81a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:52416:x1874670563674624:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:1.0:1787826364.669269:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834c00/0x22153cd396b7fea5 lrc: 3/0,1 mode: --/PW res: [0x240000404:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.669292:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834c00/0x22153cd396b7fea5 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.669305:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834c00/0x22153cd396b7fea5 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826364.669459:0:32404:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008da33e0b reply state 0000000049e95cac transno 4294967611 ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834c00/0x22153cd396b7fea5 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.669685:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834c00/0x22153cd396b7fea5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.669696:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xc:0x0].0x0 (ffff90cf371d2100) 00010000:00010000:1.0:1787826364.669699:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826364.669703:0:32404:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826364.669864:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf39f81a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+29:52416:x1874670563674624:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 716us (916us total) trans 4294967611 rc 0/0 00000100:00100000:1.0:1787826364.669873:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3370 00000100:00100000:3.0:1787826364.679800:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826364.679922:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563674752 00000100:00100000:2.0:1787826364.679934:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563674752 00000100:00100000:2.0:1787826364.680050:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1726 00000100:00100000:2.0:1787826364.680063:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136cfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:52416:x1874670563674752:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826364.680088:0:30696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826364.680115:0:30696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006cf44f1d/0x22153cd396b7feac lrc: 2/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab02e5 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787826364.680150:0:30696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x23:0x0] initial LVB size: 3700000, mtime: 0x6a9010bd, atime: 0x0, ctime: 0x6a9010bd, blocks: 0x28 00010000:00010000:2.0:1787826364.680179:0:30696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=1310s v=(0 0) 00010000:00010000:2.0:1787826364.680184:0:30696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826364.680196:0:30696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006cf44f1d/0x22153cd396b7feac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02e5 expref: 11 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.680216:0:30696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006cf44f1d/0x22153cd396b7feac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02e5 expref: 11 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.680238:0:30696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a832400, rc 0) 00000100:00100000:2.0:1787826364.680315:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136cfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:52416:x1874670563674752:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 253us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826364.680323:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1726 00000100:00100000:3.0:1787826364.688464:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826364.688599:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826364.688860:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563674880 00000100:00100000:0.0:1787826364.688873:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563674880 00000100:00100000:0.0:1787826364.688939:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563675008 00000100:00100000:0.0:1787826364.688943:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563675008 00000100:00100000:0.0:1787826364.688972:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1727 00000100:00100000:0.0:1787826364.688984:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aad7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2403:x1874670563674880:12345-192.168.203.39@tcp:2:lfs.0 00002000:00010000:0.0:1787826364.689184:0:8545:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x21:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1787826364.689189:0:8545:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x21:0x0] updating lvb mtime from disk: 1787826365 -> 1787826364 00002000:00010000:0.0:1787826364.689192:0:8545:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x21:0x0] updating lvb atime from disk: 0 -> 1787826364 00002000:00010000:0.0:1787826364.689194:0:8545:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x21:0x0] updating lvb ctime from disk: 1787826365 -> 1787826365 00002000:00010000:0.0:1787826364.689196:0:8545:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x21:0x0] updating lvb blocks from disk: 64 -> 64 00000100:00100000:0.0:1787826364.689261:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aad7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563674880:12345-192.168.203.39@tcp:2:lfs.0 Request processed in 279us (830us total) trans 17179869578 rc 0/0 00000100:00100000:0.0:1787826364.689270:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1727 00000100:00100000:0.0:1787826364.689436:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1728 00000100:00100000:0.0:1787826364.689443:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136ced00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2403:x1874670563675008:12345-192.168.203.39@tcp:2:lfs.0 00002000:00010000:0.0:1787826364.689984:0:8545:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb size from disk: 3700000 -> 3700000 00002000:00010000:0.0:1787826364.689988:0:8545:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb mtime from disk: 1787826365 -> 1787826364 00002000:00010000:0.0:1787826364.689991:0:8545:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb atime from disk: 0 -> 1787826364 00002000:00010000:0.0:1787826364.689993:0:8545:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb ctime from disk: 1787826365 -> 1787826365 00002000:00010000:0.0:1787826364.689996:0:8545:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb blocks from disk: 40 -> 40 00000100:00100000:0.0:1787826364.690031:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136ced00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563675008:12345-192.168.203.39@tcp:2:lfs.0 Request processed in 587us (1431us total) trans 21474836902 rc 0/0 00000100:00100000:0.0:1787826364.690039:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1728 00000100:00100000:3.0:1787826364.692863:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826364.692979:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563675264 00000100:00100000:2.0:1787826364.692991:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563675264 00000100:00100000:2.0:1787826364.693059:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3371 00000100:00100000:2.0:1787826364.693068:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+29:52416:x1874670563675264:12345-192.168.203.39@tcp:55:lfs.0 00010000:00010000:2.0:1787826364.693155:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832c00/0x22153cd396b7feb3 lrc: 3/0,1 mode: --/PW res: [0x240000404:0xc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.693178:0:9966:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6400/0x22153cd396b7fe0b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02b4 expref: 29 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.693188:0:9966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832c00/0x22153cd396b7feb3 lrc: 4/0,1 mode: --/PW res: [0x240000404:0xc:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.693231:0:9966:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6400/0x22153cd396b7fe0b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02b4 expref: 29 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.693248:0:9966:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6400/0x22153cd396b7fe0b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02b4 expref: 29 pid: 6518 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826364.693265:0:9966:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf39f83840 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9966:1874670585168256:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826364.693369:0:9966:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce05f8e780 going to sleep for 11 seconds 00000100:00100000:3.0:1787826364.697299:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826364.697452:0:9966:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf39f83840 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9966:1874670585168256:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826364.697548:0:9966:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832c00/0x22153cd396b7feb3 lrc: 3/0,1 mode: --/PW res: [0x240000404:0xc:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826364.698263:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563675392 00000100:00100000:0.0:1787826364.698273:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563675392 00010000:00010000:0.0:1787826364.698323:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6400/0x22153cd396b7fe0b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02b4 expref: 30 pid: 6518 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826364.698415:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 925 00000100:00100000:0.0:1787826364.698427:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136cfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:2404:x1874670563675392:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826364.698446:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826364.698455:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6400/0x22153cd396b7fe0b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02b4 expref: 30 pid: 6518 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.698490:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6400/0x22153cd396b7fe0b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02b4 expref: 30 pid: 6518 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.698531:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6400/0x22153cd396b7fe0b lrc: 0/0,0 mode: --/PR res: [0x240000404:0xc:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02b4 expref: 30 pid: 6518 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.698561:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xc:0x0].0x0 (ffff90cf371d2100) 00010000:00010000:0.0:1787826364.698567:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832c00/0x22153cd396b7feb3 lrc: 3/0,1 mode: --/PW res: [0x240000404:0xc:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.698578:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832c00/0x22153cd396b7feb3 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0xc:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.698588:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832c00/0x22153cd396b7feb3 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0xc:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.698624:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826364.698722:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136cfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+29:2404:x1874670563675392:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 284us (1429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826364.698731:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 925 00010000:00010000:2.0:1787826364.698978:0:9966:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832c00/0x22153cd396b7feb3 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0xc:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.699959:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832c00/0x22153cd396b7feb3 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0xc:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.700021:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832c00/0x22153cd396b7feb3 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0xc:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.700030:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832c00/0x22153cd396b7feb3 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0xc:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.700038:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832c00/0x22153cd396b7feb3 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0xc:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.700045:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a832c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826364.700050:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832c00/0x22153cd396b7feb3 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0xc:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.700059:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832c00/0x22153cd396b7feb3 lrc: 4/0,0 mode: PW/PW res: [0x240000404:0xc:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.700074:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xc:0x0].0x0 (ffff90cf371d2100) 00010000:00010000:2.0:1787826364.700078:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787826364.700083:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832c00/0x22153cd396b7feb3 lrc: 2/0,0 mode: --/PW res: [0x240000404:0xc:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.700089:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a832c00/0x22153cd396b7feb3 lrc: 0/0,0 mode: --/PW res: [0x240000404:0xc:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826364.700192:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+28:52416:x1874670563675264:12345-192.168.203.39@tcp:55:lfs.0 Request processed in 7119us (7337us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787826364.700204:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3371 00000100:00100000:2.0:1787826364.702963:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826364.703159:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563675648 00000100:00100000:3.0:1787826364.703171:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563675648 00000100:00100000:3.0:1787826364.703247:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3372 00000100:00100000:3.0:1787826364.707693:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf39f83840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+28:52416:x1874670563675648:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:3.0:1787826364.707893:0:16564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826364.707935:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835200/0x22153cd396b7fda9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0283 expref: 28 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.707964:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:3.0:1787826364.707971:0:16564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826364.708059:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f1200/0x22153cd396b7feba lrc: 3/0,1 mode: --/PW res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.708079:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f1200/0x22153cd396b7feba lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.708092:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f1200/0x22153cd396b7feba lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826364.708684:0:16564:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cd5ec160 reply state 00000000a1117415 transno 4294967612 ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f1200/0x22153cd396b7feba lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.708702:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f1200/0x22153cd396b7feba lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.709024:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:3.0:1787826364.709028:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826364.709032:0:16564:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826364.709187:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf39f83840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+29:52416:x1874670563675648:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 5927us (6235us total) trans 4294967612 rc 0/0 00000100:00100000:3.0:1787826364.709198:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3372 00000100:00100000:1.0:1787826364.714644:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826364.716880:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563675776 00000100:00100000:0.0:1787826364.716900:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563675776 00000100:00100000:1.0:1787826364.718652:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1729 00000100:00100000:1.0:1787826364.718678:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb95e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:52416:x1874670563675776:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826364.718701:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826364.718723:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000159f1fa4/0x22153cd396b7fec1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab02ec expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.718769:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009ada17ba/0x22153cd396b7fdef lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab029f expref: 13 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.718792:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826364.718798:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826364.718804:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000159f1fa4/0x22153cd396b7fec1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02ec expref: 13 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.718849:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009ada17ba/0x22153cd396b7fdef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab029f expref: 13 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.718865:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009ada17ba/0x22153cd396b7fdef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab029f expref: 13 pid: 8437 timeout: 1410 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826364.718890:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3fb961c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1874670585168384:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826364.719224:0:8437:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce06a86900 going to sleep for 11 seconds 00000100:00100000:2.0:1787826364.722107:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3fb961c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1874670585168384:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826364.722155:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000159f1fa4/0x22153cd396b7fec1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02ec expref: 13 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.722184:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835800, rc 0) 00000100:00100000:2.0:1787826364.722253:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb95e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:52416:x1874670563675776:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 3588us (7623us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826364.722265:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1729 00000100:00100000:2.0:1787826364.723653:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826364.723937:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563675904 00000100:00100000:1.0:1787826364.723948:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563675904 00010000:00010000:1.0:1787826364.724006:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009ada17ba/0x22153cd396b7fdef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab029f expref: 13 pid: 8437 timeout: 1410 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826364.724055:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 926 00000100:00100000:1.0:1787826364.724066:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf39f830c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2403:x1874670563675904:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826364.724085:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826364.724114:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009ada17ba/0x22153cd396b7fdef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab029f expref: 13 pid: 8437 timeout: 1410 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.724131:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009ada17ba/0x22153cd396b7fdef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab029f expref: 13 pid: 8437 timeout: 1410 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.724160:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ada17ba/0x22153cd396b7fdef lrc: 0/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab029f expref: 13 pid: 8437 timeout: 1410 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.724181:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826364.724187:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826364.724197:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000159f1fa4/0x22153cd396b7fec1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02ec expref: 12 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.724210:0:10340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000159f1fa4/0x22153cd396b7fec1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02ec expref: 12 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.724261:0:10340:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000159f1fa4/0x22153cd396b7fec1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02ec expref: 12 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826364.724279:0:10340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3fb961c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10340:1874670585168512:192.168.203.39@tcp:105: 00000100:00100000:1.0:1787826364.724386:0:10340:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce06a86cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826364.727775:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826364.727868:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563676032 00000100:00100000:2.0:1787826364.727879:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563676032 00000100:00100000:2.0:1787826364.727954:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1730 00000100:00100000:2.0:1787826364.727966:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06305680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:52416:x1874670563676032:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826364.727996:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826364.728020:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0f871e9/0x22153cd396b7fec8 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab02f3 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.728058:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000061e22549/0x22153cd396b7fdfd lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02a6 expref: 13 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.728069:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826364.728076:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826364.728082:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0f871e9/0x22153cd396b7fec8 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02f3 expref: 13 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.728122:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000061e22549/0x22153cd396b7fdfd lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02a6 expref: 13 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.728141:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000061e22549/0x22153cd396b7fdfd lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02a6 expref: 13 pid: 8437 timeout: 1410 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826364.728158:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf39f82580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1874670585168640:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826364.728252:0:8435:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce05f8e780 going to sleep for 11 seconds 00000100:00100000:3.0:1787826364.728391:0:10340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3fb961c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10340:1874670585168512:192.168.203.39@tcp:105: 00010000:00010000:3.0:1787826364.728416:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826364.728460:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf39f830c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563675904:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4394us (4818us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826364.728502:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 926 00000100:00100000:1.0:1787826364.732919:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826364.733384:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf39f82580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1874670585168640:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826364.733430:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b0f871e9/0x22153cd396b7fec8 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02f3 expref: 13 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.733457:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a832a00, rc 0) 00000100:00100000:2.0:1787826364.733588:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06305680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:52416:x1874670563676032:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 5623us (5824us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826364.733598:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1730 00000100:00100000:0.0:1787826364.733642:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563676160 00000100:00100000:0.0:1787826364.733651:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563676160 00010000:00010000:1.0:1787826364.733735:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000061e22549/0x22153cd396b7fdfd lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02a6 expref: 13 pid: 8437 timeout: 1410 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826364.733782:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 927 00000100:00100000:1.0:1787826364.733792:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06307840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2404:x1874670563676160:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826364.733809:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826364.733834:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000061e22549/0x22153cd396b7fdfd lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02a6 expref: 13 pid: 8437 timeout: 1410 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.733850:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000061e22549/0x22153cd396b7fdfd lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02a6 expref: 13 pid: 8437 timeout: 1410 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.733879:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061e22549/0x22153cd396b7fdfd lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02a6 expref: 13 pid: 8437 timeout: 1410 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.733896:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826364.733901:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826364.733910:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b0f871e9/0x22153cd396b7fec8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02f3 expref: 12 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.733923:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0f871e9/0x22153cd396b7fec8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02f3 expref: 12 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.733961:0:6503:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b0f871e9/0x22153cd396b7fec8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02f3 expref: 12 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826364.733983:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce049bb0c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6503:1874670585168768:192.168.203.39@tcp:105: 00000100:00100000:1.0:1787826364.734047:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce06a863c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826364.736441:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826364.736542:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563676288 00000100:00100000:3.0:1787826364.736552:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563676288 00000100:00100000:3.0:1787826364.736616:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1731 00000100:00100000:3.0:1787826364.736626:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049bbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:52416:x1874670563676288:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826364.736648:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826364.736671:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8d36182/0x22153cd396b7fecf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab02fa expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.736720:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000944f0deb/0x22153cd396b7fdf6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02ad expref: 13 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.736730:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826364.736736:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826364.736742:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8d36182/0x22153cd396b7fecf lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02fa expref: 13 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.736794:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000944f0deb/0x22153cd396b7fdf6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02ad expref: 13 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.736811:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000944f0deb/0x22153cd396b7fdf6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02ad expref: 13 pid: 8437 timeout: 1410 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826364.736828:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3fb961c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1874670585168896:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826364.737009:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3aaf59c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826364.739166:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce049bb0c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6503:1874670585168768:192.168.203.39@tcp:105: 00010000:00010000:2.0:1787826364.739202:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826364.739445:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06307840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563676160:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5652us (6539us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826364.739458:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 927 00000100:00100000:3.0:1787826364.740994:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3fb961c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1874670585168896:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826364.741039:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e8d36182/0x22153cd396b7fecf lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02fa expref: 13 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.741067:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf181f0200, rc 0) 00000100:00100000:3.0:1787826364.741189:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049bbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:52416:x1874670563676288:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 4562us (4757us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826364.741199:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1731 00000100:00100000:2.0:1787826364.741219:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00010000:00010000:1.0:1787826364.741231:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826364.741438:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563676416 00000100:00100000:0.0:1787826364.741446:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563676416 00010000:00010000:0.0:1787826364.741501:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000944f0deb/0x22153cd396b7fdf6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02ad expref: 13 pid: 8437 timeout: 1410 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826364.741592:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 928 00000100:00100000:0.0:1787826364.741604:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf39f82580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2403:x1874670563676416:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826364.741621:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826364.741649:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000944f0deb/0x22153cd396b7fdf6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02ad expref: 13 pid: 8437 timeout: 1410 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.741669:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000944f0deb/0x22153cd396b7fdf6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02ad expref: 13 pid: 8437 timeout: 1410 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.741696:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000944f0deb/0x22153cd396b7fdf6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02ad expref: 13 pid: 8437 timeout: 1410 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.741723:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826364.741729:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826364.741737:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e8d36182/0x22153cd396b7fecf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02fa expref: 12 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.741750:0:10341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8d36182/0x22153cd396b7fecf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02fa expref: 12 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.741793:0:10341:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e8d36182/0x22153cd396b7fecf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02fa expref: 12 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826364.741815:0:10341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf1ecac3c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10341:1874670585169024:192.168.203.39@tcp:105: 00000100:00100000:0.0:1787826364.741888:0:10341:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a2f840 going to sleep for 11 seconds 00000100:00100000:2.0:1787826364.743519:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826364.743641:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826364.743707:0:10341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf1ecac3c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10341:1874670585169024:192.168.203.39@tcp:105: 00010000:00010000:0.0:1787826364.743732:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826364.743784:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf39f82580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563676416:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 2182us (2567us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826364.743795:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 928 00000100:00100000:2.0:1787826364.744144:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826364.744199:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563676672 00000100:00100000:3.0:1787826364.744206:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563676672 00000100:00100000:1.0:1787826364.744257:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563676544 00000100:00100000:1.0:1787826364.744262:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563676544 00000100:00100000:1.0:1787826364.744305:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1732 00000100:00100000:1.0:1787826364.744315:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf39f82d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563676672:12345-192.168.203.39@tcp:2:lfs.0 00000100:00100000:0.0:1787826364.744341:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1733 00000100:00100000:0.0:1787826364.744353:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf39f81e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563676544:12345-192.168.203.39@tcp:2:lfs.0 00002000:00010000:0.0:1787826364.744530:0:8545:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1787826364.744530:0:14864:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1787826364.744546:0:14864:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb mtime from disk: 1787826364 -> 1787826364 00002000:00010000:0.0:1787826364.744547:0:8545:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb mtime from disk: 1787826364 -> 1787826364 00002000:00010000:0.0:1787826364.744553:0:8545:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb atime from disk: 0 -> 1787826364 00002000:00010000:1.0:1787826364.744553:0:14864:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb atime from disk: 0 -> 1787826364 00002000:00010000:0.0:1787826364.744560:0:8545:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb ctime from disk: 1787826364 -> 1787826365 00002000:00010000:1.0:1787826364.744560:0:14864:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb ctime from disk: 1787826364 -> 1787826365 00002000:00010000:0.0:1787826364.744568:0:8545:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb blocks from disk: 8 -> 8 00002000:00010000:1.0:1787826364.744568:0:14864:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb blocks from disk: 32 -> 32 00000100:00100000:1.0:1787826364.744624:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf39f82d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2404:x1874670563676672:12345-192.168.203.39@tcp:2:lfs.0 Request processed in 304us (1111us total) trans 17179869579 rc 0/0 00000100:00100000:1.0:1787826364.744633:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1732 00000100:00100000:3.0:1787826364.744750:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563676800 00000100:00100000:3.0:1787826364.744754:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563676800 00000100:00100000:3.0:1787826364.744782:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1734 00000100:00100000:3.0:1787826364.744800:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf39f83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563676800:12345-192.168.203.39@tcp:2:lfs.0 00002000:00010000:3.0:1787826364.744867:0:30694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 1602848 -> 1602848 00002000:00010000:3.0:1787826364.744871:0:30694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1787826364 -> 1787826364 00002000:00010000:3.0:1787826364.744873:0:30694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787826364 00002000:00010000:3.0:1787826364.744875:0:30694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787826364 -> 1787826365 00002000:00010000:3.0:1787826364.744877:0:30694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 56 -> 56 00000100:00100000:0.0:1787826364.745354:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf39f81e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2403:x1874670563676544:12345-192.168.203.39@tcp:2:lfs.0 Request processed in 1001us (1709us total) trans 21474836903 rc 0/0 00000100:00100000:0.0:1787826364.745364:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1733 00000100:00100000:3.0:1787826364.745446:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf39f83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563676800:12345-192.168.203.39@tcp:2:lfs.0 Request processed in 647us (1301us total) trans 21474836904 rc 0/0 00000100:00100000:3.0:1787826364.745455:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1734 00000100:00100000:1.0:1787826364.748637:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826364.748936:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563677056 00000100:00100000:0.0:1787826364.748956:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563677056 00000100:00100000:0.0:1787826364.749054:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 986 00000100:00100000:0.0:1787826364.749074:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+29:52416:x1874670563677056:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:0.0:1787826364.749342:0:6521:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x240000404:0x9:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6600/0x22153cd396b7fdcc lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x9:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0298 expref: 29 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.749427:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b7fed6 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.749442:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b7fc9f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0221 expref: 29 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.749459:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661200/0x22153cd396b7fcfa lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab024b expref: 29 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.749468:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835400/0x22153cd396b7fd55 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0267 expref: 29 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.749650:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b7fed6 lrc: 6/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.749690:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835400/0x22153cd396b7fd55 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0267 expref: 29 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.749705:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835400/0x22153cd396b7fd55 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0267 expref: 29 pid: 6519 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826364.749778:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf1ecac3c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6521:1874670585169152:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826364.749970:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661200/0x22153cd396b7fcfa lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab024b expref: 29 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.749981:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661200/0x22153cd396b7fcfa lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab024b expref: 29 pid: 6519 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826364.749997:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf1ecaf840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6521:1874670585169280:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826364.750024:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b7fc9f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0221 expref: 29 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.750033:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b7fc9f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0221 expref: 29 pid: 16564 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826364.750041:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf1ecada40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6521:1874670585169408:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826364.750057:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a2f840 going to sleep for 11 seconds 00000100:00100000:2.0:1787826364.752105:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826364.752130:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf1ecac3c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6521:1874670585169152:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826364.752144:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf1ecaf840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6521:1874670585169280:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826364.752146:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826364.752218:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563677440 00000100:00100000:1.0:1787826364.752227:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563677440 00000100:00100000:3.0:1787826364.752258:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563677312 00000100:00100000:3.0:1787826364.752263:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563677312 00010000:00010000:3.0:1787826364.752291:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661200/0x22153cd396b7fcfa lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab024b expref: 31 pid: 6519 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826364.752296:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 987 00000100:00100000:1.0:1787826364.752307:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf39f80780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:49796:x1874670563677440:12345-192.168.203.39@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787826364.752547:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 929 00000100:00100000:3.0:1787826364.752555:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf39f83c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+32:2401:x1874670563677312:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826364.752569:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826364.752577:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661200/0x22153cd396b7fcfa lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab024b expref: 32 pid: 6519 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.752590:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661200/0x22153cd396b7fcfa lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab024b expref: 32 pid: 6519 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.752615:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661200/0x22153cd396b7fcfa lrc: 0/0,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab024b expref: 32 pid: 6519 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.752633:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:3.0:1787826364.752639:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b7fed6 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.752649:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b7fed6 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826364.752652:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf39f80780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:49796:x1874670563677440:12345-192.168.203.39@tcp:35:ldlm_bl.0 Request processed in 346us (559us total) trans 4294967613 rc 0/0 00010000:00010000:3.0:1787826364.752657:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826364.752660:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 987 00000100:00100000:3.0:1787826364.752676:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf39f83c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:2401:x1874670563677312:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 123us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826364.752683:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 929 00000100:00100000:0.0:1787826364.753307:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf1ecada40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6521:1874670585169408:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826364.753345:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b7fed6 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826364.753665:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826364.753867:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563677568 00000100:00100000:3.0:1787826364.753874:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563677568 00010000:00010000:3.0:1787826364.753903:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b7fc9f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0221 expref: 30 pid: 16564 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826364.753938:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 930 00000100:00100000:3.0:1787826364.753946:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf39f80f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:2403:x1874670563677568:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826364.753961:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826364.753967:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b7fc9f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0221 expref: 30 pid: 16564 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.753979:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b7fc9f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0221 expref: 30 pid: 16564 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.753997:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b7fc9f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0221 expref: 30 pid: 16564 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.754011:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:3.0:1787826364.754016:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b7fed6 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.754024:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b7fed6 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.754030:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826364.754073:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf39f80f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+29:2403:x1874670563677568:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 128us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826364.754081:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 930 00000100:00100000:1.0:1787826364.755170:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826364.755269:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563677696 00000100:00100000:0.0:1787826364.755274:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563677696 00010000:00010000:0.0:1787826364.755299:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835400/0x22153cd396b7fd55 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0267 expref: 29 pid: 6519 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826364.755327:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 931 00000100:00100000:0.0:1787826364.755336:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf2063e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+29:2403:x1874670563677696:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826364.755356:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826364.755364:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835400/0x22153cd396b7fd55 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0267 expref: 29 pid: 6519 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.755376:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835400/0x22153cd396b7fd55 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0267 expref: 29 pid: 6519 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.755407:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835400/0x22153cd396b7fd55 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0267 expref: 29 pid: 6519 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.755423:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:0.0:1787826364.755428:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b7fed6 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.755438:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b7fed6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.755447:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b7fed6 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.755592:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b7fed6 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.755601:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b7fed6 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.755628:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f0000/0x22153cd396b7fedd lrc: 3/0,1 mode: --/EX res: [0x240000404:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.755640:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f0800/0x22153cd396b7fe6d lrc: 2/0,0 mode: CR/CR res: [0x240000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02d0 expref: 28 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.755649:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f0000/0x22153cd396b7fedd lrc: 4/0,1 mode: --/EX res: [0x240000404:0xc:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.755687:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f0800/0x22153cd396b7fe6d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02d0 expref: 28 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.755703:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f0800/0x22153cd396b7fe6d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02d0 expref: 28 pid: 6519 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.755942:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826364.756039:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3fb961c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6521:1874670585169536:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826364.756105:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf2063e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+28:2403:x1874670563677696:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 770us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826364.756113:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 931 00000100:00100000:3.0:1787826364.756233:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3aaf59c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826364.758943:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826364.759002:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3fb961c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6521:1874670585169536:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826364.759037:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f0000/0x22153cd396b7fedd lrc: 3/0,1 mode: --/EX res: [0x240000404:0xc:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826364.759218:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563677824 00000100:00100000:0.0:1787826364.759226:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563677824 00010000:00010000:0.0:1787826364.759271:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f0800/0x22153cd396b7fe6d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02d0 expref: 28 pid: 6519 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826364.759348:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 932 00000100:00100000:0.0:1787826364.759360:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf39f80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+28:2403:x1874670563677824:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826364.759380:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826364.759398:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f0800/0x22153cd396b7fe6d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02d0 expref: 28 pid: 6519 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.759413:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f0800/0x22153cd396b7fe6d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02d0 expref: 28 pid: 6519 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.759442:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f0800/0x22153cd396b7fe6d lrc: 0/0,0 mode: --/CR res: [0x240000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02d0 expref: 28 pid: 6519 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.759464:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xc:0x0].0x0 (ffff90cf371d2100) 00010000:00010000:0.0:1787826364.759589:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f0000/0x22153cd396b7fedd lrc: 3/0,1 mode: --/EX res: [0x240000404:0xc:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.759606:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f0000/0x22153cd396b7fedd lrc: 3/0,1 mode: EX/EX res: [0x240000404:0xc:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.759615:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f0000/0x22153cd396b7fedd lrc: 4/0,1 mode: EX/EX res: [0x240000404:0xc:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.759655:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826364.759701:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f0000/0x22153cd396b7fedd lrc: 3/0,1 mode: EX/EX res: [0x240000404:0xc:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826364.759713:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf39f80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:2403:x1874670563677824:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 354us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826364.759722:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 932 00010000:00010000:3.0:1787826364.759731:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f0000/0x22153cd396b7fedd lrc: 3/0,1 mode: EX/EX res: [0x240000404:0xc:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826364.760132:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3fb961c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6521:1874670585169664:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787826364.760216:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826364.760241:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3aaf5cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826364.760342:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585169664 00000100:00100000:1.0:1787826364.760349:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585169664 00000100:00100000:1.0:1787826364.760461:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1352 00000100:00100000:1.0:1787826364.760579:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f806580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:6521:x1874670585169664:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:0.0:1787826364.760596:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826364.760752:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f806580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:6521:x1874670585169664:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 282us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826364.760760:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1352 00000100:00100000:3.0:1787826364.760967:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3fb961c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6521:1874670585169664:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787826364.761040:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3fb961c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6521:1874670585169792:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787826364.761072:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826364.761105:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a13f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826364.761269:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585169792 00000100:00100000:0.0:1787826364.761275:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585169792 00000100:00100000:0.0:1787826364.761331:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1353 00000100:00100000:0.0:1787826364.761340:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf2f45de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:6521:x1874670585169792:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787826364.761635:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf2f45de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:6521:x1874670585169792:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 295us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826364.761642:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1353 00000100:00080000:1.0:1787826364.761729:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826364.761976:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3fb961c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6521:1874670585169792:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787826364.762036:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf2f45e580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6521:1874670585169920:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787826364.762069:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826364.762174:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a04540 going to sleep for 11 seconds 00000100:00100000:1.0:1787826364.762336:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585169920 00000100:00100000:1.0:1787826364.762342:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585169920 00000100:00100000:1.0:1787826364.762429:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1354 00000100:00100000:1.0:1787826364.762438:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf2f45ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:6521:x1874670585169920:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787826364.762565:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf2f45ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:6521:x1874670585169920:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 128us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826364.762573:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1354 00000100:00100000:3.0:1787826364.762644:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf2f45e580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6521:1874670585169920:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787826364.762691:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf2f45e580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6521:1874670585170048:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787826364.762736:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826364.763225:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a18c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826364.763336:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585170048 00000100:00100000:2.0:1787826364.763342:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585170048 00000100:00100000:2.0:1787826364.763389:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1355 00000100:00100000:2.0:1787826364.763397:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:6521:x1874670585170048:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787826364.763564:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:6521:x1874670585170048:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 167us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826364.763572:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1355 00000100:00100000:3.0:1787826364.763902:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf2f45e580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6521:1874670585170048:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787826364.763964:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf2f45e580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6521:1874670585170176:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787826364.763996:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826364.764020:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a13f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826364.764032:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585170176 00000100:00100000:1.0:1787826364.764039:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585170176 00000100:00100000:2.0:1787826364.764072:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1356 00000100:00100000:2.0:1787826364.764082:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8fbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:6521:x1874670585170176:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787826364.764183:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8fbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:6521:x1874670585170176:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 103us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826364.764190:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1356 00000100:00100000:3.0:1787826364.764369:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf2f45e580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6521:1874670585170176:0@lo:1000:mdt_rdpg00_000.0 00000040:00080000:3.0:1787826364.764633:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].18, 552 off51664 00000001:00080000:3.0:1787826364.764651:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967614 00000100:00100000:3.0:1787826364.764732:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf2f45e580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6521:1874670585170304:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787826364.764952:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826364.764969:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3aaf59c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826364.765027:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585170304 00000100:00100000:1.0:1787826364.765032:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585170304 00000100:00100000:1.0:1787826364.765055:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1357 00000100:00100000:1.0:1787826364.765063:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03aef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:6521:x1874670585170304:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787826364.765185:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03aef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6521:x1874670585170304:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 123us (233us total) trans 17179869580 rc 0/0 00000100:00100000:1.0:1787826364.765193:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1357 00000100:00100000:3.0:1787826364.765300:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf2f45e580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6521:1874670585170304:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787826364.765329:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce04f052c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6521:1874670585170432:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787826364.765368:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826364.765387:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a04540 going to sleep for 11 seconds 00000100:00100000:1.0:1787826364.765501:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585170432 00000100:00100000:1.0:1787826364.765505:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585170432 00000100:00100000:1.0:1787826364.765526:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1358 00000100:00100000:1.0:1787826364.765542:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf07966d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:6521:x1874670585170432:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787826364.765665:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf07966d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6521:x1874670585170432:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 132us (295us total) trans 21474836905 rc 0/0 00000100:00100000:1.0:1787826364.765672:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1358 00000100:00100000:3.0:1787826364.766056:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce04f052c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6521:1874670585170432:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787826364.766124:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967615 00010000:00010000:3.0:1787826364.766152:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f0000/0x22153cd396b7fedd lrc: 3/0,1 mode: EX/EX res: [0x240000404:0xc:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.766173:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f0000/0x22153cd396b7fedd lrc: 2/0,0 mode: EX/EX res: [0x240000404:0xc:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.766187:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f0000/0x22153cd396b7fedd lrc: 3/0,0 mode: EX/EX res: [0x240000404:0xc:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.766194:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf181f0000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826364.766198:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f0000/0x22153cd396b7fedd lrc: 3/0,0 mode: EX/EX res: [0x240000404:0xc:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.766207:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f0000/0x22153cd396b7fedd lrc: 4/0,0 mode: EX/EX res: [0x240000404:0xc:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.766226:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xc:0x0].0x0 (ffff90cf371d2100) 00010000:00010000:3.0:1787826364.766230:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787826364.766235:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f0000/0x22153cd396b7fedd lrc: 2/0,0 mode: --/EX res: [0x240000404:0xc:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.766242:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f0000/0x22153cd396b7fedd lrc: 0/0,0 mode: --/EX res: [0x240000404:0xc:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.766259:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b7fed6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.766266:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b7fed6 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.766272:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b7fed6 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.766277:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05660a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826364.766280:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b7fed6 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.766290:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b7fed6 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.766298:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:3.0:1787826364.766300:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787826364.766303:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b7fed6 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.766309:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b7fed6 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.766321:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:3.0:1787826364.766323:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787826364.766330:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6600/0x22153cd396b7fdcc lrc: 0/0,0 mode: --/PW res: [0x240000404:0x9:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0298 expref: 29 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826364.766997:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+28:52416:x1874670563677056:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 17931us (18382us total) trans 4294967616 rc 0/0 00000100:00100000:3.0:1787826364.767008:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 986 00000020:00080000:3.0:1787826364.767012:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1787826364.769812:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826364.769894:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563677952 00000100:00100000:0.0:1787826364.769908:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563677952 00000100:00100000:0.0:1787826364.769984:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3373 00000100:00100000:0.0:1787826364.769996:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf39f821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+28:52416:x1874670563677952:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826364.770027:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826364.770054:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660800/0x22153cd396b7fee4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0301 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.770126:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660800/0x22153cd396b7fee4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0301 expref: 29 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.770143:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660800/0x22153cd396b7fee4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0301 expref: 29 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.770177:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:0.0:1787826364.770180:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826364.770185:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05660800, rc 0) 00000100:00100000:0.0:1787826364.770521:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf39f821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+29:52416:x1874670563677952:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 525us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826364.770530:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3373 00000100:00100000:2.0:1787826364.773374:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826364.773451:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563678208 00000100:00100000:1.0:1787826364.773462:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563678208 00000100:00100000:1.0:1787826364.773569:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 988 00000100:00100000:1.0:1787826364.773580:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf39f81680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+29:52416:x1874670563678208:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:1.0:1787826364.774186:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf39f81680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:52416:x1874670563678208:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 606us (823us total) trans 4294967617 rc 0/0 00000100:00100000:1.0:1787826364.774197:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 988 00000100:00100000:1.0:1787826364.777661:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826364.777908:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563678464 00000100:00100000:3.0:1787826364.777920:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563678464 00000100:00100000:3.0:1787826364.778040:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 989 00000100:00100000:3.0:1787826364.778052:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf10476c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:52416:x1874670563678464:12345-192.168.203.39@tcp:35:lfs.0 00000004:00080000:3.0:1787826364.778321:0:6521:0:(mdd_object.c:4014:mdd_close()) Object [0x240000404:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:3.0:1787826364.778427:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f1e00/0x22153cd396b7feeb lrc: 3/0,1 mode: --/PW res: [0x240000404:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.778453:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f1e00/0x22153cd396b7feeb lrc: 3/0,1 mode: PW/PW res: [0x240000404:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.778467:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f1e00/0x22153cd396b7feeb lrc: 3/0,1 mode: PW/PW res: [0x240000404:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.778514:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f1e00/0x22153cd396b7feeb lrc: 4/0,1 mode: PW/PW res: [0x240000404:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.778521:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f1e00/0x22153cd396b7feeb lrc: 4/0,1 mode: PW/PW res: [0x240000404:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.778529:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f1e00/0x22153cd396b7feeb lrc: 3/0,0 mode: PW/PW res: [0x240000404:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.778563:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787826364.778673:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf10476c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:52416:x1874670563678464:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 621us (1024us total) trans 4294967618 rc 0/0 00000100:00100000:3.0:1787826364.778688:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 989 00010000:00010000:2.0:1787826364.779037:0:7460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826364.779047:0:7460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f1e00/0x22153cd396b7feeb lrc: 2/0,0 mode: PW/PW res: [0x240000404:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.779056:0:7460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf181f1e00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826364.779061:0:7460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f1e00/0x22153cd396b7feeb lrc: 2/0,0 mode: PW/PW res: [0x240000404:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.779071:0:7460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f1e00/0x22153cd396b7feeb lrc: 3/0,0 mode: PW/PW res: [0x240000404:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.779088:0:7460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xc:0x0].0x0 (ffff90cf371d2100) 00010000:00010000:2.0:1787826364.779093:0:7460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787826364.779098:0:7460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f1e00/0x22153cd396b7feeb lrc: 1/0,0 mode: --/PW res: [0x240000404:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.779104:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f1e00/0x22153cd396b7feeb lrc: 0/0,0 mode: --/PW res: [0x240000404:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.779119:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826364.779121:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826364.779123:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826364.810802:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826364.811318:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563678720 00000100:00100000:1.0:1787826364.811331:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563678720 00000100:00100000:1.0:1787826364.811427:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3374 00000100:00100000:1.0:1787826364.811439:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf39f80b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:52417:x1874670563678720:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826364.811500:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826364.811530:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834600/0x22153cd396b7fef2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0308 expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.811646:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835e00/0x22153cd396b7fef9 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.811665:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835e00/0x22153cd396b7fef9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.811679:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835e00/0x22153cd396b7fef9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.811696:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835600/0x22153cd396b7ff00 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.811703:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835600/0x22153cd396b7ff00 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.811709:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835600/0x22153cd396b7ff00 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.812065:0:32404:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835e00/0x22153cd396b7fef9 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.812074:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835e00/0x22153cd396b7fef9 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.812080:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835e00/0x22153cd396b7fef9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.812088:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835e00/0x22153cd396b7fef9 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.812094:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835e00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826364.812099:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835e00/0x22153cd396b7fef9 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.812108:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835e00/0x22153cd396b7fef9 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.812122:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x0 (ffff90cf1988e500) 00010000:00010000:1.0:1787826364.812125:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826364.812131:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835e00/0x22153cd396b7fef9 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.812138:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835e00/0x22153cd396b7fef9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.812153:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835600/0x22153cd396b7ff00 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.812160:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835600/0x22153cd396b7ff00 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.812166:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835600/0x22153cd396b7ff00 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.812171:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826364.812174:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835600/0x22153cd396b7ff00 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.812180:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835600/0x22153cd396b7ff00 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.812187:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x5675640f (ffff90cf04f8b400) 00010000:00010000:1.0:1787826364.812189:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826364.812193:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835600/0x22153cd396b7ff00 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.812199:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835600/0x22153cd396b7ff00 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.812239:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834600/0x22153cd396b7fef2 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0308 expref: 32 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.812257:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x0 (ffff90cf1988e500) 00010000:00010000:1.0:1787826364.812260:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787826364.812263:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834600/0x22153cd396b7fef2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0308 expref: 32 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.812274:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834600, rc 0) 00000100:00100000:1.0:1787826364.814263:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf39f80b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:52417:x1874670563678720:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 2809us (5495us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826364.814277:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3374 00000100:00100000:1.0:1787826364.822515:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826364.823040:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563678976 00000100:00100000:2.0:1787826364.823053:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563678976 00000100:00100000:2.0:1787826364.823192:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3375 00000100:00100000:2.0:1787826364.823205:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:52417:x1874670563678976:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826364.823232:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826364.827804:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a833800/0x22153cd396b7ff07 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab030f expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826364.828417:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0x8:0x0]: returning size 4096 00010000:00010000:2.0:1787826364.828576:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a833800/0x22153cd396b7ff07 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab030f expref: 33 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.829971:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cf39e67d00) 00010000:00010000:2.0:1787826364.829976:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787826364.829985:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a833800/0x22153cd396b7ff07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab030f expref: 33 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.830946:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a833800, rc 0) 00000100:00100000:2.0:1787826364.831169:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+32:52417:x1874670563678976:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 7963us (8711us total) trans 4294967619 rc 301/301 00000100:00100000:2.0:1787826364.831178:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3375 00000100:00100000:2.0:1787826364.840835:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826364.841305:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563679104 00000100:00100000:3.0:1787826364.841316:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563679104 00000100:00100000:3.0:1787826364.841380:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3376 00000100:00100000:3.0:1787826364.841390:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf39f812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+32:52417:x1874670563679104:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:3.0:1787826364.841466:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f0000/0x22153cd396b7ff15 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.841508:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f0000/0x22153cd396b7ff15 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.841520:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f0000/0x22153cd396b7ff15 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.841546:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f0a00/0x22153cd396b7ff1c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.841553:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f0a00/0x22153cd396b7ff1c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.841559:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f0a00/0x22153cd396b7ff1c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.841640:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f0400/0x22153cd396b7ff23 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.841649:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f0400/0x22153cd396b7ff23 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.841656:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f0400/0x22153cd396b7ff23 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826364.841694:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0x9:0x0]: returning size 3700000 00000004:00200000:3.0:1787826364.841698:0:16564:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826364.841709:0:16564:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f0400/0x22153cd396b7ff23 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.841721:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f0000/0x22153cd396b7ff15 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.841728:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f0000/0x22153cd396b7ff15 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.841734:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f0000/0x22153cd396b7ff15 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.841743:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf181f0000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826364.841747:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f0000/0x22153cd396b7ff15 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.841754:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f0000/0x22153cd396b7ff15 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.841765:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x0 (ffff90cf1988e500) 00010000:00010000:3.0:1787826364.841768:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826364.841772:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f0000/0x22153cd396b7ff15 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.841777:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f0000/0x22153cd396b7ff15 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.841791:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f0a00/0x22153cd396b7ff1c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.841796:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f0a00/0x22153cd396b7ff1c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.841803:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f0a00/0x22153cd396b7ff1c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.841808:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf181f0a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826364.841811:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f0a00/0x22153cd396b7ff1c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.841816:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f0a00/0x22153cd396b7ff1c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.842146:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x5675640f (ffff90cf39656000) 00010000:00010000:3.0:1787826364.842149:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826364.842153:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f0a00/0x22153cd396b7ff1c lrc: 2/0,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.842159:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f0a00/0x22153cd396b7ff1c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.842175:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f0400/0x22153cd396b7ff23 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.842181:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f0400/0x22153cd396b7ff23 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.842186:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f0400/0x22153cd396b7ff23 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.842191:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf181f0400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826364.842193:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f0400/0x22153cd396b7ff23 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.842199:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f0400/0x22153cd396b7ff23 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.842207:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:3.0:1787826364.842209:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826364.842212:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f0400/0x22153cd396b7ff23 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.842218:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f0400/0x22153cd396b7ff23 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826364.842299:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf39f812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+32:52417:x1874670563679104:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 909us (1482us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826364.842308:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3376 00000100:00100000:1.0:1787826364.845097:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826364.845225:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563679360 00000100:00100000:0.0:1787826364.845235:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563679360 00000100:00100000:0.0:1787826364.845288:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 990 00000100:00100000:0.0:1787826364.845298:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+32:52417:x1874670563679360:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:0.0:1787826364.845546:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:52417:x1874670563679360:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 249us (456us total) trans 4294967620 rc 0/0 00000100:00100000:0.0:1787826364.845556:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 990 00000100:00100000:1.0:1787826364.894705:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826364.894867:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563679616 00000100:00100000:0.0:1787826364.894878:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563679616 00000100:00100000:0.0:1787826364.894940:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3377 00000100:00100000:0.0:1787826364.894951:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:52421:x1874670563679616:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826364.894977:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826364.894998:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661e00/0x22153cd396b7ff2a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0316 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.895083:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b7ff31 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.895098:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b7ff31 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.895109:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b7ff31 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.895123:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b7ff38 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.895130:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b7ff38 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.895136:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b7ff38 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.895245:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661200/0x22153cd396b7ff3f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.895254:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661200/0x22153cd396b7ff3f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.895261:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661200/0x22153cd396b7ff3f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826364.895270:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0x9:0x0]: returning size 3700000 00010000:00010000:0.0:1787826364.895346:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b7ff31 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.895354:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b7ff31 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.895360:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b7ff31 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.895366:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b7ff31 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.895372:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05660a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826364.895376:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b7ff31 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.895384:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b7ff31 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.895395:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x0 (ffff90cf1988e500) 00010000:00010000:0.0:1787826364.895399:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826364.895403:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b7ff31 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.895409:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b7ff31 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.895423:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b7ff38 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.895429:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b7ff38 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.895434:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b7ff38 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.895440:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05661000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826364.895442:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b7ff38 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.895448:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b7ff38 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.895456:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x5675640f (ffff90cf371d2700) 00010000:00010000:0.0:1787826364.895458:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826364.895461:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b7ff38 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.895467:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b7ff38 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.895586:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661e00/0x22153cd396b7ff2a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0316 expref: 36 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.895599:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661200/0x22153cd396b7ff3f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0316 expref: 35 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826364.895611:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:0.0:1787826364.895613:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826364.895616:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05661200, rc 0) 00000100:00100000:0.0:1787826364.895670:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:52421:x1874670563679616:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 721us (975us total) trans 4294967621 rc 0/0 00000100:00100000:0.0:1787826364.895677:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3377 00000100:00100000:3.0:1787826364.934351:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826364.934408:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826364.934504:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563679744 00000100:00100000:2.0:1787826364.934524:0:30172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563679872 00000100:00100000:1.0:1787826364.934543:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563679744 00000100:00100000:2.0:1787826364.934543:0:30172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563679872 00000100:00100000:2.0:1787826364.934622:0:30172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 664 00000100:00100000:2.0:1787826364.934633:0:30172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f9352c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2403:x1874670563679872:12345-192.168.203.39@tcp:3:lfs.0 00010000:00010000:2.0:1787826364.934668:0:30172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000107bd172/0x22153cd396b7ff4d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.934689:0:30172:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e8d36182/0x22153cd396b7fecf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02fa expref: 15 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.934699:0:30172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826364.934704:0:30172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826364.934709:0:30172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000107bd172/0x22153cd396b7ff4d lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.934747:0:30172:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e8d36182/0x22153cd396b7fecf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02fa expref: 15 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826364.934759:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 665 00000100:00100000:1.0:1787826364.934773:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f934780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2402:x1874670563679744:12345-192.168.203.39@tcp:3:lfs.0 00010000:00010000:2.0:1787826364.934776:0:30172:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e8d36182/0x22153cd396b7fecf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02fa expref: 15 pid: 8436 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826364.934793:0:30172:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf39f803c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0000_UUID:30172:1874670585170560:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826364.934796:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b7ff54 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.934811:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000159f1fa4/0x22153cd396b7fec1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02ec expref: 15 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.934819:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826364.934822:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(1 0) 00000100:00100000:2.0:1787826364.934877:0:30172:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce05f8e780 going to sleep for 11 seconds 00010000:00010000:1.0:1787826364.934897:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b7ff54 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.934927:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000159f1fa4/0x22153cd396b7fec1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02ec expref: 15 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.934937:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000159f1fa4/0x22153cd396b7fec1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02ec expref: 15 pid: 8437 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826364.934948:0:8441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f82f0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0000_UUID:8441:1874670585170688:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826364.934976:0:8441:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce06a86f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787826364.935177:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826364.935563:0:14865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563680000 00000100:00100000:2.0:1787826364.935570:0:14865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563680000 00000100:00100000:2.0:1787826364.935615:0:14865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 666 00000100:00100000:2.0:1787826364.935623:0:14865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f937840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2404:x1874670563680000:12345-192.168.203.39@tcp:3:lfs.0 00010000:00010000:2.0:1787826364.935646:0:14865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000be58304c/0x22153cd396b7ff5b lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.935661:0:14865:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b0f871e9/0x22153cd396b7fec8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02f3 expref: 13 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.935670:0:14865:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826364.935674:0:14865:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x20:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826364.935678:0:14865:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be58304c/0x22153cd396b7ff5b lrc: 4/1,0 mode: --/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.935703:0:14865:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b0f871e9/0x22153cd396b7fec8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02f3 expref: 13 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.935927:0:14865:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b0f871e9/0x22153cd396b7fec8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02f3 expref: 13 pid: 8435 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826364.935942:0:14865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf39f80780 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:14865:1874670585170816:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826364.935999:0:14865:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf09f680c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826364.940892:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826364.941007:0:30173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563680128 00000100:00100000:2.0:1787826364.941017:0:30173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563680128 00000100:00100000:2.0:1787826364.941085:0:30173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 667 00000100:00100000:2.0:1787826364.941096:0:30173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecada40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2404:x1874670563680128:12345-192.168.203.39@tcp:3:lfs.0 00010000:00010000:2.0:1787826364.941130:0:30173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000782e234f/0x22153cd396b7ff62 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.941149:0:30173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826364.941154:0:30173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(2 0) 00010000:00010000:2.0:1787826364.941159:0:30173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000782e234f/0x22153cd396b7ff62 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->1605631] (req 1048576->1605631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.941168:0:30173:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000782e234f/0x22153cd396b7ff62 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->1605631] (req 1048576->1605631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826364.948987:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826364.949028:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826364.949168:0:8441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f82f0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0000_UUID:8441:1874670585170688:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826364.949194:0:8441:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b7ff54 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826364.949226:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563680256 00000100:00100000:3.0:1787826364.949232:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563680256 00010000:00010000:3.0:1787826364.949266:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e8d36182/0x22153cd396b7fecf lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02fa expref: 17 pid: 8436 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826364.949336:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563680384 00000100:00100000:3.0:1787826364.949340:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563680384 00010000:00010000:3.0:1787826364.949355:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000159f1fa4/0x22153cd396b7fec1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02ec expref: 18 pid: 8437 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826364.949378:0:30172:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf39f803c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0000_UUID:30172:1874670585170560:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826364.949395:0:30172:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000107bd172/0x22153cd396b7ff4d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826364.951199:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 933 00000100:00100000:1.0:1787826364.951221:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+18:2404:x1874670563680256:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826364.951241:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826364.951264:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e8d36182/0x22153cd396b7fecf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02fa expref: 18 pid: 8436 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.951281:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e8d36182/0x22153cd396b7fecf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02fa expref: 18 pid: 8436 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.951305:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8d36182/0x22153cd396b7fecf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02fa expref: 18 pid: 8436 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.951324:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(2 0) 00010000:00010000:1.0:1787826364.951329:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(2 0) 00010000:00010000:1.0:1787826364.951334:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000107bd172/0x22153cd396b7ff4d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 30172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.951344:0:10341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000107bd172/0x22153cd396b7ff4d lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 30172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.951353:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(2 0) 00010000:00010000:1.0:1787826364.951356:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(2 0) 00010000:00010000:1.0:1787826364.951359:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000782e234f/0x22153cd396b7ff62 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->1605631] (req 1048576->1605631) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 30173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.951366:0:10341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000782e234f/0x22153cd396b7ff62 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->1605631] (req 1048576->1605631) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 30173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.951414:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826364.951466:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+17:2404:x1874670563680256:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 255us (2487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826364.951501:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 933 00010000:00010000:2.0:1787826364.951590:0:30173:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000782e234f/0x22153cd396b7ff62 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->1605631] (req 1048576->1605631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.951606:0:30173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000782e234f/0x22153cd396b7ff62 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->1605631] (req 1048576->1605631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826364.953170:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 934 00000100:00100000:1.0:1787826364.953183:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03bdfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+17:2404:x1874670563680384:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826364.953198:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826364.953217:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000159f1fa4/0x22153cd396b7fec1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02ec expref: 17 pid: 8437 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.953233:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000159f1fa4/0x22153cd396b7fec1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02ec expref: 17 pid: 8437 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.953259:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000159f1fa4/0x22153cd396b7fec1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02ec expref: 17 pid: 8437 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.953273:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826364.953277:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826364.953282:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b7ff54 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.953291:0:10341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b7ff54 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.953319:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826364.953349:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03bdfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2404:x1874670563680384:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 169us (4319us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826364.953357:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 934 00010000:00010000:1.0:1787826364.953383:0:30172:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000107bd172/0x22153cd396b7ff4d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826364.953391:0:30172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000107bd172/0x22153cd396b7ff4d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.953591:0:8441:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b7ff54 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826364.953602:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b7ff54 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826364.955172:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826364.955199:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563680512 00000100:00100000:3.0:1787826364.955205:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563680512 00010000:00010000:3.0:1787826364.955234:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b0f871e9/0x22153cd396b7fec8 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02f3 expref: 14 pid: 8435 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826364.955268:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 935 00000100:00100000:3.0:1787826364.955277:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563680512:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826364.955290:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826364.955308:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b0f871e9/0x22153cd396b7fec8 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02f3 expref: 14 pid: 8435 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.955321:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b0f871e9/0x22153cd396b7fec8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02f3 expref: 14 pid: 8435 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.955343:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x20:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826364.955347:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x20:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826364.955352:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000be58304c/0x22153cd396b7ff5b lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 14865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.955361:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be58304c/0x22153cd396b7ff5b lrc: 4/1,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 14865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.955378:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826364.955411:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563680512:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 136us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826364.955418:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 935 00010000:00010000:3.0:1787826364.955943:0:14865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0f871e9/0x22153cd396b7fec8 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02f3 expref: 13 pid: 8435 timeout: 1410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826364.955963:0:14865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf39f80780 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:14865:1874670585170816:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826364.955983:0:14865:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000be58304c/0x22153cd396b7ff5b lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.955993:0:14865:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000be58304c/0x22153cd396b7ff5b lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.956001:0:14865:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be58304c/0x22153cd396b7ff5b lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.977104:0:30173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000782e234f/0x22153cd396b7ff62 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->1605631] (req 1048576->1605631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.977123:0:30173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000782e234f/0x22153cd396b7ff62 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->1605631] (req 1048576->1605631) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.977131:0:30173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000782e234f/0x22153cd396b7ff62 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->1605631] (req 1048576->1605631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.977138:0:30173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a832e00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826364.977143:0:30173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000782e234f/0x22153cd396b7ff62 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->1605631] (req 1048576->1605631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.977152:0:30173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000782e234f/0x22153cd396b7ff62 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->1605631] (req 1048576->1605631) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.977171:0:30173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000782e234f/0x22153cd396b7ff62 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->1605631] (req 1048576->1605631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.977179:0:30173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000782e234f/0x22153cd396b7ff62 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->1605631] (req 1048576->1605631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826364.977265:0:30173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecada40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2404:x1874670563680128:12345-192.168.203.39@tcp:3:lfs.0 Request processed in 36166us (36377us total) trans 0 rc 554272/554272 00000100:00100000:3.0:1787826364.977275:0:30173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 667 00010000:00010000:3.0:1787826364.989068:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b7ff54 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.989088:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b7ff54 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.989097:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b7ff54 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.989103:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835c00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826364.989108:0:8441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b7ff54 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.989116:0:8441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b7ff54 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.989135:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b7ff54 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826364.989143:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b7ff54 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826364.989238:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f934780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2402:x1874670563679744:12345-192.168.203.39@tcp:3:lfs.0 Request processed in 54464us (54897us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1787826364.989247:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 665 00010000:00010000:3.0:1787826365.001462:0:14865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000be58304c/0x22153cd396b7ff5b lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.001626:0:14865:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be58304c/0x22153cd396b7ff5b lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.001637:0:14865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be58304c/0x22153cd396b7ff5b lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.001644:0:14865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a833c00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826365.001649:0:14865:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be58304c/0x22153cd396b7ff5b lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.001659:0:14865:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be58304c/0x22153cd396b7ff5b lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.001681:0:14865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be58304c/0x22153cd396b7ff5b lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.001689:0:14865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be58304c/0x22153cd396b7ff5b lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826365.001844:0:14865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f937840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563680000:12345-192.168.203.39@tcp:3:lfs.0 Request processed in 66215us (66665us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1787826365.001856:0:14865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 666 00010000:00010000:1.0:1787826365.022094:0:30172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000107bd172/0x22153cd396b7ff4d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.022116:0:30172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000107bd172/0x22153cd396b7ff4d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.022131:0:30172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000107bd172/0x22153cd396b7ff4d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.022139:0:30172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a833800 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:1.0:1787826365.022144:0:30172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000107bd172/0x22153cd396b7ff4d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.022154:0:30172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000107bd172/0x22153cd396b7ff4d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.022175:0:30172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000107bd172/0x22153cd396b7ff4d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.022184:0:30172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000107bd172/0x22153cd396b7ff4d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826365.022283:0:30172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f9352c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563679872:12345-192.168.203.39@tcp:3:lfs.0 Request processed in 87647us (87869us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1787826365.022294:0:30172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 664 00000100:00100000:0.0:1787826365.115702:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826365.115893:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563680640 00000100:00100000:3.0:1787826365.115902:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563680640 00000100:00100000:3.0:1787826365.115961:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1735 00000100:00100000:3.0:1787826365.115971:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecaf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2401:x1874670563680640:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826365.115988:0:30398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826365.116008:0:30398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002050a528/0x22153cd396b7ff69 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab031d expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826365.116034:0:30398:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 1048576, mtime: 0x6a9010bc, atime: 0x6a9010bc, ctime: 0x6a9010bd, blocks: 0x8 00010000:00010000:3.0:1787826365.116053:0:30398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=1311s v=(0 0) 00010000:00010000:3.0:1787826365.116058:0:30398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826365.116069:0:30398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002050a528/0x22153cd396b7ff69 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab031d expref: 13 pid: 30398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.116086:0:30398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002050a528/0x22153cd396b7ff69 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab031d expref: 13 pid: 30398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.116101:0:30398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf181f0600, rc 0) 00000100:00100000:3.0:1787826365.116163:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecaf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2401:x1874670563680640:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 193us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826365.116170:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1735 00000100:00100000:2.0:1787826365.118332:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826365.118460:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563680768 00000100:00100000:1.0:1787826365.118468:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563680768 00000100:00100000:1.0:1787826365.118546:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1736 00000100:00100000:1.0:1787826365.118555:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf39f803c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2401:x1874670563680768:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826365.118570:0:30696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826365.118589:0:30696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088c1e0c0/0x22153cd396b7ff70 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0324 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826365.118613:0:30696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x20:0x0] initial LVB size: 2097152, mtime: 0x6a9010bc, atime: 0x6a9010bc, ctime: 0x6a9010bd, blocks: 0x20 00010000:00010000:1.0:1787826365.118630:0:30696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x20:0x0].0x0 since=1311s v=(0 0) 00010000:00010000:1.0:1787826365.118635:0:30696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826365.118644:0:30696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088c1e0c0/0x22153cd396b7ff70 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0324 expref: 13 pid: 30696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.118660:0:30696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000088c1e0c0/0x22153cd396b7ff70 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0324 expref: 13 pid: 30696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.118672:0:30696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835200, rc 0) 00000100:00100000:1.0:1787826365.118729:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf39f803c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2401:x1874670563680768:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 174us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826365.118736:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1736 00000100:00100000:0.0:1787826365.119362:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826365.119416:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563680896 00000100:00100000:1.0:1787826365.119421:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563680896 00000100:00100000:1.0:1787826365.119454:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1737 00000100:00100000:1.0:1787826365.119461:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecac3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2401:x1874670563680896:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826365.119490:0:14864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826365.119503:0:14864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b7ff77 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab032b expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826365.119522:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 1602848, mtime: 0x6a9010bc, atime: 0x6a9010bc, ctime: 0x6a9010bd, blocks: 0x38 00010000:00010000:1.0:1787826365.119548:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=1311s v=(0 0) 00010000:00010000:1.0:1787826365.119552:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826365.119561:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b7ff77 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab032b expref: 14 pid: 14864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.119575:0:14864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b7ff77 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab032b expref: 14 pid: 14864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.119585:0:14864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834a00, rc 0) 00000100:00100000:1.0:1787826365.119622:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecac3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2401:x1874670563680896:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 161us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826365.119629:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1737 00000100:00100000:0.0:1787826365.154270:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826365.154354:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563681152 00000100:00100000:3.0:1787826365.154364:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563681152 00000100:00100000:3.0:1787826365.154430:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 991 00000100:00100000:3.0:1787826365.154440:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:52421:x1874670563681152:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:3.0:1787826365.154695:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:52421:x1874670563681152:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 256us (442us total) trans 4294967622 rc 0/0 00000100:00100000:3.0:1787826365.154704:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 991 00000100:00100000:0.0:1787826365.261144:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826365.261386:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563681408 00000100:00100000:1.0:1787826365.261396:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563681408 00000100:00100000:1.0:1787826365.261453:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3378 00000100:00100000:1.0:1787826365.261463:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:52424:x1874670563681408:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826365.261520:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826365.261554:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b7ff7e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0332 expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.261671:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835a00/0x22153cd396b7ff85 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.261688:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835a00/0x22153cd396b7ff85 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.261701:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835a00/0x22153cd396b7ff85 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826365.261721:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0x9:0x0]: returning size 3700000 00010000:00010000:1.0:1787826365.261824:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b7ff7e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0332 expref: 39 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.261844:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835a00/0x22153cd396b7ff85 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0332 expref: 38 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.261853:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:1.0:1787826365.261856:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787826365.261859:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835a00, rc 0) 00000100:00100000:1.0:1787826365.262112:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:52424:x1874670563681408:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 648us (977us total) trans 4294967623 rc 0/0 00000100:00100000:1.0:1787826365.262120:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3378 00000100:00100000:1.0:1787826365.349344:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826365.349510:0:25423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563681536 00000100:00100000:3.0:1787826365.349520:0:25423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563681536 00000100:00100000:3.0:1787826365.349606:0:25423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 668 00000100:00100000:3.0:1787826365.349617:0:25423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2402:x1874670563681536:12345-192.168.203.39@tcp:3:lfs.0 00010000:00010000:3.0:1787826365.349650:0:25423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004c5f1db2/0x22153cd396b7ff93 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.349670:0:25423:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c55e1152/0x22153cd396b7fe74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02d7 expref: 13 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.349679:0:25423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000400:0x21:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787826365.349684:0:25423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x21:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826365.349688:0:25423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c5f1db2/0x22153cd396b7ff93 lrc: 4/1,0 mode: --/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.349888:0:25423:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c55e1152/0x22153cd396b7fe74 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02d7 expref: 13 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.349904:0:25423:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c55e1152/0x22153cd396b7fe74 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02d7 expref: 13 pid: 8437 timeout: 1411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826365.349919:0:25423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a988780 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:25423:1874670585170944:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826365.349998:0:25423:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf09f680c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826365.353441:0:25423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a988780 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:25423:1874670585170944:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826365.353502:0:25423:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004c5f1db2/0x22153cd396b7ff93 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826365.354794:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826365.355154:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563681664 00000100:00100000:3.0:1787826365.355162:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563681664 00010000:00010000:3.0:1787826365.355201:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c55e1152/0x22153cd396b7fe74 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02d7 expref: 14 pid: 8437 timeout: 1411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826365.355245:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 936 00000100:00100000:3.0:1787826365.355255:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2403:x1874670563681664:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826365.355270:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826365.355291:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c55e1152/0x22153cd396b7fe74 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02d7 expref: 14 pid: 8437 timeout: 1411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.355304:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c55e1152/0x22153cd396b7fe74 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02d7 expref: 14 pid: 8437 timeout: 1411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.355326:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c55e1152/0x22153cd396b7fe74 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02d7 expref: 14 pid: 8437 timeout: 1411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.355344:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x21:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826365.355348:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x21:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826365.355354:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004c5f1db2/0x22153cd396b7ff93 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.355364:0:10340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c5f1db2/0x22153cd396b7ff93 lrc: 4/1,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.355458:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826365.355556:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2403:x1874670563681664:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 302us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826365.355564:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 936 00000100:00100000:3.0:1787826365.359156:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826365.359219:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826365.359366:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563681792 00000100:00100000:1.0:1787826365.359384:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563681792 00000100:00100000:1.0:1787826365.359433:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563681920 00000100:00100000:1.0:1787826365.359436:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563681920 00000100:00100000:1.0:1787826365.359456:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1738 00000100:00100000:1.0:1787826365.359465:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a988780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2401:x1874670563681792:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826365.359514:0:8545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826365.359541:0:8545:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000159f1fa4/0x22153cd396b7ff9a lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0339 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.359571:0:8545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x21:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826365.359576:0:8545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x21:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826365.359587:0:8545:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000159f1fa4/0x22153cd396b7ff9a lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0339 expref: 14 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.359607:0:8545:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000159f1fa4/0x22153cd396b7ff9a lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0339 expref: 14 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.359620:0:8545:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835800, rc 0) 00000100:00100000:1.0:1787826365.359672:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a988780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2401:x1874670563681792:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 207us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826365.359679:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1738 00000100:00100000:1.0:1787826365.359696:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1739 00000100:00100000:1.0:1787826365.359714:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2402:x1874670563681920:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826365.359728:0:8545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826365.359738:0:8545:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b7ffa1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0340 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826365.360735:0:8545:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fded00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8545:1874670585171072:192.168.203.39@tcp:106: 00000100:00100000:1.0:1787826365.360815:0:8545:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce06a86f00 going to sleep for 11 seconds 00010000:00010000:0.0:1787826365.360971:0:25423:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004c5f1db2/0x22153cd396b7ff93 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.360983:0:25423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c5f1db2/0x22153cd396b7ff93 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826365.390087:0:8545:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fded00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8545:1874670585171072:192.168.203.39@tcp:106: 00010000:00010000:1.0:1787826365.390128:0:8545:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b7ffa1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [2097152->1073741823] (req 2097152->1073741823) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0340 expref: 15 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.390165:0:8545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b7ffa1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [2097152->1073741823] (req 2097152->1073741823) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0340 expref: 15 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.390177:0:8545:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835c00, rc 0) 00000100:00100000:1.0:1787826365.390240:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2402:x1874670563681920:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 30537us (31020us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826365.390250:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1739 00000100:00100000:0.0:1787826365.407171:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826365.407321:0:30177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563682048 00000100:00100000:1.0:1787826365.407331:0:30177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563682048 00000100:00100000:1.0:1787826365.407414:0:30177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 669 00000100:00100000:1.0:1787826365.407424:0:30177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136cfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563682048:12345-192.168.203.39@tcp:3:lfs.0 00010000:00010000:1.0:1787826365.407457:0:30177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b7ffa8 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.407510:0:30177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006cf44f1d/0x22153cd396b7feac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02e5 expref: 14 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.407520:0:30177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x23:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787826365.407525:0:30177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826365.407539:0:30177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b7ffa8 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [2097152->3702783] (req 2097152->3702783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.407576:0:30177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006cf44f1d/0x22153cd396b7feac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02e5 expref: 14 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.407591:0:30177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006cf44f1d/0x22153cd396b7feac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02e5 expref: 14 pid: 30696 timeout: 1411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826365.407611:0:30177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fded00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_015:lustre-OST0000_UUID:30177:1874670585171200:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826365.407685:0:30177:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce06a86f00 going to sleep for 11 seconds 00010000:00010000:2.0:1787826365.408318:0:25423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004c5f1db2/0x22153cd396b7ff93 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826365.408330:0:25423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004c5f1db2/0x22153cd396b7ff93 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826365.408339:0:25423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004c5f1db2/0x22153cd396b7ff93 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826365.408352:0:25423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf181f1600 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826365.408356:0:25423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004c5f1db2/0x22153cd396b7ff93 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826365.408365:0:25423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004c5f1db2/0x22153cd396b7ff93 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826365.408394:0:25423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004c5f1db2/0x22153cd396b7ff93 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826365.408402:0:25423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c5f1db2/0x22153cd396b7ff93 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826365.408468:0:25423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2402:x1874670563681536:12345-192.168.203.39@tcp:3:lfs.0 Request processed in 58851us (59134us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1787826365.408523:0:25423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 668 00000100:00100000:0.0:1787826365.419070:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826365.419193:0:30177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fded00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_015:lustre-OST0000_UUID:30177:1874670585171200:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826365.419231:0:30177:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b7ffa8 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [2097152->3702783] (req 2097152->3702783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826365.419605:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563682176 00000100:00100000:3.0:1787826365.419614:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563682176 00010000:00010000:3.0:1787826365.419654:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006cf44f1d/0x22153cd396b7feac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02e5 expref: 15 pid: 30696 timeout: 1411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826365.419695:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 937 00000100:00100000:3.0:1787826365.419714:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06307840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2404:x1874670563682176:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826365.419729:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826365.419750:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006cf44f1d/0x22153cd396b7feac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02e5 expref: 15 pid: 30696 timeout: 1411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.419918:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006cf44f1d/0x22153cd396b7feac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02e5 expref: 15 pid: 30696 timeout: 1411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.419942:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006cf44f1d/0x22153cd396b7feac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab02e5 expref: 15 pid: 30696 timeout: 1411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.419960:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826365.419964:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826365.419970:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b7ffa8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [2097152->3702783] (req 2097152->3702783) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 30177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.419987:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b7ffa8 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [2097152->3702783] (req 2097152->3702783) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 30177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.420017:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826365.420071:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06307840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563682176:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 359us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826365.420078:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 937 00010000:00010000:1.0:1787826365.421103:0:30177:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b7ffa8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [2097152->3702783] (req 2097152->3702783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.421116:0:30177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b7ffa8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [2097152->3702783] (req 2097152->3702783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.445419:0:30177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b7ffa8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [2097152->3702783] (req 2097152->3702783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.445438:0:30177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b7ffa8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [2097152->3702783] (req 2097152->3702783) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.445447:0:30177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b7ffa8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [2097152->3702783] (req 2097152->3702783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.445455:0:30177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835c00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:1.0:1787826365.445460:0:30177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b7ffa8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [2097152->3702783] (req 2097152->3702783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.445468:0:30177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b7ffa8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [2097152->3702783] (req 2097152->3702783) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.445526:0:30177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b7ffa8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [2097152->3702783] (req 2097152->3702783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.445552:0:30177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b7ffa8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [2097152->3702783] (req 2097152->3702783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826365.445635:0:30177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136cfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2404:x1874670563682048:12345-192.168.203.39@tcp:3:lfs.0 Request processed in 38208us (38469us total) trans 0 rc 1602848/1602848 00000100:00100000:1.0:1787826365.445646:0:30177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 669 00000100:00100000:2.0:1787826365.502407:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826365.502552:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563682304 00000100:00100000:3.0:1787826365.502562:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563682304 00000100:00100000:3.0:1787826365.502618:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1740 00000100:00100000:3.0:1787826365.502628:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf39f81680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2402:x1874670563682304:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826365.502647:0:30398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826365.502668:0:30398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b7ffaf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0347 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826365.502691:0:30398:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x23:0x0] initial LVB size: 3700000, mtime: 0x6a9010bc, atime: 0x6a9010bc, ctime: 0x6a9010bd, blocks: 0x28 00010000:00010000:3.0:1787826365.502725:0:30398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=1311s v=(0 0) 00010000:00010000:3.0:1787826365.502731:0:30398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826365.502741:0:30398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b7ffaf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0347 expref: 14 pid: 30398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.502759:0:30398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b7ffaf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0347 expref: 14 pid: 30398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.502773:0:30398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400c00, rc 0) 00000100:00100000:3.0:1787826365.502831:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf39f81680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2402:x1874670563682304:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 204us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826365.502838:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1740 00000100:00100000:0.0:1787826365.554171:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826365.554506:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563682560 00000100:00100000:2.0:1787826365.554516:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563682560 00000100:00100000:2.0:1787826365.554583:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3379 00000100:00100000:2.0:1787826365.554592:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:52426:x1874670563682560:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826365.554614:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826365.554634:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6600/0x22153cd396b7ffb6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab034e expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826365.554755:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6a00/0x22153cd396b7ffbd lrc: 3/0,1 mode: --/CW res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826365.554772:0:9966:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661200/0x22153cd396b7ff3f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0316 expref: 39 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826365.554781:0:9966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6a00/0x22153cd396b7ffbd lrc: 4/0,1 mode: --/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826365.554812:0:9966:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661200/0x22153cd396b7ff3f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0316 expref: 39 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826365.554827:0:9966:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661200/0x22153cd396b7ff3f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0316 expref: 39 pid: 6520 timeout: 1411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826365.554842:0:9966:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf39f830c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9966:1874670585171328:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826365.554929:0:9966:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce05f8e780 going to sleep for 11 seconds 00000100:00100000:0.0:1787826365.563725:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826365.564063:0:9966:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf39f830c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9966:1874670585171328:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826365.564093:0:9966:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6a00/0x22153cd396b7ffbd lrc: 3/0,1 mode: --/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826365.564605:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563682688 00000100:00100000:1.0:1787826365.564613:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563682688 00010000:00010000:1.0:1787826365.564654:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661200/0x22153cd396b7ff3f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0316 expref: 40 pid: 6520 timeout: 1411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826365.564696:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 938 00000100:00100000:1.0:1787826365.564719:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1064fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:2404:x1874670563682688:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826365.564736:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826365.564743:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661200/0x22153cd396b7ff3f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0316 expref: 40 pid: 6520 timeout: 1411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.564754:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661200/0x22153cd396b7ff3f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0316 expref: 40 pid: 6520 timeout: 1411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.564936:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661200/0x22153cd396b7ff3f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0316 expref: 40 pid: 6520 timeout: 1411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.564955:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:1.0:1787826365.564960:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6a00/0x22153cd396b7ffbd lrc: 3/0,1 mode: --/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.564972:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6a00/0x22153cd396b7ffbd lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.564981:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6a00/0x22153cd396b7ffbd lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.565013:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826365.565119:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1064fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+39:2404:x1874670563682688:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 414us (1417us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826365.565127:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 938 00010000:00010000:0.0:1787826365.565514:0:9966:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6a00/0x22153cd396b7ffbd lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.565524:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6a00/0x22153cd396b7ffbd lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826365.565556:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0x9:0x0]: returning size 3700000 00010000:00010000:0.0:1787826365.565694:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6600/0x22153cd396b7ffb6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab034e expref: 40 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.565731:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6a00/0x22153cd396b7ffbd lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab034e expref: 39 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.565740:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:0.0:1787826365.565743:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787826365.565746:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3abd6a00, rc 0) 00000100:00100000:0.0:1787826365.566656:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+39:52426:x1874670563682560:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 12057us (12488us total) trans 4294967624 rc 0/0 00000100:00100000:0.0:1787826365.566667:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3379 00000100:00100000:3.0:1787826365.575117:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826365.575196:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563682816 00000100:00100000:1.0:1787826365.575215:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563682816 00000100:00100000:1.0:1787826365.575272:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3380 00000100:00100000:1.0:1787826365.575282:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1366a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+39:52426:x1874670563682816:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826365.575304:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826365.575326:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835600/0x22153cd396b7ffcb lrc: 2/0,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0355 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.575783:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834600/0x22153cd396b7ffd2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.575799:0:16564:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6a00/0x22153cd396b7ffbd lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab034e expref: 40 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.575808:0:16564:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834600/0x22153cd396b7ffd2 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.575839:0:16564:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6a00/0x22153cd396b7ffbd lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab034e expref: 40 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.575853:0:16564:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6a00/0x22153cd396b7ffbd lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab034e expref: 40 pid: 9966 timeout: 1411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826365.575867:0:16564:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fdf480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:16564:1874670585171456:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826365.576097:0:16564:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce06a869c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826365.580936:0:16564:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fdf480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:16564:1874670585171456:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826365.580966:0:16564:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834600/0x22153cd396b7ffd2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826365.590744:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826365.590864:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563682944 00000100:00100000:3.0:1787826365.590874:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563682944 00010000:00010000:3.0:1787826365.590910:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6a00/0x22153cd396b7ffbd lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab034e expref: 41 pid: 9966 timeout: 1411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826365.590949:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 939 00000100:00100000:3.0:1787826365.590957:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fded00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+41:2404:x1874670563682944:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826365.590971:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826365.590977:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6a00/0x22153cd396b7ffbd lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab034e expref: 41 pid: 9966 timeout: 1411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.590990:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6a00/0x22153cd396b7ffbd lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab034e expref: 41 pid: 9966 timeout: 1411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.591011:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6a00/0x22153cd396b7ffbd lrc: 0/0,0 mode: --/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab034e expref: 41 pid: 9966 timeout: 1411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.591027:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:3.0:1787826365.591032:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834600/0x22153cd396b7ffd2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.591042:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834600/0x22153cd396b7ffd2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.591054:0:10340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834600/0x22153cd396b7ffd2 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.591083:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826365.591519:0:16564:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834600/0x22153cd396b7ffd2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.591536:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834600/0x22153cd396b7ffd2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826365.591586:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0x9:0x0]: returning size 3700000 00000004:00200000:1.0:1787826365.591590:0:16564:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826365.591608:0:16564:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834600/0x22153cd396b7ffd2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.591635:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835600/0x22153cd396b7ffcb lrc: 0/0,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0355 expref: 41 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.591650:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834600/0x22153cd396b7ffd2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0355 expref: 40 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.591657:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:1.0:1787826365.591660:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826365.591662:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834600, rc 0) 00000100:00100000:1.0:1787826365.591691:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1366a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:52426:x1874670563682816:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 16411us (16585us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826365.591700:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3380 00000100:00100000:3.0:1787826365.591906:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fded00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+39:2404:x1874670563682944:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 178us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826365.591915:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 939 00000100:00100000:1.0:1787826365.596770:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826365.597077:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563683200 00000100:00100000:2.0:1787826365.597087:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563683200 00000100:00100000:2.0:1787826365.597151:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1741 00000100:00100000:2.0:1787826365.597160:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2403:x1874670563683200:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:2.0:1787826365.597368:0:30696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ada17ba/0x22153cd396b7ffd9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826365.597450:0:30696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b7ffaf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0347 expref: 14 pid: 30398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826365.597460:0:30696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826365.597465:0:30696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826365.597501:0:30696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ada17ba/0x22153cd396b7ffd9 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826365.597548:0:30696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b7ffaf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0347 expref: 14 pid: 30398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826365.597562:0:30696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b7ffaf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0347 expref: 14 pid: 30398 timeout: 1411 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826365.597579:0:30696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf39f830c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:30696:1874670585171584:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826365.597776:0:30696:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce05f8e780 going to sleep for 11 seconds 00000100:00100000:0.0:1787826365.602460:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826365.605526:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563683072 00000100:00100000:1.0:1787826365.605549:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563683072 00000100:00100000:1.0:1787826365.606605:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826365.606679:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563683328 00000100:00100000:3.0:1787826365.606686:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563683328 00010000:00010000:3.0:1787826365.606735:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b7ffaf lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0347 expref: 15 pid: 30398 timeout: 1411 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826365.606774:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 940 00000100:00100000:3.0:1787826365.606784:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2403:x1874670563683328:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826365.606798:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826365.606819:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b7ffaf lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0347 expref: 15 pid: 30398 timeout: 1411 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.606834:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b7ffaf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0347 expref: 15 pid: 30398 timeout: 1411 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.606859:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826365.606864:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826365.606869:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009ada17ba/0x22153cd396b7ffd9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.606886:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ada17ba/0x22153cd396b7ffd9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.606905:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826365.607174:0:30696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b7ffaf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0347 expref: 15 pid: 30398 timeout: 1411 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826365.607190:0:30696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf39f830c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:30696:1874670585171584:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826365.607220:0:30696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009ada17ba/0x22153cd396b7ffd9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826365.607230:0:30696:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009ada17ba/0x22153cd396b7ffd9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826365.607237:0:30696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ada17ba/0x22153cd396b7ffd9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826365.607257:0:30696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ada17ba/0x22153cd396b7ffd9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826365.607265:0:30696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ada17ba/0x22153cd396b7ffd9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826365.607273:0:30696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ada17ba/0x22153cd396b7ffd9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826365.607280:0:30696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3abd6000 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826365.607284:0:30696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ada17ba/0x22153cd396b7ffd9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826365.607293:0:30696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ada17ba/0x22153cd396b7ffd9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826365.607304:0:30696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ada17ba/0x22153cd396b7ffd9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826365.607311:0:30696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ada17ba/0x22153cd396b7ffd9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826365.608600:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1742 00000100:00100000:0.0:1787826365.608613:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2403:x1874670563683072:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:0.0:1787826365.608653:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062c60899/0x22153cd396b7ffe0 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.608672:0:14864:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000159f1fa4/0x22153cd396b7ff9a lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0339 expref: 13 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.608688:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x21:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826365.608692:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x21:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826365.608697:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062c60899/0x22153cd396b7ffe0 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.608745:0:14864:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000159f1fa4/0x22153cd396b7ff9a lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0339 expref: 13 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.608772:0:14864:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000159f1fa4/0x22153cd396b7ff9a lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0339 expref: 13 pid: 8545 timeout: 1411 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826365.608788:0:14864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0373c780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14864:1874670585171712:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826365.609547:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2403:x1874670563683328:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 2759us (2943us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826365.609558:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 940 00000100:00100000:2.0:1787826365.610046:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2403:x1874670563683200:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 12884us (13292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826365.610056:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1741 00000100:00100000:0.0:1787826365.610321:0:14864:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf39df2cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826365.615781:0:14864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0373c780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14864:1874670585171712:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826365.615811:0:14864:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000062c60899/0x22153cd396b7ffe0 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826365.616973:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826365.617299:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563683456 00000100:00100000:2.0:1787826365.617309:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563683456 00010000:00010000:2.0:1787826365.617352:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000159f1fa4/0x22153cd396b7ff9a lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0339 expref: 14 pid: 8545 timeout: 1411 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826365.617543:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 941 00000100:00100000:2.0:1787826365.617555:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03bdfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563683456:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826365.617570:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826365.617592:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000159f1fa4/0x22153cd396b7ff9a lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0339 expref: 14 pid: 8545 timeout: 1411 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826365.617606:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000159f1fa4/0x22153cd396b7ff9a lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0339 expref: 14 pid: 8545 timeout: 1411 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826365.617629:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000159f1fa4/0x22153cd396b7ff9a lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0339 expref: 14 pid: 8545 timeout: 1411 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826365.617646:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x21:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826365.617650:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x21:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826365.617656:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000062c60899/0x22153cd396b7ffe0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826365.617667:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062c60899/0x22153cd396b7ffe0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826365.618061:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826365.618125:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03bdfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2404:x1874670563683456:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 571us (1155us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826365.618145:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 941 00010000:00010000:3.0:1787826365.620089:0:14864:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000062c60899/0x22153cd396b7ffe0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.620107:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062c60899/0x22153cd396b7ffe0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.620285:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062c60899/0x22153cd396b7ffe0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.620295:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062c60899/0x22153cd396b7ffe0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.620304:0:14864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062c60899/0x22153cd396b7ffe0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.620313:0:14864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce057cfe00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826365.620317:0:14864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062c60899/0x22153cd396b7ffe0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.620326:0:14864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062c60899/0x22153cd396b7ffe0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.620347:0:14864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062c60899/0x22153cd396b7ffe0 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.620355:0:14864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062c60899/0x22153cd396b7ffe0 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826365.620601:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563683072:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 11986us (18147us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826365.620612:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1742 00000100:00100000:3.0:1787826365.623956:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826365.624905:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563683712 00000100:00100000:0.0:1787826365.624917:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563683712 00000100:00100000:0.0:1787826365.624978:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3381 00000100:00100000:0.0:1787826365.624989:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f825a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+39:52426:x1874670563683712:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:0.0:1787826365.625065:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057ce400/0x22153cd396b7ffe7 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.625083:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660800/0x22153cd396b7fee4 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0301 expref: 39 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.625092:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835a00/0x22153cd396b7ff85 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0332 expref: 39 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.625106:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834600/0x22153cd396b7ffd2 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0355 expref: 39 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.625115:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057ce400/0x22153cd396b7ffe7 lrc: 6/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.625160:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834600/0x22153cd396b7ffd2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0355 expref: 39 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.625174:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834600/0x22153cd396b7ffd2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0355 expref: 39 pid: 16564 timeout: 1411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826365.625188:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0373c780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6520:1874670585171840:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826365.625352:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835a00/0x22153cd396b7ff85 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0332 expref: 39 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.625363:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835a00/0x22153cd396b7ff85 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0332 expref: 39 pid: 32404 timeout: 1411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826365.625442:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03975a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6520:1874670585171968:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826365.625504:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660800/0x22153cd396b7fee4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0301 expref: 39 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.625514:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660800/0x22153cd396b7fee4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0301 expref: 39 pid: 6520 timeout: 1411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826365.625541:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aaf2d00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6520:1874670585172096:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826365.625564:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf39df2900 going to sleep for 11 seconds 00000100:00100000:3.0:1787826365.630266:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0373c780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6520:1874670585171840:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826365.630282:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03975a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6520:1874670585171968:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826365.634948:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826365.634993:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826365.635059:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826365.635177:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aaf2d00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6520:1874670585172096:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826365.635218:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057ce400/0x22153cd396b7ffe7 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826365.635400:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563683840 00000100:00100000:0.0:1787826365.635406:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563683840 00010000:00010000:0.0:1787826365.635441:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834600/0x22153cd396b7ffd2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0355 expref: 40 pid: 16564 timeout: 1411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826365.635509:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563684224 00000100:00100000:0.0:1787826365.635512:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563684224 00010000:00010000:0.0:1787826365.635526:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660800/0x22153cd396b7fee4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0301 expref: 41 pid: 6520 timeout: 1411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826365.635554:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 942 00000100:00100000:0.0:1787826365.635563:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+41:2404:x1874670563683840:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826365.635577:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826365.635584:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834600/0x22153cd396b7ffd2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0355 expref: 41 pid: 16564 timeout: 1411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.635596:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834600/0x22153cd396b7ffd2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0355 expref: 41 pid: 16564 timeout: 1411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.635619:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834600/0x22153cd396b7ffd2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0355 expref: 41 pid: 16564 timeout: 1411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.635636:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:0.0:1787826365.635641:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057ce400/0x22153cd396b7ffe7 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.635651:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057ce400/0x22153cd396b7ffe7 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.635658:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057ce400/0x22153cd396b7ffe7 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.635664:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826365.635711:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:2404:x1874670563683840:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 150us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826365.635719:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 942 00000100:00100000:0.0:1787826365.635737:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 943 00000100:00100000:0.0:1787826365.635743:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+39:2404:x1874670563684224:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826365.635751:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826365.635757:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660800/0x22153cd396b7fee4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0301 expref: 39 pid: 6520 timeout: 1411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.635767:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660800/0x22153cd396b7fee4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0301 expref: 39 pid: 6520 timeout: 1411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.635779:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660800/0x22153cd396b7fee4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0301 expref: 39 pid: 6520 timeout: 1411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.635789:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:0.0:1787826365.635793:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057ce400/0x22153cd396b7ffe7 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.635800:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057ce400/0x22153cd396b7ffe7 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.635807:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057ce400/0x22153cd396b7ffe7 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.635813:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826365.635829:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:2404:x1874670563684224:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 87us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826365.635835:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 943 00000100:00100000:1.0:1787826365.636621:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563684096 00000100:00100000:1.0:1787826365.636629:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563684096 00000100:00100000:1.0:1787826365.636677:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 992 00000100:00100000:1.0:1787826365.636686:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:42221:x1874670563684096:12345-192.168.203.39@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787826365.636885:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+39:42221:x1874670563684096:12345-192.168.203.39@tcp:35:ldlm_bl.0 Request processed in 200us (1946us total) trans 4294967625 rc 0/0 00000100:00100000:1.0:1787826365.636893:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 992 00000100:00100000:3.0:1787826365.643983:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826365.644084:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563684352 00000100:00100000:2.0:1787826365.644094:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563684352 00010000:00010000:2.0:1787826365.644148:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835a00/0x22153cd396b7ff85 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0332 expref: 39 pid: 32404 timeout: 1411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826365.644188:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 944 00000100:00100000:2.0:1787826365.644198:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+39:2404:x1874670563684352:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826365.644553:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826365.644562:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835a00/0x22153cd396b7ff85 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0332 expref: 39 pid: 32404 timeout: 1411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826365.644576:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835a00/0x22153cd396b7ff85 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0332 expref: 39 pid: 32404 timeout: 1411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826365.644599:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835a00/0x22153cd396b7ff85 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0332 expref: 39 pid: 32404 timeout: 1411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826365.644616:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:2.0:1787826365.644622:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057ce400/0x22153cd396b7ffe7 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826365.644631:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057ce400/0x22153cd396b7ffe7 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826365.644640:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057ce400/0x22153cd396b7ffe7 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826365.644676:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826365.644736:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:2404:x1874670563684352:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 539us (984us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826365.644744:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 944 00010000:00010000:3.0:1787826365.645629:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057ce400/0x22153cd396b7ffe7 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.645642:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057ce400/0x22153cd396b7ffe7 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787826365.645971:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967626 00000004:00010000:3.0:1787826365.646002:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002d6f75df reply state 00000000109974a1 transno 4294967627 ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057ce400/0x22153cd396b7ffe7 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.646017:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057ce400/0x22153cd396b7ffe7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.646025:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:3.0:1787826365.646028:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2a 00000100:00100000:3.0:1787826365.646032:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826365.646328:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f825a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:52426:x1874670563683712:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 21336us (22376us total) trans 4294967627 rc 0/0 00000100:00100000:3.0:1787826365.646336:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3381 00000020:00080000:3.0:1787826365.646341:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787826365.653516:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826365.653672:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563684608 00000100:00100000:0.0:1787826365.653682:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563684608 00000100:00100000:0.0:1787826365.653758:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 993 00000100:00100000:0.0:1787826365.653769:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:52426:x1874670563684608:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:0.0:1787826365.653986:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+41:52426:x1874670563684608:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 218us (513us total) trans 4294967628 rc 0/0 00000100:00100000:0.0:1787826365.653994:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 993 00000100:00100000:0.0:1787826365.685605:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826365.685858:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563684864 00000100:00100000:1.0:1787826365.685868:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563684864 00000100:00100000:1.0:1787826365.685932:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3382 00000100:00100000:1.0:1787826365.685942:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aaf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+41:52427:x1874670563684864:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826365.685967:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826365.685990:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834e00/0x22153cd396b7ffee lrc: 2/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab035c expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.686066:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834400/0x22153cd396b7fff5 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.686080:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834400/0x22153cd396b7fff5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.686097:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834400/0x22153cd396b7fff5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.686113:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834200/0x22153cd396b7fffc lrc: 3/1,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.686121:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834200/0x22153cd396b7fffc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.686129:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834200/0x22153cd396b7fffc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.686260:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835400/0x22153cd396b80003 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.686270:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835400/0x22153cd396b80003 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.686277:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835400/0x22153cd396b80003 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826365.686286:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0x9:0x0]: returning size 3700000 00010000:00010000:1.0:1787826365.686356:0:32404:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834400/0x22153cd396b7fff5 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.686364:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834400/0x22153cd396b7fff5 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.686609:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834400/0x22153cd396b7fff5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.686617:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834400/0x22153cd396b7fff5 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.686623:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826365.686627:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834400/0x22153cd396b7fff5 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.686634:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834400/0x22153cd396b7fff5 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.686647:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x0 (ffff90cf1988e500) 00010000:00010000:1.0:1787826365.686650:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826365.686654:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834400/0x22153cd396b7fff5 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.686660:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834400/0x22153cd396b7fff5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.686675:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834200/0x22153cd396b7fffc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.686681:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834200/0x22153cd396b7fffc lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.686686:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834200/0x22153cd396b7fffc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.686691:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826365.686693:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834200/0x22153cd396b7fffc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.686698:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834200/0x22153cd396b7fffc lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.686826:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x5675640f (ffff90cf04f8bf00) 00010000:00010000:1.0:1787826365.686830:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826365.686833:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834200/0x22153cd396b7fffc lrc: 2/0,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.686839:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834200/0x22153cd396b7fffc lrc: 0/0,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.686885:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834e00/0x22153cd396b7ffee lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab035c expref: 44 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.686898:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835400/0x22153cd396b80003 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab035c expref: 43 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.686906:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:1.0:1787826365.686908:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826365.686911:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835400, rc 0) 00000100:00100000:1.0:1787826365.687079:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aaf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:52427:x1874670563684864:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1138us (1485us total) trans 4294967629 rc 0/0 00000100:00100000:1.0:1787826365.687088:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3382 00000100:00100000:2.0:1787826365.696936:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826365.696999:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826365.697115:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563685120 00000100:00100000:3.0:1787826365.697123:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563685120 00000100:00100000:3.0:1787826365.697209:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563684992 00000100:00100000:3.0:1787826365.697212:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563684992 00000100:00100000:0.0:1787826365.697248:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1743 00000100:00100000:0.0:1787826365.697258:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf39f830c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2404:x1874670563685120:12345-192.168.203.39@tcp:1:lfs.0 00002000:00010000:0.0:1787826365.697309:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x23:0x0] initial LVB size: 3700000, mtime: 0x6a9010bc, atime: 0x6a9010bc, ctime: 0x6a9010bd, blocks: 0x28 00010000:00010000:0.0:1787826365.697317:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f67c7ee/0x22153cd396b80011 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.697333:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=1311s v=(0 0) 00010000:00010000:0.0:1787826365.697337:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826365.697343:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f67c7ee/0x22153cd396b80011 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.697362:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f67c7ee/0x22153cd396b80011 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.697386:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f67c7ee/0x22153cd396b80011 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.697394:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000f67c7ee/0x22153cd396b80011 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.697402:0:8437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000f67c7ee/0x22153cd396b80011 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.697409:0:8437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce057cfc00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826365.697413:0:8437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000f67c7ee/0x22153cd396b80011 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.697422:0:8437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000f67c7ee/0x22153cd396b80011 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.697435:0:8437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000f67c7ee/0x22153cd396b80011 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.697443:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f67c7ee/0x22153cd396b80011 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826365.698045:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf39f830c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2404:x1874670563685120:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 786us (1114us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826365.698054:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1743 00000100:00100000:0.0:1787826365.698073:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1744 00000100:00100000:0.0:1787826365.698080:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf39f82580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563684992:12345-192.168.203.39@tcp:1:lfs.0 00002000:00010000:0.0:1787826365.698107:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x21:0x0] initial LVB size: 2097152, mtime: 0x6a9010bc, atime: 0x6a9010bc, ctime: 0x6a9010bd, blocks: 0x40 00010000:00010000:0.0:1787826365.698113:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7d5184b/0x22153cd396b80018 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.698123:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x21:0x0].0x0 since=1311s v=(0 0) 00010000:00010000:0.0:1787826365.698126:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826365.698142:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7d5184b/0x22153cd396b80018 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.698153:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7d5184b/0x22153cd396b80018 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.698164:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7d5184b/0x22153cd396b80018 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.698171:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7d5184b/0x22153cd396b80018 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.698179:0:8437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7d5184b/0x22153cd396b80018 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.698186:0:8437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce057cf400 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826365.698190:0:8437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7d5184b/0x22153cd396b80018 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.698197:0:8437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7d5184b/0x22153cd396b80018 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.698467:0:8437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7d5184b/0x22153cd396b80018 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.698493:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7d5184b/0x22153cd396b80018 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826365.698545:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf39f82580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563684992:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 464us (1543us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826365.698551:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1744 00000100:00100000:2.0:1787826365.703936:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826365.704007:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563685376 00000100:00100000:0.0:1787826365.704015:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563685376 00000100:00100000:0.0:1787826365.704071:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3383 00000100:00100000:0.0:1787826365.704081:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf39f83c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:52427:x1874670563685376:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:0.0:1787826365.704166:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057cee00/0x22153cd396b8001f lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.704183:0:9966:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835400/0x22153cd396b80003 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab035c expref: 43 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.704199:0:9966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057cee00/0x22153cd396b8001f lrc: 4/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.704238:0:9966:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835400/0x22153cd396b80003 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab035c expref: 43 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.704251:0:9966:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835400/0x22153cd396b80003 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab035c expref: 43 pid: 32404 timeout: 1411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826365.704264:0:9966:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aaf2d00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9966:1874670585172224:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826365.704343:0:9966:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf39df2000 going to sleep for 11 seconds 00000100:00100000:2.0:1787826365.708220:0:9966:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aaf2d00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9966:1874670585172224:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826365.708252:0:9966:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057cee00/0x22153cd396b8001f lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826365.708796:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826365.710320:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563685504 00000100:00100000:0.0:1787826365.710330:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563685504 00010000:00010000:0.0:1787826365.710435:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835400/0x22153cd396b80003 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab035c expref: 44 pid: 32404 timeout: 1411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826365.710578:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 945 00000100:00100000:0.0:1787826365.710589:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1064ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:2404:x1874670563685504:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826365.710606:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826365.710613:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835400/0x22153cd396b80003 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab035c expref: 44 pid: 32404 timeout: 1411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.710627:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835400/0x22153cd396b80003 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab035c expref: 44 pid: 32404 timeout: 1411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.710649:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835400/0x22153cd396b80003 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab035c expref: 44 pid: 32404 timeout: 1411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.710666:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:0.0:1787826365.710671:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057cee00/0x22153cd396b8001f lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.710681:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057cee00/0x22153cd396b8001f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.710689:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057cee00/0x22153cd396b8001f lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.710727:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826365.710813:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1064ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:2404:x1874670563685504:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 226us (2019us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826365.710820:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 945 00010000:00010000:2.0:1787826365.711048:0:9966:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057cee00/0x22153cd396b8001f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826365.711057:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057cee00/0x22153cd396b8001f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826365.711247:0:9966:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000456e4e7c reply state 000000009e5f025c transno 4294967630 ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057cee00/0x22153cd396b8001f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826365.711259:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057cee00/0x22153cd396b8001f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826365.711266:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:2.0:1787826365.711268:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2a 00000100:00100000:2.0:1787826365.711271:0:9966:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826365.711309:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf39f83c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:52427:x1874670563685376:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 7230us (7379us total) trans 4294967630 rc 0/0 00000100:00100000:2.0:1787826365.711316:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3383 00000100:00100000:3.0:1787826365.715331:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826365.720597:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563685760 00000100:00100000:1.0:1787826365.720611:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563685760 00000100:00100000:2.0:1787826365.720890:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 994 00000100:00100000:2.0:1787826365.720902:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:52427:x1874670563685760:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:2.0:1787826365.721154:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+45:52427:x1874670563685760:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 254us (5831us total) trans 4294967631 rc 0/0 00000100:00100000:2.0:1787826365.721163:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 994 00000100:00100000:1.0:1787826365.746641:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826365.746754:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563686016 00000100:00100000:0.0:1787826365.746775:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563686016 00000100:00100000:0.0:1787826365.746828:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3384 00000100:00100000:0.0:1787826365.746837:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03bdfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+45:52428:x1874670563686016:12345-192.168.203.39@tcp:101:lseek_test.0 00010000:00010000:0.0:1787826365.746862:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826365.746883:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057cf400/0x22153cd396b80026 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0363 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.746954:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057cfc00/0x22153cd396b8002d lrc: 3/1,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.746968:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057cfc00/0x22153cd396b8002d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.746983:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057cfc00/0x22153cd396b8002d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.746996:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057ce600/0x22153cd396b80034 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.747003:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057ce600/0x22153cd396b80034 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.747010:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057ce600/0x22153cd396b80034 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.747113:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057cfe00/0x22153cd396b8003b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.747122:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057cfe00/0x22153cd396b8003b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.747129:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057cfe00/0x22153cd396b8003b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826365.747156:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0x9:0x0]: returning size 3700000 00010000:00010000:0.0:1787826365.747232:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057cfc00/0x22153cd396b8002d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.747239:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057cfc00/0x22153cd396b8002d lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.747246:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057cfc00/0x22153cd396b8002d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.747252:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce057cfc00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826365.747257:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057cfc00/0x22153cd396b8002d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.747263:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057cfc00/0x22153cd396b8002d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.747275:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x0 (ffff90cf1988e500) 00010000:00010000:0.0:1787826365.747278:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826365.747282:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057cfc00/0x22153cd396b8002d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.747288:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057cfc00/0x22153cd396b8002d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.747302:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057ce600/0x22153cd396b80034 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.747309:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057ce600/0x22153cd396b80034 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.747315:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057ce600/0x22153cd396b80034 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.747320:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce057ce600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826365.747323:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057ce600/0x22153cd396b80034 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.747328:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057ce600/0x22153cd396b80034 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.747335:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x5675640f (ffff90cf371d2d00) 00010000:00010000:0.0:1787826365.747337:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826365.747340:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057ce600/0x22153cd396b80034 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.747346:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057ce600/0x22153cd396b80034 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.747387:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057cf400/0x22153cd396b80026 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0363 expref: 48 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.747401:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057cfe00/0x22153cd396b8003b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0363 expref: 47 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.747409:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:0.0:1787826365.747411:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826365.747413:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce057cfe00, rc 0) 00000100:00100000:0.0:1787826365.748019:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03bdfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+47:52428:x1874670563686016:12345-192.168.203.39@tcp:101:lseek_test.0 Request processed in 1180us (1383us total) trans 4294967632 rc 0/0 00000100:00100000:0.0:1787826365.748029:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3384 00000100:00100000:1.0:1787826365.756891:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826365.756978:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563686144 00000100:00100000:3.0:1787826365.756987:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563686144 00000100:00100000:3.0:1787826365.757071:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1745 00000100:00100000:3.0:1787826365.757082:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:52428:x1874670563686144:12345-192.168.203.39@tcp:101:lseek_test.0 00010000:00010000:3.0:1787826365.757099:0:30398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826365.757119:0:30398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4014864/0x22153cd396b80049 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab036a expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826365.757158:0:30398:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x21:0x0] initial LVB size: 2097152, mtime: 0x6a9010bc, atime: 0x6a9010bc, ctime: 0x6a9010bd, blocks: 0x40 00010000:00010000:3.0:1787826365.757178:0:30398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x21:0x0].0x0 since=1311s v=(0 0) 00010000:00010000:3.0:1787826365.757183:0:30398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826365.757193:0:30398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4014864/0x22153cd396b80049 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab036a expref: 13 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.757218:0:30398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f4014864/0x22153cd396b80049 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab036a expref: 13 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.757230:0:30398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400e00, rc 0) 00000100:00100000:3.0:1787826365.757282:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:52428:x1874670563686144:12345-192.168.203.39@tcp:101:lseek_test.0 Request processed in 202us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826365.757290:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1745 00010000:00010000:1.0:1787826365.766554:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826365.768903:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826365.769033:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563686272 00000100:00100000:3.0:1787826365.769044:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563686272 00000100:00100000:3.0:1787826365.769146:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1746 00000100:00100000:3.0:1787826365.769157:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf39f80f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:52428:x1874670563686272:12345-192.168.203.39@tcp:101:lseek_test.0 00010000:00010000:3.0:1787826365.769175:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826365.769195:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e843828/0x22153cd396b80050 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0371 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826365.769234:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x23:0x0] initial LVB size: 3700000, mtime: 0x6a9010bc, atime: 0x6a9010bc, ctime: 0x6a9010bd, blocks: 0x28 00010000:00010000:3.0:1787826365.769254:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=1311s v=(0 0) 00010000:00010000:3.0:1787826365.769259:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826365.769271:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e843828/0x22153cd396b80050 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0371 expref: 14 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.769290:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009e843828/0x22153cd396b80050 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0371 expref: 14 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.769304:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401a00, rc 0) 00000100:00100000:3.0:1787826365.769378:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf39f80f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:52428:x1874670563686272:12345-192.168.203.39@tcp:101:lseek_test.0 Request processed in 215us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826365.769386:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1746 00000100:00100000:1.0:1787826365.777879:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826365.777922:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826365.777996:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563686400 00000100:00100000:2.0:1787826365.778006:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563686400 00000100:00100000:2.0:1787826365.778056:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563686528 00000100:00100000:2.0:1787826365.778060:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563686528 00000100:00100000:2.0:1787826365.778080:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1747 00000100:00100000:2.0:1787826365.778089:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2401:x1874670563686400:12345-192.168.203.39@tcp:23:lseek_test.0 00000100:00100000:2.0:1787826365.778215:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2401:x1874670563686400:12345-192.168.203.39@tcp:23:lseek_test.0 Request processed in 115us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826365.778224:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1747 00000100:00100000:2.0:1787826365.778242:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1748 00000100:00100000:2.0:1787826365.778249:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06307840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2401:x1874670563686528:12345-192.168.203.39@tcp:23:lseek_test.0 00000100:00100000:2.0:1787826365.778288:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06307840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2401:x1874670563686528:12345-192.168.203.39@tcp:23:lseek_test.0 Request processed in 40us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826365.778294:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1748 00000100:00100000:2.0:1787826365.782557:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826365.782648:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563686784 00000100:00100000:1.0:1787826365.782658:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563686784 00000100:00100000:1.0:1787826365.782835:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 995 00000100:00100000:1.0:1787826365.782848:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf10477050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+47:52428:x1874670563686784:12345-192.168.203.39@tcp:35:lseek_test.0 00000100:00100000:1.0:1787826365.783083:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf10477050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:52428:x1874670563686784:12345-192.168.203.39@tcp:35:lseek_test.0 Request processed in 237us (536us total) trans 4294967633 rc 0/0 00000100:00100000:1.0:1787826365.783091:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 995 00000100:00100000:2.0:1787826365.830955:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826365.831904:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563687040 00000100:00100000:3.0:1787826365.831915:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563687040 00000100:00100000:3.0:1787826365.831981:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3385 00000100:00100000:3.0:1787826365.831991:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf39f82940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:52429:x1874670563687040:12345-192.168.203.39@tcp:101:lseek_test.0 00010000:00010000:3.0:1787826365.832015:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826365.832037:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401000/0x22153cd396b80057 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0378 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.832436:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400200/0x22153cd396b8005e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.832452:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400200/0x22153cd396b8005e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.832463:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400200/0x22153cd396b8005e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826365.832642:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0x9:0x0]: returning size 3700000 00010000:00010000:2.0:1787826365.833541:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401000/0x22153cd396b80057 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0378 expref: 51 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826365.833567:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400200/0x22153cd396b8005e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0378 expref: 50 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826365.833577:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:2.0:1787826365.833580:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787826365.833583:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400200, rc 0) 00000100:00100000:2.0:1787826365.833715:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf39f82940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+50:52429:x1874670563687040:12345-192.168.203.39@tcp:101:lseek_test.0 Request processed in 1719us (2764us total) trans 4294967634 rc 0/0 00000100:00100000:2.0:1787826365.833724:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3385 00000100:00100000:2.0:1787826365.846101:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826365.846625:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563687168 00000100:00100000:0.0:1787826365.846636:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563687168 00000100:00100000:0.0:1787826365.846858:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1749 00000100:00100000:0.0:1787826365.846870:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf39f80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2403:x1874670563687168:12345-192.168.203.39@tcp:23:lseek_test.0 00000100:00100000:0.0:1787826365.846984:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf39f80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2403:x1874670563687168:12345-192.168.203.39@tcp:23:lseek_test.0 Request processed in 116us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826365.846992:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1749 00000100:00100000:0.0:1787826365.880618:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826365.881052:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563687424 00000100:00100000:3.0:1787826365.881062:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563687424 00000100:00100000:3.0:1787826365.881281:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3386 00000100:00100000:3.0:1787826365.881292:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aaf2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+50:52430:x1874670563687424:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826365.881316:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826365.881336:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401600/0x22153cd396b8006c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab037f expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.881597:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400000/0x22153cd396b80073 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.881614:0:32404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057cfe00/0x22153cd396b8003b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0363 expref: 51 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.881624:0:32404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400000/0x22153cd396b80073 lrc: 4/0,1 mode: --/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.881656:0:32404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057cfe00/0x22153cd396b8003b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0363 expref: 51 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.881670:0:32404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057cfe00/0x22153cd396b8003b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0363 expref: 51 pid: 16564 timeout: 1411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826365.881684:0:32404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf361e5e00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001_UUID:32404:1874670585172352:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826365.881792:0:32404:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3aaf59c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826365.886873:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826365.887688:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563687552 00000100:00100000:1.0:1787826365.887697:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563687552 00010000:00010000:1.0:1787826365.887753:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057cfe00/0x22153cd396b8003b lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0363 expref: 52 pid: 16564 timeout: 1411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826365.887923:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 946 00000100:00100000:1.0:1787826365.887933:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+52:2403:x1874670563687552:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826365.887948:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826365.887954:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057cfe00/0x22153cd396b8003b lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0363 expref: 52 pid: 16564 timeout: 1411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.887967:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057cfe00/0x22153cd396b8003b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0363 expref: 52 pid: 16564 timeout: 1411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.887988:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:1.0:1787826365.887993:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400000/0x22153cd396b80073 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.888002:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400000/0x22153cd396b80073 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.888010:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400000/0x22153cd396b80073 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.888027:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826365.888070:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+52:2403:x1874670563687552:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 139us (1206us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826365.888077:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 946 00010000:00010000:0.0:1787826365.888364:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057cfe00/0x22153cd396b8003b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0363 expref: 51 pid: 16564 timeout: 1411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826365.888448:0:32404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf361e5e00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001_UUID:32404:1874670585172352:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826365.888561:0:32404:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400000/0x22153cd396b80073 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.888570:0:32404:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400000/0x22153cd396b80073 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.888576:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400000/0x22153cd396b80073 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826365.888594:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0x9:0x0]: returning size 3700000 00010000:00010000:0.0:1787826365.888730:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401600/0x22153cd396b8006c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab037f expref: 52 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.888745:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400000/0x22153cd396b80073 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab037f expref: 51 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.888753:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:0.0:1787826365.889863:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787826365.889870:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400000, rc 0) 00000100:00100000:0.0:1787826365.889922:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aaf2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+51:52430:x1874670563687424:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 8630us (9313us total) trans 4294967635 rc 0/0 00000100:00100000:0.0:1787826365.889931:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3386 00000100:00100000:3.0:1787826365.902915:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826365.903646:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563687680 00000100:00100000:2.0:1787826365.903658:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563687680 00000100:00100000:2.0:1787826365.904329:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3387 00000100:00100000:2.0:1787826365.904343:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+51:52430:x1874670563687680:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826365.904367:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826365.904387:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7400/0x22153cd396b80081 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0386 expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826365.904854:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6400/0x22153cd396b80088 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826365.904871:0:9966:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400000/0x22153cd396b80073 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab037f expref: 52 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826365.904880:0:9966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6400/0x22153cd396b80088 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826365.904913:0:9966:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400000/0x22153cd396b80073 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab037f expref: 52 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826365.904927:0:9966:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400000/0x22153cd396b80073 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab037f expref: 52 pid: 32404 timeout: 1411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826365.904940:0:9966:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf39f80780 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9966:1874670585172480:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826365.905063:0:9966:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf19bfea80 going to sleep for 11 seconds 00000100:00100000:2.0:1787826365.922043:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826365.923409:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563687808 00000100:00100000:3.0:1787826365.923420:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563687808 00010000:00010000:3.0:1787826365.923465:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400000/0x22153cd396b80073 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab037f expref: 53 pid: 32404 timeout: 1411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826365.923742:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 947 00000100:00100000:1.0:1787826365.923754:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03975a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:2403:x1874670563687808:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826365.923770:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826365.923777:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400000/0x22153cd396b80073 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab037f expref: 53 pid: 32404 timeout: 1411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.923791:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400000/0x22153cd396b80073 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab037f expref: 53 pid: 32404 timeout: 1411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.923817:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:1.0:1787826365.923822:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6400/0x22153cd396b80088 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.923833:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6400/0x22153cd396b80088 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.923840:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6400/0x22153cd396b80088 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.923858:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826365.923915:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03975a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:2403:x1874670563687808:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 162us (1881us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826365.923923:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 947 00010000:00010000:0.0:1787826365.931813:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400000/0x22153cd396b80073 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab037f expref: 52 pid: 32404 timeout: 1411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826365.931841:0:9966:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf39f80780 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9966:1874670585172480:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826365.931866:0:9966:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6400/0x22153cd396b80088 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.931876:0:9966:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6400/0x22153cd396b80088 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.931881:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6400/0x22153cd396b80088 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826365.931932:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0x9:0x0]: returning size 3700000 00000004:00200000:0.0:1787826365.931936:0:9966:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826365.931955:0:9966:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6400/0x22153cd396b80088 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.931995:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7400/0x22153cd396b80081 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0386 expref: 52 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.932008:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6400/0x22153cd396b80088 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0386 expref: 51 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.932016:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:0.0:1787826365.932018:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826365.932021:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3abd6400, rc 0) 00000100:00100000:0.0:1787826365.932159:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+51:52430:x1874670563687680:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 27820us (29253us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826365.932168:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3387 00000100:00100000:2.0:1787826365.941827:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826365.941931:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563688064 00000100:00100000:3.0:1787826365.941941:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563688064 00000100:00100000:3.0:1787826365.942040:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 996 00000100:00100000:3.0:1787826365.942050:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+51:52430:x1874670563688064:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:3.0:1787826365.942295:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+52:52430:x1874670563688064:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 245us (592us total) trans 4294967636 rc 0/0 00000100:00100000:3.0:1787826365.942303:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 996 00000100:00100000:2.0:1787826365.947986:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826365.948120:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563688320 00000100:00100000:0.0:1787826365.948130:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563688320 00000100:00100000:0.0:1787826365.948189:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3388 00000100:00100000:0.0:1787826365.948207:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03986940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+52:52430:x1874670563688320:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826365.948238:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826365.948241:0:16564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787826365.948275:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400200/0x22153cd396b8005e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0378 expref: 52 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.948294:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:0.0:1787826365.948299:0:16564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826365.948312:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057cf400/0x22153cd396b8008f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab038d expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.948405:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057ce600/0x22153cd396b80096 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.948419:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057ce600/0x22153cd396b80096 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x9:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.948429:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057ce600/0x22153cd396b80096 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x9:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826365.948440:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0x9:0x0]: returning size 3700000 00010000:00010000:0.0:1787826365.948585:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057cf400/0x22153cd396b8008f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab038d expref: 54 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.948599:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057ce600/0x22153cd396b80096 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x9:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab038d expref: 53 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826365.948607:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:0.0:1787826365.948610:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787826365.948613:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce057ce600, rc 0) 00000100:00100000:0.0:1787826365.948672:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03986940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:52430:x1874670563688320:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 475us (695us total) trans 4294967637 rc 0/0 00000100:00100000:0.0:1787826365.948684:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3388 00000100:00100000:2.0:1787826365.970910:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826365.970953:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826365.971035:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563688448 00000100:00100000:1.0:1787826365.971044:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563688448 00000100:00100000:1.0:1787826365.971096:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563688576 00000100:00100000:1.0:1787826365.971099:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563688576 00000100:00100000:1.0:1787826365.971130:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1750 00000100:00100000:1.0:1787826365.971140:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03985680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2403:x1874670563688448:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:1.0:1787826365.971183:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000673b7b2e/0x22153cd396b800a4 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.971214:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f4014864/0x22153cd396b80049 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab036a expref: 13 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.971225:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826365.971230:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826365.971235:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000673b7b2e/0x22153cd396b800a4 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.971389:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f4014864/0x22153cd396b80049 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab036a expref: 13 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.971405:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f4014864/0x22153cd396b80049 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab036a expref: 13 pid: 30398 timeout: 1411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826365.971420:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f82fc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1874670585172608:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826365.971522:0:8435:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce06a86900 going to sleep for 11 seconds 00000100:00100000:2.0:1787826365.971597:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1751 00000100:00100000:2.0:1787826365.971607:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2403:x1874670563688576:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:2.0:1787826365.971629:0:28853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061e22549/0x22153cd396b800ab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826365.971642:0:28853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009e843828/0x22153cd396b80050 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0371 expref: 14 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826365.971650:0:28853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826365.971653:0:28853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826365.971657:0:28853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061e22549/0x22153cd396b800ab lrc: 4/0,1 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826365.971718:0:28853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009e843828/0x22153cd396b80050 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0371 expref: 14 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826365.971730:0:28853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009e843828/0x22153cd396b80050 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0371 expref: 14 pid: 8436 timeout: 1411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826365.971741:0:28853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf41c86580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28853:1874670585172736:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826365.971768:0:28853:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf19bfea80 going to sleep for 11 seconds 00000100:00100000:1.0:1787826365.985151:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f82fc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1874670585172608:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826365.985181:0:8435:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000673b7b2e/0x22153cd396b800a4 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826365.985401:0:28853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf41c86580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28853:1874670585172736:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826365.985419:0:28853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000061e22549/0x22153cd396b800ab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826365.985807:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826365.985884:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826365.986152:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563688704 00000100:00100000:0.0:1787826365.986160:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563688704 00010000:00010000:0.0:1787826365.986195:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f4014864/0x22153cd396b80049 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab036a expref: 14 pid: 30398 timeout: 1411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826365.986423:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563688832 00000100:00100000:3.0:1787826365.986427:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563688832 00010000:00010000:3.0:1787826365.986446:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009e843828/0x22153cd396b80050 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0371 expref: 15 pid: 8436 timeout: 1411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826365.986512:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 948 00000100:00100000:3.0:1787826365.986522:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c86580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2403:x1874670563688704:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826365.986547:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826365.986570:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f4014864/0x22153cd396b80049 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab036a expref: 14 pid: 30398 timeout: 1411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.986584:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f4014864/0x22153cd396b80049 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab036a expref: 14 pid: 30398 timeout: 1411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.986607:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4014864/0x22153cd396b80049 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab036a expref: 14 pid: 30398 timeout: 1411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.986631:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826365.986635:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826365.986642:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000673b7b2e/0x22153cd396b800a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.986653:0:10340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000673b7b2e/0x22153cd396b800a4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.986676:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826365.986735:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c86580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2403:x1874670563688704:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 215us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826365.986744:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 948 00000100:00100000:3.0:1787826365.986771:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 949 00000100:00100000:3.0:1787826365.986779:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c86d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2403:x1874670563688832:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826365.986787:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826365.986799:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009e843828/0x22153cd396b80050 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0371 expref: 15 pid: 8436 timeout: 1411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.986811:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009e843828/0x22153cd396b80050 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0371 expref: 15 pid: 8436 timeout: 1411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.986825:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e843828/0x22153cd396b80050 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0371 expref: 15 pid: 8436 timeout: 1411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.986842:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826365.986845:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826365.986850:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000061e22549/0x22153cd396b800ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.986858:0:10340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061e22549/0x22153cd396b800ab lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826365.986874:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826365.986891:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c86d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2403:x1874670563688832:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 113us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826365.986898:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 949 00010000:00010000:1.0:1787826365.987539:0:8435:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000673b7b2e/0x22153cd396b800a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.987552:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000673b7b2e/0x22153cd396b800a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.987575:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000673b7b2e/0x22153cd396b800a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.987583:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000673b7b2e/0x22153cd396b800a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.987591:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000673b7b2e/0x22153cd396b800a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.987599:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835400 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:1.0:1787826365.987604:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000673b7b2e/0x22153cd396b800a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.987613:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000673b7b2e/0x22153cd396b800a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.987628:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000673b7b2e/0x22153cd396b800a4 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826365.987642:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000673b7b2e/0x22153cd396b800a4 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826365.987695:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03985680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563688448:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 16556us (16795us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826365.987717:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1750 00010000:00010000:2.0:1787826365.988259:0:28853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000061e22549/0x22153cd396b800ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826365.988271:0:28853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061e22549/0x22153cd396b800ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826365.988290:0:28853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061e22549/0x22153cd396b800ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826365.988299:0:28853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061e22549/0x22153cd396b800ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826365.988308:0:28853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061e22549/0x22153cd396b800ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826365.988315:0:28853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3abd7e00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826365.988319:0:28853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061e22549/0x22153cd396b800ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826365.988327:0:28853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061e22549/0x22153cd396b800ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826365.988340:0:28853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061e22549/0x22153cd396b800ab lrc: 2/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826365.988348:0:28853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061e22549/0x22153cd396b800ab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826365.988394:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2403:x1874670563688576:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 16788us (17439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826365.988400:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1751 00000100:00100000:3.0:1787826365.999049:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826365.999126:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563689088 00000100:00100000:2.0:1787826365.999136:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563689088 00000100:00100000:2.0:1787826365.999195:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3389 00000100:00100000:2.0:1787826365.999214:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:52430:x1874670563689088:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:2.0:1787826365.999285:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826365.999313:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6400/0x22153cd396b80088 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0386 expref: 53 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826365.999331:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:2.0:1787826365.999337:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826365.999365:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6a00/0x22153cd396b800b2 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826365.999378:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6a00/0x22153cd396b800b2 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826365.999388:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6a00/0x22153cd396b800b2 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787826365.999674:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].14, 88 off9160 00000004:00080000:2.0:1787826365.999683:0:6520:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1312011211207ns, next at 1201607267971ns, rc = 0 00000040:00080000:2.0:1787826366.000042:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].14, 88 off9160 00000004:00080000:2.0:1787826366.000051:0:6520:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1312011579083ns, next at 1201610029598ns, rc = 0 00000040:00080000:2.0:1787826366.000077:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].15, 88 off9248 00000004:00080000:2.0:1787826366.000082:0:6520:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1312011609908ns, next at 1201607267971ns, rc = 0 00000040:00080000:2.0:1787826366.000102:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].15, 88 off9248 00000004:00080000:2.0:1787826366.000106:0:6520:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1312011634576ns, next at 1201610029598ns, rc = 0 00000040:00080000:2.0:1787826366.000116:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].16, 88 off9336 00000004:00080000:2.0:1787826366.000119:0:6520:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1312011647246ns, next at 1201607267971ns, rc = 0 00000001:00080000:3.0:1787826366.022659:0:7449:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967638 is committed 00000004:00080000:3.0:1787826366.022676:0:7449:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 18 committed 00000004:00080000:3.0:1787826366.022696:0:7449:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 16 committed 00000004:00080000:3.0:1787826366.022703:0:7449:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 17 committed 00000004:00080000:3.0:1787826366.022705:0:7449:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 15 committed 00010000:00010000:0.0:1787826366.022825:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834c00/0x22153cd396b7fea5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.022840:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834c00/0x22153cd396b7fea5 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.022850:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834c00/0x22153cd396b7fea5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.022859:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826366.022864:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834c00/0x22153cd396b7fea5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.022873:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834c00/0x22153cd396b7fea5 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.022890:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xc:0x0].0x0 (ffff90cf371d2100) 00010000:00010000:0.0:1787826366.022893:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826366.022897:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834c00/0x22153cd396b7fea5 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.022904:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834c00/0x22153cd396b7fea5 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.022939:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f1200/0x22153cd396b7feba lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.022947:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f1200/0x22153cd396b7feba lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.022953:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f1200/0x22153cd396b7feba lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.022958:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf181f1200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826366.022961:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f1200/0x22153cd396b7feba lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.022968:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f1200/0x22153cd396b7feba lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.022976:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:0.0:1787826366.022978:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826366.022981:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f1200/0x22153cd396b7feba lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.022988:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf181f1200/0x22153cd396b7feba lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.022999:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057ce400/0x22153cd396b7ffe7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.023006:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057ce400/0x22153cd396b7ffe7 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.023012:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057ce400/0x22153cd396b7ffe7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.023019:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce057ce400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826366.023023:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057ce400/0x22153cd396b7ffe7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.023030:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057ce400/0x22153cd396b7ffe7 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.023039:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:0.0:1787826366.023042:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2a 00010000:00010000:0.0:1787826366.023045:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057ce400/0x22153cd396b7ffe7 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.023052:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057ce400/0x22153cd396b7ffe7 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.023062:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057cee00/0x22153cd396b8001f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.023070:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057cee00/0x22153cd396b8001f lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.023081:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057cee00/0x22153cd396b8001f lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.023090:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce057cee00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826366.023094:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057cee00/0x22153cd396b8001f lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.023102:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057cee00/0x22153cd396b8001f lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.023117:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:0.0:1787826366.023120:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2a 00010000:00010000:0.0:1787826366.023124:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057cee00/0x22153cd396b8001f lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.023130:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057cee00/0x22153cd396b8001f lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826366.023136:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf41c87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585172992:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1787826366.023243:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826366.023296:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf41c85e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585172864:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1787826366.023329:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585172992 00000100:00100000:2.0:1787826366.023338:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585172992 00000100:00100000:0.0:1787826366.023373:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826366.023420:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585172864 00000100:00100000:0.0:1787826366.023423:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585173376:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1787826366.023428:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585172864 00000100:00100000:0.0:1787826366.023464:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826366.023508:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1752 00000100:00100000:2.0:1787826366.023523:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c87c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+7:3647:x1874670585172992:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1787826366.023573:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585173376 00000100:00100000:0.0:1787826366.023582:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585173376 00000100:00100000:0.0:1787826366.023626:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1753 00000100:00100000:0.0:1787826366.023636:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+7:3646:x1874670585172864:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:0.0:1787826366.023783:0:30695:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1787826366.023787:0:30695:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb mtime from disk: 1787826364 -> 1787826364 00002000:00010000:0.0:1787826366.023790:0:30695:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb atime from disk: 1787826364 -> 1787826364 00002000:00010000:0.0:1787826366.023793:0:30695:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb ctime from disk: 1787826365 -> 1787826365 00002000:00010000:0.0:1787826366.023795:0:30695:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1787826366.023831:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+8:3646:x1874670585172864:12345-0@lo:2:osp-syn-0-1.0 Request processed in 196us (459us total) trans 21474836906 rc 0/0 00000100:00100000:0.0:1787826366.023839:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1753 00000100:00100000:0.0:1787826366.023856:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1754 00000100:00100000:0.0:1787826366.023862:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf36202940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+6:3646:x1874670585173376:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1787826366.023938:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf36202940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+7:3646:x1874670585173376:12345-0@lo:2:osp-syn-1-1.0 Request processed in 75us (478us total) trans 17179869581 rc 0/0 00000100:00100000:0.0:1787826366.023945:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1754 00000004:00080000:0.0:1787826366.023986:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf41c85e00/2, rc 0, transno 21474836906 00000100:00100000:0.0:1787826366.023992:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf41c85e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585172864:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1787826366.024002:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce01fded00/2, rc 0, transno 17179869581 00000100:00100000:0.0:1787826366.024006:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585173376:0@lo:2:osp-syn-1-1.0 00000100:00080000:0.0:1787826366.024030:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787826366.024034:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1787826366.024547:0:7449:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 16 committed 00002000:00010000:2.0:1787826366.024625:0:30696:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 1602848 -> 1602848 00000020:00080000:3.0:1787826366.024630:0:7449:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff90cf3aaf5e40 refcount 2 committed 0 result 0 batchid 21 00002000:00010000:2.0:1787826366.024633:0:30696:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1787826364 -> 1787826364 00000020:00080000:3.0:1787826366.024639:0:7449:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90ce04e9be00 obd lustre-OST0001-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff90cf10a180c0 00002000:00010000:2.0:1787826366.024641:0:30696:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 1787826364 -> 1787826364 00002000:00010000:2.0:1787826366.024651:0:30696:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787826365 -> 1787826365 00000020:00080000:3.0:1787826366.024653:0:7449:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cf07807300 obd lustre-OST0000-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff90cf18385480 00002000:00010000:2.0:1787826366.024658:0:30696:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 56 -> 56 00000020:00080000:3.0:1787826366.024660:0:7449:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90ce03007b00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90ce04fa6e00 00000020:00080000:3.0:1787826366.024667:0:7449:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].18 00000020:00080000:3.0:1787826366.024685:0:7449:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 20 batchid updated 00000100:00100000:2.0:1787826366.024734:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c87c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+8:3647:x1874670585172992:12345-0@lo:2:osp-syn-0-1.0 Request processed in 1213us (1492us total) trans 21474836907 rc 0/0 00000100:00100000:2.0:1787826366.024745:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1752 00000004:00080000:2.0:1787826366.024813:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf41c87480/2, rc 0, transno 21474836907 00000100:00100000:2.0:1787826366.024828:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf41c87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585172992:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1787826366.025435:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf41c84780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585173120:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1787826366.025534:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1787826366.025577:0:7472:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 21 committed batchid 20 00000100:00100000:3.0:1787826366.025585:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787826366.025595:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf39f80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585173248:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1787826366.025625:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826366.025673:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585173120 00000100:00100000:3.0:1787826366.025679:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585173120 00000004:00080000:1.0:1787826366.025730:0:7472:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff90ce06a86900 with version 33 00000100:00100000:3.0:1787826366.025862:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585173248 00000100:00100000:3.0:1787826366.025867:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585173248 00000100:00100000:3.0:1787826366.025892:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1755 00000100:00100000:3.0:1787826366.025899:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+8:3644:x1874670585173120:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1787826366.025996:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1756 00000100:00100000:2.0:1787826366.026012:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+7:3644:x1874670585173248:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1787826366.026067:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+9:3644:x1874670585173120:12345-0@lo:2:osp-syn-0-1.0 Request processed in 166us (542us total) trans 21474836908 rc 0/0 00000100:00100000:3.0:1787826366.026077:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1755 00000004:00080000:3.0:1787826366.026133:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf41c84780/2, rc 0, transno 21474836908 00000100:00100000:3.0:1787826366.026140:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf41c84780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585173120:0@lo:2:osp-syn-0-1.0 00002000:00010000:2.0:1787826366.026147:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1787826366.026152:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb mtime from disk: 1787826364 -> 1787826364 00002000:00010000:2.0:1787826366.026155:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb atime from disk: 1787826364 -> 1787826364 00002000:00010000:2.0:1787826366.026158:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb ctime from disk: 1787826365 -> 1787826365 00002000:00010000:2.0:1787826366.026161:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb blocks from disk: 32 -> 32 00000100:00100000:2.0:1787826366.026224:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+8:3644:x1874670585173248:12345-0@lo:2:osp-syn-1-1.0 Request processed in 217us (597us total) trans 17179869582 rc 0/0 00000100:00100000:2.0:1787826366.026231:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1756 00000004:00010000:3.0:1787826366.026495:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aab7d885 reply state 00000000208ee3bc transno 4294967638 ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6a00/0x22153cd396b800b2 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.026519:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6a00/0x22153cd396b800b2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.026539:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:3.0:1787826366.026542:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1787826366.026547:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1787826366.026628:0:6520:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1787826366.026647:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:52430:x1874670563689088:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 27432us (27604us total) trans 4294967638 rc 0/0 00000100:00100000:3.0:1787826366.026654:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3389 00010000:00010000:3.0:1787826366.026683:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6a00/0x22153cd396b800b2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.026691:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6a00/0x22153cd396b800b2 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.026700:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6a00/0x22153cd396b800b2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.026717:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3abd6a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826366.026722:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6a00/0x22153cd396b800b2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.026731:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6a00/0x22153cd396b800b2 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.026742:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:3.0:1787826366.026745:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826366.026749:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6a00/0x22153cd396b800b2 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.026757:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6a00/0x22153cd396b800b2 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787826366.026796:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf39f80780/2, rc 0, transno 17179869582 00000100:00100000:3.0:1787826366.026802:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf39f80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585173248:0@lo:2:osp-syn-1-1.0 00000020:00080000:1.0:1787826366.028992:0:7472:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 20 cancel update log [0x200000401:0x2:0x0].15: rc = 0 00000020:00080000:1.0:1787826366.029438:0:7472:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 20 cancel update log [0x240000400:0x2:0x0].17: rc = 0 00000020:00080000:1.0:1787826366.029450:0:7472:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 20 00000004:00080000:1.0:1787826366.029501:0:7464:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff90cf076a8cc0 version 33 rpc_version 33 00000020:00100000:1.0:1787826366.029560:0:7464:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826366.029573:0:7464:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff90cf3f82fc00 x1874670585173632/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826366.029602:0:7464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f82fc00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7464:1874670585173632:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787826366.029688:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826366.029841:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585173632 00000100:00100000:2.0:1787826366.029851:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585173632 00000100:00100000:2.0:1787826366.029918:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1359 00000100:00100000:2.0:1787826366.029931:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:7464:x1874670585173632:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787826366.031386:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:7464:x1874670585173632:12345-0@lo:1000:osp_up0-1.0 Request processed in 1448us (1687us total) trans 8589934617 rc 0/0 00000100:00100000:2.0:1787826366.031400:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1359 00000100:00100000:2.0:1787826366.031508:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826366.033942:0:7464:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce06a863c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826366.034020:0:7464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f82fc00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7464:1874670585173632:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787826366.035448:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563689216 00000100:00100000:3.0:1787826366.035463:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563689216 00000100:00100000:3.0:1787826366.035584:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3390 00000100:00100000:3.0:1787826366.035595:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c84f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:52430:x1874670563689216:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826366.035619:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826366.035644:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401a00/0x22153cd396b800b9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0394 expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.035703:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401a00/0x22153cd396b800b9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0394 expref: 22 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.035730:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401a00/0x22153cd396b800b9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0394 expref: 22 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.035748:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:3.0:1787826366.035752:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826366.035755:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401a00, rc 0) 00000100:00100000:3.0:1787826366.035820:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c84f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:52430:x1874670563689216:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 227us (4314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826366.035828:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3390 00000100:00080000:1.0:1787826366.039016:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787826366.183561:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826366.185220:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563689344 00000100:00100000:0.0:1787826366.185239:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563689344 00000100:00100000:0.0:1787826366.185339:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3391 00000100:00100000:0.0:1787826366.185352:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:52430:x1874670563689344:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826366.185380:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826366.185409:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057cee00/0x22153cd396b800c0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab039b expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.185577:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057ce400/0x22153cd396b800c7 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.185597:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057ce400/0x22153cd396b800c7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.185613:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057ce400/0x22153cd396b800c7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826366.185649:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0x9:0x0]: returning size 3700000 00000004:00200000:0.0:1787826366.185654:0:9966:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826366.185676:0:9966:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057ce400/0x22153cd396b800c7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.185717:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057cee00/0x22153cd396b800c0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab039b expref: 24 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.185743:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057ce400/0x22153cd396b800c7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab039b expref: 23 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.185754:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:0.0:1787826366.185757:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826366.185761:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce057ce400, rc 0) 00000100:00100000:0.0:1787826366.185982:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+23:52430:x1874670563689344:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 632us (2512us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826366.185991:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3391 00000100:00100000:2.0:1787826366.192517:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826366.192625:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826366.192725:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563689472 00000100:00100000:1.0:1787826366.192738:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563689472 00000100:00100000:1.0:1787826366.192827:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563689600 00000100:00100000:1.0:1787826366.192830:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563689600 00000100:00100000:1.0:1787826366.192859:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1757 00000100:00100000:1.0:1787826366.192870:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563689472:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826366.192893:0:8545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826366.192919:0:8545:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000673b7b2e/0x22153cd396b800ce lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab03a2 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826366.192952:0:8545:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x21:0x0] initial LVB size: 2097152, mtime: 0x6a9010bc, atime: 0x6a9010bc, ctime: 0x6a9010bd, blocks: 0x40 00010000:00010000:1.0:1787826366.192978:0:8545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x21:0x0].0x0 since=1312s v=(0 0) 00010000:00010000:1.0:1787826366.192984:0:8545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826366.193010:0:8545:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000673b7b2e/0x22153cd396b800ce lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03a2 expref: 13 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826366.193035:0:8545:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000673b7b2e/0x22153cd396b800ce lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03a2 expref: 13 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826366.193052:0:8545:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835400, rc 0) 00000100:00100000:1.0:1787826366.193135:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2403:x1874670563689472:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 266us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826366.193142:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1757 00000100:00100000:1.0:1787826366.193162:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1758 00000100:00100000:1.0:1787826366.193168:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c85680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2404:x1874670563689600:12345-192.168.203.39@tcp:101:lfs.0 00000100:00080000:2.0:1787826366.193421:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787826366.193427:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787826366.193739:0:8545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826366.193757:0:8545:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b608887/0x22153cd396b800d5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab03a9 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826366.193777:0:8545:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x23:0x0] initial LVB size: 3700000, mtime: 0x6a9010bc, atime: 0x6a9010bc, ctime: 0x6a9010bd, blocks: 0x28 00010000:00010000:1.0:1787826366.193791:0:8545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=1312s v=(0 0) 00010000:00010000:1.0:1787826366.193795:0:8545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826366.193804:0:8545:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b608887/0x22153cd396b800d5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03a9 expref: 14 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826366.193818:0:8545:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004b608887/0x22153cd396b800d5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03a9 expref: 14 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826366.193828:0:8545:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834e00, rc 0) 00000100:00100000:1.0:1787826366.193903:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c85680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563689600:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 734us (1276us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826366.193910:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1758 00000100:00100000:2.0:1787826366.208795:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826366.208963:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563689728 00000100:00100000:3.0:1787826366.208975:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563689728 00000100:00100000:3.0:1787826366.209055:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1759 00000100:00100000:3.0:1787826366.209067:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c84b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2403:x1874670563689728:12345-192.168.203.39@tcp:23:lfs.0 00000100:00100000:3.0:1787826366.209227:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c84b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2403:x1874670563689728:12345-192.168.203.39@tcp:23:lfs.0 Request processed in 162us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826366.209236:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1759 00000100:00100000:2.0:1787826366.215704:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826366.215936:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563689856 00000100:00100000:3.0:1787826366.215948:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563689856 00000100:00100000:3.0:1787826366.216026:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1760 00000100:00100000:3.0:1787826366.216037:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2402:x1874670563689856:12345-192.168.203.39@tcp:23:lfs.0 00000100:00100000:3.0:1787826366.216296:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2402:x1874670563689856:12345-192.168.203.39@tcp:23:lfs.0 Request processed in 260us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826366.216306:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1760 00000100:00100000:2.0:1787826366.220721:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826366.225138:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563689984 00000100:00100000:3.0:1787826366.225163:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563689984 00000100:00100000:3.0:1787826366.225290:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3392 00000100:00100000:3.0:1787826366.225304:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+23:52430:x1874670563689984:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826366.225338:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826366.225372:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400e00/0x22153cd396b800dc lrc: 2/0,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab03b0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.225426:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401200/0x22153cd396b800e3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.225445:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401200/0x22153cd396b800e3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.225459:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401200/0x22153cd396b800e3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.225675:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400e00/0x22153cd396b800dc lrc: 0/0,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03b0 expref: 25 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.225700:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401200/0x22153cd396b800e3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03b0 expref: 24 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.226094:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:3.0:1787826366.226097:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787826366.226102:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401200, rc 0) 00000100:00100000:0.0:1787826366.226342:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:52430:x1874670563689984:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1039us (5660us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826366.226354:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3392 00000100:00100000:2.0:1787826366.230045:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826366.230317:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563690240 00000100:00100000:3.0:1787826366.230330:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563690240 00000100:00100000:3.0:1787826366.230406:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3393 00000100:00100000:3.0:1787826366.230417:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:52430:x1874670563690240:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:3.0:1787826366.230539:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826366.230574:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057ce400/0x22153cd396b800c7 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab039b expref: 24 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.230597:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:3.0:1787826366.230603:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826366.230847:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400a00/0x22153cd396b800ea lrc: 3/0,1 mode: --/PW res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.230864:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400a00/0x22153cd396b800ea lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.230875:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400a00/0x22153cd396b800ea lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787826366.230929:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967639 00000004:00010000:3.0:1787826366.230956:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ea436d41 reply state 00000000d90343c7 transno 4294967640 ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400a00/0x22153cd396b800ea lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.230968:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400a00/0x22153cd396b800ea lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.230975:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:3.0:1787826366.230978:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826366.230981:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826366.231085:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:52430:x1874670563690240:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 669us (1056us total) trans 4294967640 rc 0/0 00000100:00100000:3.0:1787826366.231093:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3393 00000020:00080000:3.0:1787826366.231100:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787826366.236437:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826366.236658:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563690368 00000100:00100000:2.0:1787826366.236671:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563690368 00000100:00100000:2.0:1787826366.237733:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1761 00000100:00100000:2.0:1787826366.237751:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf362003c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:52430:x1874670563690368:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826366.237939:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826366.237965:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb167c78/0x22153cd396b800f1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab03b7 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.238013:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002050a528/0x22153cd396b7ff69 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab031d expref: 15 pid: 30398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.238025:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787826366.238030:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826366.238036:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb167c78/0x22153cd396b800f1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03b7 expref: 15 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.238074:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002050a528/0x22153cd396b7ff69 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab031d expref: 15 pid: 30398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.238088:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002050a528/0x22153cd396b7ff69 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab031d expref: 15 pid: 30398 timeout: 1412 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826366.238105:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf41c85a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1874670585173760:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826366.238302:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3aaf59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826366.241672:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826366.242002:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf41c85a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1874670585173760:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826366.242050:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000eb167c78/0x22153cd396b800f1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03b7 expref: 15 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.242077:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3abd7000, rc 0) 00000100:00100000:2.0:1787826366.242153:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf362003c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:52430:x1874670563690368:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 4408us (5731us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826366.242164:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1761 00000100:00100000:1.0:1787826366.244193:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563690496 00000100:00100000:1.0:1787826366.244209:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563690496 00010000:00010000:1.0:1787826366.244269:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002050a528/0x22153cd396b7ff69 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab031d expref: 15 pid: 30398 timeout: 1412 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826366.244321:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 950 00000100:00100000:1.0:1787826366.244332:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf362012c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2403:x1874670563690496:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826366.244353:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826366.244360:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002050a528/0x22153cd396b7ff69 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab031d expref: 15 pid: 30398 timeout: 1412 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826366.244376:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002050a528/0x22153cd396b7ff69 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab031d expref: 15 pid: 30398 timeout: 1412 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826366.244411:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002050a528/0x22153cd396b7ff69 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab031d expref: 15 pid: 30398 timeout: 1412 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826366.244434:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826366.244439:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826366.244450:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000eb167c78/0x22153cd396b800f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03b7 expref: 14 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826366.244461:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb167c78/0x22153cd396b800f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03b7 expref: 14 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826366.244557:0:6504:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000eb167c78/0x22153cd396b800f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03b7 expref: 14 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826366.244574:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0b430000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6504:1874670585173888:192.168.203.39@tcp:105: 00000100:00100000:1.0:1787826366.244681:0:6504:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce06a863c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826366.249233:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826366.249392:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563690624 00000100:00100000:2.0:1787826366.249405:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563690624 00000100:00100000:2.0:1787826366.249513:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1762 00000100:00100000:2.0:1787826366.249535:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf36203840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:52430:x1874670563690624:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826366.249560:0:30696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826366.249588:0:30696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048042b98/0x22153cd396b800f8 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab03be expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.249634:0:30696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000088c1e0c0/0x22153cd396b7ff70 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0324 expref: 14 pid: 30696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.249645:0:30696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x20:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787826366.249650:0:30696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826366.249656:0:30696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048042b98/0x22153cd396b800f8 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03be expref: 14 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.249710:0:30696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000088c1e0c0/0x22153cd396b7ff70 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0324 expref: 14 pid: 30696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.249727:0:30696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000088c1e0c0/0x22153cd396b7ff70 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0324 expref: 14 pid: 30696 timeout: 1412 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826366.249746:0:30696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf41c85a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:30696:1874670585174016:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826366.249843:0:30696:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3aaf59c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826366.252720:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0b430000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6504:1874670585173888:192.168.203.39@tcp:105: 00010000:00010000:1.0:1787826366.252816:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826366.252891:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf362012c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2403:x1874670563690496:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 8559us (11232us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826366.252904:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 950 00000100:00100000:3.0:1787826366.254142:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826366.254511:0:30696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf41c85a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:30696:1874670585174016:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826366.254564:0:30696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000048042b98/0x22153cd396b800f8 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03be expref: 14 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.254594:0:30696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3abd7a00, rc 0) 00000100:00100000:2.0:1787826366.254656:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf36203840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:52430:x1874670563690624:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 5132us (5437us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826366.254671:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1762 00000100:00100000:1.0:1787826366.254979:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563690752 00000100:00100000:1.0:1787826366.254988:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563690752 00010000:00010000:1.0:1787826366.255022:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000088c1e0c0/0x22153cd396b7ff70 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0324 expref: 14 pid: 30696 timeout: 1412 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826366.255060:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 951 00000100:00100000:1.0:1787826366.255070:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563690752:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826366.255091:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826366.255098:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000088c1e0c0/0x22153cd396b7ff70 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0324 expref: 14 pid: 30696 timeout: 1412 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826366.255113:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000088c1e0c0/0x22153cd396b7ff70 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0324 expref: 14 pid: 30696 timeout: 1412 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826366.255140:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088c1e0c0/0x22153cd396b7ff70 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0324 expref: 14 pid: 30696 timeout: 1412 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826366.255156:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826366.255161:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826366.255169:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000048042b98/0x22153cd396b800f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03be expref: 13 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826366.256622:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048042b98/0x22153cd396b800f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03be expref: 13 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826366.256695:0:6503:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000048042b98/0x22153cd396b800f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03be expref: 13 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826366.256730:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0b430000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6503:1874670585174144:192.168.203.39@tcp:105: 00000100:00100000:1.0:1787826366.258148:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce06a863c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826366.264507:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0b430000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6503:1874670585174144:192.168.203.39@tcp:105: 00010000:00010000:1.0:1787826366.264552:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826366.264624:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2404:x1874670563690752:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 9554us (10490us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826366.264637:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 951 00000100:00100000:0.0:1787826366.264834:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826366.269656:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563690880 00000100:00100000:1.0:1787826366.269678:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563690880 00000100:00100000:1.0:1787826366.269793:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1763 00000100:00100000:1.0:1787826366.269805:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf36201a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:52430:x1874670563690880:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826366.269830:0:8545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826366.269856:0:8545:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088c1e0c0/0x22153cd396b800ff lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab03c5 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826366.269898:0:8545:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b7ff77 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab032b expref: 15 pid: 14864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826366.269908:0:8545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787826366.269913:0:8545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826366.269919:0:8545:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088c1e0c0/0x22153cd396b800ff lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03c5 expref: 15 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826366.269965:0:8545:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b7ff77 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab032b expref: 15 pid: 14864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826366.269982:0:8545:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b7ff77 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab032b expref: 15 pid: 14864 timeout: 1412 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826366.269998:0:8545:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0b430000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8545:1874670585174272:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826366.270122:0:8545:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce06a863c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826366.274210:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826366.274457:0:8545:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0b430000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8545:1874670585174272:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826366.274540:0:8545:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000088c1e0c0/0x22153cd396b800ff lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03c5 expref: 15 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826366.274571:0:8545:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835200, rc 0) 00000100:00100000:1.0:1787826366.274649:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf36201a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:52430:x1874670563690880:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 4846us (9816us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826366.274660:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1763 00000100:00100000:2.0:1787826366.274871:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563691008 00000100:00100000:2.0:1787826366.274890:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563691008 00010000:00010000:2.0:1787826366.274934:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b7ff77 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab032b expref: 15 pid: 14864 timeout: 1412 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826366.274976:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 952 00000100:00100000:2.0:1787826366.274986:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1064e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2403:x1874670563691008:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826366.275004:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826366.275010:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b7ff77 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab032b expref: 15 pid: 14864 timeout: 1412 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.275026:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b7ff77 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab032b expref: 15 pid: 14864 timeout: 1412 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.275055:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b7ff77 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab032b expref: 15 pid: 14864 timeout: 1412 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.275072:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826366.275077:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826366.275084:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088c1e0c0/0x22153cd396b800ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03c5 expref: 14 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.275095:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088c1e0c0/0x22153cd396b800ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03c5 expref: 14 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.275141:0:6505:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000088c1e0c0/0x22153cd396b800ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03c5 expref: 14 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826366.275157:0:6505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf41c85a40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1874670585174400:192.168.203.39@tcp:105: 00000100:00100000:2.0:1787826366.275231:0:6505:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3aaf59c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826366.283659:0:6505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf41c85a40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1874670585174400:192.168.203.39@tcp:105: 00010000:00010000:2.0:1787826366.283712:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826366.283796:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1064e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2403:x1874670563691008:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 8809us (9602us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826366.283810:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 952 00000100:00100000:0.0:1787826366.286971:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826366.287014:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826366.287084:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826366.287317:0:25425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563691136 00000100:00100000:1.0:1787826366.287329:0:25425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563691136 00002000:00010000:1.0:1787826366.287384:0:25425:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/33 (0->18446744073709551615) 00002000:00100000:1.0:1787826366.287390:0:25425:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf362012c0 with x1874670563691136 ext(0->18446744073709551615) 00002000:00010000:1.0:1787826366.287405:0:25425:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf362012c0. 00000100:00100000:1.0:1787826366.287438:0:25425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563691264 00000100:00100000:1.0:1787826366.287441:0:25425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563691264 00002000:00010000:1.0:1787826366.287455:0:25425:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/32 (0->18446744073709551615) 00002000:00100000:1.0:1787826366.287458:0:25425:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf3ab161c0 with x1874670563691264 ext(0->18446744073709551615) 00002000:00010000:1.0:1787826366.287465:0:25425:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90cf3ab161c0. 00000100:00100000:1.0:1787826366.287518:0:25425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563691392 00000100:00100000:1.0:1787826366.287531:0:25425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563691392 00002000:00010000:1.0:1787826366.287543:0:25425:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/34 (0->18446744073709551615) 00002000:00100000:1.0:1787826366.287545:0:25425:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce05123480 with x1874670563691392 ext(0->18446744073709551615) 00002000:00010000:1.0:1787826366.287551:0:25425:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90ce05123480. 00000100:00100000:1.0:1787826366.287573:0:25425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 670 00000100:00100000:1.0:1787826366.287584:0:25425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf362012c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2404:x1874670563691136:12345-192.168.203.39@tcp:10:lfs.0 00000100:00100000:2.0:1787826366.288468:0:30188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 671 00000100:00100000:2.0:1787826366.288509:0:30188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2404:x1874670563691264:12345-192.168.203.39@tcp:10:lfs.0 00000100:00100000:3.0:1787826366.288986:0:20692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 672 00000100:00100000:3.0:1787826366.288997:0:20692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2404:x1874670563691392:12345-192.168.203.39@tcp:10:lfs.0 00002000:00010000:2.0:1787826366.291802:0:30188:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb size from disk: 2097152 -> 0 00002000:00010000:2.0:1787826366.291813:0:30188:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb mtime from disk: 1787826364 -> 1787826366 00002000:00010000:2.0:1787826366.291816:0:30188:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb atime from disk: 1787826364 -> 1787826364 00002000:00010000:2.0:1787826366.291818:0:30188:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb ctime from disk: 1787826365 -> 1787826366 00002000:00010000:2.0:1787826366.291821:0:30188:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb blocks from disk: 32 -> 0 00002000:00010000:1.0:1787826366.292575:0:25425:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb size from disk: 1048576 -> 0 00002000:00010000:1.0:1787826366.292581:0:25425:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb mtime from disk: 1787826364 -> 1787826366 00002000:00010000:1.0:1787826366.292584:0:25425:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb atime from disk: 1787826364 -> 1787826364 00002000:00010000:1.0:1787826366.292586:0:25425:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb ctime from disk: 1787826365 -> 1787826366 00002000:00010000:1.0:1787826366.292588:0:25425:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1787826366.293110:0:30188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563691264:12345-192.168.203.39@tcp:10:lfs.0 Request processed in 4597us (6084us total) trans 17179869583 rc 0/0 00000100:00100000:2.0:1787826366.293125:0:30188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 671 00002000:00010000:2.0:1787826366.293132:0:30188:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/32 (0->18446744073709551615) 00002000:00100000:2.0:1787826366.293135:0:30188:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf3ab161c0 with x1874670563691264 ext(0->18446744073709551615) 00002000:00010000:2.0:1787826366.293146:0:30188:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90cf3ab161c0. 00000100:00100000:1.0:1787826366.293236:0:25425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf362012c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2404:x1874670563691136:12345-192.168.203.39@tcp:10:lfs.0 Request processed in 5653us (6280us total) trans 21474836909 rc 0/0 00000100:00100000:1.0:1787826366.293244:0:25425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 670 00002000:00010000:1.0:1787826366.293247:0:25425:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/33 (0->18446744073709551615) 00002000:00100000:1.0:1787826366.293250:0:25425:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf362012c0 with x1874670563691136 ext(0->18446744073709551615) 00002000:00010000:1.0:1787826366.293256:0:25425:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf362012c0. 00002000:00010000:3.0:1787826366.294193:0:20692:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 1602848 -> 0 00002000:00010000:3.0:1787826366.294201:0:20692:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1787826364 -> 1787826366 00002000:00010000:3.0:1787826366.294204:0:20692:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 1787826364 -> 1787826364 00002000:00010000:3.0:1787826366.294207:0:20692:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787826365 -> 1787826366 00002000:00010000:3.0:1787826366.294209:0:20692:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 56 -> 0 00000100:00100000:3.0:1787826366.294254:0:20692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2404:x1874670563691392:12345-192.168.203.39@tcp:10:lfs.0 Request processed in 5257us (7167us total) trans 21474836910 rc 0/0 00000100:00100000:3.0:1787826366.294263:0:20692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 672 00002000:00010000:3.0:1787826366.294267:0:20692:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/34 (0->18446744073709551615) 00002000:00100000:3.0:1787826366.294270:0:20692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce05123480 with x1874670563691392 ext(0->18446744073709551615) 00002000:00010000:3.0:1787826366.294276:0:20692:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90ce05123480. 00000100:00100000:0.0:1787826366.302404:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826366.304179:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563691520 00000100:00100000:3.0:1787826366.304201:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563691520 00000100:00100000:3.0:1787826366.304309:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3394 00000100:00100000:3.0:1787826366.304322:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05120780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:52430:x1874670563691520:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826366.304356:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826366.304384:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400e00/0x22153cd396b80106 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab03cc expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.304577:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b8010d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.304596:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b8010d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.304611:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b8010d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826366.304646:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0x9:0x0]: returning size 0 00000004:00200000:3.0:1787826366.304651:0:32404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826366.304673:0:32404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b8010d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.304977:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400e00/0x22153cd396b80106 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03cc expref: 28 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.305000:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b8010d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03cc expref: 27 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.305011:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:3.0:1787826366.305014:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826366.305018:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401800, rc 0) 00000100:00100000:3.0:1787826366.305105:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05120780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:52430:x1874670563691520:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 786us (2716us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826366.305114:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3394 00000100:00100000:0.0:1787826366.312758:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826366.312818:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826366.313075:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563691648 00000100:00100000:1.0:1787826366.313088:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563691648 00000100:00100000:1.0:1787826366.313143:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563691776 00000100:00100000:1.0:1787826366.313145:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563691776 00000100:00100000:1.0:1787826366.313183:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1764 00000100:00100000:1.0:1787826366.313193:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05123c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563691648:12345-192.168.203.39@tcp:23:lfs.0 00000100:00100000:1.0:1787826366.313330:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05123c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563691648:12345-192.168.203.39@tcp:23:lfs.0 Request processed in 138us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826366.313339:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1764 00000100:00100000:1.0:1787826366.313357:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1765 00000100:00100000:1.0:1787826366.313363:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05120f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2404:x1874670563691776:12345-192.168.203.39@tcp:23:lfs.0 00000100:00100000:1.0:1787826366.313399:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05120f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2404:x1874670563691776:12345-192.168.203.39@tcp:23:lfs.0 Request processed in 36us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826366.313406:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1765 00000100:00100000:0.0:1787826366.318028:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826366.318076:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826366.318223:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563691904 00000100:00100000:2.0:1787826366.318237:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563691904 00000100:00100000:2.0:1787826366.318310:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563692032 00000100:00100000:2.0:1787826366.318314:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563692032 00000100:00100000:2.0:1787826366.318351:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1766 00000100:00100000:2.0:1787826366.318363:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563691904:12345-192.168.203.39@tcp:23:lfs.0 00000100:00100000:2.0:1787826366.318560:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563691904:12345-192.168.203.39@tcp:23:lfs.0 Request processed in 199us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826366.318570:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1766 00000100:00100000:2.0:1787826366.318591:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1767 00000100:00100000:2.0:1787826366.318597:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aad5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2404:x1874670563692032:12345-192.168.203.39@tcp:23:lfs.0 00000100:00100000:2.0:1787826366.318638:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aad5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2404:x1874670563692032:12345-192.168.203.39@tcp:23:lfs.0 Request processed in 41us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826366.318644:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1767 00000100:00100000:0.0:1787826366.324240:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826366.326795:0:25422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563692160 00000100:00100000:2.0:1787826366.326816:0:25422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563692160 00000100:00100000:2.0:1787826366.326935:0:25422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 673 00000100:00100000:2.0:1787826366.326948:0:25422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce051221c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563692160:12345-192.168.203.39@tcp:3:lfs.0 00010000:00010000:2.0:1787826366.326994:0:25422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009ada17ba/0x22153cd396b80114 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.327016:0:25422:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826366.327022:0:25422:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826366.327029:0:25422:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ada17ba/0x22153cd396b80114 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [1044480->1069055] (req 1044480->1069055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.327047:0:25422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ada17ba/0x22153cd396b80114 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [1044480->1069055] (req 1044480->1069055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.335275:0:25422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009ada17ba/0x22153cd396b80114 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [1044480->1069055] (req 1044480->1069055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.335409:0:25422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009ada17ba/0x22153cd396b80114 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [1044480->1069055] (req 1044480->1069055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.335420:0:25422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009ada17ba/0x22153cd396b80114 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [1044480->1069055] (req 1044480->1069055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.335429:0:25422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3abd6000 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826366.335434:0:25422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009ada17ba/0x22153cd396b80114 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [1044480->1069055] (req 1044480->1069055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.335444:0:25422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009ada17ba/0x22153cd396b80114 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [1044480->1069055] (req 1044480->1069055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.335466:0:25422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009ada17ba/0x22153cd396b80114 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [1044480->1069055] (req 1044480->1069055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.335500:0:25422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ada17ba/0x22153cd396b80114 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [1044480->1069055] (req 1044480->1069055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826366.335615:0:25422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce051221c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563692160:12345-192.168.203.39@tcp:3:lfs.0 Request processed in 8663us (11385us total) trans 0 rc 24576/24576 00000100:00100000:2.0:1787826366.335628:0:25422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 673 00000100:00100000:0.0:1787826366.348735:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826366.348990:0:25426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563692288 00000100:00100000:1.0:1787826366.349003:0:25426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563692288 00000100:00100000:1.0:1787826366.349090:0:25426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 674 00000100:00100000:1.0:1787826366.349101:0:25426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05121680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2401:x1874670563692288:12345-192.168.203.39@tcp:4:lfs.0 00010000:00010000:1.0:1787826366.349147:0:25426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b8011b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826366.349181:0:25426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000eb167c78/0x22153cd396b800f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03b7 expref: 16 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826366.349191:0:25426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826366.349196:0:25426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826366.349202:0:25426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b8011b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826366.349243:0:25426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000eb167c78/0x22153cd396b800f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03b7 expref: 16 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826366.349258:0:25426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000eb167c78/0x22153cd396b800f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03b7 expref: 16 pid: 8436 timeout: 1412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826366.349283:0:25426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0b430000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0000_UUID:25426:1874670585174528:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826366.349465:0:25426:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce06a863c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826366.352074:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826366.352179:0:30173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563692416 00000100:00100000:3.0:1787826366.352189:0:30173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563692416 00000100:00100000:3.0:1787826366.352264:0:30173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 675 00000100:00100000:3.0:1787826366.352274:0:30173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b430f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+17:2401:x1874670563692416:12345-192.168.203.39@tcp:4:lfs.0 00010000:00010000:3.0:1787826366.352311:0:30173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4014864/0x22153cd396b80122 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.352340:0:30173:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088c1e0c0/0x22153cd396b800ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03c5 expref: 17 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.352349:0:30173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826366.352354:0:30173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826366.352360:0:30173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4014864/0x22153cd396b80122 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.352397:0:30173:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000088c1e0c0/0x22153cd396b800ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03c5 expref: 17 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.352409:0:30173:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000088c1e0c0/0x22153cd396b800ff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03c5 expref: 17 pid: 8545 timeout: 1412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826366.352423:0:30173:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf361e70c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0000_UUID:30173:1874670585174656:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826366.352562:0:30173:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf19bfea80 going to sleep for 11 seconds 00000100:00100000:0.0:1787826366.355071:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826366.355231:0:25426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0b430000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0000_UUID:25426:1874670585174528:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826366.355263:0:25426:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b8011b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826366.355338:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563692544 00000100:00100000:2.0:1787826366.355346:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563692544 00010000:00010000:2.0:1787826366.355394:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000eb167c78/0x22153cd396b800f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03b7 expref: 18 pid: 8436 timeout: 1412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826366.355434:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 953 00000100:00100000:2.0:1787826366.355444:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05120b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+18:2404:x1874670563692544:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826366.355461:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826366.355519:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000eb167c78/0x22153cd396b800f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03b7 expref: 18 pid: 8436 timeout: 1412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.355544:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000eb167c78/0x22153cd396b800f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03b7 expref: 18 pid: 8436 timeout: 1412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.355574:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb167c78/0x22153cd396b800f1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03b7 expref: 18 pid: 8436 timeout: 1412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.355595:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826366.355600:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826366.355606:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b8011b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.355617:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b8011b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.355651:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826366.355681:0:25426:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b8011b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.355690:0:25426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b8011b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826366.355713:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05120b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+17:2404:x1874670563692544:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 269us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826366.355721:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 953 00000100:00100000:3.0:1787826366.359439:0:30173:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf361e70c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0000_UUID:30173:1874670585174656:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826366.359514:0:30173:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f4014864/0x22153cd396b80122 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826366.362047:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826366.362135:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563692672 00000100:00100000:1.0:1787826366.362146:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563692672 00010000:00010000:1.0:1787826366.362210:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000088c1e0c0/0x22153cd396b800ff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03c5 expref: 19 pid: 8545 timeout: 1412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826366.362264:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 954 00000100:00100000:1.0:1787826366.362276:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce051212c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:2404:x1874670563692672:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826366.362294:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826366.362334:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000088c1e0c0/0x22153cd396b800ff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03c5 expref: 19 pid: 8545 timeout: 1412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826366.362351:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000088c1e0c0/0x22153cd396b800ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03c5 expref: 19 pid: 8545 timeout: 1412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826366.362379:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088c1e0c0/0x22153cd396b800ff lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03c5 expref: 19 pid: 8545 timeout: 1412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826366.362399:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826366.362404:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826366.362411:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f4014864/0x22153cd396b80122 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 30173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826366.362428:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4014864/0x22153cd396b80122 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 30173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826366.362462:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826366.362563:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce051212c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+18:2404:x1874670563692672:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 289us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826366.362572:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 954 00010000:00010000:2.0:1787826366.362848:0:30173:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f4014864/0x22153cd396b80122 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.362859:0:30173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4014864/0x22153cd396b80122 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787826366.363239:0:26205:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836911 is committed 00000001:00080000:1.0:1787826366.363257:0:26205:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836908 is committed 00002000:00010000:2.0:1787826366.363849:0:25426:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:2.0:1787826366.363856:0:25426:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1787826366.363868:0:25426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b8011b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.363879:0:25426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b8011b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.363888:0:25426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b8011b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.363896:0:25426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835c00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826366.363902:0:25426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b8011b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.363912:0:25426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b8011b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.363932:0:25426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b8011b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.363941:0:25426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b8011b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826366.364010:0:25426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05121680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2401:x1874670563692288:12345-192.168.203.39@tcp:4:lfs.0 Request processed in 14907us (15287us total) trans 21474836911 rc 0/0 00000100:00100000:2.0:1787826366.364020:0:25426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 674 00000001:00080000:0.0:1787826366.380578:0:26205:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836912 is committed 00002000:00010000:2.0:1787826366.380718:0:30173:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 20480 00002000:00010000:2.0:1787826366.380723:0:30173:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 0 -> 40 00010000:00010000:2.0:1787826366.380740:0:30173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4014864/0x22153cd396b80122 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.380756:0:30173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4014864/0x22153cd396b80122 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.380775:0:30173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4014864/0x22153cd396b80122 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.380782:0:30173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400e00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826366.380788:0:30173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4014864/0x22153cd396b80122 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.380798:0:30173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4014864/0x22153cd396b80122 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.380822:0:30173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4014864/0x22153cd396b80122 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.380836:0:30173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4014864/0x22153cd396b80122 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826366.380973:0:30173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b430f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2401:x1874670563692416:12345-192.168.203.39@tcp:4:lfs.0 Request processed in 28693us (28904us total) trans 21474836912 rc 0/0 00000100:00100000:2.0:1787826366.380986:0:30173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 675 00000100:00100000:0.0:1787826366.384346:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826366.384395:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826366.384509:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563692800 00000100:00100000:2.0:1787826366.384520:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563692800 00000100:00100000:2.0:1787826366.384591:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563692928 00000100:00100000:2.0:1787826366.384594:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563692928 00000100:00100000:2.0:1787826366.384628:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1768 00000100:00100000:2.0:1787826366.384640:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce051203c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2402:x1874670563692800:12345-192.168.203.39@tcp:23:lfs.0 00000100:00100000:0.0:1787826366.384687:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1769 00000100:00100000:0.0:1787826366.384696:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05122940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2402:x1874670563692928:12345-192.168.203.39@tcp:23:lfs.0 00000100:00100000:0.0:1787826366.384817:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05122940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2402:x1874670563692928:12345-192.168.203.39@tcp:23:lfs.0 Request processed in 122us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826366.384825:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1769 00000100:00100000:2.0:1787826366.385111:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce051203c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2402:x1874670563692800:12345-192.168.203.39@tcp:23:lfs.0 Request processed in 473us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826366.385120:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1768 00000100:00100000:0.0:1787826366.389607:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826366.389662:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826366.389752:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563693184 00000100:00100000:3.0:1787826366.389765:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563693184 00000100:00100000:3.0:1787826366.389829:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563693056 00000100:00100000:3.0:1787826366.389832:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563693056 00000100:00100000:3.0:1787826366.389901:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1770 00000100:00100000:3.0:1787826366.389914:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05121a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2402:x1874670563693184:12345-192.168.203.39@tcp:23:lfs.0 00000100:00100000:3.0:1787826366.390048:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05121a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2402:x1874670563693184:12345-192.168.203.39@tcp:23:lfs.0 Request processed in 137us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826366.390057:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1770 00000100:00100000:3.0:1787826366.390075:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1771 00000100:00100000:3.0:1787826366.390082:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05123840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2402:x1874670563693056:12345-192.168.203.39@tcp:23:lfs.0 00000100:00100000:3.0:1787826366.390123:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05123840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2402:x1874670563693056:12345-192.168.203.39@tcp:23:lfs.0 Request processed in 42us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826366.390130:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1771 00000100:00100000:0.0:1787826366.401079:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826366.401184:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826366.406216:0:14865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563693312 00000100:00100000:2.0:1787826366.406238:0:14865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563693312 00000100:00100000:2.0:1787826366.406351:0:14865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563693440 00000100:00100000:2.0:1787826366.406355:0:14865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563693440 00000100:00100000:2.0:1787826366.406490:0:14865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 676 00000100:00100000:2.0:1787826366.406504:0:14865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce051230c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2401:x1874670563693312:12345-192.168.203.39@tcp:3:lfs.0 00010000:00010000:2.0:1787826366.406588:0:14865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000eb167c78/0x22153cd396b80129 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.406612:0:14865:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826366.406618:0:14865:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826366.406627:0:14865:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb167c78/0x22153cd396b80129 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [2088960->2097151] (req 2088960->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.406643:0:14865:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb167c78/0x22153cd396b80129 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [2088960->2097151] (req 2088960->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.406788:0:14865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000eb167c78/0x22153cd396b80129 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [2088960->2097151] (req 2088960->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.406799:0:14865:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eb167c78/0x22153cd396b80129 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [2088960->2097151] (req 2088960->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.406809:0:14865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eb167c78/0x22153cd396b80129 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [2088960->2097151] (req 2088960->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.406817:0:14865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3abd7000 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826366.406822:0:14865:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb167c78/0x22153cd396b80129 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [2088960->2097151] (req 2088960->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.406832:0:14865:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb167c78/0x22153cd396b80129 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [2088960->2097151] (req 2088960->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.406852:0:14865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eb167c78/0x22153cd396b80129 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [2088960->2097151] (req 2088960->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.406862:0:14865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb167c78/0x22153cd396b80129 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [2088960->2097151] (req 2088960->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826366.406966:0:14865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce051230c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2401:x1874670563693312:12345-192.168.203.39@tcp:3:lfs.0 Request processed in 464us (5898us total) trans 0 rc 8192/8192 00000100:00100000:2.0:1787826366.406975:0:14865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 676 00000100:00100000:2.0:1787826366.406997:0:14865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 677 00000100:00100000:2.0:1787826366.407005:0:14865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05122580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2401:x1874670563693440:12345-192.168.203.39@tcp:3:lfs.0 00010000:00010000:2.0:1787826366.407047:0:14865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009ada17ba/0x22153cd396b80130 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.407057:0:14865:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826366.407060:0:14865:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826366.407066:0:14865:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ada17ba/0x22153cd396b80130 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [2097152->2113535] (req 2097152->2113535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.407076:0:14865:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ada17ba/0x22153cd396b80130 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [2097152->2113535] (req 2097152->2113535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.409779:0:14865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009ada17ba/0x22153cd396b80130 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [2097152->2113535] (req 2097152->2113535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.409809:0:14865:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ada17ba/0x22153cd396b80130 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [2097152->2113535] (req 2097152->2113535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.409818:0:14865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ada17ba/0x22153cd396b80130 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [2097152->2113535] (req 2097152->2113535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.409833:0:14865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3abd6000 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826366.409840:0:14865:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ada17ba/0x22153cd396b80130 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [2097152->2113535] (req 2097152->2113535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.409851:0:14865:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ada17ba/0x22153cd396b80130 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [2097152->2113535] (req 2097152->2113535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.409877:0:14865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ada17ba/0x22153cd396b80130 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [2097152->2113535] (req 2097152->2113535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.409885:0:14865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ada17ba/0x22153cd396b80130 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [2097152->2113535] (req 2097152->2113535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826366.409986:0:14865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05122580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2401:x1874670563693440:12345-192.168.203.39@tcp:3:lfs.0 Request processed in 2975us (8795us total) trans 0 rc 16384/16384 00000100:00100000:2.0:1787826366.409997:0:14865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 677 00000100:00100000:0.0:1787826366.421897:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826366.422059:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826366.422436:0:25423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563693568 00000100:00100000:2.0:1787826366.422449:0:25423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563693568 00000100:00100000:2.0:1787826366.422561:0:25423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563693696 00000100:00100000:2.0:1787826366.422565:0:25423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563693696 00000100:00100000:2.0:1787826366.422608:0:25423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 678 00000100:00100000:2.0:1787826366.422620:0:25423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf2f500050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2402:x1874670563693568:12345-192.168.203.39@tcp:4:lfs.0 00002000:00010000:2.0:1787826366.422682:0:25423:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 20480, mtime: 0x6a9010be, atime: 0x6a9010bc, ctime: 0x6a9010be, blocks: 0x28 00010000:00010000:2.0:1787826366.422694:0:25423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ada17ba/0x22153cd396b80137 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.422721:0:25423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=1312s v=(0 0) 00010000:00010000:2.0:1787826366.422726:0:25423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826366.422734:0:25423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ada17ba/0x22153cd396b80137 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1040384->1048575] (req 1040384->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.422752:0:25423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ada17ba/0x22153cd396b80137 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1040384->1048575] (req 1040384->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826366.423281:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 679 00000100:00100000:3.0:1787826366.423294:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05122d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2402:x1874670563693696:12345-192.168.203.39@tcp:4:lfs.0 00010000:00010000:3.0:1787826366.423317:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9767cf8/0x22153cd396b8013e lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.423339:0:8442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000048042b98/0x22153cd396b800f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03be expref: 14 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.423347:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826366.423350:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x20:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826366.423355:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9767cf8/0x22153cd396b8013e lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [1048576->1064959] (req 1048576->1064959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.423394:0:8442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000048042b98/0x22153cd396b800f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000080020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03be expref: 14 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.423420:0:8442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000048042b98/0x22153cd396b800f8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000480020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03be expref: 14 pid: 30696 timeout: 1412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826366.423437:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf361e70c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:8442:1874670585174784:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826366.423555:0:8442:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf09f680c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826366.428275:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf361e70c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:8442:1874670585174784:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826366.428316:0:8442:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e9767cf8/0x22153cd396b8013e lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [1048576->1064959] (req 1048576->1064959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826366.428642:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826366.429423:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563693824 00000100:00100000:3.0:1787826366.429436:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563693824 00010000:00010000:3.0:1787826366.429675:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000048042b98/0x22153cd396b800f8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03be expref: 15 pid: 30696 timeout: 1412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826366.429904:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 955 00000100:00100000:3.0:1787826366.429917:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b430000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2404:x1874670563693824:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826366.429937:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826366.429966:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000048042b98/0x22153cd396b800f8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03be expref: 15 pid: 30696 timeout: 1412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.429981:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000048042b98/0x22153cd396b800f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000480020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03be expref: 15 pid: 30696 timeout: 1412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.430009:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048042b98/0x22153cd396b800f8 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801480020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03be expref: 15 pid: 30696 timeout: 1412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.430031:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x20:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826366.430037:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x20:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826366.430043:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e9767cf8/0x22153cd396b8013e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [1048576->1064959] (req 1048576->1064959) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.430054:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9767cf8/0x22153cd396b8013e lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [1048576->1064959] (req 1048576->1064959) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.430088:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826366.430223:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b430000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563693824:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 308us (1582us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826366.430231:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 955 00010000:00010000:3.0:1787826366.430265:0:8442:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e9767cf8/0x22153cd396b8013e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [1048576->1064959] (req 1048576->1064959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.430274:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9767cf8/0x22153cd396b8013e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [1048576->1064959] (req 1048576->1064959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787826366.434274:0:27651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179869584 is committed 00000001:00080000:1.0:1787826366.434297:0:27651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179869582 is committed 00002000:00010000:3.0:1787826366.434446:0:8442:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb size from disk: 0 -> 1064960 00002000:00010000:3.0:1787826366.434452:0:8442:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb mtime from disk: 1787826366 -> 1787826367 00002000:00010000:3.0:1787826366.434454:0:8442:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb ctime from disk: 1787826366 -> 1787826367 00002000:00010000:3.0:1787826366.434457:0:8442:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb blocks from disk: 0 -> 32 00010000:00010000:3.0:1787826366.434492:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9767cf8/0x22153cd396b8013e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [1048576->1064959] (req 1048576->1064959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.434507:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9767cf8/0x22153cd396b8013e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [1048576->1064959] (req 1048576->1064959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.434518:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9767cf8/0x22153cd396b8013e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [1048576->1064959] (req 1048576->1064959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.434535:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401e00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826366.434541:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9767cf8/0x22153cd396b8013e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [1048576->1064959] (req 1048576->1064959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.434551:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9767cf8/0x22153cd396b8013e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [1048576->1064959] (req 1048576->1064959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.434575:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9767cf8/0x22153cd396b8013e lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [1048576->1064959] (req 1048576->1064959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.434585:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9767cf8/0x22153cd396b8013e lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [1048576->1064959] (req 1048576->1064959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826366.434745:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05122d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2402:x1874670563693696:12345-192.168.203.39@tcp:4:lfs.0 Request processed in 11447us (12677us total) trans 17179869584 rc 0/0 00000100:00100000:3.0:1787826366.434757:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 679 00000001:00080000:2.0:1787826366.435296:0:26205:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836913 is committed 00002000:00010000:0.0:1787826366.437799:0:25423:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 20480 -> 1048576 00002000:00010000:0.0:1787826366.437811:0:25423:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1787826366 -> 1787826367 00002000:00010000:0.0:1787826366.437814:0:25423:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787826366 -> 1787826367 00002000:00010000:0.0:1787826366.437816:0:25423:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 40 -> 56 00010000:00010000:0.0:1787826366.437833:0:25423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ada17ba/0x22153cd396b80137 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1040384->1048575] (req 1040384->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.437854:0:25423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ada17ba/0x22153cd396b80137 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1040384->1048575] (req 1040384->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.437864:0:25423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ada17ba/0x22153cd396b80137 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1040384->1048575] (req 1040384->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.437873:0:25423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3abd6000 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826366.437879:0:25423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ada17ba/0x22153cd396b80137 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1040384->1048575] (req 1040384->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.437889:0:25423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ada17ba/0x22153cd396b80137 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1040384->1048575] (req 1040384->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.437913:0:25423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ada17ba/0x22153cd396b80137 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1040384->1048575] (req 1040384->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.437922:0:25423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ada17ba/0x22153cd396b80137 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1040384->1048575] (req 1040384->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826366.438089:0:25423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf2f500050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2402:x1874670563693568:12345-192.168.203.39@tcp:4:lfs.0 Request processed in 15463us (16198us total) trans 21474836913 rc 0/0 00000100:00100000:0.0:1787826366.438109:0:25423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 678 00000100:00100000:2.0:1787826366.443661:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826366.443885:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563693952 00000100:00100000:1.0:1787826366.443897:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563693952 00000100:00100000:1.0:1787826366.443998:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1772 00000100:00100000:1.0:1787826366.444011:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c87c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563693952:12345-192.168.203.39@tcp:23:lfs.0 00000100:00100000:1.0:1787826366.444334:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c87c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563693952:12345-192.168.203.39@tcp:23:lfs.0 Request processed in 323us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826366.444343:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1772 00000100:00100000:0.0:1787826366.447281:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826366.447388:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563694080 00000100:00100000:1.0:1787826366.447401:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563694080 00000100:00100000:1.0:1787826366.447566:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1773 00000100:00100000:1.0:1787826366.447579:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2402:x1874670563694080:12345-192.168.203.39@tcp:23:lfs.0 00000100:00100000:1.0:1787826366.447738:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2402:x1874670563694080:12345-192.168.203.39@tcp:23:lfs.0 Request processed in 161us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826366.447750:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1773 00000100:00100000:2.0:1787826366.451795:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826366.452233:0:30188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563694208 00000100:00100000:3.0:1787826366.452247:0:30188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563694208 00000100:00100000:3.0:1787826366.452340:0:30188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 680 00000100:00100000:3.0:1787826366.452351:0:30188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670563694208:12345-192.168.203.39@tcp:3:lfs.0 00010000:00010000:3.0:1787826366.452398:0:30188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b80145 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.452421:0:30188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826366.452426:0:30188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826366.452433:0:30188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b80145 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [3698688->3702783] (req 3698688->3702783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.452450:0:30188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b80145 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [3698688->3702783] (req 3698688->3702783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.452632:0:30188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b80145 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [3698688->3702783] (req 3698688->3702783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.452642:0:30188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b80145 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [3698688->3702783] (req 3698688->3702783) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.452651:0:30188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b80145 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [3698688->3702783] (req 3698688->3702783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.452658:0:30188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401e00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826366.452663:0:30188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b80145 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [3698688->3702783] (req 3698688->3702783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.452672:0:30188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b80145 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [3698688->3702783] (req 3698688->3702783) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.452691:0:30188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b80145 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [3698688->3702783] (req 3698688->3702783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.452714:0:30188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b80145 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [3698688->3702783] (req 3698688->3702783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826366.452802:0:30188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670563694208:12345-192.168.203.39@tcp:3:lfs.0 Request processed in 452us (1021us total) trans 0 rc 1312/1312 00000100:00100000:3.0:1787826366.452811:0:30188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 680 00000100:00100000:2.0:1787826366.468671:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826366.469188:0:20692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563694336 00000100:00100000:3.0:1787826366.469906:0:20692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563694336 00000100:00100000:2.0:1787826366.470453:0:20692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 681 00000100:00100000:2.0:1787826366.470468:0:20692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c85680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2402:x1874670563694336:12345-192.168.203.39@tcp:4:lfs.0 00002000:00010000:2.0:1787826366.470581:0:20692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 1048576, mtime: 0x6a9010bf, atime: 0x6a9010bc, ctime: 0x6a9010bf, blocks: 0x38 00010000:00010000:2.0:1787826366.470593:0:20692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000944f0deb/0x22153cd396b8014c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.470616:0:20692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=1312s v=(0 0) 00010000:00010000:2.0:1787826366.470622:0:20692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826366.470631:0:20692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000944f0deb/0x22153cd396b8014c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1601536->1605631] (req 1601536->1605631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.470649:0:20692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000944f0deb/0x22153cd396b8014c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1601536->1605631] (req 1601536->1605631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787826366.481567:0:26205:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836914 is committed 00002000:00010000:2.0:1787826366.481742:0:20692:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 1048576 -> 1605632 00002000:00010000:2.0:1787826366.481748:0:20692:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 56 -> 64 00010000:00010000:2.0:1787826366.481780:0:20692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000944f0deb/0x22153cd396b8014c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1601536->1605631] (req 1601536->1605631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.481794:0:20692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000944f0deb/0x22153cd396b8014c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1601536->1605631] (req 1601536->1605631) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.481804:0:20692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000944f0deb/0x22153cd396b8014c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1601536->1605631] (req 1601536->1605631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.481813:0:20692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3abd6a00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826366.481818:0:20692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000944f0deb/0x22153cd396b8014c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1601536->1605631] (req 1601536->1605631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.481828:0:20692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000944f0deb/0x22153cd396b8014c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1601536->1605631] (req 1601536->1605631) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.481853:0:20692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000944f0deb/0x22153cd396b8014c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1601536->1605631] (req 1601536->1605631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.481861:0:20692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000944f0deb/0x22153cd396b8014c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1601536->1605631] (req 1601536->1605631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826366.481984:0:20692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c85680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2402:x1874670563694336:12345-192.168.203.39@tcp:4:lfs.0 Request processed in 11512us (13324us total) trans 21474836914 rc 0/0 00000100:00100000:2.0:1787826366.481997:0:20692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 681 00000100:00100000:3.0:1787826366.486431:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826366.486563:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563694592 00000100:00100000:2.0:1787826366.486576:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563694592 00000100:00100000:2.0:1787826366.486649:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3395 00000100:00100000:2.0:1787826366.486660:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:52430:x1874670563694592:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:2.0:1787826366.486750:0:9966:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826366.486802:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b8010d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03cc expref: 27 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.486828:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:2.0:1787826366.486834:0:9966:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826366.487131:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6400/0x22153cd396b80153 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.487149:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6400/0x22153cd396b80153 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.487159:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6400/0x22153cd396b80153 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787826366.487212:0:9966:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967641 00000004:00010000:2.0:1787826366.487237:0:9966:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000df60f039 reply state 00000000defb8754 transno 4294967642 ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6400/0x22153cd396b80153 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.487250:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6400/0x22153cd396b80153 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.487256:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:2.0:1787826366.487260:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826366.487263:0:9966:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826366.487934:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+29:52430:x1874670563694592:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 1270us (1583us total) trans 4294967642 rc 0/0 00000100:00100000:2.0:1787826366.487945:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3395 00000020:00080000:2.0:1787826366.487952:0:9966:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787826366.490710:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826366.491054:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563694720 00000100:00100000:1.0:1787826366.491066:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563694720 00000100:00100000:1.0:1787826366.491143:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1774 00000100:00100000:1.0:1787826366.491156:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:52430:x1874670563694720:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826366.491180:0:30398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826366.491210:0:30398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000159f1fa4/0x22153cd396b8015a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab03d3 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826366.491245:0:30398:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 1048576, mtime: 0x6a9010be, atime: 0x6a9010bc, ctime: 0x6a9010be, blocks: 0x8 00010000:00010000:1.0:1787826366.491274:0:30398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=1312s v=(0 0) 00010000:00010000:1.0:1787826366.491279:0:30398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826366.491292:0:30398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000159f1fa4/0x22153cd396b8015a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03d3 expref: 10 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826366.491311:0:30398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000159f1fa4/0x22153cd396b8015a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03d3 expref: 10 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826366.491327:0:30398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835800, rc 0) 00000100:00100000:1.0:1787826366.491561:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:52430:x1874670563694720:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 407us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826366.491571:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1774 00000100:00100000:3.0:1787826366.494970:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826366.495060:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563694848 00000100:00100000:0.0:1787826366.495074:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563694848 00000100:00100000:0.0:1787826366.495152:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1775 00000100:00100000:0.0:1787826366.495163:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:52430:x1874670563694848:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826366.495185:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826366.495211:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7d5184b/0x22153cd396b80161 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab03da expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826366.495245:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x20:0x0] initial LVB size: 1064960, mtime: 0x6a9010bf, atime: 0x6a9010bc, ctime: 0x6a9010bf, blocks: 0x20 00010000:00010000:0.0:1787826366.495269:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x20:0x0].0x0 since=1312s v=(0 0) 00010000:00010000:0.0:1787826366.495274:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826366.495285:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7d5184b/0x22153cd396b80161 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03da expref: 11 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.495304:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f7d5184b/0x22153cd396b80161 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03da expref: 11 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.495318:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce057cf400, rc 0) 00000100:00100000:0.0:1787826366.495405:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:52430:x1874670563694848:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 243us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826366.495413:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1775 00000100:00100000:2.0:1787826366.499385:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826366.499566:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563694976 00000100:00100000:1.0:1787826366.499579:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563694976 00000100:00100000:1.0:1787826366.499648:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1776 00000100:00100000:1.0:1787826366.499660:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c84b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:52430:x1874670563694976:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826366.499683:0:30694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826366.499721:0:30694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002904bac2/0x22153cd396b80168 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab03e1 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826366.499752:0:30694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 1605632, mtime: 0x6a9010bf, atime: 0x6a9010bc, ctime: 0x6a9010bf, blocks: 0x40 00010000:00010000:1.0:1787826366.499778:0:30694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=1312s v=(0 0) 00010000:00010000:1.0:1787826366.499783:0:30694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826366.499792:0:30694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002904bac2/0x22153cd396b80168 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03e1 expref: 11 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826366.499810:0:30694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002904bac2/0x22153cd396b80168 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03e1 expref: 11 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826366.499825:0:30694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835a00, rc 0) 00000100:00100000:1.0:1787826366.499893:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c84b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:52430:x1874670563694976:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 235us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826366.499901:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1776 00000100:00100000:1.0:1787826366.502212:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826366.502387:0:25424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563695104 00000100:00100000:0.0:1787826366.502398:0:25424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563695104 00002000:00010000:0.0:1787826366.502448:0:25424:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/32 (2097152->18446744073709551615) 00002000:00100000:0.0:1787826366.502454:0:25424:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce0b4312c0 with x1874670563695104 ext(2097152->18446744073709551615) 00002000:00010000:0.0:1787826366.502503:0:25424:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90ce0b4312c0. 00000100:00100000:0.0:1787826366.502549:0:25424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 682 00000100:00100000:0.0:1787826366.502561:0:25424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b4312c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2404:x1874670563695104:12345-192.168.203.39@tcp:10:lfs.0 00002000:00010000:0.0:1787826366.502812:0:25424:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb size from disk: 1064960 -> 2097152 00002000:00010000:0.0:1787826366.502817:0:25424:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb mtime from disk: 1787826367 -> 1787826367 00002000:00010000:0.0:1787826366.502820:0:25424:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb atime from disk: 1787826364 -> 1787826364 00002000:00010000:0.0:1787826366.502823:0:25424:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb ctime from disk: 1787826367 -> 1787826367 00002000:00010000:0.0:1787826366.502825:0:25424:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb blocks from disk: 32 -> 32 00000100:00100000:0.0:1787826366.502890:0:25424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b4312c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563695104:12345-192.168.203.39@tcp:10:lfs.0 Request processed in 331us (692us total) trans 17179869585 rc 0/0 00000100:00100000:0.0:1787826366.502899:0:25424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 682 00002000:00010000:0.0:1787826366.502904:0:25424:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/32 (2097152->18446744073709551615) 00002000:00100000:0.0:1787826366.502907:0:25424:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce0b4312c0 with x1874670563695104 ext(2097152->18446744073709551615) 00002000:00010000:0.0:1787826366.502912:0:25424:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90ce0b4312c0. 00000100:00100000:3.0:1787826366.505162:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826366.505310:0:30178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563695232 00000100:00100000:2.0:1787826366.505322:0:30178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563695232 00002000:00010000:2.0:1787826366.505384:0:30178:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/34 (1602848->18446744073709551615) 00002000:00100000:2.0:1787826366.505389:0:30178:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf361e7c00 with x1874670563695232 ext(1602848->18446744073709551615) 00002000:00010000:2.0:1787826366.505402:0:30178:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf361e7c00. 00000100:00100000:2.0:1787826366.505437:0:30178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 683 00000100:00100000:2.0:1787826366.505447:0:30178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2404:x1874670563695232:12345-192.168.203.39@tcp:10:lfs.0 00002000:00010000:2.0:1787826366.505844:0:30178:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 1605632 -> 1602848 00002000:00010000:2.0:1787826366.505849:0:30178:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1787826367 -> 1787826367 00002000:00010000:2.0:1787826366.505852:0:30178:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 1787826364 -> 1787826364 00002000:00010000:2.0:1787826366.505855:0:30178:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787826367 -> 1787826367 00002000:00010000:2.0:1787826366.505858:0:30178:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 64 -> 64 00000100:00100000:2.0:1787826366.505933:0:30178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563695232:12345-192.168.203.39@tcp:10:lfs.0 Request processed in 486us (782us total) trans 21474836915 rc 0/0 00000100:00100000:2.0:1787826366.505942:0:30178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 683 00002000:00010000:2.0:1787826366.505946:0:30178:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/34 (1602848->18446744073709551615) 00002000:00100000:2.0:1787826366.505949:0:30178:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf361e7c00 with x1874670563695232 ext(1602848->18446744073709551615) 00002000:00010000:2.0:1787826366.505955:0:30178:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf361e7c00. 00000100:00100000:1.0:1787826366.519357:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826366.519530:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563695488 00000100:00100000:2.0:1787826366.519543:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563695488 00000100:00100000:2.0:1787826366.519616:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 997 00000100:00100000:2.0:1787826366.519628:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b433480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+29:52430:x1874670563695488:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:2.0:1787826366.519729:0:6522:0:(mdt_open.c:2504:mdt_close_resync_done()) ### [0x240000404:0x9:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057ce600/0x22153cd396b80096 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x9:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab038d expref: 29 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.519794:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6a00/0x22153cd396b8016f lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.519810:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401a00/0x22153cd396b800b9 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0394 expref: 29 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.519820:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6a00/0x22153cd396b8016f lrc: 4/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.519863:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401a00/0x22153cd396b800b9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0394 expref: 29 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.519880:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401a00/0x22153cd396b800b9 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0394 expref: 29 pid: 32404 timeout: 1412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826366.519899:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf41c852c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:6522:1874670585174912:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826366.520008:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf013f1180 going to sleep for 11 seconds 00000100:00100000:2.0:1787826366.523262:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf41c852c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:6522:1874670585174912:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826366.523312:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6a00/0x22153cd396b8016f lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826366.524942:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826366.525061:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563695616 00000100:00100000:2.0:1787826366.525073:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563695616 00010000:00010000:2.0:1787826366.525136:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401a00/0x22153cd396b800b9 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0394 expref: 30 pid: 32404 timeout: 1412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826366.525182:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 956 00000100:00100000:2.0:1787826366.525193:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b4330c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:2404:x1874670563695616:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826366.525213:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826366.525221:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401a00/0x22153cd396b800b9 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0394 expref: 30 pid: 32404 timeout: 1412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.525236:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401a00/0x22153cd396b800b9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0394 expref: 30 pid: 32404 timeout: 1412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.525265:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401a00/0x22153cd396b800b9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0394 expref: 30 pid: 32404 timeout: 1412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.525285:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:2.0:1787826366.525292:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6a00/0x22153cd396b8016f lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.525302:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6a00/0x22153cd396b8016f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.525310:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6a00/0x22153cd396b8016f lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.525515:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6a00/0x22153cd396b8016f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.525535:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6a00/0x22153cd396b8016f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787826366.525877:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].17, 88 off9424 00000004:00080000:0.0:1787826366.525890:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1312537417649ns, next at 1201607267971ns, rc = 0 00000040:00080000:0.0:1787826366.525929:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].16, 88 off9336 00000004:00080000:0.0:1787826366.525936:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1312537464467ns, next at 1201610029598ns, rc = 0 00000040:00080000:0.0:1787826366.525962:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].18, 88 off9512 00000004:00080000:0.0:1787826366.525966:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1312537494855ns, next at 1201607267971ns, rc = 0 00000040:00080000:0.0:1787826366.525976:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].17, 88 off9424 00000004:00080000:0.0:1787826366.525980:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1312537508282ns, next at 1201610029598ns, rc = 0 00000040:00080000:0.0:1787826366.525988:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].19, 88 off9600 00000004:00080000:0.0:1787826366.525992:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1312537519909ns, next at 1201607267971ns, rc = 0 00010000:00010000:2.0:1787826366.526800:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826366.526890:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b4330c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:2404:x1874670563695616:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 1691us (1954us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826366.526903:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 956 00000001:00080000:3.0:1787826366.531341:0:7449:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967643 is committed 00000004:00080000:3.0:1787826366.531367:0:7449:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 21 committed 00000004:00080000:3.0:1787826366.531387:0:7449:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 18 committed 00000004:00080000:3.0:1787826366.531405:0:7449:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 20 committed 00000004:00080000:3.0:1787826366.531408:0:7449:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 17 committed 00000004:00080000:3.0:1787826366.531410:0:7449:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 19 committed 00000020:00080000:3.0:1787826366.531431:0:7449:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 21 batchid updated 00000100:00100000:0.0:1787826366.531650:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce051221c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585175040:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1787826366.531754:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826366.531840:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce05121680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585175168:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1787826366.531865:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826366.531886:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787826366.531891:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce051230c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585175296:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1787826366.531912:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826366.531947:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585175040 00000100:00100000:0.0:1787826366.531955:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585175040 00000100:00100000:0.0:1787826366.532009:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585175168 00000100:00100000:0.0:1787826366.532012:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585175168 00000100:00100000:0.0:1787826366.532035:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1777 00000100:00100000:0.0:1787826366.532044:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05122580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+6:3647:x1874670585175040:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:0.0:1787826366.532243:0:30696:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1787826366.532248:0:30696:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb mtime from disk: 1787826366 -> 1787826366 00002000:00010000:0.0:1787826366.532251:0:30696:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb atime from disk: 1787826364 -> 1787826364 00002000:00010000:0.0:1787826366.532253:0:30696:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb ctime from disk: 1787826366 -> 1787826366 00002000:00010000:0.0:1787826366.532255:0:30696:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1787826366.532297:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05122580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+7:3647:x1874670585175040:12345-0@lo:2:osp-syn-0-1.0 Request processed in 253us (543us total) trans 21474836916 rc 0/0 00000100:00100000:0.0:1787826366.532305:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1777 00000100:00100000:0.0:1787826366.532324:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585175296 00000100:00100000:0.0:1787826366.532327:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585175296 00000100:00100000:0.0:1787826366.532349:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1778 00000100:00100000:0.0:1787826366.532355:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05121e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+7:3644:x1874670585175168:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:0.0:1787826366.532416:0:30696:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 1602848 -> 1602848 00002000:00010000:0.0:1787826366.532420:0:30696:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1787826367 -> 1787826367 00002000:00010000:0.0:1787826366.532422:0:30696:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 1787826364 -> 1787826364 00002000:00010000:0.0:1787826366.532424:0:30696:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787826367 -> 1787826367 00002000:00010000:0.0:1787826366.532425:0:30696:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 64 -> 64 00000100:00100000:0.0:1787826366.532454:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05121e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+8:3644:x1874670585175168:12345-0@lo:2:osp-syn-0-1.0 Request processed in 99us (588us total) trans 21474836917 rc 0/0 00000100:00100000:0.0:1787826366.532461:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1778 00000100:00100000:0.0:1787826366.532501:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1779 00000100:00100000:0.0:1787826366.532508:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05123c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+7:3644:x1874670585175296:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:0.0:1787826366.532574:0:30696:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb size from disk: 3700000 -> 3700000 00002000:00010000:0.0:1787826366.532577:0:30696:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb mtime from disk: 1787826364 -> 1787826364 00002000:00010000:0.0:1787826366.532579:0:30696:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb atime from disk: 1787826364 -> 1787826364 00002000:00010000:0.0:1787826366.532581:0:30696:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb ctime from disk: 1787826365 -> 1787826365 00002000:00010000:0.0:1787826366.532583:0:30696:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb blocks from disk: 40 -> 40 00000100:00100000:0.0:1787826366.532606:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05123c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+8:3644:x1874670585175296:12345-0@lo:2:osp-syn-0-1.0 Request processed in 100us (694us total) trans 21474836918 rc 0/0 00000100:00100000:0.0:1787826366.532612:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1779 00000100:00100000:0.0:1787826366.532672:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 21474836908 gen 2 00000004:00080000:0.0:1787826366.532678:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474836905 committed transno 21474836908 00000004:00080000:0.0:1787826366.532705:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf41c85e00, transno 21474836906 00000004:00080000:0.0:1787826366.532715:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf41c87480, transno 21474836907 00000004:00080000:0.0:1787826366.532717:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf41c84780, transno 21474836908 00000100:00100000:0.0:1787826366.532724:0:3644:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff90ce051230c0 x1874670585175296/t21474836918(21474836918) o2->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 440/432 e 0 to 0 dl 1787826382 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1787826366.532736:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce051230c0/2, rc 0, transno 21474836918 00000100:00100000:0.0:1787826366.532742:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce051230c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585175296:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1787826366.532756:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce05121680/2, rc 0, transno 21474836917 00000100:00100000:0.0:1787826366.532759:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce05121680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585175168:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1787826366.532858:0:8538:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0001: 0 changes, 3 in progress, 1 in flight, 3 done 00000004:00080000:0.0:1787826366.532878:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce051221c0/2, rc 0, transno 21474836916 00000100:00100000:0.0:1787826366.532882:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce051221c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585175040:0@lo:2:osp-syn-0-1.0 00000004:00010000:0.0:1787826366.532926:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e4582508 reply state 00000000d78f3c22 transno 4294967643 ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6a00/0x22153cd396b8016f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.532950:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6a00/0x22153cd396b8016f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.532961:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:0.0:1787826366.532965:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1787826366.532970:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787826366.532977:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:0.0:1787826366.532979:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787826366.532987:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057ce600/0x22153cd396b80096 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x9:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab038d expref: 24 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1787826366.533096:0:6522:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1787826366.533111:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b433480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:52430:x1874670563695488:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 13484us (13778us total) trans 4294967643 rc 0/0 00000100:00100000:0.0:1787826366.533121:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 997 00010000:00010000:0.0:1787826366.533151:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6a00/0x22153cd396b8016f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.533161:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6a00/0x22153cd396b8016f lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.533173:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6a00/0x22153cd396b8016f lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.533180:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3abd6a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826366.533186:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6a00/0x22153cd396b8016f lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.533196:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6a00/0x22153cd396b8016f lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.533208:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:0.0:1787826366.533211:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826366.533215:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6a00/0x22153cd396b8016f lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.533221:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6a00/0x22153cd396b8016f lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787826366.533691:0:7472:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 21 00000020:00080000:1.0:1787826366.533785:0:7472:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 21 cancel update log [0x240000400:0x2:0x0].18: rc = 0 00000020:00080000:1.0:1787826366.533797:0:7472:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 21 00000100:00100000:1.0:1787826366.533891:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0b431e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585175552:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1787826366.533942:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826366.533974:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787826366.533980:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0b430b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585175424:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1787826366.534004:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826366.534033:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585175552 00000100:00100000:1.0:1787826366.534039:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585175552 00000100:00100000:1.0:1787826366.534076:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585175424 00000100:00100000:1.0:1787826366.534079:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585175424 00000100:00100000:1.0:1787826366.534195:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1780 00000100:00100000:1.0:1787826366.534204:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b431a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3647:x1874670585175552:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:1.0:1787826366.534327:0:14864:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x21:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1787826366.534330:0:14864:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x21:0x0] updating lvb mtime from disk: 1787826364 -> 1787826364 00002000:00010000:1.0:1787826366.534333:0:14864:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x21:0x0] updating lvb atime from disk: 1787826364 -> 1787826364 00002000:00010000:1.0:1787826366.534335:0:14864:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x21:0x0] updating lvb ctime from disk: 1787826365 -> 1787826365 00002000:00010000:1.0:1787826366.534337:0:14864:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x21:0x0] updating lvb blocks from disk: 64 -> 64 00000100:00100000:1.0:1787826366.534376:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b431a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+7:3647:x1874670585175552:12345-0@lo:2:osp-syn-1-1.0 Request processed in 173us (432us total) trans 17179869586 rc 0/0 00000100:00100000:1.0:1787826366.534383:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1780 00000100:00100000:1.0:1787826366.534400:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1781 00000100:00100000:1.0:1787826366.534406:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b431680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3647:x1874670585175424:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:1.0:1787826366.534455:0:14864:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1787826366.534458:0:14864:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb mtime from disk: 1787826367 -> 1787826367 00002000:00010000:1.0:1787826366.534460:0:14864:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb atime from disk: 1787826364 -> 1787826364 00002000:00010000:1.0:1787826366.534463:0:14864:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb ctime from disk: 1787826367 -> 1787826367 00002000:00010000:1.0:1787826366.534464:0:14864:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb blocks from disk: 32 -> 32 00000100:00100000:1.0:1787826366.535179:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b431680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+7:3647:x1874670585175424:12345-0@lo:2:osp-syn-1-1.0 Request processed in 770us (1171us total) trans 17179869587 rc 0/0 00000100:00100000:1.0:1787826366.535188:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1781 00000100:00100000:1.0:1787826366.535245:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179869582 gen 2 00000004:00080000:1.0:1787826366.535251:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869580 committed transno 17179869582 00000004:00080000:1.0:1787826366.535275:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce01fded00, transno 17179869581 00000004:00080000:1.0:1787826366.535287:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf39f80780, transno 17179869582 00000100:00100000:1.0:1787826366.535294:0:3647:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff90ce0b430b40 x1874670585175424/t17179869587(17179869587) o2->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 440/432 e 0 to 0 dl 1787826382 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1787826366.535305:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce0b430b40/2, rc 0, transno 17179869587 00000100:00100000:1.0:1787826366.535310:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0b430b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585175424:0@lo:2:osp-syn-1-1.0 00000004:00080000:1.0:1787826366.535322:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce0b431e00/2, rc 0, transno 17179869586 00000100:00100000:1.0:1787826366.535326:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0b431e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585175552:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1787826366.537779:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826366.537911:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563695744 00000100:00100000:3.0:1787826366.537924:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563695744 00000100:00100000:3.0:1787826366.537995:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3396 00000100:00100000:3.0:1787826366.538007:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b4321c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:52430:x1874670563695744:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826366.538036:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826366.538062:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b80176 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab03e8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.538208:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b80176 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03e8 expref: 25 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.538228:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b80176 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03e8 expref: 25 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.538252:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:3.0:1787826366.538255:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826366.538260:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401e00, rc 0) 00000100:00100000:3.0:1787826366.538321:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b4321c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:52430:x1874670563695744:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 316us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826366.538328:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3396 00010000:00010000:2.0:1787826366.539282:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400a00/0x22153cd396b800ea lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.539298:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400a00/0x22153cd396b800ea lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.539306:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400a00/0x22153cd396b800ea lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.539313:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826366.539319:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400a00/0x22153cd396b800ea lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.539327:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400a00/0x22153cd396b800ea lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.539417:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:2.0:1787826366.539421:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826366.539427:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400a00/0x22153cd396b800ea lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.539579:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400a00/0x22153cd396b800ea lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.539601:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6400/0x22153cd396b80153 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.539608:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6400/0x22153cd396b80153 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.539614:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6400/0x22153cd396b80153 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.539620:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3abd6400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826366.539624:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6400/0x22153cd396b80153 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.539631:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6400/0x22153cd396b80153 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.539640:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:2.0:1787826366.539643:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826366.539646:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6400/0x22153cd396b80153 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.539652:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6400/0x22153cd396b80153 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826366.555568:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826366.556889:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563696000 00000100:00100000:3.0:1787826366.556910:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563696000 00000100:00100000:3.0:1787826366.557023:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 998 00000100:00100000:3.0:1787826366.557036:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:52430:x1874670563696000:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:3.0:1787826366.559517:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+23:52430:x1874670563696000:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 2440us (3927us total) trans 4294967644 rc 0/0 00000100:00100000:3.0:1787826366.559546:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 998 00000100:00100000:0.0:1787826366.589638:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826366.590217:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563696256 00000100:00100000:2.0:1787826366.590231:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563696256 00000100:00100000:2.0:1787826366.590320:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3397 00000100:00100000:2.0:1787826366.590331:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05120f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+23:52431:x1874670563696256:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826366.590364:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826366.590391:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6400/0x22153cd396b8017d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab03ef expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.590544:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6a00/0x22153cd396b80184 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.590561:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6a00/0x22153cd396b80184 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.590575:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6a00/0x22153cd396b80184 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.590597:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6600/0x22153cd396b8018b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.590604:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6600/0x22153cd396b8018b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.590609:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6600/0x22153cd396b8018b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.590887:0:8247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6a00/0x22153cd396b80184 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.590896:0:8247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6a00/0x22153cd396b80184 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.590903:0:8247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6a00/0x22153cd396b80184 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.590910:0:8247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3abd6a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826366.590914:0:8247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6a00/0x22153cd396b80184 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.590922:0:8247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6a00/0x22153cd396b80184 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.590936:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x0 (ffff90cf1988e500) 00010000:00010000:2.0:1787826366.590940:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826366.590944:0:8247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6a00/0x22153cd396b80184 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.590951:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6a00/0x22153cd396b80184 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.590967:0:8247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6600/0x22153cd396b8018b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.590974:0:8247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6600/0x22153cd396b8018b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.590979:0:8247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6600/0x22153cd396b8018b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.590985:0:8247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3abd6600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826366.590988:0:8247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6600/0x22153cd396b8018b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.590994:0:8247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6600/0x22153cd396b8018b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.591002:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x5675640f (ffff90cf39e67000) 00010000:00010000:2.0:1787826366.591004:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826366.591007:0:8247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6600/0x22153cd396b8018b lrc: 2/0,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.591012:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6600/0x22153cd396b8018b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.591054:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6400/0x22153cd396b8017d lrc: 1/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03ef expref: 24 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.591065:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x0 (ffff90cf1988e500) 00010000:00010000:2.0:1787826366.591067:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787826366.591071:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6400/0x22153cd396b8017d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03ef expref: 24 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.591081:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3abd6400, rc 0) 00000100:00100000:2.0:1787826366.591412:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05120f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+23:52431:x1874670563696256:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1082us (1791us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826366.591423:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3397 00000100:00100000:1.0:1787826366.609831:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826366.609966:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563696512 00000100:00100000:3.0:1787826366.609982:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563696512 00000100:00100000:3.0:1787826366.610073:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3398 00000100:00100000:3.0:1787826366.610086:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b430f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+23:52431:x1874670563696512:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826366.610116:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826366.610149:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400400/0x22153cd396b80192 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab03f6 expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826366.610288:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0x8:0x0]: returning size 4096 00010000:00010000:3.0:1787826366.610632:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400400/0x22153cd396b80192 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03f6 expref: 25 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.610651:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cf39656500) 00010000:00010000:3.0:1787826366.610654:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787826366.610660:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400400/0x22153cd396b80192 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03f6 expref: 25 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.610684:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400400, rc 0) 00000100:00100000:3.0:1787826366.610757:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b430f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:52431:x1874670563696512:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 674us (942us total) trans 4294967645 rc 301/301 00000100:00100000:3.0:1787826366.610767:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3398 00000100:00100000:2.0:1787826366.619454:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826366.619668:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563696640 00000100:00100000:0.0:1787826366.619683:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563696640 00000100:00100000:0.0:1787826366.619755:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3399 00000100:00100000:0.0:1787826366.619766:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c86580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:52431:x1874670563696640:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:0.0:1787826366.619862:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057cec00/0x22153cd396b801a0 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.619895:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057cec00/0x22153cd396b801a0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.619907:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057cec00/0x22153cd396b801a0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.619924:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057ce600/0x22153cd396b801a7 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.619931:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057ce600/0x22153cd396b801a7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.619937:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057ce600/0x22153cd396b801a7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.620041:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057cfe00/0x22153cd396b801ae lrc: 3/1,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.620050:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057cfe00/0x22153cd396b801ae lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.620056:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057cfe00/0x22153cd396b801ae lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826366.620264:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0x9:0x0]: returning size 3700000 00000004:00200000:0.0:1787826366.620269:0:9966:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826366.620284:0:9966:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057cfe00/0x22153cd396b801ae lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.620300:0:9966:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057cec00/0x22153cd396b801a0 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.620306:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057cec00/0x22153cd396b801a0 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.620312:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057cec00/0x22153cd396b801a0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.620323:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057cec00/0x22153cd396b801a0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.620329:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce057cec00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826366.620333:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057cec00/0x22153cd396b801a0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.620341:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057cec00/0x22153cd396b801a0 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.620355:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x0 (ffff90cf1988e500) 00010000:00010000:0.0:1787826366.620358:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826366.620362:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057cec00/0x22153cd396b801a0 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.620370:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057cec00/0x22153cd396b801a0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.620384:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057ce600/0x22153cd396b801a7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.620390:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057ce600/0x22153cd396b801a7 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.620396:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057ce600/0x22153cd396b801a7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.620400:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce057ce600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826366.620403:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057ce600/0x22153cd396b801a7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.620412:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057ce600/0x22153cd396b801a7 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.620419:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x5675640f (ffff90cf371d2f00) 00010000:00010000:0.0:1787826366.620421:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826366.620423:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057ce600/0x22153cd396b801a7 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.620429:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057ce600/0x22153cd396b801a7 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.620445:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057cfe00/0x22153cd396b801ae lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.620452:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057cfe00/0x22153cd396b801ae lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.620458:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057cfe00/0x22153cd396b801ae lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.620463:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce057cfe00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826366.620466:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057cfe00/0x22153cd396b801ae lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.620586:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057cfe00/0x22153cd396b801ae lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.620594:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:0.0:1787826366.620597:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826366.620600:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057cfe00/0x22153cd396b801ae lrc: 2/0,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.620610:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce057cfe00/0x22153cd396b801ae lrc: 0/0,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826366.620717:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c86580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:52431:x1874670563696640:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 951us (1276us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826366.620726:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3399 00000100:00100000:0.0:1787826366.627607:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826366.627864:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563696896 00000100:00100000:2.0:1787826366.627889:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563696896 00000100:00100000:2.0:1787826366.627976:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 999 00000100:00100000:2.0:1787826366.627989:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:52431:x1874670563696896:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:2.0:1787826366.628618:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:52431:x1874670563696896:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 629us (1023us total) trans 4294967646 rc 0/0 00000100:00100000:2.0:1787826366.628629:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 999 00000100:00100000:2.0:1787826366.669530:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826366.669649:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563697152 00000100:00100000:1.0:1787826366.669664:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563697152 00000100:00100000:1.0:1787826366.669736:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3400 00000100:00100000:1.0:1787826366.669750:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:52435:x1874670563697152:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826366.669784:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826366.669813:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834400/0x22153cd396b801b5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab03fd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826366.669922:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834200/0x22153cd396b801bc lrc: 3/1,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826366.669942:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834200/0x22153cd396b801bc lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826366.669962:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834200/0x22153cd396b801bc lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826366.669980:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834c00/0x22153cd396b801c3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826366.669989:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834c00/0x22153cd396b801c3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826366.669996:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834c00/0x22153cd396b801c3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826366.670159:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834a00/0x22153cd396b801ca lrc: 3/1,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826366.670239:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834a00/0x22153cd396b801ca lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826366.670250:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834a00/0x22153cd396b801ca lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826366.670263:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0x9:0x0]: returning size 3700000 00010000:00010000:1.0:1787826366.670374:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834200/0x22153cd396b801bc lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826366.670381:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834200/0x22153cd396b801bc lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826366.670389:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834200/0x22153cd396b801bc lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826366.670396:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834200/0x22153cd396b801bc lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826366.670403:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826366.670409:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834200/0x22153cd396b801bc lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826366.670418:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834200/0x22153cd396b801bc lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826366.670434:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x0 (ffff90cf1988e500) 00010000:00010000:1.0:1787826366.670438:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826366.670444:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834200/0x22153cd396b801bc lrc: 3/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826366.670452:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834200/0x22153cd396b801bc lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826366.670942:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834c00/0x22153cd396b801c3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826366.670953:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834c00/0x22153cd396b801c3 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826366.670961:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834c00/0x22153cd396b801c3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826366.670967:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826366.670971:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834c00/0x22153cd396b801c3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826366.670979:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834c00/0x22153cd396b801c3 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826366.670995:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x5675640f (ffff90cf04f8ba00) 00010000:00010000:1.0:1787826366.670998:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826366.671002:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834c00/0x22153cd396b801c3 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826366.671010:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834c00/0x22153cd396b801c3 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.671132:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834400/0x22153cd396b801b5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03fd expref: 28 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.671153:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834a00/0x22153cd396b801ca lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03fd expref: 27 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.671162:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:2.0:1787826366.671165:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826366.671167:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834a00, rc 0) 00000100:00100000:2.0:1787826366.671270:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:52435:x1874670563697152:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1523us (1799us total) trans 4294967647 rc 0/0 00000100:00100000:2.0:1787826366.671284:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3400 00000100:00100000:3.0:1787826366.717633:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826366.718841:0:25426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563697280 00000100:00100000:2.0:1787826366.718858:0:25426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563697280 00000100:00100000:2.0:1787826366.718966:0:25426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 684 00000100:00100000:2.0:1787826366.718979:0:25426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2402:x1874670563697280:12345-192.168.203.39@tcp:3:lfs.0 00010000:00010000:2.0:1787826366.719026:0:25426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa1d1988/0x22153cd396b801d8 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.719052:0:25426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000159f1fa4/0x22153cd396b8015a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03d3 expref: 12 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.719062:0:25426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826366.719067:0:25426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826366.719072:0:25426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa1d1988/0x22153cd396b801d8 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.719116:0:25426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000159f1fa4/0x22153cd396b8015a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03d3 expref: 12 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.719133:0:25426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000159f1fa4/0x22153cd396b8015a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03d3 expref: 12 pid: 30398 timeout: 1412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826366.719150:0:25426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf41c85a40 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0000_UUID:25426:1874670585175680:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826366.719266:0:25426:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf013f1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787826366.722158:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826366.722191:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826366.722225:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826366.722344:0:30176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563697408 00000100:00100000:3.0:1787826366.722356:0:30176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563697408 00000100:00100000:3.0:1787826366.722518:0:30176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563697536 00000100:00100000:3.0:1787826366.722531:0:30176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563697536 00000100:00100000:3.0:1787826366.722554:0:30176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563697664 00000100:00100000:3.0:1787826366.722557:0:30176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563697664 00000100:00100000:3.0:1787826366.722580:0:30176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 685 00000100:00100000:3.0:1787826366.722591:0:30176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf07964f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2402:x1874670563697408:12345-192.168.203.39@tcp:3:lfs.0 00010000:00010000:3.0:1787826366.722635:0:30176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000021c90a82/0x22153cd396b801df lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.722662:0:30176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002904bac2/0x22153cd396b80168 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03e1 expref: 14 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.722673:0:30176:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826366.722678:0:30176:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826366.722684:0:30176:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021c90a82/0x22153cd396b801df lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826366.722863:0:14865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 686 00000100:00100000:0.0:1787826366.722872:0:14865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf07967c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2401:x1874670563697536:12345-192.168.203.39@tcp:3:lfs.0 00010000:00010000:0.0:1787826366.722893:0:14865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004a81bd0e/0x22153cd396b801e6 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.722906:0:14865:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f7d5184b/0x22153cd396b80161 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03da expref: 12 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.722914:0:14865:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826366.722917:0:14865:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x20:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826366.722920:0:14865:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a81bd0e/0x22153cd396b801e6 lrc: 4/1,0 mode: --/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.722953:0:14865:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f7d5184b/0x22153cd396b80161 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03da expref: 12 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.722975:0:14865:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f7d5184b/0x22153cd396b80161 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03da expref: 12 pid: 8437 timeout: 1412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826366.722992:0:14865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf079643c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:14865:1874670585175808:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826366.723092:0:14865:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf39df2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826366.723116:0:30175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 687 00000100:00100000:0.0:1787826366.723125:0:30175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf07967480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2402:x1874670563697664:12345-192.168.203.39@tcp:3:lfs.0 00010000:00010000:0.0:1787826366.723141:0:30175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b448b608/0x22153cd396b801ed lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.723151:0:30175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826366.723155:0:30175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(2 0) 00010000:00010000:0.0:1787826366.723158:0:30175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b448b608/0x22153cd396b801ed lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->1605631] (req 1048576->1605631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.723168:0:30175:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b448b608/0x22153cd396b801ed lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->1605631] (req 1048576->1605631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.723261:0:30176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002904bac2/0x22153cd396b80168 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03e1 expref: 14 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.723273:0:30176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002904bac2/0x22153cd396b80168 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03e1 expref: 14 pid: 30694 timeout: 1412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826366.723285:0:30176:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf361e4780 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0000_UUID:30176:1874670585175936:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826366.723313:0:30176:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf19bfea80 going to sleep for 11 seconds 00000100:00100000:0.0:1787826366.724062:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787826366.724082:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf079661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585176064:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826366.724136:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826366.724178:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585176064 00000100:00100000:0.0:1787826366.724185:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585176064 00000100:00100000:0.0:1787826366.724232:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1360 00000100:00100000:0.0:1787826366.724239:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf07964780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:3645:x1874670585176064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787826366.724277:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445961728 avail 1299722240 00000100:00100000:0.0:1787826366.724327:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf07964780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:3645:x1874670585176064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826366.724335:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1360 00000100:00100000:0.0:1787826366.724553:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf079661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585176064:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826366.724797:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab90f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e3c550b8-2c3c-46c3-ad36-671c284167ea:3646:1874670585176320:0@lo:400:kworker.0 00000100:00100000:1.0:1787826366.724839:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826366.724871:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab91e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874670585176832:0@lo:400:kworker.0 00000100:00100000:1.0:1787826366.724897:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826366.724916:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585177344:0@lo:400:kworker.0 00000100:00100000:1.0:1787826366.724941:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826366.724960:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787826366.724965:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab93c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874670585176448:0@lo:400:kworker.0 00000100:00100000:1.0:1787826366.724984:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826366.725001:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1874670585176960:0@lo:400:kworker.0 00000100:00100000:1.0:1787826366.725018:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826366.725032:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce044d2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874670585177472:0@lo:400:kworker.0 00000100:00100000:1.0:1787826366.725056:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826366.725085:0:34488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585176320 00000100:00100000:1.0:1787826366.725089:0:34488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585176320 00000100:00100000:1.0:1787826366.725126:0:34488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787826366.725134:0:34488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf39cccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3c550b8-2c3c-46c3-ad36-671c284167ea+24:3646:x1874670585176320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826366.725174:0:34488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf39cccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3c550b8-2c3c-46c3-ad36-671c284167ea+24:3646:x1874670585176320:12345-0@lo:400:kworker.0 Request processed in 41us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826366.725181:0:34488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787826366.725211:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585176832 00000100:00100000:1.0:1787826366.725215:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585176832 00000100:00100000:1.0:1787826366.725253:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585176448 00000100:00100000:1.0:1787826366.725256:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585176448 00000100:00100000:1.0:1787826366.725274:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585176960 00000100:00100000:1.0:1787826366.725277:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585176960 00000100:00100000:1.0:1787826366.725298:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585177472 00000100:00100000:1.0:1787826366.725300:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585177472 00000100:00100000:1.0:1787826366.725313:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1506 00000100:00100000:1.0:1787826366.725319:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874670585176832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826366.725350:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874670585176832:12345-0@lo:400:kworker.0 Request processed in 32us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826366.725356:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1506 00000100:00100000:1.0:1787826366.725384:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1507 00000100:00100000:1.0:1787826366.725391:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874670585176448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826366.725415:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874670585176448:12345-0@lo:400:kworker.0 Request processed in 26us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826366.725421:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1507 00000100:00100000:1.0:1787826366.725432:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1508 00000100:00100000:1.0:1787826366.725439:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874670585176960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826366.725464:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874670585176960:12345-0@lo:400:kworker.0 Request processed in 26us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826366.725505:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1508 00000100:00100000:1.0:1787826366.725517:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1509 00000100:00100000:1.0:1787826366.725534:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874670585177472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826366.725563:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874670585177472:12345-0@lo:400:kworker.0 Request processed in 30us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826366.725569:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1509 00000100:00080000:1.0:1787826366.725596:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787826366.725600:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787826366.725645:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab93c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874670585176448:0@lo:400:kworker.0 00000100:00100000:1.0:1787826366.725655:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1874670585176960:0@lo:400:kworker.0 00000100:00100000:1.0:1787826366.725664:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce044d2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874670585177472:0@lo:400:kworker.0 00000100:00100000:1.0:1787826366.725672:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab90f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e3c550b8-2c3c-46c3-ad36-671c284167ea:3646:1874670585176320:0@lo:400:kworker.0 00000100:00100000:1.0:1787826366.725679:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab91e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874670585176832:0@lo:400:kworker.0 00000100:00100000:2.0:1787826366.727503:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874670585176576:0@lo:400:kworker.0 00000100:00100000:2.0:1787826366.727606:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826366.727641:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585177088:0@lo:400:kworker.0 00000100:00100000:2.0:1787826366.727669:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826366.727721:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787826366.727728:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab91a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585176192:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787826366.727749:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826366.727767:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874670585176704:0@lo:400:kworker.0 00000100:00100000:2.0:1787826366.727789:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826366.727813:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585177216:0@lo:400:kworker.0 00000100:00100000:2.0:1787826366.727838:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826366.727878:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585176576 00000100:00100000:2.0:1787826366.727887:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585176576 00000100:00100000:2.0:1787826366.727950:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585176704 00000100:00100000:2.0:1787826366.727953:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585176704 00000100:00100000:2.0:1787826366.727977:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1510 00000100:00100000:2.0:1787826366.727985:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c87840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874670585176576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826366.728039:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c87840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874670585176576:12345-0@lo:400:kworker.0 Request processed in 54us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826366.728046:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1510 00000100:00100000:2.0:1787826366.728062:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1511 00000100:00100000:2.0:1787826366.728068:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874670585176704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826366.728094:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874670585176704:12345-0@lo:400:kworker.0 Request processed in 26us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826366.728099:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1511 00000100:00080000:2.0:1787826366.728119:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787826366.728123:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787826366.728155:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874670585176704:0@lo:400:kworker.0 00000100:00100000:2.0:1787826366.728166:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874670585176576:0@lo:400:kworker.0 00000100:00100000:0.0:1787826366.735921:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585177344 00000100:00100000:0.0:1787826366.735944:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585177344 00000100:00100000:0.0:1787826366.736061:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585177216 00000100:00100000:0.0:1787826366.736065:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585177216 00000100:00100000:0.0:1787826366.736110:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 891 00000100:00100000:0.0:1787826366.736124:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3646:x1874670585177344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826366.736258:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3646:x1874670585177344:12345-0@lo:400:kworker.0 Request processed in 137us (11315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826366.736266:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 891 00000100:00100000:0.0:1787826366.736288:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 892 00000100:00100000:0.0:1787826366.736295:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c84780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3644:x1874670585177216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826366.736335:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c84780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3644:x1874670585177216:12345-0@lo:400:kworker.0 Request processed in 41us (8496us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826366.736340:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 892 00000100:00100000:0.0:1787826366.736388:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585177088 00000100:00100000:0.0:1787826366.736393:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585177088 00000100:00100000:0.0:1787826366.736420:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585176192 00000100:00100000:0.0:1787826366.736423:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585176192 00000100:00100000:0.0:1787826366.736436:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1361 00000100:00100000:0.0:1787826366.736442:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1874670585177088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826366.736513:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1874670585177088:12345-0@lo:400:kworker.0 Request processed in 72us (8843us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826366.736531:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1361 00000100:00100000:0.0:1787826366.736543:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1362 00000100:00100000:0.0:1787826366.736549:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c85e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874670585176192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787826366.736582:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446236160 avail 1299996672 00000100:00080000:2.0:1787826366.736584:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787826366.736589:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826366.736618:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c85e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874670585176192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 69us (8867us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826366.736624:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1362 00000100:00100000:0.0:1787826366.736698:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585177344:0@lo:400:kworker.0 00000100:00100000:0.0:1787826366.736761:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab91a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585176192:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826366.736775:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836893 gen 2 00000004:00080000:0.0:1787826366.736782:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3abc30c0, transno 21474836893 00000100:00100000:0.0:1787826366.736800:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585177216:0@lo:400:kworker.0 00000100:00100000:0.0:1787826366.736811:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585177088:0@lo:400:kworker.0 00000100:00100000:1.0:1787826366.742330:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826366.742571:0:25426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf41c85a40 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0000_UUID:25426:1874670585175680:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826366.742609:0:25426:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa1d1988/0x22153cd396b801d8 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826366.742853:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563697792 00000100:00100000:0.0:1787826366.742863:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563697792 00000100:00100000:1.0:1787826366.743111:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00010000:00010000:0.0:1787826366.743165:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000159f1fa4/0x22153cd396b8015a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03d3 expref: 15 pid: 30398 timeout: 1412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826366.743203:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563697920 00000100:00100000:0.0:1787826366.743207:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563697920 00010000:00010000:0.0:1787826366.743222:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f7d5184b/0x22153cd396b80161 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03da expref: 13 pid: 8437 timeout: 1412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826366.743251:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 957 00000100:00100000:0.0:1787826366.743262:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2403:x1874670563697792:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826366.743283:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826366.743310:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000159f1fa4/0x22153cd396b8015a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03d3 expref: 15 pid: 30398 timeout: 1412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.743325:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000159f1fa4/0x22153cd396b8015a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03d3 expref: 15 pid: 30398 timeout: 1412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.743356:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000159f1fa4/0x22153cd396b8015a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03d3 expref: 15 pid: 30398 timeout: 1412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.743392:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826366.743398:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826366.743404:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa1d1988/0x22153cd396b801d8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826366.743928:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 958 00000100:00100000:2.0:1787826366.743945:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2404:x1874670563697920:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826366.743957:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826366.743977:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f7d5184b/0x22153cd396b80161 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03da expref: 13 pid: 8437 timeout: 1412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.743991:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f7d5184b/0x22153cd396b80161 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03da expref: 13 pid: 8437 timeout: 1412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.744009:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x20:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826366.744013:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x20:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826366.744018:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004a81bd0e/0x22153cd396b801e6 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 14865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.744030:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a81bd0e/0x22153cd396b801e6 lrc: 4/1,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 14865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.744063:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826366.744146:0:10340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa1d1988/0x22153cd396b801d8 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.744169:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826366.746786:0:14865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7d5184b/0x22153cd396b80161 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03da expref: 13 pid: 8437 timeout: 1412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826366.746832:0:14865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf079643c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:14865:1874670585175808:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826366.747022:0:14865:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004a81bd0e/0x22153cd396b801e6 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.747039:0:14865:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004a81bd0e/0x22153cd396b801e6 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.747046:0:14865:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a81bd0e/0x22153cd396b801e6 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826366.751317:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826366.751355:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563698048 00000100:00100000:1.0:1787826366.751365:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563698048 00010000:00010000:1.0:1787826366.751423:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002904bac2/0x22153cd396b80168 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03e1 expref: 15 pid: 30694 timeout: 1412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826366.751466:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 959 00000100:00100000:1.0:1787826366.751492:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf076d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2403:x1874670563698048:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826366.751515:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826366.751554:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002904bac2/0x22153cd396b80168 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03e1 expref: 15 pid: 30694 timeout: 1412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826366.751579:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002904bac2/0x22153cd396b80168 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03e1 expref: 15 pid: 30694 timeout: 1412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826366.751612:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(2 0) 00010000:00010000:1.0:1787826366.751617:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(2 0) 00010000:00010000:1.0:1787826366.751624:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000021c90a82/0x22153cd396b801df lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 30176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826366.751636:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021c90a82/0x22153cd396b801df lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 30176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826366.751646:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(2 0) 00010000:00010000:1.0:1787826366.751649:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(2 0) 00010000:00010000:1.0:1787826366.751652:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b448b608/0x22153cd396b801ed lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->1605631] (req 1048576->1605631) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 30175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826366.751659:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b448b608/0x22153cd396b801ed lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->1605631] (req 1048576->1605631) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 30175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826366.751690:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826366.751764:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf076d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2403:x1874670563698048:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 273us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826366.751773:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 959 00010000:00010000:1.0:1787826366.751808:0:30175:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b448b608/0x22153cd396b801ed lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->1605631] (req 1048576->1605631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826366.751824:0:30175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b448b608/0x22153cd396b801ed lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->1605631] (req 1048576->1605631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826366.757997:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563697920:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 14041us (14868us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826366.758014:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 958 00010000:00010000:2.0:1787826366.758086:0:25426:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa1d1988/0x22153cd396b801d8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.758102:0:25426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa1d1988/0x22153cd396b801d8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826366.758390:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2403:x1874670563697792:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 15127us (16074us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826366.758399:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 957 00010000:00010000:3.0:1787826366.762034:0:30176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002904bac2/0x22153cd396b80168 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03e1 expref: 14 pid: 30694 timeout: 1412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826366.762064:0:30176:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf361e4780 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0000_UUID:30176:1874670585175936:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826366.762097:0:30176:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000021c90a82/0x22153cd396b801df lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.762111:0:30176:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000021c90a82/0x22153cd396b801df lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.762120:0:30176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021c90a82/0x22153cd396b801df lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.781773:0:30175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b448b608/0x22153cd396b801ed lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->1605631] (req 1048576->1605631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.781804:0:30175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b448b608/0x22153cd396b801ed lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->1605631] (req 1048576->1605631) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.781815:0:30175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b448b608/0x22153cd396b801ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->1605631] (req 1048576->1605631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.781824:0:30175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce057cec00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826366.781829:0:30175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b448b608/0x22153cd396b801ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->1605631] (req 1048576->1605631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.781840:0:30175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b448b608/0x22153cd396b801ed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->1605631] (req 1048576->1605631) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.781871:0:30175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b448b608/0x22153cd396b801ed lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->1605631] (req 1048576->1605631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826366.781880:0:30175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b448b608/0x22153cd396b801ed lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->1605631] (req 1048576->1605631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826366.782014:0:30175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf07967480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2402:x1874670563697664:12345-192.168.203.39@tcp:3:lfs.0 Request processed in 58881us (59779us total) trans 0 rc 554272/554272 00000100:00100000:2.0:1787826366.782026:0:30175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 687 00010000:00010000:3.0:1787826366.789922:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826366.801203:0:14865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004a81bd0e/0x22153cd396b801e6 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.801231:0:14865:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004a81bd0e/0x22153cd396b801e6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.801241:0:14865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004a81bd0e/0x22153cd396b801e6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.801250:0:14865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce057ce600 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826366.801255:0:14865:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004a81bd0e/0x22153cd396b801e6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.801265:0:14865:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004a81bd0e/0x22153cd396b801e6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.801289:0:14865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004a81bd0e/0x22153cd396b801e6 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.801297:0:14865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a81bd0e/0x22153cd396b801e6 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826366.801673:0:14865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf07967c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2401:x1874670563697536:12345-192.168.203.39@tcp:3:lfs.0 Request processed in 78559us (79236us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1787826366.801691:0:14865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 686 00010000:00010000:3.0:1787826366.827008:0:30176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000021c90a82/0x22153cd396b801df lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.827034:0:30176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021c90a82/0x22153cd396b801df lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.827045:0:30176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021c90a82/0x22153cd396b801df lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.827053:0:30176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400400 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826366.827058:0:30176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021c90a82/0x22153cd396b801df lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.827069:0:30176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021c90a82/0x22153cd396b801df lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.827091:0:30176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021c90a82/0x22153cd396b801df lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.827101:0:30176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021c90a82/0x22153cd396b801df lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826366.827222:0:30176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf07964f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2402:x1874670563697408:12345-192.168.203.39@tcp:3:lfs.0 Request processed in 104625us (105070us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1787826366.827234:0:30176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 685 00010000:00010000:0.0:1787826366.831014:0:25426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa1d1988/0x22153cd396b801d8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.831040:0:25426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa1d1988/0x22153cd396b801d8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.831050:0:25426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa1d1988/0x22153cd396b801d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.831058:0:25426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3abd6600 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826366.831064:0:25426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa1d1988/0x22153cd396b801d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.831075:0:25426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa1d1988/0x22153cd396b801d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.831098:0:25426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa1d1988/0x22153cd396b801d8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.831108:0:25426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa1d1988/0x22153cd396b801d8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826366.831229:0:25426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2402:x1874670563697280:12345-192.168.203.39@tcp:3:lfs.0 Request processed in 112245us (113604us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1787826366.831242:0:25426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 684 00000100:00100000:1.0:1787826366.881545:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826366.881614:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563698176 00000100:00100000:0.0:1787826366.881628:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563698176 00000100:00100000:0.0:1787826366.881708:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1782 00000100:00100000:0.0:1787826366.881730:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563698176:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826366.881754:0:30398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826366.881782:0:30398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021508201/0x22153cd396b801f4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0404 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826366.881817:0:30398:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 1048576, mtime: 0x6a9010be, atime: 0x6a9010bc, ctime: 0x6a9010be, blocks: 0x8 00010000:00010000:0.0:1787826366.881843:0:30398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=1312s v=(0 0) 00010000:00010000:0.0:1787826366.881849:0:30398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826366.881863:0:30398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021508201/0x22153cd396b801f4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0404 expref: 11 pid: 30398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.881894:0:30398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000021508201/0x22153cd396b801f4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0404 expref: 11 pid: 30398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.883286:0:30398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf01518e00, rc 0) 00000100:00100000:0.0:1787826366.883372:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2404:x1874670563698176:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1649us (1849us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826366.883575:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1782 00000100:00100000:2.0:1787826366.883820:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826366.883955:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563698304 00000100:00100000:3.0:1787826366.883964:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563698304 00000100:00100000:3.0:1787826366.884026:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1783 00000100:00100000:3.0:1787826366.884036:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c85a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2404:x1874670563698304:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826366.884055:0:30694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826366.884079:0:30694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021c90a82/0x22153cd396b801fb lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab040b expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826366.884111:0:30694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x20:0x0] initial LVB size: 2097152, mtime: 0x6a9010bf, atime: 0x6a9010bc, ctime: 0x6a9010bf, blocks: 0x20 00010000:00010000:3.0:1787826366.884137:0:30694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x20:0x0].0x0 since=1312s v=(0 0) 00010000:00010000:3.0:1787826366.884144:0:30694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826366.884159:0:30694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021c90a82/0x22153cd396b801fb lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab040b expref: 12 pid: 30694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.884252:0:30694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000021c90a82/0x22153cd396b801fb lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab040b expref: 12 pid: 30694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.884269:0:30694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400400, rc 0) 00000100:00100000:3.0:1787826366.884307:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c85a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563698304:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 272us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826366.884314:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1783 00000100:00100000:1.0:1787826366.886940:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826366.887032:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563698432 00000100:00100000:3.0:1787826366.887044:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563698432 00000100:00100000:3.0:1787826366.887160:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1784 00000100:00100000:3.0:1787826366.887244:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2404:x1874670563698432:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826366.887270:0:8545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826366.887299:0:8545:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc2068bb/0x22153cd396b80202 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0412 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826366.887334:0:8545:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 1602848, mtime: 0x6a9010bf, atime: 0x6a9010bc, ctime: 0x6a9010bf, blocks: 0x40 00010000:00010000:3.0:1787826366.887358:0:8545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=1312s v=(0 0) 00010000:00010000:3.0:1787826366.887363:0:8545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826366.887375:0:8545:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc2068bb/0x22153cd396b80202 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0412 expref: 12 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.887394:0:8545:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dc2068bb/0x22153cd396b80202 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0412 expref: 12 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826366.887410:0:8545:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400800, rc 0) 00000100:00100000:3.0:1787826366.887629:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563698432:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 459us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826366.887638:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1784 00000100:00100000:2.0:1787826366.907707:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826366.907947:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563698688 00000100:00100000:3.0:1787826366.907959:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563698688 00000100:00100000:3.0:1787826366.908032:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1000 00000100:00100000:3.0:1787826366.908044:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf10474050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:52435:x1874670563698688:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:2.0:1787826366.908998:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf10474050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+28:52435:x1874670563698688:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 948us (1313us total) trans 4294967648 rc 0/0 00000100:00100000:2.0:1787826366.909009:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1000 00000100:00100000:1.0:1787826366.989084:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826366.989209:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563698944 00000100:00100000:0.0:1787826366.989222:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563698944 00000100:00100000:0.0:1787826366.989301:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3401 00000100:00100000:0.0:1787826366.989314:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+28:52438:x1874670563698944:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826366.989345:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826366.989371:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf01518200/0x22153cd396b80209 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0419 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.989567:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf01519c00/0x22153cd396b80210 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.989587:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf01519c00/0x22153cd396b80210 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.989606:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf01519c00/0x22153cd396b80210 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826366.989618:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0x9:0x0]: returning size 3700000 00010000:00010000:0.0:1787826366.989769:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf01518200/0x22153cd396b80209 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0419 expref: 31 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.989793:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf01519c00/0x22153cd396b80210 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0419 expref: 30 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826366.989802:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:0.0:1787826366.989806:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787826366.989809:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf01519c00, rc 0) 00000100:00100000:0.0:1787826366.989874:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:52438:x1874670563698944:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 563us (803us total) trans 4294967649 rc 0/0 00000100:00100000:0.0:1787826366.989883:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3401 00000100:00100000:1.0:1787826367.049423:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826367.049530:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826367.049626:0:25423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563699072 00000100:00100000:0.0:1787826367.049639:0:25423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563699072 00000100:00100000:0.0:1787826367.049743:0:25423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563699200 00000100:00100000:0.0:1787826367.049747:0:25423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563699200 00000100:00100000:0.0:1787826367.049789:0:25423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 688 00000100:00100000:0.0:1787826367.049801:0:25423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563699072:12345-192.168.203.39@tcp:3:lfs.0 00010000:00010000:0.0:1787826367.049847:0:25423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003b745b1c/0x22153cd396b8021e lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826367.049869:0:25423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x21:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787826367.049874:0:25423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826367.049883:0:25423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b745b1c/0x22153cd396b8021e lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826367.049902:0:25423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b745b1c/0x22153cd396b8021e lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826367.052450:0:25425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 689 00000100:00100000:1.0:1787826367.052510:0:25425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2402:x1874670563699200:12345-192.168.203.39@tcp:3:lfs.0 00010000:00010000:1.0:1787826367.052573:0:25425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003eb46645/0x22153cd396b80225 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826367.052594:0:25425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787826367.052599:0:25425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826367.052606:0:25425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003eb46645/0x22153cd396b80225 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [2097152->3702783] (req 2097152->3702783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826367.052626:0:25425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003eb46645/0x22153cd396b80225 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [2097152->3702783] (req 2097152->3702783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826367.097533:0:25423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003b745b1c/0x22153cd396b8021e lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826367.097562:0:25423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b745b1c/0x22153cd396b8021e lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826367.097571:0:25423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b745b1c/0x22153cd396b8021e lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826367.097579:0:25423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf01518200 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826367.097585:0:25423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b745b1c/0x22153cd396b8021e lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826367.097595:0:25423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b745b1c/0x22153cd396b8021e lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826367.097618:0:25423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b745b1c/0x22153cd396b8021e lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826367.097628:0:25423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b745b1c/0x22153cd396b8021e lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826367.097754:0:25423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563699072:12345-192.168.203.39@tcp:3:lfs.0 Request processed in 47949us (48343us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1787826367.097765:0:25423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 688 00010000:00010000:0.0:1787826367.098534:0:25425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003eb46645/0x22153cd396b80225 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [2097152->3702783] (req 2097152->3702783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826367.098550:0:25425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003eb46645/0x22153cd396b80225 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [2097152->3702783] (req 2097152->3702783) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826367.098559:0:25425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003eb46645/0x22153cd396b80225 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [2097152->3702783] (req 2097152->3702783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826367.098565:0:25425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46ba00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826367.098570:0:25425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003eb46645/0x22153cd396b80225 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [2097152->3702783] (req 2097152->3702783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826367.098577:0:25425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003eb46645/0x22153cd396b80225 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [2097152->3702783] (req 2097152->3702783) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826367.098592:0:25425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003eb46645/0x22153cd396b80225 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [2097152->3702783] (req 2097152->3702783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826367.098599:0:25425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003eb46645/0x22153cd396b80225 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [2097152->3702783] (req 2097152->3702783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826367.098653:0:25425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2402:x1874670563699200:12345-192.168.203.39@tcp:3:lfs.0 Request processed in 46187us (49120us total) trans 0 rc 1602848/1602848 00000100:00100000:0.0:1787826367.098662:0:25425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 689 00000100:00100000:3.0:1787826367.183865:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826367.184861:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563699456 00000100:00100000:2.0:1787826367.184886:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563699456 00000100:00100000:2.0:1787826367.184977:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3402 00000100:00100000:2.0:1787826367.184990:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:52440:x1874670563699456:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826367.185026:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826367.185055:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7400/0x22153cd396b8022c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0420 expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826367.185220:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7a00/0x22153cd396b80233 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826367.185238:0:32404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834a00/0x22153cd396b801ca lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03fd expref: 31 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826367.185250:0:32404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7a00/0x22153cd396b80233 lrc: 4/0,1 mode: --/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826367.185308:0:32404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834a00/0x22153cd396b801ca lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03fd expref: 31 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826367.185325:0:32404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834a00/0x22153cd396b801ca lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03fd expref: 31 pid: 6520 timeout: 1413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826367.185344:0:32404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf41c852c0 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001_UUID:32404:1874670585177600:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826367.186221:0:32404:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf013f1180 going to sleep for 11 seconds 00000100:00100000:2.0:1787826367.198277:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826367.199064:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563699584 00000100:00100000:3.0:1787826367.199078:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563699584 00010000:00010000:3.0:1787826367.199141:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834a00/0x22153cd396b801ca lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03fd expref: 32 pid: 6520 timeout: 1413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826367.199210:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 960 00000100:00100000:3.0:1787826367.199224:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136cde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+32:2404:x1874670563699584:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826367.199243:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826367.199251:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834a00/0x22153cd396b801ca lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03fd expref: 32 pid: 6520 timeout: 1413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826367.199267:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834a00/0x22153cd396b801ca lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03fd expref: 32 pid: 6520 timeout: 1413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826367.199373:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:3.0:1787826367.199381:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7a00/0x22153cd396b80233 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826367.199394:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7a00/0x22153cd396b80233 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826367.199403:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7a00/0x22153cd396b80233 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826367.199430:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826367.199859:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136cde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+32:2404:x1874670563699584:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 635us (1596us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826367.199870:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 960 00010000:00010000:1.0:1787826367.200119:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834a00/0x22153cd396b801ca lrc: 0/0,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03fd expref: 31 pid: 6520 timeout: 1413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826367.200142:0:32404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf41c852c0 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001_UUID:32404:1874670585177600:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826367.200182:0:32404:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7a00/0x22153cd396b80233 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826367.200193:0:32404:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7a00/0x22153cd396b80233 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826367.200199:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7a00/0x22153cd396b80233 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826367.200224:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0x9:0x0]: returning size 3700000 00010000:00010000:1.0:1787826367.200545:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7400/0x22153cd396b8022c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0420 expref: 32 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826367.200563:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7a00/0x22153cd396b80233 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0420 expref: 31 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826367.200574:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:1.0:1787826367.200578:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787826367.200581:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3abd7a00, rc 0) 00000100:00100000:1.0:1787826367.200636:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:52440:x1874670563699456:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 15650us (16787us total) trans 4294967650 rc 0/0 00000100:00100000:1.0:1787826367.200644:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3402 00000100:00100000:2.0:1787826367.206273:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826367.207088:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563699712 00000100:00100000:1.0:1787826367.207103:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563699712 00000100:00100000:1.0:1787826367.207398:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3403 00000100:00100000:1.0:1787826367.207413:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136ce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:52440:x1874670563699712:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826367.207443:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826367.207490:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124600/0x22153cd396b80241 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0427 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826367.207628:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124400/0x22153cd396b80248 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826367.207645:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7a00/0x22153cd396b80233 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0420 expref: 32 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826367.207655:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124400/0x22153cd396b80248 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826367.207716:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7a00/0x22153cd396b80233 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0420 expref: 32 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826367.207732:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7a00/0x22153cd396b80233 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0420 expref: 32 pid: 32404 timeout: 1413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826367.207770:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf41c852c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6518:1874670585177728:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826367.207890:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce06a86b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826367.211893:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826367.212030:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563699840 00000100:00100000:3.0:1787826367.212042:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563699840 00010000:00010000:3.0:1787826367.212096:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7a00/0x22153cd396b80233 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0420 expref: 33 pid: 32404 timeout: 1413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826367.212146:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 961 00000100:00100000:3.0:1787826367.212157:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:2404:x1874670563699840:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826367.212188:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826367.212196:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7a00/0x22153cd396b80233 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0420 expref: 33 pid: 32404 timeout: 1413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826367.212210:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7a00/0x22153cd396b80233 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0420 expref: 33 pid: 32404 timeout: 1413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826367.212240:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:3.0:1787826367.212246:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124400/0x22153cd396b80248 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826367.212258:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124400/0x22153cd396b80248 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826367.212268:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124400/0x22153cd396b80248 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826367.212292:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826367.212512:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:2404:x1874670563699840:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 355us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826367.212530:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 961 00010000:00010000:2.0:1787826367.213418:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7a00/0x22153cd396b80233 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0420 expref: 32 pid: 32404 timeout: 1413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826367.213442:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf41c852c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6518:1874670585177728:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826367.213531:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124400/0x22153cd396b80248 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826367.213542:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124400/0x22153cd396b80248 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826367.213548:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124400/0x22153cd396b80248 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826367.213619:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0x9:0x0]: returning size 3700000 00000004:00200000:2.0:1787826367.213625:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826367.213650:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124400/0x22153cd396b80248 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826367.213707:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124600/0x22153cd396b80241 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0427 expref: 32 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826367.213725:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124400/0x22153cd396b80248 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0427 expref: 31 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826367.213734:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:2.0:1787826367.213738:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826367.213740:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05124400, rc 0) 00000100:00100000:2.0:1787826367.213809:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136ce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:52440:x1874670563699712:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 6401us (7551us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826367.213818:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3403 00000100:00100000:1.0:1787826367.219014:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826367.219225:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563699968 00000100:00100000:0.0:1787826367.219239:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563699968 00000100:00100000:0.0:1787826367.219410:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1785 00000100:00100000:0.0:1787826367.219423:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563699968:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:0.0:1787826367.219524:0:30696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087d8141e/0x22153cd396b8024f lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826367.219552:0:30696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000673b7b2e/0x22153cd396b800ce lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03a2 expref: 12 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826367.219563:0:30696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826367.219569:0:30696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826367.219575:0:30696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087d8141e/0x22153cd396b8024f lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826367.219627:0:30696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000673b7b2e/0x22153cd396b800ce lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03a2 expref: 12 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826367.219646:0:30696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000673b7b2e/0x22153cd396b800ce lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03a2 expref: 12 pid: 8545 timeout: 1413 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826367.219665:0:30696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf079661c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:30696:1874670585177856:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826367.219949:0:30696:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf39df2000 going to sleep for 11 seconds 00000100:00100000:0.0:1787826367.222054:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826367.225095:0:30696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf079661c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:30696:1874670585177856:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826367.225137:0:30696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000087d8141e/0x22153cd396b8024f lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826367.225867:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826367.226064:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563700096 00000100:00100000:2.0:1787826367.226075:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563700096 00000100:00100000:2.0:1787826367.226140:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1786 00000100:00100000:2.0:1787826367.226151:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf07966940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563700096:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:2.0:1787826367.226220:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048042b98/0x22153cd396b80256 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826367.226243:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004b608887/0x22153cd396b800d5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03a9 expref: 12 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826367.226254:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826367.226259:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826367.226266:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048042b98/0x22153cd396b80256 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826367.226431:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004b608887/0x22153cd396b800d5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03a9 expref: 12 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826367.226446:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004b608887/0x22153cd396b800d5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03a9 expref: 12 pid: 8545 timeout: 1413 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826367.226464:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf136cf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1874670585177984:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826367.226602:0:8435:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf013f1180 going to sleep for 11 seconds 00000100:00100000:3.0:1787826367.227244:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563700224 00000100:00100000:3.0:1787826367.227252:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563700224 00010000:00010000:3.0:1787826367.227290:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000673b7b2e/0x22153cd396b800ce lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03a2 expref: 13 pid: 8545 timeout: 1413 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826367.231526:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 962 00000100:00100000:3.0:1787826367.231549:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf079661c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2403:x1874670563700224:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826367.231578:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826367.231610:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000673b7b2e/0x22153cd396b800ce lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03a2 expref: 13 pid: 8545 timeout: 1413 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826367.231630:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000673b7b2e/0x22153cd396b800ce lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03a2 expref: 13 pid: 8545 timeout: 1413 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826367.231660:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000673b7b2e/0x22153cd396b800ce lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03a2 expref: 13 pid: 8545 timeout: 1413 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826367.231681:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826367.231687:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826367.231712:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000087d8141e/0x22153cd396b8024f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826367.231724:0:10340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087d8141e/0x22153cd396b8024f lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826367.231769:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826367.231798:0:30696:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000087d8141e/0x22153cd396b8024f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826367.231808:0:30696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087d8141e/0x22153cd396b8024f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826367.231832:0:30696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087d8141e/0x22153cd396b8024f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826367.231841:0:30696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087d8141e/0x22153cd396b8024f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826367.231850:0:30696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087d8141e/0x22153cd396b8024f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826367.231859:0:30696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf01519600 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826367.231864:0:30696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087d8141e/0x22153cd396b8024f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826367.231874:0:30696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087d8141e/0x22153cd396b8024f lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826367.231886:0:30696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087d8141e/0x22153cd396b8024f lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826367.231894:0:30696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087d8141e/0x22153cd396b8024f lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826367.232764:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563699968:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 13327us (13749us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826367.232778:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1785 00000100:00100000:2.0:1787826367.234437:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826367.234499:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563700352 00000100:00100000:2.0:1787826367.234510:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563700352 00010000:00010000:2.0:1787826367.234567:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004b608887/0x22153cd396b800d5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03a9 expref: 13 pid: 8545 timeout: 1413 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826367.235007:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 963 00000100:00100000:2.0:1787826367.235021:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136cfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2404:x1874670563700352:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826367.235041:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826367.235069:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004b608887/0x22153cd396b800d5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03a9 expref: 13 pid: 8545 timeout: 1413 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826367.235086:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004b608887/0x22153cd396b800d5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03a9 expref: 13 pid: 8545 timeout: 1413 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826367.235122:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826367.235128:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826367.235135:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000048042b98/0x22153cd396b80256 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826367.235146:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048042b98/0x22153cd396b80256 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826367.235233:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826367.235491:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136cfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2404:x1874670563700352:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 455us (1046us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826367.235500:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 963 00010000:00010000:1.0:1787826367.235619:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b608887/0x22153cd396b800d5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03a9 expref: 12 pid: 8545 timeout: 1413 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826367.235639:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf136cf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1874670585177984:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826367.235667:0:8435:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000048042b98/0x22153cd396b80256 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826367.235684:0:8435:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000048042b98/0x22153cd396b80256 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826367.235930:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048042b98/0x22153cd396b80256 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826367.235960:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048042b98/0x22153cd396b80256 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826367.235969:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000048042b98/0x22153cd396b80256 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826367.235978:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000048042b98/0x22153cd396b80256 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826367.235987:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3abd7a00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:1.0:1787826367.235991:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000048042b98/0x22153cd396b80256 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826367.236001:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000048042b98/0x22153cd396b80256 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826367.236017:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000048042b98/0x22153cd396b80256 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826367.236031:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048042b98/0x22153cd396b80256 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826367.236194:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf079661c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2403:x1874670563700224:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4653us (10327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826367.236207:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 962 00000100:00100000:0.0:1787826367.236498:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf361e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585178112:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826367.236572:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826367.238235:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585178112 00000100:00100000:3.0:1787826367.238254:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585178112 00000100:00100000:3.0:1787826367.238567:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 742 00000100:00100000:3.0:1787826367.238580:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf079643c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+8:3644:x1874670585178112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787826367.238614:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 110631744 pending 0 free 3919265792 avail 3687608320 00000100:00100000:3.0:1787826367.238824:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf079643c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+8:3644:x1874670585178112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 247us (2252us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826367.238833:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 742 00000100:00100000:0.0:1787826367.239019:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf361e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585178112:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826367.239652:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf136ced00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585178240:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787826367.239827:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826367.239874:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787826367.239883:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf136cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585178368:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826367.239915:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826367.239943:0:12021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585178240 00000100:00100000:2.0:1787826367.239949:0:12021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585178240 00000100:00100000:2.0:1787826367.239990:0:12021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585178368 00000100:00100000:2.0:1787826367.239993:0:12021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585178368 00000100:00100000:2.0:1787826367.240015:0:12021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 743 00000100:00100000:2.0:1787826367.240024:0:12021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874670585178240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787826367.240044:0:12021:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1073152 granted 93846336 pending 0 free 3921354752 avail 3689791488 00000100:00100000:2.0:1787826367.240088:0:12021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874670585178240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826367.240096:0:12021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 743 00000100:00100000:2.0:1787826367.240112:0:12021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 744 00000100:00100000:2.0:1787826367.240117:0:12021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb952c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3647:x1874670585178368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787826367.240128:0:12021:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1073152 granted 93846336 pending 0 free 3921354752 avail 3689791488 00000100:00100000:2.0:1787826367.240154:0:12021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb952c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3647:x1874670585178368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 36us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826367.240160:0:12021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 744 00000100:00100000:2.0:1787826367.240271:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf136cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585178368:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826367.240373:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf136ced00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585178240:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787826367.240537:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787826367.240549:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce05120000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585178496:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787826367.240584:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826367.240613:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585178496 00000100:00100000:0.0:1787826367.240618:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585178496 00000100:00100000:0.0:1787826367.240644:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 745 00000100:00100000:0.0:1787826367.240651:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05120b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874670585178496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787826367.240664:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 110631744 pending 0 free 3919265792 avail 3687608320 00000100:00100000:0.0:1787826367.240874:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05120b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874670585178496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 223us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826367.240882:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 745 00000100:00100000:1.0:1787826367.241102:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf07966940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2404:x1874670563700096:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 14948us (19054us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826367.241113:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1786 00000100:00100000:3.0:1787826367.243866:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826367.245193:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce05120000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585178496:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787826367.245488:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563700608 00000100:00100000:0.0:1787826367.245498:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563700608 00000100:00100000:0.0:1787826367.245581:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3404 00000100:00100000:0.0:1787826367.245593:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3960b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:52440:x1874670563700608:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:0.0:1787826367.245662:0:9966:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826367.245829:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401200/0x22153cd396b800e3 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03b0 expref: 31 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826367.245855:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:0.0:1787826367.245862:0:9966:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826367.245893:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf01518600/0x22153cd396b8025d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826367.245909:0:9966:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124400/0x22153cd396b80248 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0427 expref: 30 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826367.245918:0:9966:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b80176 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03e8 expref: 30 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826367.245926:0:9966:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf01519c00/0x22153cd396b80210 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0419 expref: 30 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826367.245935:0:9966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf01518600/0x22153cd396b8025d lrc: 6/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826367.245972:0:9966:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff90cf01519c00/0x22153cd396b80210 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0419 expref: 30 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826367.245987:0:9966:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf01519c00/0x22153cd396b80210 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0419 expref: 30 pid: 16564 timeout: 1413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826367.246010:0:9966:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce05120000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9966:1874670585178624:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826367.246200:0:9966:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b80176 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03e8 expref: 30 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826367.246210:0:9966:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b80176 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03e8 expref: 30 pid: 6519 timeout: 1413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826367.246220:0:9966:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce051212c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9966:1874670585178752:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826367.246254:0:9966:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124400/0x22153cd396b80248 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0427 expref: 30 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826367.246264:0:9966:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124400/0x22153cd396b80248 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0427 expref: 30 pid: 6518 timeout: 1413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826367.246273:0:9966:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0b433480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9966:1874670585178880:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826367.246369:0:9966:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf39df2000 going to sleep for 11 seconds 00000100:00100000:2.0:1787826367.253636:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826367.253674:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826367.253739:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826367.253793:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563701120 00000100:00100000:2.0:1787826367.253803:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563701120 00010000:00010000:2.0:1787826367.253854:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124400/0x22153cd396b80248 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0427 expref: 31 pid: 6518 timeout: 1413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826367.253891:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563700992 00000100:00100000:2.0:1787826367.253894:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563700992 00010000:00010000:2.0:1787826367.253907:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b80176 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03e8 expref: 32 pid: 6519 timeout: 1413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826367.253927:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 964 00000100:00100000:2.0:1787826367.253938:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb97840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+32:2403:x1874670563701120:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826367.253956:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826367.253966:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124400/0x22153cd396b80248 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0427 expref: 32 pid: 6518 timeout: 1413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826367.253981:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124400/0x22153cd396b80248 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0427 expref: 32 pid: 6518 timeout: 1413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826367.254011:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:2.0:1787826367.254018:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff90cf01518600/0x22153cd396b8025d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826367.254028:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff90cf01518600/0x22153cd396b8025d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826367.254035:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff90cf01518600/0x22153cd396b8025d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826367.254042:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826367.254103:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb97840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+32:2403:x1874670563701120:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 165us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826367.254112:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 964 00000100:00100000:2.0:1787826367.254132:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 965 00000100:00100000:2.0:1787826367.254139:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb95e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:2403:x1874670563700992:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826367.254147:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826367.254152:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b80176 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03e8 expref: 31 pid: 6519 timeout: 1413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826367.254161:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b80176 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03e8 expref: 31 pid: 6519 timeout: 1413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826367.254508:0:9966:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce05120000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9966:1874670585178624:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826367.254532:0:9966:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce051212c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9966:1874670585178752:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826367.254542:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124400/0x22153cd396b80248 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0427 expref: 31 pid: 6518 timeout: 1413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826367.254561:0:9966:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0b433480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9966:1874670585178880:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826367.255025:0:9966:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff90cf01518600/0x22153cd396b8025d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826367.255118:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563700864 00000100:00100000:3.0:1787826367.255126:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563700864 00000100:00100000:3.0:1787826367.255267:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1001 00000100:00100000:3.0:1787826367.255277:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb95a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:42220:x1874670563700864:12345-192.168.203.39@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787826367.255593:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb95a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+32:42220:x1874670563700864:12345-192.168.203.39@tcp:35:ldlm_bl.0 Request processed in 317us (1972us total) trans 4294967651 rc 0/0 00000100:00100000:3.0:1787826367.255601:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1001 00010000:00010000:2.0:1787826367.256240:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b80176 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab03e8 expref: 31 pid: 6519 timeout: 1413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826367.256263:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:2.0:1787826367.256270:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff90cf01518600/0x22153cd396b8025d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826367.256280:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff90cf01518600/0x22153cd396b8025d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826367.256287:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff90cf01518600/0x22153cd396b8025d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826367.256305:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826367.256343:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb95e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:2403:x1874670563700992:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 2203us (2603us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826367.256354:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 965 00000100:00100000:0.0:1787826367.259980:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826367.260080:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563701248 00000100:00100000:3.0:1787826367.260091:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563701248 00010000:00010000:3.0:1787826367.260144:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf01519c00/0x22153cd396b80210 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0419 expref: 30 pid: 16564 timeout: 1413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826367.260292:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 966 00000100:00100000:3.0:1787826367.260369:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf076da050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:2404:x1874670563701248:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826367.260392:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826367.260401:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff90cf01519c00/0x22153cd396b80210 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0419 expref: 30 pid: 16564 timeout: 1413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826367.260417:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff90cf01519c00/0x22153cd396b80210 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0419 expref: 30 pid: 16564 timeout: 1413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826367.260447:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf01519c00/0x22153cd396b80210 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0419 expref: 30 pid: 16564 timeout: 1413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826367.260577:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:3.0:1787826367.260585:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff90cf01518600/0x22153cd396b8025d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826367.260597:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf01518600/0x22153cd396b8025d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826367.260606:0:10340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf01518600/0x22153cd396b8025d lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826367.260672:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826367.260896:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf076da050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+29:2404:x1874670563701248:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 530us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826367.260904:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 966 00010000:00010000:0.0:1787826367.262265:0:9966:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff90cf01518600/0x22153cd396b8025d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826367.262284:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf01518600/0x22153cd396b8025d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826367.262659:0:9966:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001c287892 reply state 0000000073678836 transno 4294967652 ns: mdt-lustre-MDT0001_UUID lock: ffff90cf01518600/0x22153cd396b8025d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826367.262680:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf01518600/0x22153cd396b8025d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826367.262985:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:0.0:1787826367.262990:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2a 00000100:00100000:0.0:1787826367.262996:0:9966:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787826367.263157:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3960b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:52440:x1874670563700608:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 17561us (19301us total) trans 4294967652 rc 0/0 00000100:00100000:0.0:1787826367.263177:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3404 00000100:00100000:0.0:1787826367.272125:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826367.272284:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563701504 00000100:00100000:2.0:1787826367.272365:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563701504 00000100:00100000:2.0:1787826367.272544:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1002 00000100:00100000:2.0:1787826367.272559:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b433c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:52440:x1874670563701504:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:2.0:1787826367.273256:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b433c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:52440:x1874670563701504:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 696us (1141us total) trans 4294967653 rc 0/0 00000100:00100000:2.0:1787826367.273266:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1002 00000100:00100000:1.0:1787826367.289275:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826367.290510:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563701760 00000100:00100000:2.0:1787826367.290539:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563701760 00000100:00100000:2.0:1787826367.290686:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3405 00000100:00100000:2.0:1787826367.290715:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab91a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:52441:x1874670563701760:12345-192.168.203.39@tcp:101:lseek_test.0 00010000:00010000:2.0:1787826367.290748:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826367.291017:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6800/0x22153cd396b80264 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab042e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826367.291120:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7000/0x22153cd396b8026b lrc: 3/1,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826367.291138:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7000/0x22153cd396b8026b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826367.291153:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7000/0x22153cd396b8026b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826367.291181:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7400/0x22153cd396b80272 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826367.291189:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7400/0x22153cd396b80272 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826367.291196:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7400/0x22153cd396b80272 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826367.291467:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6000/0x22153cd396b80279 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826367.291655:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6000/0x22153cd396b80279 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826367.291663:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6000/0x22153cd396b80279 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826367.291681:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0x9:0x0]: returning size 3700000 00010000:00010000:2.0:1787826367.291971:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7000/0x22153cd396b8026b lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826367.291980:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7000/0x22153cd396b8026b lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826367.291986:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7000/0x22153cd396b8026b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826367.291992:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7000/0x22153cd396b8026b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826367.291998:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3abd7000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826367.292002:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7000/0x22153cd396b8026b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826367.292010:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7000/0x22153cd396b8026b lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826367.292025:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x0 (ffff90cf1988e500) 00010000:00010000:2.0:1787826367.292028:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826367.292033:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7000/0x22153cd396b8026b lrc: 3/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826367.292040:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7000/0x22153cd396b8026b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826367.292057:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7400/0x22153cd396b80272 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826367.292063:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7400/0x22153cd396b80272 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826367.292069:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7400/0x22153cd396b80272 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826367.292073:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3abd7400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826367.292076:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7400/0x22153cd396b80272 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826367.292081:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7400/0x22153cd396b80272 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826367.292088:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x5675640f (ffff90cf39e67000) 00010000:00010000:2.0:1787826367.292090:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826367.292093:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7400/0x22153cd396b80272 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826367.292098:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd7400/0x22153cd396b80272 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826367.292152:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6800/0x22153cd396b80264 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab042e expref: 34 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826367.292359:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3abd6000/0x22153cd396b80279 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab042e expref: 33 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826367.292370:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:2.0:1787826367.292372:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826367.292375:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3abd6000, rc 0) 00000100:00100000:2.0:1787826367.292600:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab91a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:52441:x1874670563701760:12345-192.168.203.39@tcp:101:lseek_test.0 Request processed in 1887us (3340us total) trans 4294967654 rc 0/0 00000100:00100000:2.0:1787826367.292614:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3405 00000100:00100000:0.0:1787826367.297602:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826367.297716:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826367.298118:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826367.298161:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563701888 00000100:00100000:1.0:1787826367.298182:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563701888 00000100:00100000:1.0:1787826367.298253:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563702144 00000100:00100000:1.0:1787826367.298256:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563702144 00000100:00100000:1.0:1787826367.298283:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1787 00000100:00100000:3.0:1787826367.298383:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1788 00000100:00100000:3.0:1787826367.298394:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b4303c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563702144:12345-192.168.203.39@tcp:23:lseek_test.0 00000100:00100000:3.0:1787826367.298556:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b4303c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563702144:12345-192.168.203.39@tcp:23:lseek_test.0 Request processed in 164us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826367.298565:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1788 00000100:00100000:1.0:1787826367.298687:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b433840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2403:x1874670563701888:12345-192.168.203.39@tcp:23:lseek_test.0 00000100:00100000:1.0:1787826367.299033:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b433840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2403:x1874670563701888:12345-192.168.203.39@tcp:23:lseek_test.0 Request processed in 740us (1445us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826367.299040:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1787 00000100:00100000:2.0:1787826367.300863:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563702016 00000100:00100000:2.0:1787826367.300881:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563702016 00000100:00100000:3.0:1787826367.301161:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1789 00000100:00100000:3.0:1787826367.301185:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b4321c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2403:x1874670563702016:12345-192.168.203.39@tcp:23:lseek_test.0 00000100:00100000:3.0:1787826367.301444:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b4321c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2403:x1874670563702016:12345-192.168.203.39@tcp:23:lseek_test.0 Request processed in 263us (3324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826367.301453:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1789 00000100:00100000:1.0:1787826367.304507:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826367.304635:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563702400 00000100:00100000:2.0:1787826367.304648:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563702400 00000100:00100000:2.0:1787826367.304886:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1003 00000100:00100000:2.0:1787826367.304899:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:52441:x1874670563702400:12345-192.168.203.39@tcp:35:lseek_test.0 00000100:00100000:2.0:1787826367.305222:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:52441:x1874670563702400:12345-192.168.203.39@tcp:35:lseek_test.0 Request processed in 324us (761us total) trans 4294967655 rc 0/0 00000100:00100000:2.0:1787826367.305231:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1003 00000100:00100000:0.0:1787826367.320843:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826367.321076:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563702656 00000100:00100000:1.0:1787826367.321089:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563702656 00000100:00100000:1.0:1787826367.321171:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3406 00000100:00100000:1.0:1787826367.321183:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b430f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:52442:x1874670563702656:12345-192.168.203.39@tcp:101:lseek_test.0 00010000:00010000:1.0:1787826367.321217:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826367.321247:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124c00/0x22153cd396b80287 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0435 expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826367.321411:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125400/0x22153cd396b8028e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826367.321431:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125400/0x22153cd396b8028e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826367.321445:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125400/0x22153cd396b8028e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826367.321458:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0x9:0x0]: returning size 3700000 00010000:00010000:1.0:1787826367.322048:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124c00/0x22153cd396b80287 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0435 expref: 37 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826367.322074:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125400/0x22153cd396b8028e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0435 expref: 36 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826367.322085:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:1.0:1787826367.322088:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787826367.322092:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05125400, rc 0) 00000100:00100000:1.0:1787826367.322224:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b430f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:52442:x1874670563702656:12345-192.168.203.39@tcp:101:lseek_test.0 Request processed in 1043us (1395us total) trans 4294967656 rc 0/0 00000100:00100000:1.0:1787826367.322232:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3406 00000100:00100000:1.0:1787826367.331368:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826367.331544:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563702784 00000100:00100000:2.0:1787826367.331560:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563702784 00000100:00100000:2.0:1787826367.331653:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1790 00000100:00100000:2.0:1787826367.331665:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab921c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2401:x1874670563702784:12345-192.168.203.39@tcp:23:lseek_test.0 00000100:00100000:2.0:1787826367.332307:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab921c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2401:x1874670563702784:12345-192.168.203.39@tcp:23:lseek_test.0 Request processed in 641us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826367.332316:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1790 00000100:00100000:2.0:1787826367.374235:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826367.374724:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563702912 00000100:00100000:0.0:1787826367.374738:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563702912 00000100:00100000:0.0:1787826367.374828:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 339 00000100:00100000:0.0:1787826367.374839:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb94000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:42221:x1874670563702912:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826367.374864:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 5 locks, starting at 0 00010000:00010000:0.0:1787826367.374918:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc2068bb/0x22153cd396b80202 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0412 expref: 11 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826367.374965:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021508201/0x22153cd396b801f4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0404 expref: 10 pid: 30398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826367.374989:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8d9bc84/0x22153cd396b7f361 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab00bc expref: 9 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826367.375012:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a816990/0x22153cd396b7e87f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafd66 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826367.375034:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bacf1a1a/0x22153cd396b7e2e4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafc01 expref: 7 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826367.375047:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826367.375131:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb94000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+6:42221:x1874670563702912:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 294us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826367.375141:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 339 00000100:00100000:3.0:1787826367.380575:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826367.380669:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563703040 00000100:00100000:0.0:1787826367.380683:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563703040 00002000:00100000:0.0:1787826367.380751:0:8440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xe0:0x0] (0->1048575) req@ffff90cf361e4f00 x1874670563703040/t0(0) o4->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:723/0 lens 488/0 e 0 to 0 dl 1787826378 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826367.380766:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf361e4f00 with x1874670563703040 ext(0->1048575) 00002000:00010000:0.0:1787826367.380774:0:8440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90cf361e4f00 00000100:00100000:0.0:1787826367.380816:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 690 00000100:00100000:0.0:1787826367.380827:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2401:x1874670563703040:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1787826367.412038:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2401:x1874670563703040:12345-192.168.203.39@tcp:4:dd.0 Request processed in 31195us (31460us total) trans 17179869588 rc 0/0 00000100:00100000:0.0:1787826367.412055:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 690 00002000:00100000:0.0:1787826367.412072:0:8440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xe0:0x0] (0->1048575) req@ffff90cf361e4f00 x1874670563703040/t17179869588(0) o4->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:723/0 lens 488/448 e 0 to 0 dl 1787826378 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826367.412083:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf361e4f00 with x1874670563703040 ext(0->1048575) 00002000:00010000:0.0:1787826367.412090:0:8440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90cf361e4f00 00000100:00100000:2.0:1787826367.418250:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826367.418569:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563703168 00000100:00100000:3.0:1787826367.418583:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563703168 00000100:00100000:2.0:1787826367.418734:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 340 00000100:00100000:2.0:1787826367.418747:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb96940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:49796:x1874670563703168:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826367.418770:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 5 locks, starting at 0 00002000:00010000:2.0:1787826367.418795:0:6505:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x1a:0x0] updating lvb size from disk: 0 -> 3381 00002000:00010000:2.0:1787826367.418799:0:6505:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x1a:0x0] updating lvb mtime from disk: 1787826215 -> 1787826216 00002000:00010000:2.0:1787826367.418802:0:6505:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x1a:0x0] updating lvb atime from disk: 1787826193 -> 1787826216 00002000:00010000:2.0:1787826367.418805:0:6505:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x1a:0x0] updating lvb ctime from disk: 1787826215 -> 1787826216 00002000:00010000:2.0:1787826367.418808:0:6505:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x1a:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1787826367.418839:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0ad9192/0x22153cd396b7e067 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafb44 expref: 13 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826367.419006:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021c90a82/0x22153cd396b801fb lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab040b expref: 12 pid: 30694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787826367.419032:0:6505:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xe0:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:2.0:1787826367.419034:0:6505:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xe0:0x0] updating lvb blocks from disk: 0 -> 2048 00010000:00010000:2.0:1787826367.419044:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003299944/0x22153cd396b7fb6b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab01d4 expref: 11 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826367.419066:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c43350b1/0x22153cd396b7f36f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xdf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab00c3 expref: 10 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826367.419086:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009befb8a5/0x22153cd396b7e2eb lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62aafc08 expref: 9 pid: 30695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826367.419098:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826367.419259:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb96940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:49796:x1874670563703168:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 513us (1020us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826367.419267:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 340 00000100:00100000:1.0:1787826367.640095:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826367.640148:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826367.640176:0:34485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563703296 00000100:00100000:0.0:1787826367.640189:0:34485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563703296 00000100:00100000:1.0:1787826367.640194:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826367.640261:0:34485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 82 00000100:00100000:0.0:1787826367.640273:0:34485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf39ccfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:307626ff-a376-4faf-93e0-9f55b723d964+10:2402:x1874670563703296:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1787826367.640375:0:34485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf39ccfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:307626ff-a376-4faf-93e0-9f55b723d964+10:2402:x1874670563703296:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 104us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826367.640384:0:34485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 82 00000100:00100000:2.0:1787826367.640411:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563703552 00000100:00100000:2.0:1787826367.640418:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563703552 00000100:00100000:2.0:1787826367.640459:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563703424 00000100:00100000:2.0:1787826367.640463:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563703424 00000100:00100000:0.0:1787826367.640529:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1512 00000100:00100000:0.0:1787826367.640540:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:2402:x1874670563703552:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1787826367.640554:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1513 00000100:00100000:2.0:1787826367.640564:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab91e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+17:2402:x1874670563703424:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1787826367.640584:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:2402:x1874670563703552:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 45us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826367.640592:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1512 00000100:00100000:2.0:1787826367.640607:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab91e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+17:2402:x1874670563703424:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 44us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826367.640617:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1513 00000100:00080000:2.0:1787826367.640640:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787826367.815929:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826368.835629:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826369.860035:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826370.883680:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826371.844252:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0b433480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874670585179264:0@lo:400:kworker.0 00000100:00100000:0.0:1787826371.844360:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826371.844430:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf41c86940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874670585179776:0@lo:400:kworker.0 00000100:00100000:0.0:1787826371.844454:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826371.844502:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf41c87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585180288:0@lo:400:kworker.0 00000100:00100000:0.0:1787826371.844531:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826371.844564:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787826371.844570:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf41c84f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585179392:0@lo:400:kworker.0 00000100:00100000:0.0:1787826371.844596:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826371.844686:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf41c86580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874670585179904:0@lo:400:kworker.0 00000100:00100000:0.0:1787826371.844884:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826371.844902:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf1ecade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585180416:0@lo:400:kworker.0 00000100:00100000:0.0:1787826371.844923:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826371.845344:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0b430000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e3c550b8-2c3c-46c3-ad36-671c284167ea:3644:1874670585179008:0@lo:400:kworker.0 00000100:00100000:2.0:1787826371.845390:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826371.845419:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf41c84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585179520:0@lo:400:kworker.0 00000100:00100000:2.0:1787826371.845443:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826371.845460:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf41c86d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874670585180032:0@lo:400:kworker.0 00000100:00100000:2.0:1787826371.845520:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826371.845544:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf1ecac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874670585180544:0@lo:400:kworker.0 00000100:00100000:2.0:1787826371.845568:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826371.845594:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787826371.845601:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0b4330c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585179136:0@lo:400:kworker.0 00000100:00100000:0.0:1787826371.846052:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585179264 00000100:00100000:0.0:1787826371.846063:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585179264 00000100:00100000:0.0:1787826371.846116:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585179776 00000100:00100000:0.0:1787826371.846119:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585179776 00000100:00100000:0.0:1787826371.846149:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585179904 00000100:00100000:0.0:1787826371.846152:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585179904 00000100:00100000:0.0:1787826371.846165:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585180032 00000100:00100000:0.0:1787826371.846168:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585180032 00000100:00100000:0.0:1787826371.846179:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585180544 00000100:00100000:0.0:1787826371.846181:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585180544 00000100:00100000:0.0:1787826371.846201:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1514 00000100:00100000:0.0:1787826371.846211:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecafc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874670585179264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826371.846343:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecafc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874670585179264:12345-0@lo:400:kworker.0 Request processed in 71us (1922us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826371.846350:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1514 00000100:00100000:0.0:1787826371.846370:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1515 00000100:00100000:0.0:1787826371.846376:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecacf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874670585179776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826371.846405:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecacf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874670585179776:12345-0@lo:400:kworker.0 Request processed in 30us (1950us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826371.846411:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1515 00000100:00100000:0.0:1787826371.846422:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1516 00000100:00100000:0.0:1787826371.846428:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874670585179904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826371.846452:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874670585179904:12345-0@lo:400:kworker.0 Request processed in 25us (1568us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826371.846458:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1516 00000100:00100000:0.0:1787826371.846500:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1517 00000100:00100000:0.0:1787826371.846508:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874670585180032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826371.846536:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874670585180032:12345-0@lo:400:kworker.0 Request processed in 30us (1016us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826371.846542:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1517 00000100:00100000:0.0:1787826371.846564:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1518 00000100:00100000:0.0:1787826371.846570:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb95680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874670585180544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826371.846595:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb95680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874670585180544:12345-0@lo:400:kworker.0 Request processed in 26us (1027us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826371.846601:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1518 00000100:00100000:1.0:1787826371.846974:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585180288 00000100:00100000:1.0:1787826371.846980:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585180288 00000100:00100000:1.0:1787826371.847019:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585179392 00000100:00100000:1.0:1787826371.847022:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585179392 00000100:00100000:1.0:1787826371.847042:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585180416 00000100:00100000:1.0:1787826371.847044:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585180416 00000100:00100000:1.0:1787826371.847063:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585179520 00000100:00100000:1.0:1787826371.847066:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585179520 00000100:00100000:1.0:1787826371.847087:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 893 00000100:00100000:1.0:1787826371.847094:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecad680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874670585180288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826371.847136:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecad680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874670585180288:12345-0@lo:400:kworker.0 Request processed in 43us (2604us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826371.847143:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 893 00000100:00100000:1.0:1787826371.847156:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 894 00000100:00100000:1.0:1787826371.847161:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecacb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+8:3646:x1874670585179392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826371.847189:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecacb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+8:3646:x1874670585179392:12345-0@lo:400:kworker.0 Request processed in 28us (2592us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826371.847195:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 894 00000100:00100000:1.0:1787826371.847206:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 895 00000100:00100000:1.0:1787826371.847212:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecae940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874670585180416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826371.847240:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecae940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874670585180416:12345-0@lo:400:kworker.0 Request processed in 29us (2315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826371.847245:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 895 00000100:00100000:1.0:1787826371.847256:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 896 00000100:00100000:1.0:1787826371.847262:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb96580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+7:3644:x1874670585179520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826371.847291:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb96580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+7:3644:x1874670585179520:12345-0@lo:400:kworker.0 Request processed in 29us (1847us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826371.847300:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 896 00000100:00100000:1.0:1787826371.847325:0:34488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585179008 00000100:00100000:1.0:1787826371.847329:0:34488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585179008 00000100:00100000:1.0:1787826371.847355:0:34488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787826371.847361:0:34488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf39cce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3c550b8-2c3c-46c3-ad36-671c284167ea+24:3644:x1874670585179008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826371.847393:0:34488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf39cce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3c550b8-2c3c-46c3-ad36-671c284167ea+24:3644:x1874670585179008:12345-0@lo:400:kworker.0 Request processed in 32us (2002us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826371.847399:0:34488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787826371.848190:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826371.854295:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf361e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585180800:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1787826371.854411:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787826371.854419:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787826371.854423:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787826371.854427:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826371.854444:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab90f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585180672:0@lo:41:osp-pre-1-0.0 00000001:00080000:3.0:1787826371.860551:0:27651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179869588 is committed 00000001:00080000:3.0:1787826371.860575:0:27651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179869587 is committed 00000100:00100000:2.0:1787826371.860845:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf41c843c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874670585179648:0@lo:400:kworker.0 00000100:00100000:2.0:1787826371.860928:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826371.860952:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf41c87840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585180160:0@lo:400:kworker.0 00000100:00100000:2.0:1787826371.860980:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826371.861024:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0b430000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e3c550b8-2c3c-46c3-ad36-671c284167ea:3644:1874670585179008:0@lo:400:kworker.0 00000100:00100000:2.0:1787826371.861045:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf41c84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585179520:0@lo:400:kworker.0 00000100:00100000:2.0:1787826371.861062:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf41c86d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874670585180032:0@lo:400:kworker.0 00000100:00100000:2.0:1787826371.861078:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf1ecac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874670585180544:0@lo:400:kworker.0 00000100:00100000:1.0:1787826371.861086:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826371.861167:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585179136 00000100:00100000:1.0:1787826371.861176:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585179136 00000100:00100000:2.0:1787826371.861178:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585180160 00000100:00100000:2.0:1787826371.861184:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585180160 00000100:00100000:3.0:1787826371.861246:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585180672 00000100:00100000:3.0:1787826371.861250:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585180672 00000100:00100000:1.0:1787826371.862144:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1363 00000100:00100000:1.0:1787826371.862159:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb94f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:3644:x1874670585179136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826371.862250:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb94f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:3644:x1874670585179136:12345-0@lo:400:kworker.0 Request processed in 96us (14063us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826371.862258:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1363 00000100:00100000:0.0:1787826371.868113:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585179648 00000100:00100000:0.0:1787826371.868135:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585179648 00000100:00100000:0.0:1787826371.868262:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1519 00000100:00100000:0.0:1787826371.868274:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb94b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874670585179648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826371.870524:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb94b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874670585179648:12345-0@lo:400:kworker.0 Request processed in 2238us (9581us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826371.870544:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1519 00000100:00080000:0.0:1787826371.870611:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787826371.871796:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1364 00000100:00100000:2.0:1787826371.871972:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb96d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1874670585180160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826371.872074:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb96d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1874670585180160:12345-0@lo:400:kworker.0 Request processed in 268us (11092us total) trans 0 rc 0/0 00000001:00080000:0.0:1787826371.872101:0:26205:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836918 is committed 00000001:00080000:0.0:1787826371.872117:0:26205:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836915 is committed 00000100:00100000:2.0:1787826371.872227:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1364 00000100:00100000:2.0:1787826371.872291:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0b4330c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585179136:0@lo:400:kworker.0 00000100:00100000:2.0:1787826371.872308:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf41c843c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874670585179648:0@lo:400:kworker.0 00000100:00100000:2.0:1787826371.872318:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf41c87840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585180160:0@lo:400:kworker.0 00000100:00100000:2.0:1787826371.872447:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826371.872730:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf41c84f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585179392:0@lo:400:kworker.0 00000100:00100000:2.0:1787826371.872745:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf41c86580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874670585179904:0@lo:400:kworker.0 00000100:00100000:2.0:1787826371.872760:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf1ecade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585180416:0@lo:400:kworker.0 00000100:00100000:2.0:1787826371.872775:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0b433480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874670585179264:0@lo:400:kworker.0 00000100:00100000:2.0:1787826371.872787:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf41c86940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874670585179776:0@lo:400:kworker.0 00000100:00100000:2.0:1787826371.872801:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf41c87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585180288:0@lo:400:kworker.0 00000100:00100000:3.0:1787826371.873084:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585180800 00000100:00100000:3.0:1787826371.873094:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585180800 00000100:00100000:3.0:1787826371.873301:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1365 00000100:00100000:3.0:1787826371.873311:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874670585180672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787826371.873351:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446236160 avail 1299996672 00000100:00100000:2.0:1787826371.873752:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1366 00000100:00100000:2.0:1787826371.873763:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:3646:x1874670585180800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787826371.873788:0:7796:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445961728 avail 1299722240 00000100:00100000:2.0:1787826371.873878:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:3646:x1874670585180800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (1431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826371.873887:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1366 00000100:00100000:2.0:1787826371.873944:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf361e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585180800:0@lo:41:osp-pre-0-1.0 00000001:00080000:0.0:1787826371.874014:0:34481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934617 is committed 00000100:00100000:3.0:1787826371.875253:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874670585180672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1936us (14161us total) trans 0 rc 0/0 00000001:00080000:1.0:1787826371.875258:0:7449:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967656 is committed 00000100:00100000:3.0:1787826371.875269:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1365 00010000:00010000:0.0:1787826371.875365:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf01518600/0x22153cd396b8025d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826371.875379:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf01518600/0x22153cd396b8025d lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826371.875386:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf01518600/0x22153cd396b8025d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826371.875393:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf01518600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826371.875399:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf01518600/0x22153cd396b8025d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826371.875407:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf01518600/0x22153cd396b8025d lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826371.875432:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff90cf20606d00) 00010000:00010000:0.0:1787826371.875435:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2a 00010000:00010000:0.0:1787826371.875442:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf01518600/0x22153cd396b8025d lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826371.875449:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf01518600/0x22153cd396b8025d lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826371.875461:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab90f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585180672:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787826371.907870:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826372.358961:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab93c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585180928:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826372.359071:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826372.359153:0:25628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585180928 00000100:00100000:1.0:1787826372.359162:0:25628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585180928 00000100:00100000:1.0:1787826372.359244:0:25628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 746 00000100:00100000:1.0:1787826372.359256:0:25628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab90f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874670585180928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787826372.359295:0:25628:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 101210944 pending 0 free 3920289792 avail 3688767488 00000100:00100000:1.0:1787826372.359350:0:25628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab90f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874670585180928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826372.359358:0:25628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 746 00000100:00100000:1.0:1787826372.359420:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab93c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585180928:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826372.366622:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787826372.366649:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab93c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585181056:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826372.366720:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826372.366818:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab93840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585181184:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826372.366846:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826372.367128:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585181056 00000100:00100000:2.0:1787826372.367146:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585181056 00000100:00100000:2.0:1787826372.367189:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585181184 00000100:00100000:2.0:1787826372.367192:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585181184 00000100:00100000:2.0:1787826372.367217:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 747 00000100:00100000:2.0:1787826372.367226:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab92940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874670585181056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787826372.367254:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 110631744 pending 0 free 3919228928 avail 3687706624 00000100:00100000:2.0:1787826372.367306:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab92940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874670585181056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826372.367313:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 747 00000100:00100000:2.0:1787826372.367329:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 748 00000100:00100000:2.0:1787826372.367335:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab92580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874670585181184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787826372.367346:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 101210944 pending 0 free 3920289792 avail 3688767488 00000100:00100000:2.0:1787826372.367369:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab92580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874670585181184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 35us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826372.367374:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 748 00000100:00100000:2.0:1787826372.367416:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179869587 gen 2 00000100:00100000:3.0:1787826372.367581:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf361e6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585181312:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787826372.367652:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1787826372.367822:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce0b431e00, transno 17179869586 00000004:00080000:2.0:1787826372.367838:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce0b430b40, transno 17179869587 00000100:00100000:2.0:1787826372.367855:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab93840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585181184:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826372.367881:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab93c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585181056:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787826372.368056:0:25628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585181312 00000100:00100000:2.0:1787826372.368060:0:25628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585181312 00000100:00100000:2.0:1787826372.368089:0:25628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 749 00000100:00100000:2.0:1787826372.368098:0:25628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874670585181312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787826372.368112:0:25628:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 110631744 pending 0 free 3919228928 avail 3687706624 00000100:00100000:2.0:1787826372.368845:0:25628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874670585181312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 746us (1190us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826372.368854:0:25628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 749 00000100:00100000:3.0:1787826372.373154:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 21474836918 gen 2 00000004:00080000:3.0:1787826372.373172:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce051221c0, transno 21474836916 00000004:00080000:3.0:1787826372.373190:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce05121680, transno 21474836917 00000004:00080000:3.0:1787826372.373193:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce051230c0, transno 21474836918 00000100:00100000:3.0:1787826372.373215:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf361e6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585181312:0@lo:13:osp-pre-0-1.0 00000004:00080000:1.0:1787826372.373915:0:8538:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0001: 0 changes, 0 in progress, 0 in flight, 3 done 00000100:00100000:1.0:1787826372.754687:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826372.755376:0:34487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563703680 00000100:00100000:3.0:1787826372.755386:0:34487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563703680 00000100:00100000:3.0:1787826372.755443:0:34487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 84 00000100:00100000:3.0:1787826372.755453:0:34487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf39ccd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:307626ff-a376-4faf-93e0-9f55b723d964+10:2404:x1874670563703680:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1787826372.755577:0:34487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf39ccd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:307626ff-a376-4faf-93e0-9f55b723d964+10:2404:x1874670563703680:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 125us (900us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826372.755586:0:34487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 84 00000100:00100000:3.0:1787826372.755651:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826372.755782:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826372.755804:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563703808 00000100:00100000:3.0:1787826372.755808:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563703808 00000100:00100000:3.0:1787826372.755851:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1520 00000100:00100000:3.0:1787826372.755859:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+17:2403:x1874670563703808:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1787826372.755895:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+17:2403:x1874670563703808:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 37us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826372.755902:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1520 00000100:00100000:3.0:1787826372.755934:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563704064 00000100:00100000:3.0:1787826372.755938:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563704064 00000100:00100000:3.0:1787826372.755968:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 897 00000100:00100000:3.0:1787826372.755974:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+5:2403:x1874670563704064:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1787826372.756003:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+5:2403:x1874670563704064:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 30us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826372.756011:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 897 00000100:00080000:3.0:1787826372.756027:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787826372.756031:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787826372.774046:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826372.774283:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563703936 00000100:00100000:0.0:1787826372.774293:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563703936 00000100:00100000:0.0:1787826372.774377:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1521 00000100:00100000:0.0:1787826372.774387:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab93c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:2404:x1874670563703936:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1787826372.774466:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab93c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:2404:x1874670563703936:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 80us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826372.774505:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1521 00000100:00080000:1.0:1787826372.775045:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826372.782616:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826372.782885:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563704192 00000100:00100000:3.0:1787826372.782894:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563704192 00000100:00100000:3.0:1787826372.783010:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 898 00000100:00100000:3.0:1787826372.783021:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab93840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+5:2404:x1874670563704192:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1787826372.783094:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab93840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+5:2404:x1874670563704192:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 75us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826372.783102:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 898 00000100:00080000:1.0:1787826372.783409:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787826372.932092:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826373.955852:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787826374.883966:0:35506:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 50b: mirror rsync handles sparseness == 06:26:13 (1787826373) 00010000:00010000:2.0:1787826374.980804:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826375.003676:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826375.004346:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563704448 00000100:00100000:2.0:1787826375.004356:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563704448 00000100:00100000:2.0:1787826375.004424:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3407 00000100:00100000:2.0:1787826375.004435:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+17:53026:x1874670563704448:12345-192.168.203.39@tcp:36:mkdir.0 00010000:00010000:2.0:1787826375.004522:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826375.004552:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b7fbf7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab01f0 expref: 17 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.004569:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ce01f45300) 00010000:00010000:2.0:1787826375.004574:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826375.004647:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7a00/0x22153cd396b8029c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.004660:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7a00/0x22153cd396b8029c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.004674:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7a00/0x22153cd396b8029c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.004690:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6800/0x22153cd396b802a3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4c1754aa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.004698:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6800/0x22153cd396b802a3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4c1754aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.004704:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6800/0x22153cd396b802a3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4c1754aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.005179:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7400/0x22153cd396b802aa lrc: 3/0,1 mode: --/PW res: [0x200000405:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.005190:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7400/0x22153cd396b802aa lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.005197:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7400/0x22153cd396b802aa lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826375.005212:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009d0a1acb reply state 00000000377bda92 transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7400/0x22153cd396b802aa lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.005223:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7400/0x22153cd396b802aa lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.005228:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0x0 (ffff90cf39e67500) 00010000:00010000:2.0:1787826375.005231:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826375.005234:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787826375.005238:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x13:0x0]: returning size 4096 00010000:00010000:2.0:1787826375.005247:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7a00/0x22153cd396b8029c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.005254:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7a00/0x22153cd396b8029c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.005260:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7a00/0x22153cd396b8029c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.005266:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7a00/0x22153cd396b8029c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.005271:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3abd7a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826375.005276:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7a00/0x22153cd396b8029c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.005283:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7a00/0x22153cd396b8029c lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.005291:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ce01f45300) 00010000:00010000:2.0:1787826375.005293:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826375.005297:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7a00/0x22153cd396b8029c lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.005303:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7a00/0x22153cd396b8029c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826375.005313:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009d0a1acb reply state 00000000377bda92 transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6800/0x22153cd396b802a3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4c1754aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.005320:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6800/0x22153cd396b802a3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4c1754aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.005329:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4c1754aa (ffff90cf39e67800) 00010000:00010000:2.0:1787826375.005332:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826375.005334:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1787826375.005432:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+18:53026:x1874670563704448:12345-192.168.203.39@tcp:36:mkdir.0 Request processed in 997us (1761us total) trans 8589934618 rc 0/0 00000100:00100000:2.0:1787826375.005440:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3407 00000100:00080000:3.0:1787826375.005863:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787826375.050313:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826375.051032:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563704576 00000100:00100000:0.0:1787826375.051046:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563704576 00000100:00100000:0.0:1787826375.051116:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3408 00000100:00100000:0.0:1787826375.051127:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+18:53029:x1874670563704576:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826375.051150:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826375.051172:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519c00/0x22153cd396b802b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab043c expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.051237:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519e00/0x22153cd396b802b8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.051250:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519e00/0x22153cd396b802b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.051262:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519e00/0x22153cd396b802b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826375.051311:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787826375.051315:0:8247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826375.051335:0:8247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519e00/0x22153cd396b802b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.051365:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519c00/0x22153cd396b802b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab043c expref: 20 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.051383:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519e00/0x22153cd396b802b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab043c expref: 19 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.051393:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ce01f45300) 00010000:00010000:0.0:1787826375.051397:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787826375.051401:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf01519e00, rc 0) 00000100:00100000:0.0:1787826375.051489:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:53029:x1874670563704576:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 337us (1156us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826375.051498:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3408 00000100:00100000:2.0:1787826375.053587:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826375.053677:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563704704 00000100:00100000:0.0:1787826375.053686:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563704704 00000100:00100000:0.0:1787826375.053770:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3409 00000100:00100000:0.0:1787826375.053780:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb95e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:53029:x1874670563704704:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826375.053796:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826375.053813:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518600/0x22153cd396b802bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0443 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.053868:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519600/0x22153cd396b802c6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.053882:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519600/0x22153cd396b802c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.053892:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519600/0x22153cd396b802c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.053904:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518400/0x22153cd396b802cd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4c1754aa bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.053912:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518400/0x22153cd396b802cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4c1754aa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.053918:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518400/0x22153cd396b802cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4c1754aa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.053981:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518200/0x22153cd396b802d4 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.053988:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518200/0x22153cd396b802d4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.053994:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518200/0x22153cd396b802d4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826375.054030:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x13:0x0]: returning size 4096 00000004:00200000:0.0:1787826375.054034:0:16564:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826375.054050:0:16564:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518200/0x22153cd396b802d4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.054067:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519600/0x22153cd396b802c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.054074:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519600/0x22153cd396b802c6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.054082:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519600/0x22153cd396b802c6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.054092:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf01519600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826375.054097:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519600/0x22153cd396b802c6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.054104:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519600/0x22153cd396b802c6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.054118:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ce01f45300) 00010000:00010000:0.0:1787826375.054120:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826375.054124:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519600/0x22153cd396b802c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.054130:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519600/0x22153cd396b802c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.054143:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518400/0x22153cd396b802cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4c1754aa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.054150:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518400/0x22153cd396b802cd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4c1754aa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.054156:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518400/0x22153cd396b802cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4c1754aa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.054162:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf01518400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826375.054165:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518400/0x22153cd396b802cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4c1754aa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.054171:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518400/0x22153cd396b802cd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4c1754aa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.054181:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4c1754aa (ffff90cf39e67800) 00010000:00010000:0.0:1787826375.054183:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826375.054185:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518400/0x22153cd396b802cd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4c1754aa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.054189:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518400/0x22153cd396b802cd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4c1754aa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.054208:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518600/0x22153cd396b802bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0443 expref: 21 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.054217:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518200/0x22153cd396b802d4 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0443 expref: 20 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.054222:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0x0 (ffff90cf39e67500) 00010000:00010000:0.0:1787826375.054224:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787826375.054225:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf01518200, rc 0) 00000100:00100000:0.0:1787826375.054276:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb95e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:53029:x1874670563704704:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 498us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826375.054284:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3409 00000100:00100000:0.0:1787826375.056397:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826375.056958:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563704832 00000100:00100000:2.0:1787826375.056968:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563704832 00000100:00100000:2.0:1787826375.057058:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3410 00000100:00100000:2.0:1787826375.057069:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:53029:x1874670563704832:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826375.057087:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826375.057109:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7a00/0x22153cd396b802db lrc: 2/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab044a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.057174:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b802e2 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.057190:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b802e2 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.057201:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b802e2 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.057219:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6a00/0x22153cd396b802e9 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.057226:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6a00/0x22153cd396b802e9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.057236:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6a00/0x22153cd396b802e9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.057270:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b802e2 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.057276:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b802e2 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.057282:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b802e2 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.057288:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3abd6600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826375.057292:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b802e2 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.057299:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b802e2 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.057309:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0x0 (ffff90cf39e67500) 00010000:00010000:2.0:1787826375.057312:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826375.057316:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b802e2 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.057322:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b802e2 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.057332:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6a00/0x22153cd396b802e9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.057417:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6a00/0x22153cd396b802e9 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.057424:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6a00/0x22153cd396b802e9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.057430:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3abd6a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826375.057433:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6a00/0x22153cd396b802e9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.057439:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6a00/0x22153cd396b802e9 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.057448:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0xe1e61496 (ffff90cf39e67a00) 00010000:00010000:2.0:1787826375.057451:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826375.057454:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6a00/0x22153cd396b802e9 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.057468:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6a00/0x22153cd396b802e9 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.057539:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7a00/0x22153cd396b802db lrc: 1/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab044a expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.057551:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0x0 (ffff90cf39e67500) 00010000:00010000:2.0:1787826375.057553:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826375.057557:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7a00/0x22153cd396b802db lrc: 0/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab044a expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.057566:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3abd7a00, rc 0) 00000100:00100000:2.0:1787826375.057627:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:53029:x1874670563704832:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 561us (1237us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826375.057638:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3410 00000100:00100000:1.0:1787826375.063729:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826375.063896:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563704960 00000100:00100000:0.0:1787826375.063905:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563704960 00000100:00100000:0.0:1787826375.063971:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3411 00000100:00100000:0.0:1787826375.063982:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:53029:x1874670563704960:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826375.064002:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826375.064024:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519c00/0x22153cd396b802f0 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0451 expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.064090:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518a00/0x22153cd396b802f7 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.064105:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518a00/0x22153cd396b802f7 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.064117:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518a00/0x22153cd396b802f7 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.064134:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518e00/0x22153cd396b802fe lrc: 3/1,0 mode: --/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.064141:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518e00/0x22153cd396b802fe lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.064148:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518e00/0x22153cd396b802fe lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.064188:0:32404:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518a00/0x22153cd396b802f7 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.064195:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518a00/0x22153cd396b802f7 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.064201:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518a00/0x22153cd396b802f7 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.064208:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518a00/0x22153cd396b802f7 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.064214:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf01518a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826375.064219:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518a00/0x22153cd396b802f7 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.064226:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518a00/0x22153cd396b802f7 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.064238:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0x0 (ffff90cf39e67500) 00010000:00010000:0.0:1787826375.064241:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826375.064244:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518a00/0x22153cd396b802f7 lrc: 3/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.064251:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518a00/0x22153cd396b802f7 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.064262:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518e00/0x22153cd396b802fe lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.064268:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518e00/0x22153cd396b802fe lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.064274:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518e00/0x22153cd396b802fe lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.064279:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf01518e00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826375.064282:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518e00/0x22153cd396b802fe lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.064288:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518e00/0x22153cd396b802fe lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.064295:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0xe1e61496 (ffff90cf371d2700) 00010000:00010000:0.0:1787826375.064983:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826375.064991:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518e00/0x22153cd396b802fe lrc: 2/0,0 mode: --/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.064998:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518e00/0x22153cd396b802fe lrc: 0/0,0 mode: --/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.065041:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519c00/0x22153cd396b802f0 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0451 expref: 21 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.065053:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0x0 (ffff90cf39e67500) 00010000:00010000:0.0:1787826375.065056:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826375.065059:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519c00/0x22153cd396b802f0 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0451 expref: 21 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.065070:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf01519c00, rc 0) 00000100:00100000:0.0:1787826375.065146:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:53029:x1874670563704960:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1165us (1427us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826375.065154:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3411 00000100:00100000:1.0:1787826375.076408:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826375.076874:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563705088 00000100:00100000:0.0:1787826375.076884:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563705088 00000100:00100000:0.0:1787826375.076946:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3412 00000100:00100000:0.0:1787826375.076957:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:53029:x1874670563705088:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826375.076978:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826375.076998:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518600/0x22153cd396b80305 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0458 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.077064:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518400/0x22153cd396b8030c lrc: 3/1,0 mode: --/PR res: [0x200000405:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.077083:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518400/0x22153cd396b8030c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.077095:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518400/0x22153cd396b8030c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826375.077136:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x13:0x0]: returning size 4096 00000004:00200000:0.0:1787826375.077139:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826375.077158:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518400/0x22153cd396b8030c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.077192:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518600/0x22153cd396b80305 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0458 expref: 22 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.077212:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518400/0x22153cd396b8030c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0458 expref: 21 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.077221:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0x0 (ffff90cf39e67500) 00010000:00010000:0.0:1787826375.077224:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787826375.077228:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf01518400, rc 0) 00000100:00100000:0.0:1787826375.077281:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:53029:x1874670563705088:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 326us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826375.077289:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3412 00000100:00100000:1.0:1787826375.084834:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826375.085099:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563705216 00000100:00100000:0.0:1787826375.085108:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563705216 00000100:00100000:0.0:1787826375.085167:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3413 00000100:00100000:0.0:1787826375.085175:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:53029:x1874670563705216:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826375.085193:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826375.085213:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518a00/0x22153cd396b80313 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab045f expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.085275:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519600/0x22153cd396b8031a lrc: 3/1,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.085288:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519600/0x22153cd396b8031a lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.085299:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519600/0x22153cd396b8031a lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.085315:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839a00/0x22153cd396b80321 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.085322:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839a00/0x22153cd396b80321 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.085328:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839a00/0x22153cd396b80321 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.085362:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519600/0x22153cd396b8031a lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.085370:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519600/0x22153cd396b8031a lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.085377:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519600/0x22153cd396b8031a lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.085395:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf01519600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826375.085399:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519600/0x22153cd396b8031a lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.085409:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519600/0x22153cd396b8031a lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.085420:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0x0 (ffff90cf39e67500) 00010000:00010000:0.0:1787826375.085422:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826375.085426:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519600/0x22153cd396b8031a lrc: 2/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.085432:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519600/0x22153cd396b8031a lrc: 0/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.085444:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839a00/0x22153cd396b80321 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.085449:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839a00/0x22153cd396b80321 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.085454:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839a00/0x22153cd396b80321 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.085459:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a839a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826375.085867:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839a00/0x22153cd396b80321 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.085876:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839a00/0x22153cd396b80321 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.085885:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0xe1e61496 (ffff90cf371d2300) 00010000:00010000:0.0:1787826375.085888:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826375.085891:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839a00/0x22153cd396b80321 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.085898:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839a00/0x22153cd396b80321 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.085933:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518a00/0x22153cd396b80313 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab045f expref: 22 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.085944:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0x0 (ffff90cf39e67500) 00010000:00010000:0.0:1787826375.085946:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826375.085950:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518a00/0x22153cd396b80313 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab045f expref: 22 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.085960:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf01518a00, rc 0) 00000100:00100000:0.0:1787826375.086014:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:53029:x1874670563705216:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 839us (1190us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826375.086022:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3413 00000100:00100000:3.0:1787826375.090211:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826375.090555:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563705472 00000100:00100000:0.0:1787826375.090565:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563705472 00000100:00100000:0.0:1787826375.090612:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3414 00000100:00100000:0.0:1787826375.090621:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:53029:x1874670563705472:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826375.090641:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826375.090644:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787826375.090673:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01518400/0x22153cd396b8030c lrc: 0/0,0 mode: --/PR res: [0x200000405:0x13:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0458 expref: 21 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.090689:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0x0 (ffff90cf39e67500) 00010000:00010000:0.0:1787826375.090694:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826375.090706:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839600/0x22153cd396b80328 lrc: 2/0,0 mode: --/CW res: [0x200000405:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0466 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.090800:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839800/0x22153cd396b8032f lrc: 3/0,1 mode: --/CW res: [0x200000405:0x13:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.090813:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839800/0x22153cd396b8032f lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.090821:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839800/0x22153cd396b8032f lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.090834:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839200/0x22153cd396b80336 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.090841:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839200/0x22153cd396b80336 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.090847:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839200/0x22153cd396b80336 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.091279:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a838600/0x22153cd396b8033d lrc: 3/1,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.091289:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a838600/0x22153cd396b8033d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.091297:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a838600/0x22153cd396b8033d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826375.091307:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x14:0x0]: returning size 0 00010000:00010000:0.0:1787826375.091330:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839800/0x22153cd396b8032f lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.091341:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839800/0x22153cd396b8032f lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.091348:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839800/0x22153cd396b8032f lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.091354:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a839800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826375.091359:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839800/0x22153cd396b8032f lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.091367:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839800/0x22153cd396b8032f lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.091376:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0x0 (ffff90cf39e67500) 00010000:00010000:0.0:1787826375.091379:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826375.091401:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839800/0x22153cd396b8032f lrc: 2/0,0 mode: --/CW res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.091408:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839800/0x22153cd396b8032f lrc: 0/0,0 mode: --/CW res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826375.091419:0:6518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d88914df reply state 000000004d6b343e transno 8589934619 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839200/0x22153cd396b80336 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.091430:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839200/0x22153cd396b80336 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.091436:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0xe1e61496 (ffff90cf371d2700) 00010000:00010000:0.0:1787826375.091438:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826375.091441:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787826375.091500:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839600/0x22153cd396b80328 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0466 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.091513:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a838600/0x22153cd396b8033d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0466 expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.091521:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf371d2900) 00010000:00010000:0.0:1787826375.091523:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826375.091525:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a838600, rc 0) 00000100:00100000:0.0:1787826375.091596:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+23:53029:x1874670563705472:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 976us (1508us total) trans 8589934619 rc 0/0 00000100:00100000:0.0:1787826375.091605:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3414 00000100:00100000:1.0:1787826375.095660:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826375.099537:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563705728 00000100:00100000:2.0:1787826375.099553:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563705728 00000100:00100000:2.0:1787826375.099630:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3415 00000100:00100000:2.0:1787826375.099642:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+23:53029:x1874670563705728:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826375.099663:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826375.099684:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6a00/0x22153cd396b8034b lrc: 2/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab046d expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.099813:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b80352 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.099829:0:32404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a838600/0x22153cd396b8033d lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0466 expref: 24 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.099839:0:32404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b80352 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.099876:0:32404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a838600/0x22153cd396b8033d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0466 expref: 24 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.099891:0:32404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a838600/0x22153cd396b8033d lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0466 expref: 24 pid: 6518 timeout: 1421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826375.099905:0:32404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3fb97c00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:32404:1874670585181440:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826375.100067:0:32404:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3ab7f780 going to sleep for 11 seconds 00000100:00100000:0.0:1787826375.103584:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826375.103621:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563705856 00000100:00100000:0.0:1787826375.103629:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563705856 00010000:00010000:0.0:1787826375.103670:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a838600/0x22153cd396b8033d lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0466 expref: 25 pid: 6518 timeout: 1421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826375.103705:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 967 00000100:00100000:0.0:1787826375.103715:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecaf840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:2404:x1874670563705856:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826375.103729:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826375.103736:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a838600/0x22153cd396b8033d lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0466 expref: 25 pid: 6518 timeout: 1421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.103750:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a838600/0x22153cd396b8033d lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0466 expref: 25 pid: 6518 timeout: 1421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.103775:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf371d2900) 00010000:00010000:0.0:1787826375.103781:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b80352 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.103790:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b80352 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.103796:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b80352 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.103815:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826375.103863:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecaf840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:2404:x1874670563705856:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 150us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826375.103870:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 967 00010000:00010000:2.0:1787826375.110513:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a838600/0x22153cd396b8033d lrc: 0/0,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0466 expref: 24 pid: 6518 timeout: 1421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826375.110540:0:32404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3fb97c00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:32404:1874670585181440:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826375.110565:0:32404:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b80352 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.110575:0:32404:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b80352 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.110580:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b80352 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826375.110602:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x14:0x0]: returning size 0 00000004:00080000:2.0:1787826375.110752:0:32404:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0xe1:0x0], count =33 00000004:00080000:2.0:1787826375.110826:0:32404:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0xe1:0x0]+33 in llog 00000004:00080000:2.0:1787826375.110863:0:32404:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x102:0x0], index 1: 0 00000004:00080000:2.0:1787826375.110868:0:32404:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0xd5:0x0], count =45 00000004:00080000:2.0:1787826375.110872:0:32404:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0xd5:0x0]+45 in llog 00000004:00080000:2.0:1787826375.110875:0:32404:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x102:0x0], index 0: 0 00010000:00010000:2.0:1787826375.110975:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b80352 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.110985:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b80352 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.110991:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b80352 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.110997:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3abd6600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826375.111001:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b80352 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.111994:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b80352 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.112087:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf371d2900) 00010000:00010000:2.0:1787826375.112091:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826375.112096:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b80352 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.112103:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b80352 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.112292:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6a00/0x22153cd396b8034b lrc: 1/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab046d expref: 24 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.112304:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0x0 (ffff90cf39e67500) 00010000:00010000:2.0:1787826375.112306:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787826375.112310:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6a00/0x22153cd396b8034b lrc: 0/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab046d expref: 24 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.112322:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3abd6a00, rc 0) 00000100:00100000:2.0:1787826375.112486:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+23:53029:x1874670563705728:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 12821us (16810us total) trans 8589934620 rc 301/301 00000100:00100000:2.0:1787826375.112495:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3415 00000100:00100000:0.0:1787826375.116744:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826375.116969:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563706112 00000100:00100000:1.0:1787826375.116981:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563706112 00000100:00100000:1.0:1787826375.117042:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1004 00000100:00100000:1.0:1787826375.117052:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+23:53029:x1874670563706112:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:1.0:1787826375.117336:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:53029:x1874670563706112:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 283us (602us total) trans 8589934621 rc 0/0 00000100:00100000:1.0:1787826375.117345:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1004 00000100:00100000:3.0:1787826375.119269:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826375.119366:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563706368 00000100:00100000:2.0:1787826375.119378:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563706368 00000100:00100000:2.0:1787826375.119451:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1005 00000100:00100000:2.0:1787826375.119512:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:53029:x1874670563706368:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:2.0:1787826375.119817:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:53029:x1874670563706368:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 355us (559us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1787826375.119827:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1005 00000100:00100000:1.0:1787826375.141583:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826375.141935:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563706624 00000100:00100000:3.0:1787826375.141955:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563706624 00000100:00100000:3.0:1787826375.142037:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3416 00000100:00100000:3.0:1787826375.142050:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:53030:x1874670563706624:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:3.0:1787826375.142083:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826375.142109:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b80360 lrc: 2/0,0 mode: --/CW res: [0x200000405:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0474 expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.142301:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401c00/0x22153cd396b80367 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.142320:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401c00/0x22153cd396b80367 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.142335:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401c00/0x22153cd396b80367 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.142348:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b8036e lrc: 3/1,0 mode: --/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.142356:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b8036e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.142363:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b8036e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.142492:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b80375 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.142501:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b80375 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.142584:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b80375 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826375.142598:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x14:0x0]: returning size 0 00010000:00010000:3.0:1787826375.142716:0:9966:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401c00/0x22153cd396b80367 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.142725:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401c00/0x22153cd396b80367 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.142732:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401c00/0x22153cd396b80367 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.142739:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401c00/0x22153cd396b80367 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.142746:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826375.142751:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401c00/0x22153cd396b80367 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.142764:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401c00/0x22153cd396b80367 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.142778:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0x0 (ffff90cf39e67500) 00010000:00010000:3.0:1787826375.142781:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826375.142787:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401c00/0x22153cd396b80367 lrc: 3/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.142793:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401c00/0x22153cd396b80367 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.142809:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b8036e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.142815:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b8036e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.142820:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b8036e lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.142825:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826375.142827:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b8036e lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.142833:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b8036e lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.142839:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0xe1e61496 (ffff90cf371d2700) 00010000:00010000:3.0:1787826375.142841:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826375.142844:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b8036e lrc: 2/0,0 mode: --/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.142854:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b8036e lrc: 0/0,0 mode: --/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.142897:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b80360 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0474 expref: 28 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.142914:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b80375 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0474 expref: 27 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.142922:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:3.0:1787826375.142925:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826375.142929:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401400, rc 0) 00000100:00100000:3.0:1787826375.143023:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:53030:x1874670563706624:12345-192.168.203.39@tcp:101:dd.0 Request processed in 974us (1447us total) trans 8589934623 rc 0/0 00000100:00100000:3.0:1787826375.143031:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3416 00000100:00100000:1.0:1787826375.155248:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826375.155398:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563706752 00000100:00100000:3.0:1787826375.155414:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563706752 00000100:00100000:3.0:1787826375.155550:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3417 00000100:00100000:3.0:1787826375.155563:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:53030:x1874670563706752:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:3.0:1787826375.155599:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826375.155628:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b80383 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab047b expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.155785:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b8038a lrc: 3/1,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.155802:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b8038a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.155820:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b8038a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.155965:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b80383 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab047b expref: 29 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.155987:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b8038a lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab047b expref: 28 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.155997:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:3.0:1787826375.156000:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787826375.156004:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401e00, rc 0) 00000100:00100000:3.0:1787826375.156086:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+28:53030:x1874670563706752:12345-192.168.203.39@tcp:101:dd.0 Request processed in 525us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826375.156095:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3417 00000100:00100000:0.0:1787826375.166374:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826375.171988:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563707008 00000100:00100000:3.0:1787826375.172009:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563707008 00000100:00100000:3.0:1787826375.172092:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3418 00000100:00100000:3.0:1787826375.172106:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+28:53030:x1874670563707008:12345-192.168.203.39@tcp:36:dd.0 00010000:00010000:3.0:1787826375.172181:0:8247:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826375.172219:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b80375 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0474 expref: 28 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.172238:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:3.0:1787826375.172244:0:8247:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826375.172511:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b80391 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.172529:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b80391 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.172541:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b80391 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787826375.172598:0:8247:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000004:00010000:3.0:1787826375.172624:0:8247:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000000edcfa7 reply state 00000000dd895d61 transno 8589934625 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b80391 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.172915:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b80391 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.172925:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:3.0:1787826375.172928:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826375.172932:0:8247:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826375.173072:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:53030:x1874670563707008:12345-192.168.203.39@tcp:36:dd.0 Request processed in 967us (6706us total) trans 8589934625 rc 0/0 00000100:00100000:3.0:1787826375.173081:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3418 00000020:00080000:3.0:1787826375.173087:0:8247:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787826375.178948:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826375.179005:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563707136 00000100:00100000:3.0:1787826375.179017:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563707136 00000100:00100000:3.0:1787826375.179085:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3419 00000100:00100000:3.0:1787826375.179098:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:53030:x1874670563707136:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:3.0:1787826375.179131:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826375.179159:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b80398 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0482 expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.179406:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b80398 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0482 expref: 31 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.179423:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b80398 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0482 expref: 31 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.179447:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:3.0:1787826375.179450:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826375.179455:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400400, rc 0) 00000100:00100000:3.0:1787826375.179970:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:53030:x1874670563707136:12345-192.168.203.39@tcp:101:dd.0 Request processed in 872us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826375.179979:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3419 00000100:00100000:3.0:1787826375.200160:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826375.200363:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563707392 00000100:00100000:0.0:1787826375.200378:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563707392 00000100:00100000:0.0:1787826375.200454:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3420 00000100:00100000:0.0:1787826375.200522:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:53030:x1874670563707392:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:0.0:1787826375.200549:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826375.200553:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787826375.200589:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b80398 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0482 expref: 31 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.200610:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:0.0:1787826375.200616:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826375.200649:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839a00/0x22153cd396b8039f lrc: 2/0,0 mode: --/EX res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0489 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.200719:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a838000/0x22153cd396b803a6 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.200736:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a838000/0x22153cd396b803a6 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.200749:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a838000/0x22153cd396b803a6 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787826375.201863:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:0.0:1787826375.201885:0:6520:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1321213413350ns, next at 0ns, rc = 0 00000040:00080000:0.0:1787826375.201940:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 88 off8408 00000004:00080000:0.0:1787826375.201949:0:6520:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1321213476693ns, next at 1309127889395ns, rc = 0 00000001:00080000:2.0:1787826375.203548:0:34481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934626 is committed 00000004:00080000:2.0:1787826375.203560:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000004:00080000:2.0:1787826375.203578:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:1.0:1787826375.203697:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0300cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585181568:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787826375.203784:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787826375.203789:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6800/0x22153cd396b802a3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4c1754aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.203807:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6800/0x22153cd396b802a3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4c1754aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.203817:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6800/0x22153cd396b802a3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4c1754aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.203825:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3abd6800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826375.203832:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6800/0x22153cd396b802a3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4c1754aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.203842:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6800/0x22153cd396b802a3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4c1754aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826375.203862:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585181568 00010000:00010000:3.0:1787826375.203870:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4c1754aa (ffff90cf39e67800) 00000100:00100000:1.0:1787826375.203876:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585181568 00010000:00010000:3.0:1787826375.203876:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826375.203886:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6800/0x22153cd396b802a3 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4c1754aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.203896:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6800/0x22153cd396b802a3 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4c1754aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.203934:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7400/0x22153cd396b802aa lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.203942:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7400/0x22153cd396b802aa lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.203949:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7400/0x22153cd396b802aa lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.203956:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3abd7400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826375.203960:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7400/0x22153cd396b802aa lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826375.203963:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1791 00010000:00010000:3.0:1787826375.203978:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7400/0x22153cd396b802aa lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826375.203989:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874670585181568:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1787826375.203989:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0x0 (ffff90cf39e67500) 00010000:00010000:3.0:1787826375.203998:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826375.204006:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7400/0x22153cd396b802aa lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.204016:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7400/0x22153cd396b802aa lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.204040:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839200/0x22153cd396b80336 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.204048:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839200/0x22153cd396b80336 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.204054:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839200/0x22153cd396b80336 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.204059:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a839200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826375.204061:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839200/0x22153cd396b80336 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.204067:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839200/0x22153cd396b80336 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.204077:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0xe1e61496 (ffff90cf371d2700) 00010000:00010000:3.0:1787826375.204080:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826375.204083:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839200/0x22153cd396b80336 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.204090:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839200/0x22153cd396b80336 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.204107:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b80391 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.204112:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b80391 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.204119:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b80391 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.204124:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826375.204127:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b80391 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.204133:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b80391 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.204144:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:3.0:1787826375.204147:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826375.204151:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b80391 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.204157:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b80391 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826375.204212:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1874670585181568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 228us (427us total) trans 21474836919 rc 0/0 00000100:00100000:1.0:1787826375.204224:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1791 00000004:00080000:1.0:1787826375.204274:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce0300cb40/2, rc 0, transno 21474836919 00000100:00100000:1.0:1787826375.204279:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0300cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585181568:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787826375.204372:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787826375.204382:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3fb97c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585181696:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787826375.204413:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826375.204441:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585181696 00000100:00100000:2.0:1787826375.204445:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585181696 00000100:00100000:2.0:1787826375.204594:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1792 00000100:00100000:2.0:1787826375.204602:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1874670585181696:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787826375.204776:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3645:x1874670585181696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 174us (361us total) trans 17179869589 rc 0/0 00000100:00100000:2.0:1787826375.204783:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1792 00000004:00080000:2.0:1787826375.204810:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3fb97c00/2, rc 0, transno 17179869589 00000100:00100000:2.0:1787826375.204815:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3fb97c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585181696:0@lo:2:osp-syn-1-0.0 00000100:00080000:3.0:1787826375.205713:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787826375.205724:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787826375.206090:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a838000/0x22153cd396b803a6 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0489 expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.206105:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:0.0:1787826375.206108:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1787826375.206125:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839a00/0x22153cd396b8039f lrc: 0/0,0 mode: --/EX res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0489 expref: 21 pid: 6520 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.206144:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a838000/0x22153cd396b803a6 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0489 expref: 20 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.206174:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:0.0:1787826375.206177:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1787826375.206179:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a838000, rc 0) 00000100:00100000:0.0:1787826375.206237:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:53030:x1874670563707392:12345-192.168.203.39@tcp:101:dd.0 Request processed in 5773us (6091us total) trans 8589934626 rc 0/0 00000100:00100000:0.0:1787826375.206246:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3420 00000100:00100000:0.0:1787826375.214423:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826375.220574:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563707520 00000100:00100000:3.0:1787826375.220595:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563707520 00000100:00100000:3.0:1787826375.220716:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1793 00000100:00100000:3.0:1787826375.220728:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecade00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+5:53030:x1874670563707520:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:3.0:1787826375.220751:0:30694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826375.220777:0:30694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d747c98/0x22153cd396b803ad lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0490 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826375.220816:0:30694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x102:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826375.220845:0:30694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x102:0x0].0x0 since=1321s v=(0 0) 00010000:00010000:3.0:1787826375.220850:0:30694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x102:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826375.220864:0:30694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d747c98/0x22153cd396b803ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0490 expref: 6 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.220885:0:30694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004d747c98/0x22153cd396b803ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0490 expref: 6 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.220900:0:30694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401200, rc 0) 00000100:00100000:3.0:1787826375.220986:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecade00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+6:53030:x1874670563707520:12345-192.168.203.39@tcp:101:dd.0 Request processed in 260us (6576us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826375.220995:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1793 00000100:00080000:0.0:1787826375.221246:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826375.238629:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826375.239263:0:25422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563707648 00000100:00100000:0.0:1787826375.239273:0:25422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563707648 00002000:00010000:0.0:1787826375.239326:0:25422:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/258 (1045504->18446744073709551615) 00002000:00100000:0.0:1787826375.239330:0:25422:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf41c86940 with x1874670563707648 ext(1045504->18446744073709551615) 00002000:00010000:0.0:1787826375.239342:0:25422:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90cf41c86940. 00000100:00100000:0.0:1787826375.239378:0:25422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 691 00000100:00100000:0.0:1787826375.239387:0:25422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c86940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+6:2404:x1874670563707648:12345-192.168.203.39@tcp:10:dd.0 00002000:00010000:1.0:1787826375.239837:0:25422:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x102:0x0] updating lvb size from disk: 0 -> 1045504 00002000:00010000:1.0:1787826375.239841:0:25422:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x102:0x0] updating lvb mtime from disk: 0 -> 1787826375 00002000:00010000:1.0:1787826375.239844:0:25422:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x102:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787826375.239846:0:25422:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x102:0x0] updating lvb ctime from disk: 0 -> 1787826375 00002000:00010000:1.0:1787826375.239849:0:25422:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x102:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1787826375.239927:0:25422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c86940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2404:x1874670563707648:12345-192.168.203.39@tcp:10:dd.0 Request processed in 540us (1305us total) trans 17179869590 rc 0/0 00000100:00100000:1.0:1787826375.239935:0:25422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 691 00002000:00010000:1.0:1787826375.239940:0:25422:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/258 (1045504->18446744073709551615) 00002000:00100000:1.0:1787826375.239943:0:25422:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf41c86940 with x1874670563707648 ext(1045504->18446744073709551615) 00002000:00010000:1.0:1787826375.239948:0:25422:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90cf41c86940. 00000100:00100000:2.0:1787826375.244693:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826375.244822:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563707776 00000100:00100000:3.0:1787826375.244832:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563707776 00002000:00100000:3.0:1787826375.244881:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x102:0x0] (1044480->1048575) req@ffff90cf41c86580 x1874670563707776/t0(0) o3->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:731/0 lens 488/0 e 0 to 0 dl 1787826386 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826375.244893:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf41c86580 with x1874670563707776 ext(1044480->1048575) 00002000:00010000:3.0:1787826375.244898:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90cf41c86580 00000100:00100000:3.0:1787826375.244935:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 692 00000100:00100000:3.0:1787826375.244944:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c86580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2403:x1874670563707776:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:3.0:1787826375.245633:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c86580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2403:x1874670563707776:12345-192.168.203.39@tcp:3:dd.0 Request processed in 686us (946us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787826375.245641:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 692 00002000:00100000:3.0:1787826375.245649:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x102:0x0] (1044480->1048575) req@ffff90cf41c86580 x1874670563707776/t0(0) o3->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:731/0 lens 488/4536 e 0 to 0 dl 1787826386 ref 1 fl Complete:/600/0 rc 4096/4096 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826375.245657:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf41c86580 with x1874670563707776 ext(1044480->1048575) 00002000:00010000:3.0:1787826375.245661:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90cf41c86580 00000100:00100000:0.0:1787826375.270146:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826375.270892:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563708032 00000100:00100000:3.0:1787826375.270909:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563708032 00000100:00100000:3.0:1787826375.270998:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3421 00000100:00100000:3.0:1787826375.271013:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:53030:x1874670563708032:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:3.0:1787826375.271047:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826375.271052:0:16564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787826375.271089:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a838000/0x22153cd396b803a6 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0489 expref: 20 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.271116:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:3.0:1787826375.271122:0:16564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826375.271138:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b803b4 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0497 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.271215:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b803bb lrc: 3/0,1 mode: --/EX res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.271233:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b803bb lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.271245:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b803bb lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787826375.271715:0:16564:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x103:0x0], index 1: 0 00000040:00080000:2.0:1787826375.271853:0:16564:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].3, 88 off8432 00000004:00080000:2.0:1787826375.271862:0:16564:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1321283390157ns, next at 0ns, rc = 0 00000040:00080000:2.0:1787826375.271937:0:16564:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].4, 88 off8520 00000004:00080000:2.0:1787826375.271942:0:16564:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1321283470752ns, next at 0ns, rc = 0 00000040:00080000:2.0:1787826375.275404:0:16564:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 88 off8496 00000004:00080000:2.0:1787826375.275424:0:16564:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1321286951721ns, next at 1309127889395ns, rc = 0 00000001:00080000:2.0:1787826375.287211:0:34481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000004:00080000:2.0:1787826375.287229:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000004:00080000:2.0:1787826375.287245:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000004:00080000:2.0:1787826375.287346:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000100:00100000:1.0:1787826375.287441:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787826375.287502:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0300de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585181824:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787826375.287566:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826375.287615:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585181824 00000100:00100000:1.0:1787826375.287622:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585181824 00000100:00100000:1.0:1787826375.287688:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1794 00000100:00100000:1.0:1787826375.287698:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3644:x1874670585181824:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787826375.287858:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:3644:x1874670585181824:12345-0@lo:2:osp-syn-0-0.0 Request processed in 161us (292us total) trans 21474836920 rc 0/0 00000100:00100000:1.0:1787826375.287865:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1794 00000004:00080000:1.0:1787826375.287904:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce0300de00/2, rc 0, transno 21474836920 00000100:00100000:1.0:1787826375.287909:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0300de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585181824:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1787826375.288774:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b803bb lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0497 expref: 21 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.288789:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00000100:00100000:1.0:1787826375.288791:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf361e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585182080:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1787826375.288792:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1787826375.288807:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b803b4 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0497 expref: 21 pid: 16564 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.288826:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b803bb lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0497 expref: 20 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826375.288827:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787826375.288853:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00000100:00100000:1.0:1787826375.288855:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1787826375.288856:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1787826375.288859:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401400, rc 0) 00000100:00100000:1.0:1787826375.288860:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf361e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585181952:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787826375.288991:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:53030:x1874670563708032:12345-192.168.203.39@tcp:101:dd.0 Request processed in 17982us (18851us total) trans 8589934627 rc 0/0 00000100:00100000:1.0:1787826375.288992:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826375.289000:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3421 00000100:00100000:0.0:1787826375.289116:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585182080 00000100:00100000:0.0:1787826375.289123:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585182080 00000100:00100000:0.0:1787826375.289195:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585181952 00000100:00100000:0.0:1787826375.289199:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585181952 00000100:00100000:0.0:1787826375.289229:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1795 00000100:00100000:0.0:1787826375.289236:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3647:x1874670585182080:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787826375.289360:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3647:x1874670585182080:12345-0@lo:2:osp-syn-1-0.0 Request processed in 124us (532us total) trans 17179869591 rc 0/0 00000100:00100000:0.0:1787826375.289367:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1795 00000100:00100000:0.0:1787826375.289379:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1796 00000100:00100000:0.0:1787826375.289385:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3647:x1874670585181952:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1787826375.289435:0:14864:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x102:0x0] updating lvb size from disk: 1045504 -> 1045504 00002000:00010000:0.0:1787826375.289439:0:14864:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x102:0x0] updating lvb mtime from disk: 1787826375 -> 1787826375 00002000:00010000:0.0:1787826375.289442:0:14864:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x102:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787826375.289445:0:14864:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x102:0x0] updating lvb ctime from disk: 1787826375 -> 1787826375 00002000:00010000:0.0:1787826375.289447:0:14864:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x102:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1787826375.289499:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3647:x1874670585181952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 112us (504us total) trans 17179869592 rc 0/0 00000100:00100000:0.0:1787826375.289505:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1796 00000004:00080000:0.0:1787826375.289536:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf361e4780/2, rc 0, transno 17179869592 00000100:00100000:0.0:1787826375.289541:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf361e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585181952:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1787826375.289549:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf361e5a40/2, rc 0, transno 17179869591 00000100:00100000:0.0:1787826375.289552:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf361e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585182080:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787826375.293875:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826375.293961:0:30172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563708160 00000100:00100000:1.0:1787826375.293970:0:30172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563708160 00002000:00100000:1.0:1787826375.294016:0:30172:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x102:0x0] (1044480->1048575) req@ffff90cf41c84f00 x1874670563708160/t0(0) o4->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:731/0 lens 4584/0 e 0 to 0 dl 1787826386 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826375.294027:0:30172:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf41c84f00 with x1874670563708160 ext(1044480->1048575) 00002000:00010000:1.0:1787826375.294031:0:30172:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90cf41c84f00 00000100:00100000:1.0:1787826375.294102:0:30172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 693 00000100:00100000:1.0:1787826375.294112:0:30172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c84f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2404:x1874670563708160:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:1.0:1787826375.299111:0:30172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c84f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563708160:12345-192.168.203.39@tcp:4:dd.0 Request processed in 4990us (5234us total) trans 17179869593 rc 0/0 00000100:00100000:1.0:1787826375.299126:0:30172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 693 00002000:00100000:1.0:1787826375.299139:0:30172:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x102:0x0] (1044480->1048575) req@ffff90cf41c84f00 x1874670563708160/t17179869593(0) o4->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:731/0 lens 4584/448 e 0 to 0 dl 1787826386 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826375.299160:0:30172:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf41c84f00 with x1874670563708160 ext(1044480->1048575) 00002000:00010000:1.0:1787826375.299167:0:30172:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90cf41c84f00 00000100:00100000:3.0:1787826375.309749:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826375.309999:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563708288 00000100:00100000:2.0:1787826375.310009:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563708288 00000100:00100000:2.0:1787826375.310116:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1797 00000100:00100000:2.0:1787826375.310127:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf07964b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:53030:x1874670563708288:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:2.0:1787826375.310145:0:8545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826375.310169:0:8545:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000086fb5c8/0x22153cd396b803c2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab049e expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787826375.310196:0:8545:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x103:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826375.310219:0:8545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x103:0x0].0x0 since=1321s v=(0 0) 00010000:00010000:2.0:1787826375.310224:0:8545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x103:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826375.310234:0:8545:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000086fb5c8/0x22153cd396b803c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->1052671) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab049e expref: 10 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.310250:0:8545:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000086fb5c8/0x22153cd396b803c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->1052671) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab049e expref: 10 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.310264:0:8545:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3abd6400, rc 0) 00000100:00100000:2.0:1787826375.310323:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf07964b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:53030:x1874670563708288:12345-192.168.203.39@tcp:101:dd.0 Request processed in 198us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826375.310330:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1797 00000100:00100000:0.0:1787826375.317104:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826375.317368:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563708544 00000100:00100000:2.0:1787826375.317378:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563708544 00000100:00100000:2.0:1787826375.317523:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1006 00000100:00100000:2.0:1787826375.317534:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf10476450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:53030:x1874670563708544:12345-192.168.203.39@tcp:35:dd.0 00000100:00100000:2.0:1787826375.317846:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf10476450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:53030:x1874670563708544:12345-192.168.203.39@tcp:35:dd.0 Request processed in 313us (751us total) trans 8589934628 rc 0/0 00000100:00100000:2.0:1787826375.317855:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1006 00000100:00100000:3.0:1787826375.328538:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826375.328702:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563708672 00000100:00100000:2.0:1787826375.328712:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563708672 00000100:00100000:2.0:1787826375.328870:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3422 00000100:00100000:2.0:1787826375.328881:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf07967840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:53031:x1874670563708672:12345-192.168.203.39@tcp:101:truncate.0 00010000:00010000:2.0:1787826375.328906:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826375.328925:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7e00/0x22153cd396b803c9 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab04a5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.329124:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b803d0 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.329139:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b803d0 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.329150:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b803d0 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.329164:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6a00/0x22153cd396b803d7 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.329171:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6a00/0x22153cd396b803d7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.329178:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6a00/0x22153cd396b803d7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.329256:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7400/0x22153cd396b803de lrc: 3/1,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.329265:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7400/0x22153cd396b803de lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.329272:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7400/0x22153cd396b803de lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826375.329315:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x14:0x0]: returning size 1065984 00000004:00200000:2.0:1787826375.329320:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826375.329361:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7400/0x22153cd396b803de lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.329373:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7400/0x22153cd396b803de lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.329383:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b803d0 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.329390:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b803d0 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.329396:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b803d0 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.329402:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b803d0 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.329407:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3abd6600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826375.329411:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b803d0 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.329418:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b803d0 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.329431:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0x0 (ffff90cf39e67500) 00010000:00010000:2.0:1787826375.329434:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826375.329438:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b803d0 lrc: 3/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.329445:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b803d0 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.329503:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6a00/0x22153cd396b803d7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.329508:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6a00/0x22153cd396b803d7 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.329512:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6a00/0x22153cd396b803d7 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.329515:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3abd6a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826375.329517:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6a00/0x22153cd396b803d7 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.329521:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6a00/0x22153cd396b803d7 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.329526:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0xe1e61496 (ffff90cf1859a600) 00010000:00010000:2.0:1787826375.329528:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826375.329529:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6a00/0x22153cd396b803d7 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.329533:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6a00/0x22153cd396b803d7 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.329557:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7e00/0x22153cd396b803c9 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04a5 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.329565:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7400/0x22153cd396b803de lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04a5 expref: 22 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.329574:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:2.0:1787826375.329575:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826375.329577:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3abd7400, rc 0) 00000100:00100000:2.0:1787826375.329628:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf07967840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:53031:x1874670563708672:12345-192.168.203.39@tcp:101:truncate.0 Request processed in 750us (1101us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826375.329635:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3422 00000100:00100000:3.0:1787826375.333561:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826375.333876:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563708928 00000100:00100000:0.0:1787826375.333887:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563708928 00000100:00100000:0.0:1787826375.334054:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3423 00000100:00100000:0.0:1787826375.334065:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf07965a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:53031:x1874670563708928:12345-192.168.203.39@tcp:36:truncate.0 00010000:00010000:0.0:1787826375.334120:0:9966:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1787826375.334146:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b803bb lrc: 0/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0497 expref: 22 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.334168:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7400/0x22153cd396b803de lrc: 0/0,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04a5 expref: 21 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.334179:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:0.0:1787826375.334184:0:9966:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826375.334355:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a838a00/0x22153cd396b803e5 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.334370:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a838a00/0x22153cd396b803e5 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.334381:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a838a00/0x22153cd396b803e5 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787826375.334424:0:9966:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00000004:00010000:0.0:1787826375.334445:0:9966:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000e26f570 reply state 00000000ebff61db transno 8589934630 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a838a00/0x22153cd396b803e5 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.334456:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a838a00/0x22153cd396b803e5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.334511:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:0.0:1787826375.334514:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826375.334517:0:9966:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787826375.334601:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf07965a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+23:53031:x1874670563708928:12345-192.168.203.39@tcp:36:truncate.0 Request processed in 538us (1052us total) trans 8589934630 rc 0/0 00000100:00100000:0.0:1787826375.334609:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3423 00000020:00080000:0.0:1787826375.334614:0:9966:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787826375.336911:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826375.337002:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563709056 00000100:00100000:2.0:1787826375.337010:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563709056 00000100:00100000:2.0:1787826375.337064:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3424 00000100:00100000:2.0:1787826375.337074:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+23:53031:x1874670563709056:12345-192.168.203.39@tcp:101:truncate.0 00010000:00010000:2.0:1787826375.337094:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826375.337113:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7e00/0x22153cd396b803ec lrc: 2/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab04ac expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.337170:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7e00/0x22153cd396b803ec lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04ac expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.337183:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7e00/0x22153cd396b803ec lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04ac expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.337201:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:2.0:1787826375.337205:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826375.337208:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3abd7e00, rc 0) 00000100:00100000:2.0:1787826375.337260:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:53031:x1874670563709056:12345-192.168.203.39@tcp:101:truncate.0 Request processed in 188us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826375.337271:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3424 00000100:00100000:3.0:1787826375.341441:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826375.341676:0:30174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563709184 00000100:00100000:2.0:1787826375.341688:0:30174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563709184 00002000:00010000:2.0:1787826375.341733:0:30174:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/259 (3700000->18446744073709551615) 00002000:00100000:2.0:1787826375.341737:0:30174:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf07966580 with x1874670563709184 ext(3700000->18446744073709551615) 00002000:00010000:2.0:1787826375.341749:0:30174:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90cf07966580. 00000100:00100000:2.0:1787826375.341785:0:30174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 694 00000100:00100000:2.0:1787826375.341795:0:30174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf07966580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2402:x1874670563709184:12345-192.168.203.39@tcp:10:truncate.0 00002000:00010000:2.0:1787826375.342027:0:30174:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x103:0x0] updating lvb size from disk: 0 -> 3700000 00002000:00010000:2.0:1787826375.342031:0:30174:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x103:0x0] updating lvb mtime from disk: 0 -> 1787826375 00002000:00010000:2.0:1787826375.342033:0:30174:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x103:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787826375.342035:0:30174:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x103:0x0] updating lvb ctime from disk: 0 -> 1787826375 00002000:00010000:2.0:1787826375.342037:0:30174:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x103:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1787826375.342104:0:30174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf07966580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2402:x1874670563709184:12345-192.168.203.39@tcp:10:truncate.0 Request processed in 310us (672us total) trans 17179869594 rc 0/0 00000100:00100000:2.0:1787826375.342112:0:30174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 694 00002000:00010000:2.0:1787826375.342116:0:30174:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/259 (3700000->18446744073709551615) 00002000:00100000:2.0:1787826375.342119:0:30174:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf07966580 with x1874670563709184 ext(3700000->18446744073709551615) 00002000:00010000:2.0:1787826375.342123:0:30174:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90cf07966580. 00000100:00100000:3.0:1787826375.357003:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826375.357364:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563709440 00000100:00100000:2.0:1787826375.357374:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563709440 00000100:00100000:2.0:1787826375.357445:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3425 00000100:00100000:2.0:1787826375.357456:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf079661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:53032:x1874670563709440:12345-192.168.203.39@tcp:101:lseek_test.0 00010000:00010000:2.0:1787826375.358012:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826375.358036:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6a00/0x22153cd396b803f3 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab04b3 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.358126:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b803fa lrc: 3/1,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.358140:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b803fa lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.358152:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b803fa lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.358168:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6800/0x22153cd396b80401 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.358175:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6800/0x22153cd396b80401 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.358181:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6800/0x22153cd396b80401 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.358292:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7a00/0x22153cd396b80408 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.358299:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7a00/0x22153cd396b80408 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.358304:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7a00/0x22153cd396b80408 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826375.358311:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x14:0x0]: returning size 3700000 00010000:00010000:2.0:1787826375.358374:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b803fa lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.358549:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b803fa lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.358557:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b803fa lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.358562:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3abd6600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826375.358566:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b803fa lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.358573:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b803fa lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.358585:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0x0 (ffff90cf39e67500) 00010000:00010000:2.0:1787826375.358588:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826375.358592:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b803fa lrc: 2/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.358598:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b803fa lrc: 0/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.358611:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6800/0x22153cd396b80401 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.358617:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6800/0x22153cd396b80401 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.358622:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6800/0x22153cd396b80401 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.358628:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3abd6800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826375.358632:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6800/0x22153cd396b80401 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.358637:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6800/0x22153cd396b80401 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.358645:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0xe1e61496 (ffff90cf1859a600) 00010000:00010000:2.0:1787826375.358647:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826375.358650:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6800/0x22153cd396b80401 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.358656:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6800/0x22153cd396b80401 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.358730:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6a00/0x22153cd396b803f3 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04b3 expref: 27 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.358745:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7a00/0x22153cd396b80408 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04b3 expref: 26 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.358754:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:2.0:1787826375.358756:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826375.358758:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3abd7a00, rc 0) 00000100:00100000:2.0:1787826375.358827:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf079661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:53032:x1874670563709440:12345-192.168.203.39@tcp:101:lseek_test.0 Request processed in 1372us (1832us total) trans 8589934631 rc 0/0 00000100:00100000:2.0:1787826375.358835:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3425 00000100:00100000:0.0:1787826375.362937:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826375.363025:0:14865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563709568 00000100:00100000:3.0:1787826375.363036:0:14865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563709568 00002000:00100000:3.0:1787826375.363083:0:14865:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x103:0x0] (1048576->1069055) req@ffff90cf1ecae1c0 x1874670563709568/t0(0) o4->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:731/0 lens 488/0 e 0 to 0 dl 1787826386 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826375.363091:0:14865:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf1ecae1c0 with x1874670563709568 ext(1048576->1069055) 00002000:00010000:3.0:1787826375.363095:0:14865:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90cf1ecae1c0 00000100:00100000:3.0:1787826375.363149:0:14865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 695 00000100:00100000:3.0:1787826375.363159:0:14865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2403:x1874670563709568:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:1.0:1787826375.368696:0:14865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2403:x1874670563709568:12345-192.168.203.39@tcp:4:dd.0 Request processed in 5526us (5759us total) trans 17179869595 rc 0/0 00000100:00100000:1.0:1787826375.368711:0:14865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 695 00002000:00100000:1.0:1787826375.368725:0:14865:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x103:0x0] (1048576->1069055) req@ffff90cf1ecae1c0 x1874670563709568/t17179869595(0) o4->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:731/0 lens 488/448 e 0 to 0 dl 1787826386 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826375.368737:0:14865:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf1ecae1c0 with x1874670563709568 ext(1048576->1069055) 00002000:00010000:1.0:1787826375.368743:0:14865:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90cf1ecae1c0 00000100:00100000:0.0:1787826375.374487:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826375.374536:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826375.374586:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563709824 00000100:00100000:1.0:1787826375.374594:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563709824 00000100:00100000:1.0:1787826375.374645:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563709696 00000100:00100000:1.0:1787826375.374648:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563709696 00000100:00100000:1.0:1787826375.374676:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1798 00000100:00100000:1.0:1787826375.374686:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2401:x1874670563709824:12345-192.168.203.39@tcp:23:lseek_test.0 00000100:00100000:2.0:1787826375.374740:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1799 00000100:00100000:2.0:1787826375.374754:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2401:x1874670563709696:12345-192.168.203.39@tcp:23:lseek_test.0 00000100:00100000:1.0:1787826375.374784:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2401:x1874670563709824:12345-192.168.203.39@tcp:23:lseek_test.0 Request processed in 98us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826375.374796:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1798 00000100:00100000:2.0:1787826375.374807:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2401:x1874670563709696:12345-192.168.203.39@tcp:23:lseek_test.0 Request processed in 56us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826375.374816:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1799 00000100:00100000:2.0:1787826375.377569:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826375.377668:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563710080 00000100:00100000:0.0:1787826375.377676:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563710080 00000100:00100000:0.0:1787826375.377770:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1007 00000100:00100000:0.0:1787826375.377780:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c87840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:53032:x1874670563710080:12345-192.168.203.39@tcp:35:lseek_test.0 00000100:00100000:0.0:1787826375.378065:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c87840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:53032:x1874670563710080:12345-192.168.203.39@tcp:35:lseek_test.0 Request processed in 285us (503us total) trans 8589934632 rc 0/0 00000100:00100000:0.0:1787826375.378075:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1007 00000100:00100000:3.0:1787826375.405721:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826375.405876:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563710336 00000100:00100000:2.0:1787826375.405885:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563710336 00000100:00100000:2.0:1787826375.405946:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3426 00000100:00100000:2.0:1787826375.405956:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:53033:x1874670563710336:12345-192.168.203.39@tcp:101:lseek_test.0 00010000:00010000:2.0:1787826375.405978:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826375.405998:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6800/0x22153cd396b80416 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab04ba expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.406116:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b8041d lrc: 3/1,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.406132:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b8041d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.406143:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b8041d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826375.406155:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x14:0x0]: returning size 3700000 00010000:00010000:2.0:1787826375.406255:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6800/0x22153cd396b80416 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04ba expref: 30 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.406274:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b8041d lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04ba expref: 29 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.406283:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:2.0:1787826375.406287:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787826375.406292:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3abd6600, rc 0) 00000100:00100000:2.0:1787826375.406355:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+29:53033:x1874670563710336:12345-192.168.203.39@tcp:101:lseek_test.0 Request processed in 400us (647us total) trans 8589934633 rc 0/0 00000100:00100000:2.0:1787826375.406363:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3426 00000100:00100000:1.0:1787826375.414723:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826375.415217:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563710464 00000100:00100000:0.0:1787826375.415228:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563710464 00000100:00100000:0.0:1787826375.415442:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1800 00000100:00100000:0.0:1787826375.415452:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2404:x1874670563710464:12345-192.168.203.39@tcp:23:lseek_test.0 00000100:00100000:0.0:1787826375.415617:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2404:x1874670563710464:12345-192.168.203.39@tcp:23:lseek_test.0 Request processed in 165us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826375.415625:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1800 00000100:00100000:3.0:1787826375.436358:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826375.436858:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563710720 00000100:00100000:0.0:1787826375.436870:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563710720 00000100:00100000:0.0:1787826375.436935:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3427 00000100:00100000:0.0:1787826375.436945:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+29:53034:x1874670563710720:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826375.436968:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826375.436990:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839e00/0x22153cd396b8042b lrc: 2/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab04c1 expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.437096:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839c00/0x22153cd396b80432 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.437111:0:9966:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7a00/0x22153cd396b80408 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04b3 expref: 30 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.437120:0:9966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839c00/0x22153cd396b80432 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x14:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.437150:0:9966:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7a00/0x22153cd396b80408 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04b3 expref: 30 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.437163:0:9966:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7a00/0x22153cd396b80408 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04b3 expref: 30 pid: 16564 timeout: 1421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826375.437177:0:9966:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0373ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9966:1874670585182208:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826375.437258:0:9966:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf09f7de40 going to sleep for 11 seconds 00000100:00100000:0.0:1787826375.439309:0:9966:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0373ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9966:1874670585182208:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826375.439337:0:9966:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839c00/0x22153cd396b80432 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x14:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826375.439628:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826375.440132:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563710848 00000100:00100000:1.0:1787826375.440140:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563710848 00010000:00010000:1.0:1787826375.440175:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7a00/0x22153cd396b80408 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04b3 expref: 31 pid: 16564 timeout: 1421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826375.440271:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 968 00000100:00100000:1.0:1787826375.440281:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:2403:x1874670563710848:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826375.440296:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826375.440303:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7a00/0x22153cd396b80408 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04b3 expref: 31 pid: 16564 timeout: 1421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.440314:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7a00/0x22153cd396b80408 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04b3 expref: 31 pid: 16564 timeout: 1421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.440334:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7a00/0x22153cd396b80408 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04b3 expref: 31 pid: 16564 timeout: 1421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.440349:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:1.0:1787826375.440354:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839c00/0x22153cd396b80432 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x14:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.440364:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839c00/0x22153cd396b80432 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x14:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.440371:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839c00/0x22153cd396b80432 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x14:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.440401:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826375.440451:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:2403:x1874670563710848:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 171us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826375.440514:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 968 00010000:00010000:0.0:1787826375.440573:0:9966:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839c00/0x22153cd396b80432 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x14:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.440581:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839c00/0x22153cd396b80432 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x14:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826375.440602:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x14:0x0]: returning size 3700000 00010000:00010000:0.0:1787826375.440755:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839e00/0x22153cd396b8042b lrc: 0/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04c1 expref: 31 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.440772:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839c00/0x22153cd396b80432 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x14:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04c1 expref: 30 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.440779:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:0.0:1787826375.440781:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787826375.440784:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a839c00, rc 0) 00000100:00100000:0.0:1787826375.440816:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:53034:x1874670563710720:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 3873us (4468us total) trans 8589934634 rc 0/0 00000100:00100000:0.0:1787826375.440824:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3427 00000100:00100000:3.0:1787826375.444548:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826375.444684:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563710976 00000100:00100000:2.0:1787826375.444693:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563710976 00000100:00100000:2.0:1787826375.444749:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3428 00000100:00100000:2.0:1787826375.444769:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:53034:x1874670563710976:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826375.444789:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826375.444808:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6800/0x22153cd396b80440 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab04c8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.444893:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6a00/0x22153cd396b80447 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.444906:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839c00/0x22153cd396b80432 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x14:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04c1 expref: 31 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.444914:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6a00/0x22153cd396b80447 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.444943:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839c00/0x22153cd396b80432 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x14:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04c1 expref: 31 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.444955:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839c00/0x22153cd396b80432 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x14:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04c1 expref: 31 pid: 9966 timeout: 1421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826375.444969:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf41c843c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1874670585182336:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826375.445047:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce05b56300 going to sleep for 11 seconds 00000100:00100000:2.0:1787826375.447442:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf41c843c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1874670585182336:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826375.447512:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6a00/0x22153cd396b80447 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826375.448147:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826375.448191:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563711104 00000100:00100000:0.0:1787826375.448198:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563711104 00010000:00010000:0.0:1787826375.448233:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839c00/0x22153cd396b80432 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x14:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04c1 expref: 32 pid: 9966 timeout: 1421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826375.448269:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 969 00000100:00100000:0.0:1787826375.448279:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+32:2404:x1874670563711104:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826375.448294:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826375.448301:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839c00/0x22153cd396b80432 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x14:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04c1 expref: 32 pid: 9966 timeout: 1421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.448313:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839c00/0x22153cd396b80432 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x14:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04c1 expref: 32 pid: 9966 timeout: 1421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.448336:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839c00/0x22153cd396b80432 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x14:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04c1 expref: 32 pid: 9966 timeout: 1421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.448352:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:0.0:1787826375.448584:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6a00/0x22153cd396b80447 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.448595:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6a00/0x22153cd396b80447 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.448602:0:10340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6a00/0x22153cd396b80447 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.448626:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826375.448676:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6a00/0x22153cd396b80447 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826375.448679:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:2404:x1874670563711104:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 401us (534us total) trans 0 rc 0/0 00010000:00010000:2.0:1787826375.448684:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6a00/0x22153cd396b80447 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826375.448690:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 969 00000004:00200000:2.0:1787826375.448736:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x14:0x0]: returning size 3700000 00000004:00200000:2.0:1787826375.448741:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826375.448766:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6a00/0x22153cd396b80447 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.448799:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6800/0x22153cd396b80440 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04c8 expref: 31 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.448810:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6a00/0x22153cd396b80447 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04c8 expref: 30 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.448815:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:2.0:1787826375.448817:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826375.448819:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3abd6a00, rc 0) 00000100:00100000:2.0:1787826375.448847:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:53034:x1874670563710976:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 4091us (4313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826375.448851:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3428 00000100:00100000:3.0:1787826375.451604:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826375.451782:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563711360 00000100:00100000:2.0:1787826375.451792:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563711360 00000100:00100000:2.0:1787826375.451849:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1008 00000100:00100000:2.0:1787826375.451863:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:53034:x1874670563711360:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:2.0:1787826375.452078:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:53034:x1874670563711360:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 215us (487us total) trans 8589934635 rc 0/0 00000100:00100000:2.0:1787826375.452085:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1008 00000100:00100000:3.0:1787826375.454049:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826375.454268:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563711616 00000100:00100000:2.0:1787826375.454276:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563711616 00000100:00100000:2.0:1787826375.454332:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3429 00000100:00100000:2.0:1787826375.454341:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:53034:x1874670563711616:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826375.454362:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826375.454365:0:16564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787826375.454392:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6600/0x22153cd396b8041d lrc: 0/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04ba expref: 31 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.454411:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:2.0:1787826375.454417:0:16564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826375.454430:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7000/0x22153cd396b8044e lrc: 2/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab04cf expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.454586:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7400/0x22153cd396b80455 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.454602:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7400/0x22153cd396b80455 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x14:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.454613:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7400/0x22153cd396b80455 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x14:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826375.454630:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x14:0x0]: returning size 3700000 00010000:00010000:2.0:1787826375.454940:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7000/0x22153cd396b8044e lrc: 0/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04cf expref: 33 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.454954:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7400/0x22153cd396b80455 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x14:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04cf expref: 32 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.454963:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:2.0:1787826375.454965:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787826375.454968:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3abd7400, rc 0) 00000100:00100000:2.0:1787826375.455099:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+32:53034:x1874670563711616:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 759us (1058us total) trans 8589934636 rc 0/0 00000100:00100000:2.0:1787826375.455107:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3429 00000100:00100000:3.0:1787826375.461266:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826375.461326:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826375.461433:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563711744 00000100:00100000:2.0:1787826375.461441:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563711744 00000100:00100000:1.0:1787826375.461520:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563711872 00000100:00100000:1.0:1787826375.461525:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563711872 00000100:00100000:1.0:1787826375.461573:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1801 00000100:00100000:1.0:1787826375.461584:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2403:x1874670563711872:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:1.0:1787826375.461630:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c240e7d3/0x22153cd396b80463 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826375.461636:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1802 00010000:00010000:1.0:1787826375.461650:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000086fb5c8/0x22153cd396b803c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1052671) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab049e expref: 14 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826375.461655:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aad4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2403:x1874670563711744:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:1.0:1787826375.461659:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x103:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826375.461663:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x103:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826375.461668:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c240e7d3/0x22153cd396b80463 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.461672:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009a032ff/0x22153cd396b8046a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.461681:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004d747c98/0x22153cd396b803ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0490 expref: 14 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.461687:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x102:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826375.461690:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x102:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826375.461693:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009a032ff/0x22153cd396b8046a lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.461702:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000086fb5c8/0x22153cd396b803c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1052671) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab049e expref: 14 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.461708:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004d747c98/0x22153cd396b803ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0490 expref: 14 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.461716:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000086fb5c8/0x22153cd396b803c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1052671) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab049e expref: 14 pid: 8545 timeout: 1421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.461717:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004d747c98/0x22153cd396b803ad lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0490 expref: 14 pid: 30694 timeout: 1421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826375.461731:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0300ed00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1874670585182464:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826375.461731:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf41c843c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1874670585182592:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826375.461995:0:8435:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf39df2540 going to sleep for 11 seconds 00000100:00100000:2.0:1787826375.461995:0:8437:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce05b56e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826375.463971:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0300ed00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1874670585182464:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826375.464000:0:8435:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c240e7d3/0x22153cd396b80463 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826375.464004:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf41c843c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1874670585182592:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826375.464016:0:8437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000009a032ff/0x22153cd396b8046a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826375.465563:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826375.465621:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826375.465623:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563712128 00000100:00100000:2.0:1787826375.465639:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563712128 00010000:00010000:2.0:1787826375.465679:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000086fb5c8/0x22153cd396b803c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1052671) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab049e expref: 15 pid: 8545 timeout: 1421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826375.465722:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563712000 00000100:00100000:2.0:1787826375.465726:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563712000 00010000:00010000:2.0:1787826375.465739:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004d747c98/0x22153cd396b803ad lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0490 expref: 16 pid: 30694 timeout: 1421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826375.465770:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 970 00000100:00100000:2.0:1787826375.465779:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2404:x1874670563712128:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826375.465797:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787826375.465814:0:6503:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x103:0x0] updating lvb blocks from disk: 0 -> 40 00010000:00010000:2.0:1787826375.465821:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000086fb5c8/0x22153cd396b803c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1052671) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab049e expref: 16 pid: 8545 timeout: 1421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.465833:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000086fb5c8/0x22153cd396b803c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1052671) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab049e expref: 16 pid: 8545 timeout: 1421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.465856:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000086fb5c8/0x22153cd396b803c2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1052671) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab049e expref: 16 pid: 8545 timeout: 1421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.465872:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x103:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826375.465876:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x103:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826375.465880:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c240e7d3/0x22153cd396b80463 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.465889:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c240e7d3/0x22153cd396b80463 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.465913:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826375.465955:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2404:x1874670563712128:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 177us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826375.465962:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 970 00000100:00100000:2.0:1787826375.465980:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 971 00000100:00100000:2.0:1787826375.465986:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf076d9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563712000:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826375.465997:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787826375.466005:0:6503:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x102:0x0] updating lvb size from disk: 1045504 -> 1048576 00002000:00010000:2.0:1787826375.466008:0:6503:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x102:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1787826375.466013:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004d747c98/0x22153cd396b803ad lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0490 expref: 14 pid: 30694 timeout: 1421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.466023:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004d747c98/0x22153cd396b803ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0490 expref: 14 pid: 30694 timeout: 1421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.466035:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d747c98/0x22153cd396b803ad lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0490 expref: 14 pid: 30694 timeout: 1421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.466044:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x102:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826375.466047:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x102:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826375.466051:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000009a032ff/0x22153cd396b8046a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.466059:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009a032ff/0x22153cd396b8046a lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.466085:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826375.466103:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf076d9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2404:x1874670563712000:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 117us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826375.466109:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 971 00010000:00010000:2.0:1787826375.466155:0:8437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000009a032ff/0x22153cd396b8046a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.466170:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009a032ff/0x22153cd396b8046a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.466189:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009a032ff/0x22153cd396b8046a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.466197:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009a032ff/0x22153cd396b8046a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.466205:0:8437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009a032ff/0x22153cd396b8046a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.466211:0:8437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3abd6800 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826375.466215:0:8437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009a032ff/0x22153cd396b8046a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.466224:0:8437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009a032ff/0x22153cd396b8046a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.466235:0:8437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009a032ff/0x22153cd396b8046a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.466242:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009a032ff/0x22153cd396b8046a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826375.466288:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aad4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563711744:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 4644us (5029us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826375.466295:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1802 00010000:00010000:1.0:1787826375.466516:0:8435:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c240e7d3/0x22153cd396b80463 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.466526:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c240e7d3/0x22153cd396b80463 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.466541:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c240e7d3/0x22153cd396b80463 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.466549:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c240e7d3/0x22153cd396b80463 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.466556:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c240e7d3/0x22153cd396b80463 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.466562:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05124400 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:1.0:1787826375.466565:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c240e7d3/0x22153cd396b80463 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.466571:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c240e7d3/0x22153cd396b80463 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.466587:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c240e7d3/0x22153cd396b80463 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.466594:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c240e7d3/0x22153cd396b80463 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826375.466631:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2403:x1874670563711872:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 5049us (5302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826375.466638:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1801 00000100:00100000:3.0:1787826375.468634:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826375.468679:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563712384 00000100:00100000:1.0:1787826375.468688:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563712384 00000100:00100000:1.0:1787826375.468744:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3430 00000100:00100000:1.0:1787826375.468753:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+32:53034:x1874670563712384:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:1.0:1787826375.468805:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1787826375.468830:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7e00/0x22153cd396b803ec lrc: 0/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04ac expref: 32 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.468850:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6a00/0x22153cd396b80447 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04c8 expref: 31 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.468859:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:1.0:1787826375.468865:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826375.468893:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125e00/0x22153cd396b80471 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.468903:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125e00/0x22153cd396b80471 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.468909:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125e00/0x22153cd396b80471 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787826375.469055:0:6518:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x103:0x0], index 0: 0 00000040:00080000:1.0:1787826375.469113:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5, 88 off8608 00000004:00080000:1.0:1787826375.469117:0:6518:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1321480645523ns, next at 0ns, rc = 0 00000040:00080000:1.0:1787826375.469139:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].6, 88 off8696 00000004:00080000:1.0:1787826375.469143:0:6518:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1321480671327ns, next at 0ns, rc = 0 00000040:00080000:1.0:1787826375.469164:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 88 off8584 00000004:00080000:1.0:1787826375.469168:0:6518:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1321480696371ns, next at 1309127889395ns, rc = 0 00000040:00080000:1.0:1787826375.469197:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 88 off8672 00000004:00080000:1.0:1787826375.469202:0:6518:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1321480730464ns, next at 1309127889395ns, rc = 0 00000001:00080000:1.0:1787826375.476394:0:34481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934637 is committed 00000004:00080000:1.0:1787826375.476408:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000004:00080000:1.0:1787826375.476419:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:1.0:1787826375.476422:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:1.0:1787826375.476435:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000100:00100000:3.0:1787826375.476695:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f82d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585183104:0@lo:2:osp-syn-1-0.0 00000004:00010000:1.0:1787826375.476736:0:6518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000098a5e0f9 reply state 00000000e1d74c99 transno 8589934637 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125e00/0x22153cd396b80471 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.476766:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125e00/0x22153cd396b80471 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.476775:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:1.0:1787826375.476778:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1787826375.476782:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826375.476858:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f82da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585182976:0@lo:2:osp-syn-1-0.0 00010000:00080000:1.0:1787826375.476884:0:6518:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1787826375.476901:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:53034:x1874670563712384:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 8146us (8271us total) trans 8589934637 rc 0/0 00000100:00100000:1.0:1787826375.476914:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3430 00000100:00100000:1.0:1787826375.476967:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf41c87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585182720:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787826375.476998:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826375.477026:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585183104 00000100:00100000:1.0:1787826375.477033:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585183104 00000100:00100000:3.0:1787826375.477060:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826375.477084:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585182976 00000100:00100000:3.0:1787826375.477087:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585182976 00000100:00100000:3.0:1787826375.477116:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1803 00000100:00100000:3.0:1787826375.477122:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:3646:x1874670585182976:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787826375.477222:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1804 00000100:00100000:1.0:1787826375.477232:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:3647:x1874670585183104:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787826375.477268:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:3646:x1874670585182976:12345-0@lo:2:osp-syn-1-0.0 Request processed in 144us (206us total) trans 17179869596 rc 0/0 00000100:00100000:3.0:1787826375.477275:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1803 00000004:00080000:3.0:1787826375.477317:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3f82da40/2, rc 0, transno 17179869596 00000100:00100000:3.0:1787826375.477323:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f82da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585182976:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1787826375.477339:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125e00/0x22153cd396b80471 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.477349:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125e00/0x22153cd396b80471 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826375.477350:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:3647:x1874670585183104:12345-0@lo:2:osp-syn-1-0.0 Request processed in 118us (350us total) trans 17179869597 rc 0/0 00010000:00010000:3.0:1787826375.477364:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125e00/0x22153cd396b80471 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826375.477368:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1804 00010000:00010000:3.0:1787826375.477375:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05125e00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826375.477381:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125e00/0x22153cd396b80471 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.477388:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125e00/0x22153cd396b80471 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.477398:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:3.0:1787826375.477401:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826375.477404:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125e00/0x22153cd396b80471 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.477410:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125e00/0x22153cd396b80471 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787826375.477434:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3f82d680/2, rc 0, transno 17179869597 00000100:00100000:3.0:1787826375.477438:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f82d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585183104:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1787826375.477451:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a838a00/0x22153cd396b803e5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.477493:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a838a00/0x22153cd396b803e5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.477500:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a838a00/0x22153cd396b803e5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.477506:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a838a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826375.477510:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a838a00/0x22153cd396b803e5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.477517:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a838a00/0x22153cd396b803e5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.477528:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:0.0:1787826375.477530:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826375.477533:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a838a00/0x22153cd396b803e5 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.477540:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a838a00/0x22153cd396b803e5 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826375.477565:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf41c84b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585182848:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787826375.477597:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826375.477674:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585182848 00000100:00100000:1.0:1787826375.477679:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585182848 00000100:00100000:1.0:1787826375.477709:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1805 00000100:00100000:1.0:1787826375.477715:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:3645:x1874670585182848:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787826375.477806:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3645:x1874670585182848:12345-0@lo:2:osp-syn-0-0.0 Request processed in 91us (208us total) trans 21474836921 rc 0/0 00000100:00100000:1.0:1787826375.477813:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1805 00000004:00080000:1.0:1787826375.477836:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf41c84b40/2, rc 0, transno 21474836921 00000100:00100000:1.0:1787826375.477840:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf41c84b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585182848:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787826375.478270:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826375.478336:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585182720 00000100:00100000:1.0:1787826375.478340:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585182720 00000100:00100000:1.0:1787826375.478369:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1806 00000100:00100000:1.0:1787826375.478375:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c84780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3644:x1874670585182720:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787826375.478457:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c84780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3644:x1874670585182720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (187us total) trans 21474836922 rc 0/0 00000100:00100000:1.0:1787826375.478491:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1806 00000004:00080000:2.0:1787826375.478580:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf41c87c00/2, rc 0, transno 21474836922 00000100:00100000:2.0:1787826375.478584:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf41c87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585182720:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787826375.481250:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826375.481323:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563712512 00000100:00100000:1.0:1787826375.481330:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563712512 00000100:00100000:1.0:1787826375.481398:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3431 00000100:00100000:1.0:1787826375.481406:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:53034:x1874670563712512:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826375.481427:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826375.481444:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05124400/0x22153cd396b80478 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab04d6 expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.481521:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05124400/0x22153cd396b80478 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04d6 expref: 21 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.481535:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05124400/0x22153cd396b80478 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04d6 expref: 21 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.481554:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:1.0:1787826375.481558:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826375.481562:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05124400, rc 0) 00000100:00100000:1.0:1787826375.481607:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:53034:x1874670563712512:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 202us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826375.481613:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3431 00000100:00100000:3.0:1787826375.485200:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826375.485558:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563712640 00000100:00100000:2.0:1787826375.485569:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563712640 00000100:00100000:2.0:1787826375.485728:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3432 00000100:00100000:2.0:1787826375.485739:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:53034:x1874670563712640:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826375.486045:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826375.486067:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6400/0x22153cd396b8047f lrc: 2/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab04dd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.486159:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7000/0x22153cd396b80486 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.486174:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7000/0x22153cd396b80486 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.486185:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7000/0x22153cd396b80486 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826375.486212:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x14:0x0]: returning size 3700000 00000004:00200000:2.0:1787826375.486216:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826375.486235:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7000/0x22153cd396b80486 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.486268:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6400/0x22153cd396b8047f lrc: 0/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04dd expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.486285:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7000/0x22153cd396b80486 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04dd expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.486293:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:2.0:1787826375.486296:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826375.486299:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3abd7000, rc 0) 00000100:00100000:2.0:1787826375.486367:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:53034:x1874670563712640:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 629us (1175us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826375.486375:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3432 00000100:00100000:2.0:1787826375.491313:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826375.491402:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826375.491428:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563712768 00000100:00100000:0.0:1787826375.491437:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563712768 00000100:00100000:1.0:1787826375.491489:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563712896 00000100:00100000:1.0:1787826375.491495:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563712896 00000100:00100000:0.0:1787826375.492162:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1807 00000100:00100000:0.0:1787826375.492176:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c85a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563712768:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826375.492194:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826375.492216:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dcdd028e/0x22153cd396b8048d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab04e4 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826375.492239:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x102:0x0] initial LVB size: 1048576, mtime: 0x6a9010c7, atime: 0x0, ctime: 0x6a9010c7, blocks: 0x8 00010000:00010000:0.0:1787826375.492258:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x102:0x0].0x0 since=1321s v=(0 0) 00010000:00010000:0.0:1787826375.492263:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x102:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826375.492273:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcdd028e/0x22153cd396b8048d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04e4 expref: 13 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.492289:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dcdd028e/0x22153cd396b8048d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04e4 expref: 13 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.492303:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a839c00, rc 0) 00000100:00100000:0.0:1787826375.492367:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c85a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2404:x1874670563712768:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 195us (1063us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826375.492374:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1807 00000100:00100000:0.0:1787826375.493653:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1808 00000100:00100000:0.0:1787826375.493667:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563712896:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826375.493681:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826375.493696:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085a803c1/0x22153cd396b80494 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab04eb expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826375.493715:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x103:0x0] initial LVB size: 3700000, mtime: 0x6a9010c7, atime: 0x0, ctime: 0x6a9010c7, blocks: 0x28 00010000:00010000:0.0:1787826375.493730:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x103:0x0].0x0 since=1321s v=(0 0) 00010000:00010000:0.0:1787826375.493735:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x103:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826375.493744:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085a803c1/0x22153cd396b80494 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04eb expref: 13 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.493757:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000085a803c1/0x22153cd396b80494 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04eb expref: 13 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.493769:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a839e00, rc 0) 00000100:00100000:0.0:1787826375.493816:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2403:x1874670563712896:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 154us (2415us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826375.493825:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1808 00000100:00100000:2.0:1787826375.542189:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826375.542283:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826375.542380:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563713024 00000100:00100000:3.0:1787826375.542390:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563713024 00000100:00100000:3.0:1787826375.542451:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563713152 00000100:00100000:3.0:1787826375.542454:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563713152 00000100:00100000:3.0:1787826375.542523:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1809 00000100:00100000:3.0:1787826375.542532:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563713024:12345-192.168.203.39@tcp:23:lfs.0 00000100:00100000:3.0:1787826375.542630:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563713024:12345-192.168.203.39@tcp:23:lfs.0 Request processed in 98us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826375.542637:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1809 00000100:00100000:3.0:1787826375.542656:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1810 00000100:00100000:3.0:1787826375.542663:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c86d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2404:x1874670563713152:12345-192.168.203.39@tcp:23:lfs.0 00000100:00100000:3.0:1787826375.542696:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c86d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2404:x1874670563713152:12345-192.168.203.39@tcp:23:lfs.0 Request processed in 33us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826375.542701:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1810 00000100:00100000:3.0:1787826375.550279:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826375.550389:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563713280 00000100:00100000:1.0:1787826375.550398:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563713280 00000100:00100000:1.0:1787826375.550505:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1811 00000100:00100000:1.0:1787826375.550515:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2403:x1874670563713280:12345-192.168.203.39@tcp:23:lfs.0 00000100:00100000:1.0:1787826375.550620:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2403:x1874670563713280:12345-192.168.203.39@tcp:23:lfs.0 Request processed in 105us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826375.550631:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1811 00000100:00100000:2.0:1787826375.552965:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826375.553014:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563713408 00000100:00100000:3.0:1787826375.553026:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563713408 00000100:00100000:3.0:1787826375.553239:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1812 00000100:00100000:3.0:1787826375.553250:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2403:x1874670563713408:12345-192.168.203.39@tcp:23:lfs.0 00000100:00100000:3.0:1787826375.553362:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2403:x1874670563713408:12345-192.168.203.39@tcp:23:lfs.0 Request processed in 114us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826375.553369:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1812 00000100:00100000:2.0:1787826375.560119:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826375.560291:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563713536 00000100:00100000:1.0:1787826375.560301:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563713536 00000100:00100000:1.0:1787826375.560396:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1813 00000100:00100000:1.0:1787826375.560407:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf07966940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+5:53034:x1874670563713536:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826375.560426:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826375.560448:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e42b1469/0x22153cd396b8049b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab04f2 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826375.560530:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x102:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826375.560552:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x102:0x0].0x0 since=1321s v=(0 0) 00010000:00010000:1.0:1787826375.560556:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x102:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826375.560567:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e42b1469/0x22153cd396b8049b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1044479) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04f2 expref: 6 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.560586:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e42b1469/0x22153cd396b8049b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1044479) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04f2 expref: 6 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.560599:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05124a00, rc 0) 00000100:00100000:1.0:1787826375.560663:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf07966940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+6:53034:x1874670563713536:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 258us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826375.560671:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1813 00000100:00080000:0.0:1787826375.565513:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826375.581385:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826375.581515:0:25426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563713664 00000100:00100000:0.0:1787826375.581526:0:25426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563713664 00000100:00100000:0.0:1787826375.581601:0:25426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 696 00000100:00100000:0.0:1787826375.581611:0:25426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+6:2404:x1874670563713664:12345-192.168.203.39@tcp:22:lfs.0 00002000:00010000:0.0:1787826375.581758:0:25426:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x102:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787826375.581762:0:25426:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x102:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1787826375.581764:0:25426:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x102:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787826375.581766:0:25426:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x102:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1787826375.581768:0:25426:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x102:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1787826375.581823:0:25426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2404:x1874670563713664:12345-192.168.203.39@tcp:22:lfs.0 Request processed in 213us (449us total) trans 21474836923 rc 0/0 00000100:00100000:0.0:1787826375.581831:0:25426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 696 00000100:00100000:2.0:1787826375.597655:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826375.597731:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826375.597943:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563713920 00000100:00100000:3.0:1787826375.597952:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563713920 00000100:00100000:3.0:1787826375.598017:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563713792 00000100:00100000:3.0:1787826375.598020:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563713792 00000100:00100000:3.0:1787826375.598042:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 697 00000100:00100000:3.0:1787826375.598049:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf07964b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2403:x1874670563713920:12345-192.168.203.39@tcp:3:lfs.0 00000100:00100000:1.0:1787826375.598059:0:25425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 698 00000100:00100000:1.0:1787826375.598069:0:25425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecad680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2403:x1874670563713792:12345-192.168.203.39@tcp:3:lfs.0 00010000:00010000:3.0:1787826375.598084:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c3d097e2/0x22153cd396b804a2 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.598088:0:25425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000086914dcf/0x22153cd396b804a9 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.598109:0:25425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x102:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826375.598109:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x103:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826375.598118:0:25425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x102:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826375.598118:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x103:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826375.598128:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3d097e2/0x22153cd396b804a2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x103:0x0].0x0 rrc: 3 type: EXT [1048576->1069055] (req 1048576->1069055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.598129:0:25425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086914dcf/0x22153cd396b804a9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x102:0x0].0x0 rrc: 3 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.598142:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3d097e2/0x22153cd396b804a2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x103:0x0].0x0 rrc: 3 type: EXT [1048576->1069055] (req 1048576->1069055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.598307:0:25425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000086914dcf/0x22153cd396b804a9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x102:0x0].0x0 rrc: 3 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.598566:0:25425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000086914dcf/0x22153cd396b804a9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x102:0x0].0x0 rrc: 3 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.598575:0:25425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000086914dcf/0x22153cd396b804a9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x102:0x0].0x0 rrc: 3 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.598581:0:25425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000086914dcf/0x22153cd396b804a9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x102:0x0].0x0 rrc: 3 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.598586:0:25425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05124e00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:1.0:1787826375.598589:0:25425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000086914dcf/0x22153cd396b804a9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x102:0x0].0x0 rrc: 3 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.598594:0:25425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000086914dcf/0x22153cd396b804a9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x102:0x0].0x0 rrc: 3 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.598611:0:25425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000086914dcf/0x22153cd396b804a9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x102:0x0].0x0 rrc: 3 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.598618:0:25425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000086914dcf/0x22153cd396b804a9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x102:0x0].0x0 rrc: 3 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826375.598658:0:25425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecad680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2403:x1874670563713792:12345-192.168.203.39@tcp:3:lfs.0 Request processed in 591us (926us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787826375.598667:0:25425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 698 00010000:00010000:3.0:1787826375.606287:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c3d097e2/0x22153cd396b804a2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x103:0x0].0x0 rrc: 3 type: EXT [1048576->1069055] (req 1048576->1069055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.606308:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c3d097e2/0x22153cd396b804a2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x103:0x0].0x0 rrc: 3 type: EXT [1048576->1069055] (req 1048576->1069055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.606319:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c3d097e2/0x22153cd396b804a2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x103:0x0].0x0 rrc: 3 type: EXT [1048576->1069055] (req 1048576->1069055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.606327:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401c00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826375.606331:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3d097e2/0x22153cd396b804a2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x103:0x0].0x0 rrc: 3 type: EXT [1048576->1069055] (req 1048576->1069055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.606340:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3d097e2/0x22153cd396b804a2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x103:0x0].0x0 rrc: 3 type: EXT [1048576->1069055] (req 1048576->1069055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.606359:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c3d097e2/0x22153cd396b804a2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x103:0x0].0x0 rrc: 3 type: EXT [1048576->1069055] (req 1048576->1069055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.606366:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3d097e2/0x22153cd396b804a2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x103:0x0].0x0 rrc: 3 type: EXT [1048576->1069055] (req 1048576->1069055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826375.610397:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf07964b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2403:x1874670563713920:12345-192.168.203.39@tcp:3:lfs.0 Request processed in 8405us (8816us total) trans 0 rc 20480/20480 00000100:00100000:3.0:1787826375.610420:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 697 00000100:00100000:2.0:1787826375.616926:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826375.617036:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563714048 00000100:00100000:0.0:1787826375.617047:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563714048 00000100:00100000:0.0:1787826375.617127:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 699 00000100:00100000:0.0:1787826375.617137:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecacb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2404:x1874670563714048:12345-192.168.203.39@tcp:4:lfs.0 00010000:00010000:0.0:1787826375.617272:0:8440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024abb415/0x22153cd396b804b0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.617293:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e42b1469/0x22153cd396b8049b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1044479) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04f2 expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.617302:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x102:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826375.617314:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x102:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826375.617319:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024abb415/0x22153cd396b804b0 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [1044480->1069055] (req 1044480->1069055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.617353:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e42b1469/0x22153cd396b8049b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1044479) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04f2 expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.617368:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e42b1469/0x22153cd396b8049b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1044479) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04f2 expref: 7 pid: 8435 timeout: 1421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826375.617381:0:8440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0373d680 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:8440:1874670585183232:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826375.617506:0:8440:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf09f7d240 going to sleep for 11 seconds 00000100:00100000:0.0:1787826375.632413:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826375.633985:0:8440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0373d680 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:8440:1874670585183232:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826375.634015:0:8440:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024abb415/0x22153cd396b804b0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [1044480->1069055] (req 1044480->1069055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826375.634828:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563714176 00000100:00100000:1.0:1787826375.634838:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563714176 00010000:00010000:1.0:1787826375.634892:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e42b1469/0x22153cd396b8049b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1044479) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04f2 expref: 8 pid: 8435 timeout: 1421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826375.634936:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 972 00000100:00100000:1.0:1787826375.634945:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2404:x1874670563714176:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826375.634959:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826375.634979:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e42b1469/0x22153cd396b8049b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1044479) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04f2 expref: 8 pid: 8435 timeout: 1421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.634991:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e42b1469/0x22153cd396b8049b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1044479) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04f2 expref: 8 pid: 8435 timeout: 1421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.635014:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e42b1469/0x22153cd396b8049b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x102:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1044479) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04f2 expref: 8 pid: 8435 timeout: 1421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.635037:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x102:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826375.635042:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x102:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826375.635047:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024abb415/0x22153cd396b804b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [1044480->1069055] (req 1044480->1069055) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.635057:0:10340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024abb415/0x22153cd396b804b0 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [1044480->1069055] (req 1044480->1069055) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.635088:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826375.635160:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2404:x1874670563714176:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 216us (2756us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826375.635167:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 972 00010000:00010000:3.0:1787826375.635513:0:8440:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024abb415/0x22153cd396b804b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [1044480->1069055] (req 1044480->1069055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.635523:0:8440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024abb415/0x22153cd396b804b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [1044480->1069055] (req 1044480->1069055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787826375.647040:0:26205:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836924 is committed 00000001:00080000:0.0:1787826375.647055:0:26205:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836922 is committed 00002000:00010000:3.0:1787826375.647251:0:8440:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x102:0x0] updating lvb size from disk: 0 -> 1069056 00002000:00010000:3.0:1787826375.647255:0:8440:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x102:0x0] updating lvb mtime from disk: 0 -> 1787826376 00002000:00010000:3.0:1787826375.647257:0:8440:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x102:0x0] updating lvb ctime from disk: 0 -> 1787826376 00002000:00010000:3.0:1787826375.647259:0:8440:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x102:0x0] updating lvb blocks from disk: 0 -> 48 00010000:00010000:3.0:1787826375.647270:0:8440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024abb415/0x22153cd396b804b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [1044480->1069055] (req 1044480->1069055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.647280:0:8440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024abb415/0x22153cd396b804b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [1044480->1069055] (req 1044480->1069055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.647286:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024abb415/0x22153cd396b804b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [1044480->1069055] (req 1044480->1069055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.647290:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a838e00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826375.647293:0:8440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024abb415/0x22153cd396b804b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [1044480->1069055] (req 1044480->1069055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.647300:0:8440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024abb415/0x22153cd396b804b0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [1044480->1069055] (req 1044480->1069055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.647315:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024abb415/0x22153cd396b804b0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [1044480->1069055] (req 1044480->1069055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.647322:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024abb415/0x22153cd396b804b0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [1044480->1069055] (req 1044480->1069055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826375.647452:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecacb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+5:2404:x1874670563714048:12345-192.168.203.39@tcp:4:lfs.0 Request processed in 30312us (30533us total) trans 21474836924 rc 0/0 00000100:00100000:3.0:1787826375.647531:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 699 00000100:00100000:0.0:1787826375.650596:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826375.650859:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563714304 00000100:00100000:3.0:1787826375.650876:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563714304 00000100:00100000:3.0:1787826375.650961:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1814 00000100:00100000:3.0:1787826375.650973:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2404:x1874670563714304:12345-192.168.203.39@tcp:23:lfs.0 00000100:00100000:3.0:1787826375.651127:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2404:x1874670563714304:12345-192.168.203.39@tcp:23:lfs.0 Request processed in 155us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826375.651136:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1814 00000100:00100000:0.0:1787826375.656373:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826375.656521:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563714432 00000100:00100000:1.0:1787826375.656535:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563714432 00000100:00100000:1.0:1787826375.656609:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1815 00000100:00100000:1.0:1787826375.656621:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+5:53034:x1874670563714432:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826375.656656:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826375.656686:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e42b1469/0x22153cd396b804b7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab04f9 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826375.656722:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x102:0x0] initial LVB size: 1069056, mtime: 0x6a9010c8, atime: 0x0, ctime: 0x6a9010c8, blocks: 0x30 00010000:00010000:1.0:1787826375.656751:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x102:0x0].0x0 since=1321s v=(0 0) 00010000:00010000:1.0:1787826375.656757:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x102:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826375.656769:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e42b1469/0x22153cd396b804b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1069056->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04f9 expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.656795:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e42b1469/0x22153cd396b804b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1069056->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04f9 expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.656810:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05124a00, rc 0) 00000100:00100000:1.0:1787826375.656877:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+6:53034:x1874670563714432:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 257us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826375.656884:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1815 00000100:00100000:3.0:1787826375.658977:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826375.659025:0:30178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563714560 00000100:00100000:2.0:1787826375.659040:0:30178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563714560 00000100:00100000:2.0:1787826375.659415:0:30178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 700 00000100:00100000:2.0:1787826375.659430:0:30178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce063043c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+6:2404:x1874670563714560:12345-192.168.203.39@tcp:22:lfs.0 00002000:00010000:2.0:1787826375.659833:0:30178:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x102:0x0] updating lvb size from disk: 1069056 -> 1069056 00002000:00010000:2.0:1787826375.659838:0:30178:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x102:0x0] updating lvb mtime from disk: 1787826376 -> 1787826376 00002000:00010000:2.0:1787826375.659842:0:30178:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x102:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787826375.659844:0:30178:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x102:0x0] updating lvb ctime from disk: 1787826376 -> 1787826376 00002000:00010000:2.0:1787826375.659847:0:30178:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x102:0x0] updating lvb blocks from disk: 48 -> 48 00000100:00100000:2.0:1787826375.659917:0:30178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce063043c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2404:x1874670563714560:12345-192.168.203.39@tcp:22:lfs.0 Request processed in 490us (952us total) trans 21474836925 rc 0/0 00000100:00100000:2.0:1787826375.659926:0:30178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 700 00000100:00100000:0.0:1787826375.667566:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826375.667691:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563714816 00000100:00100000:2.0:1787826375.667704:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563714816 00000100:00100000:2.0:1787826375.667781:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3433 00000100:00100000:2.0:1787826375.667793:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:53034:x1874670563714816:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:2.0:1787826375.667860:0:16564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826375.667894:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7000/0x22153cd396b80486 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04dd expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.667919:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:2.0:1787826375.667925:0:16564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826375.668144:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7a00/0x22153cd396b804be lrc: 3/0,1 mode: --/PW res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.668162:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7a00/0x22153cd396b804be lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.668174:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7a00/0x22153cd396b804be lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787826375.668224:0:16564:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934638 00000004:00010000:2.0:1787826375.668246:0:16564:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007fd5cfd9 reply state 000000002fa0cb8c transno 8589934639 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7a00/0x22153cd396b804be lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.668260:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7a00/0x22153cd396b804be lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.668267:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:2.0:1787826375.668269:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826375.668272:0:16564:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826375.668383:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:53034:x1874670563714816:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 591us (830us total) trans 8589934639 rc 0/0 00000100:00100000:2.0:1787826375.668391:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3433 00000020:00080000:2.0:1787826375.668397:0:16564:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787826375.670780:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826375.671276:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563714944 00000100:00100000:1.0:1787826375.671288:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563714944 00000100:00100000:1.0:1787826375.671398:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1816 00000100:00100000:1.0:1787826375.671409:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:53034:x1874670563714944:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826375.671431:0:30696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826375.671467:0:30696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086914dcf/0x22153cd396b804c5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0500 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826375.671530:0:30696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x103:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826375.671558:0:30696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x103:0x0].0x0 since=1321s v=(0 0) 00010000:00010000:1.0:1787826375.671563:0:30696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x103:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826375.671576:0:30696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086914dcf/0x22153cd396b804c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0500 expref: 8 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.671595:0:30696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000086914dcf/0x22153cd396b804c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0500 expref: 8 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.671618:0:30696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05124e00, rc 0) 00000100:00100000:1.0:1787826375.671707:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:53034:x1874670563714944:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 300us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826375.671715:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1816 00000100:00100000:0.0:1787826375.678764:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826375.678987:0:30173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563715072 00000100:00100000:2.0:1787826375.679000:0:30173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563715072 00002000:00010000:2.0:1787826375.679057:0:30173:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/259 (3700000->18446744073709551615) 00002000:00100000:2.0:1787826375.679062:0:30173:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce0373c3c0 with x1874670563715072 ext(3700000->18446744073709551615) 00002000:00010000:2.0:1787826375.679079:0:30173:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90ce0373c3c0. 00000100:00100000:2.0:1787826375.679120:0:30173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 701 00000100:00100000:2.0:1787826375.679132:0:30173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2404:x1874670563715072:12345-192.168.203.39@tcp:10:lfs.0 00002000:00010000:2.0:1787826375.679434:0:30173:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x103:0x0] updating lvb size from disk: 0 -> 3700000 00002000:00010000:2.0:1787826375.679438:0:30173:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x103:0x0] updating lvb mtime from disk: 0 -> 1787826376 00002000:00010000:2.0:1787826375.679441:0:30173:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x103:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787826375.679443:0:30173:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x103:0x0] updating lvb ctime from disk: 0 -> 1787826376 00002000:00010000:2.0:1787826375.679446:0:30173:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x103:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1787826375.679567:0:30173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563715072:12345-192.168.203.39@tcp:10:lfs.0 Request processed in 437us (818us total) trans 21474836926 rc 0/0 00000100:00100000:2.0:1787826375.679576:0:30173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 701 00002000:00010000:2.0:1787826375.679582:0:30173:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/259 (3700000->18446744073709551615) 00002000:00100000:2.0:1787826375.679585:0:30173:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce0373c3c0 with x1874670563715072 ext(3700000->18446744073709551615) 00002000:00010000:2.0:1787826375.679590:0:30173:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90ce0373c3c0. 00000100:00100000:2.0:1787826375.682360:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826375.682526:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563715200 00000100:00100000:1.0:1787826375.682538:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563715200 00000100:00100000:2.0:1787826375.685936:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3434 00000100:00100000:2.0:1787826375.685970:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:53034:x1874670563715200:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826375.686004:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826375.686035:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7000/0x22153cd396b804cc lrc: 2/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0507 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.686159:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6a00/0x22153cd396b804d3 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.686177:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6a00/0x22153cd396b804d3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.686191:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6a00/0x22153cd396b804d3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826375.686222:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x14:0x0]: returning size 3700000 00000004:00200000:2.0:1787826375.686227:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826375.686248:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6a00/0x22153cd396b804d3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.686277:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7000/0x22153cd396b804cc lrc: 0/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0507 expref: 26 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.686299:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6a00/0x22153cd396b804d3 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0507 expref: 25 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.686316:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:2.0:1787826375.686319:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826375.686324:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3abd6a00, rc 0) 00000100:00100000:2.0:1787826375.686407:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:53034:x1874670563715200:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 455us (4062us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826375.686416:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3434 00000100:00100000:2.0:1787826375.690439:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826375.692847:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563715456 00000100:00100000:1.0:1787826375.692865:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563715456 00000100:00100000:1.0:1787826375.692957:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3435 00000100:00100000:1.0:1787826375.692969:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:53034:x1874670563715456:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:1.0:1787826375.693043:0:9966:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826375.693078:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6a00/0x22153cd396b804d3 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0507 expref: 25 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.693104:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:1.0:1787826375.693111:0:9966:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826375.693339:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125a00/0x22153cd396b804da lrc: 3/0,1 mode: --/PW res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.693357:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125a00/0x22153cd396b804da lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.693370:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125a00/0x22153cd396b804da lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787826375.693423:0:9966:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934640 00000004:00010000:1.0:1787826375.693449:0:9966:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000701ac894 reply state 0000000098472ff5 transno 8589934641 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125a00/0x22153cd396b804da lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.693518:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125a00/0x22153cd396b804da lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.693526:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:1.0:1787826375.693528:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826375.693531:0:9966:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826375.693980:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:53034:x1874670563715456:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 1011us (3552us total) trans 8589934641 rc 0/0 00000100:00100000:1.0:1787826375.693990:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3435 00000020:00080000:1.0:1787826375.693996:0:9966:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787826375.697039:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826375.697139:0:30177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563715584 00000100:00100000:2.0:1787826375.697151:0:30177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563715584 00002000:00010000:2.0:1787826375.697205:0:30177:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/259 (2097152->18446744073709551615) 00002000:00100000:2.0:1787826375.697210:0:30177:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce0373c000 with x1874670563715584 ext(2097152->18446744073709551615) 00002000:00010000:2.0:1787826375.697225:0:30177:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90ce0373c000. 00000100:00100000:2.0:1787826375.697295:0:30177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 702 00000100:00100000:2.0:1787826375.697308:0:30177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670563715584:12345-192.168.203.39@tcp:10:lfs.0 00002000:00010000:2.0:1787826375.697875:0:30177:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x103:0x0] updating lvb size from disk: 3700000 -> 2097152 00002000:00010000:2.0:1787826375.697880:0:30177:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x103:0x0] updating lvb mtime from disk: 1787826376 -> 1787826376 00002000:00010000:2.0:1787826375.697883:0:30177:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x103:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787826375.697886:0:30177:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x103:0x0] updating lvb ctime from disk: 1787826376 -> 1787826376 00002000:00010000:2.0:1787826375.697889:0:30177:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x103:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1787826375.697972:0:30177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670563715584:12345-192.168.203.39@tcp:10:lfs.0 Request processed in 666us (946us total) trans 21474836927 rc 0/0 00000100:00100000:2.0:1787826375.697983:0:30177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 702 00002000:00010000:2.0:1787826375.697987:0:30177:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/259 (2097152->18446744073709551615) 00002000:00100000:2.0:1787826375.697990:0:30177:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce0373c000 with x1874670563715584 ext(2097152->18446744073709551615) 00002000:00010000:2.0:1787826375.697997:0:30177:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90ce0373c000. 00000100:00100000:3.0:1787826375.700050:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826375.700152:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563715712 00000100:00100000:0.0:1787826375.700164:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563715712 00000100:00100000:0.0:1787826375.700237:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3436 00000100:00100000:0.0:1787826375.700248:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06306580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:53034:x1874670563715712:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826375.700279:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826375.700304:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a838e00/0x22153cd396b804e1 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab050e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.700424:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839200/0x22153cd396b804e8 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.700443:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839200/0x22153cd396b804e8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.700507:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839200/0x22153cd396b804e8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826375.700547:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x14:0x0]: returning size 2097152 00000004:00200000:0.0:1787826375.700552:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826375.700575:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839200/0x22153cd396b804e8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.700608:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a838e00/0x22153cd396b804e1 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab050e expref: 29 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.700640:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839200/0x22153cd396b804e8 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab050e expref: 28 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.700659:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:0.0:1787826375.700662:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826375.700667:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a839200, rc 0) 00000100:00100000:0.0:1787826375.700739:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06306580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+28:53034:x1874670563715712:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 492us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826375.700748:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3436 00000100:00100000:0.0:1787826375.704029:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826375.704121:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563715968 00000100:00100000:3.0:1787826375.704133:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563715968 00000100:00100000:3.0:1787826375.704207:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3437 00000100:00100000:3.0:1787826375.704219:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+28:53034:x1874670563715968:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:3.0:1787826375.704288:0:8247:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826375.704323:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a839200/0x22153cd396b804e8 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab050e expref: 28 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.704346:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:3.0:1787826375.704351:0:8247:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826375.704608:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401c00/0x22153cd396b804ef lrc: 3/0,1 mode: --/PW res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.704626:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401c00/0x22153cd396b804ef lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.704762:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401c00/0x22153cd396b804ef lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787826375.705866:0:8247:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934642 00000004:00010000:1.0:1787826375.705911:0:8247:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000945de6c1 reply state 00000000259e522e transno 8589934643 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401c00/0x22153cd396b804ef lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.705932:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401c00/0x22153cd396b804ef lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.705941:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:1.0:1787826375.705944:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826375.705948:0:8247:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826375.706128:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:53034:x1874670563715968:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 1906us (2109us total) trans 8589934643 rc 0/0 00000100:00100000:1.0:1787826375.706138:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3437 00000020:00080000:1.0:1787826375.706146:0:8247:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787826375.708577:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826375.709011:0:30175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563716096 00000100:00100000:3.0:1787826375.709025:0:30175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563716096 00002000:00010000:3.0:1787826375.709080:0:30175:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/259 (3700000->18446744073709551615) 00002000:00100000:3.0:1787826375.709085:0:30175:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf1ecaf840 with x1874670563716096 ext(3700000->18446744073709551615) 00002000:00010000:3.0:1787826375.709099:0:30175:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf1ecaf840. 00000100:00100000:3.0:1787826375.709135:0:30175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 703 00000100:00100000:3.0:1787826375.709146:0:30175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecaf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563716096:12345-192.168.203.39@tcp:10:lfs.0 00002000:00010000:3.0:1787826375.709424:0:30175:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x103:0x0] updating lvb size from disk: 2097152 -> 3700000 00002000:00010000:3.0:1787826375.709428:0:30175:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x103:0x0] updating lvb mtime from disk: 1787826376 -> 1787826376 00002000:00010000:3.0:1787826375.709432:0:30175:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x103:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787826375.709435:0:30175:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x103:0x0] updating lvb ctime from disk: 1787826376 -> 1787826376 00002000:00010000:3.0:1787826375.709437:0:30175:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x103:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1787826375.709663:0:30175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecaf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2404:x1874670563716096:12345-192.168.203.39@tcp:10:lfs.0 Request processed in 517us (1098us total) trans 21474836928 rc 0/0 00000100:00100000:3.0:1787826375.709673:0:30175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 703 00002000:00010000:3.0:1787826375.709678:0:30175:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/259 (3700000->18446744073709551615) 00002000:00100000:3.0:1787826375.709681:0:30175:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf1ecaf840 with x1874670563716096 ext(3700000->18446744073709551615) 00002000:00010000:3.0:1787826375.709687:0:30175:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf1ecaf840. 00000100:00100000:2.0:1787826375.721602:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826375.721774:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563716224 00000100:00100000:1.0:1787826375.721787:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563716224 00000100:00100000:1.0:1787826375.721859:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3438 00000100:00100000:1.0:1787826375.721870:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb96580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:53034:x1874670563716224:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826375.721901:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826375.721930:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125800/0x22153cd396b804f6 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0515 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.722054:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125000/0x22153cd396b804fd lrc: 3/1,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.722072:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125000/0x22153cd396b804fd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.722087:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125000/0x22153cd396b804fd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826375.722120:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x14:0x0]: returning size 3700000 00000004:00200000:1.0:1787826375.722126:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826375.722148:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125000/0x22153cd396b804fd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.722176:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125800/0x22153cd396b804f6 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0515 expref: 32 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.722197:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125000/0x22153cd396b804fd lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0515 expref: 31 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.722208:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:1.0:1787826375.722211:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826375.722215:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05125000, rc 0) 00000100:00100000:1.0:1787826375.722280:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb96580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:53034:x1874670563716224:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 411us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826375.722288:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3438 00000100:00100000:0.0:1787826375.726069:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826375.726626:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563716480 00000100:00100000:1.0:1787826375.726640:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563716480 00000100:00100000:1.0:1787826375.726813:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3439 00000100:00100000:1.0:1787826375.726824:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:53034:x1874670563716480:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:1.0:1787826375.726892:0:9966:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826375.726928:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125000/0x22153cd396b804fd lrc: 0/0,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0515 expref: 31 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.726951:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:1.0:1787826375.726957:0:9966:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826375.727659:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125800/0x22153cd396b80504 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.727682:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125800/0x22153cd396b80504 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.727694:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125800/0x22153cd396b80504 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787826375.727754:0:9966:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934644 00000004:00010000:1.0:1787826375.727788:0:9966:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cc190950 reply state 00000000d90343c7 transno 8589934645 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125800/0x22153cd396b80504 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.727801:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125800/0x22153cd396b80504 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.727807:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:1.0:1787826375.727810:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826375.727814:0:9966:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826375.727922:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:53034:x1874670563716480:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 1098us (1867us total) trans 8589934645 rc 0/0 00000100:00100000:1.0:1787826375.727931:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3439 00000020:00080000:1.0:1787826375.727938:0:9966:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787826375.730722:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826375.730955:0:30176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563716608 00000100:00100000:3.0:1787826375.730968:0:30176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563716608 00002000:00010000:3.0:1787826375.731023:0:30176:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/259 (3700000->18446744073709551615) 00002000:00100000:3.0:1787826375.731028:0:30176:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce0373de00 with x1874670563716608 ext(3700000->18446744073709551615) 00002000:00010000:3.0:1787826375.731043:0:30176:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90ce0373de00. 00000100:00100000:3.0:1787826375.731082:0:30176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 704 00000100:00100000:3.0:1787826375.731092:0:30176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2404:x1874670563716608:12345-192.168.203.39@tcp:10:lfs.0 00002000:00010000:3.0:1787826375.731279:0:30176:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x103:0x0] updating lvb size from disk: 3700000 -> 3700000 00002000:00010000:3.0:1787826375.731284:0:30176:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x103:0x0] updating lvb mtime from disk: 1787826376 -> 1787826376 00002000:00010000:3.0:1787826375.731287:0:30176:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x103:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787826375.731290:0:30176:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x103:0x0] updating lvb ctime from disk: 1787826376 -> 1787826376 00002000:00010000:3.0:1787826375.731292:0:30176:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x103:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1787826375.731364:0:30176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563716608:12345-192.168.203.39@tcp:10:lfs.0 Request processed in 273us (658us total) trans 21474836929 rc 0/0 00000100:00100000:3.0:1787826375.731373:0:30176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 704 00002000:00010000:3.0:1787826375.731377:0:30176:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/259 (3700000->18446744073709551615) 00002000:00100000:3.0:1787826375.731380:0:30176:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce0373de00 with x1874670563716608 ext(3700000->18446744073709551615) 00002000:00010000:3.0:1787826375.731384:0:30176:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90ce0373de00. 00000100:00100000:2.0:1787826375.734120:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826375.734222:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563716864 00000100:00100000:3.0:1787826375.734235:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563716864 00000100:00100000:3.0:1787826375.734312:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3440 00000100:00100000:3.0:1787826375.734322:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:53034:x1874670563716864:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:3.0:1787826375.734523:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b8050b lrc: 3/0,1 mode: --/PW res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.734546:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b8050b lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.734560:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b8050b lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826375.734710:0:16564:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000081a41a4a reply state 000000001019e3e2 transno 8589934646 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b8050b lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.734725:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b8050b lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.734739:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:3.0:1787826375.734743:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826375.734747:0:16564:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826375.735027:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:53034:x1874670563716864:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 704us (919us total) trans 8589934646 rc 0/0 00000100:00100000:3.0:1787826375.735036:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3440 00000100:00100000:0.0:1787826375.738541:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826375.738652:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563716992 00000100:00100000:3.0:1787826375.738666:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563716992 00000100:00100000:3.0:1787826375.738741:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1817 00000100:00100000:3.0:1787826375.738753:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:53034:x1874670563716992:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826375.738776:0:28853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826375.738800:0:28853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000595c07c9/0x22153cd396b80512 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab051c expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.738840:0:28853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dcdd028e/0x22153cd396b8048d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04e4 expref: 14 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.738853:0:28853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x102:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826375.738859:0:28853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x102:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826375.738865:0:28853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000595c07c9/0x22153cd396b80512 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab051c expref: 14 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.738907:0:28853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dcdd028e/0x22153cd396b8048d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04e4 expref: 14 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.738921:0:28853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dcdd028e/0x22153cd396b8048d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04e4 expref: 14 pid: 8437 timeout: 1421 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826375.738938:0:28853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce063061c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28853:1874670585183360:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826375.739044:0:28853:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f5e7240 going to sleep for 11 seconds 00000100:00100000:1.0:1787826375.741791:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826375.741937:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563717120 00000100:00100000:2.0:1787826375.741947:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563717120 00010000:00010000:2.0:1787826375.741997:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dcdd028e/0x22153cd396b8048d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04e4 expref: 15 pid: 8437 timeout: 1421 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826375.742051:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 973 00000100:00100000:2.0:1787826375.742063:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2404:x1874670563717120:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826375.742082:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826375.742109:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dcdd028e/0x22153cd396b8048d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x102:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04e4 expref: 15 pid: 8437 timeout: 1421 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.742127:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dcdd028e/0x22153cd396b8048d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x102:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04e4 expref: 15 pid: 8437 timeout: 1421 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.742160:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x102:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826375.742165:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x102:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826375.742175:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000595c07c9/0x22153cd396b80512 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab051c expref: 15 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.742187:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000595c07c9/0x22153cd396b80512 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab051c expref: 15 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.742233:0:6505:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000595c07c9/0x22153cd396b80512 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab051c expref: 15 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826375.742250:0:6505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3fb96940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1874670585183488:192.168.203.39@tcp:105: 00000100:00100000:2.0:1787826375.742343:0:6505:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce05b56d80 going to sleep for 11 seconds 00010000:00010000:3.0:1787826375.742592:0:28853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dcdd028e/0x22153cd396b8048d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x102:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04e4 expref: 15 pid: 8437 timeout: 1421 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826375.742610:0:28853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce063061c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28853:1874670585183360:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826375.742655:0:28853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000595c07c9/0x22153cd396b80512 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab051c expref: 14 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.742667:0:28853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400a00, rc 0) 00000100:00100000:3.0:1787826375.742701:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:53034:x1874670563716992:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 3950us (4176us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826375.742711:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1817 00000100:00100000:2.0:1787826375.746246:0:6505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3fb96940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1874670585183488:192.168.203.39@tcp:105: 00010000:00010000:2.0:1787826375.746283:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826375.746361:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2404:x1874670563717120:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4298us (4581us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826375.746376:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 973 00000100:00100000:0.0:1787826375.746689:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826375.746840:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563717248 00000100:00100000:2.0:1787826375.746849:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563717248 00000100:00100000:2.0:1787826375.746902:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1818 00000100:00100000:2.0:1787826375.746912:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03984f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:53034:x1874670563717248:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826375.746933:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826375.746956:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa1d1988/0x22153cd396b80519 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0523 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.746995:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000085a803c1/0x22153cd396b80494 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04eb expref: 14 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.747006:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x103:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826375.747011:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x103:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826375.747017:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa1d1988/0x22153cd396b80519 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0523 expref: 14 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.747057:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000085a803c1/0x22153cd396b80494 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04eb expref: 14 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.747073:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000085a803c1/0x22153cd396b80494 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04eb expref: 14 pid: 8437 timeout: 1421 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826375.747089:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3fb96940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1874670585183616:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826375.747153:0:8437:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce05b56d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787826375.751625:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826375.751997:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563717376 00000100:00100000:1.0:1787826375.752009:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563717376 00010000:00010000:1.0:1787826375.752062:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000085a803c1/0x22153cd396b80494 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04eb expref: 15 pid: 8437 timeout: 1421 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826375.752114:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 974 00000100:00100000:1.0:1787826375.752126:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03987c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2404:x1874670563717376:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826375.752148:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826375.752176:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000085a803c1/0x22153cd396b80494 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x103:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04eb expref: 15 pid: 8437 timeout: 1421 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.752193:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000085a803c1/0x22153cd396b80494 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x103:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04eb expref: 15 pid: 8437 timeout: 1421 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.752231:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x103:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826375.752236:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x103:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826375.752246:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fa1d1988/0x22153cd396b80519 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0523 expref: 15 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.752260:0:10341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa1d1988/0x22153cd396b80519 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0523 expref: 15 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.752306:0:10341:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fa1d1988/0x22153cd396b80519 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0523 expref: 15 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826375.752332:0:10341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0300e580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10341:1874670585183744:192.168.203.39@tcp:105: 00000100:00100000:1.0:1787826375.752445:0:10341:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2069ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826375.754562:0:10341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0300e580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10341:1874670585183744:192.168.203.39@tcp:105: 00010000:00010000:0.0:1787826375.754598:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826375.754673:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03987c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2404:x1874670563717376:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 2547us (3061us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826375.754686:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 974 00010000:00010000:2.0:1787826375.755828:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085a803c1/0x22153cd396b80494 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04eb expref: 14 pid: 8437 timeout: 1421 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826375.755853:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3fb96940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1874670585183616:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826375.755884:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fa1d1988/0x22153cd396b80519 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0523 expref: 13 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.755903:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3abd6600, rc 0) 00000100:00100000:2.0:1787826375.756014:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03984f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:53034:x1874670563717248:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 9101us (9324us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826375.756024:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1818 00000100:00100000:1.0:1787826375.758422:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826375.758536:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563717504 00000100:00100000:3.0:1787826375.758549:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563717504 00000100:00100000:3.0:1787826375.758614:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1819 00000100:00100000:3.0:1787826375.758625:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2404:x1874670563717504:12345-192.168.203.39@tcp:2:lfs.0 00002000:00010000:3.0:1787826375.758916:0:30694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x102:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1787826375.758920:0:30694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x102:0x0] updating lvb mtime from disk: 1787826375 -> 1787826375 00002000:00010000:3.0:1787826375.758923:0:30694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x102:0x0] updating lvb atime from disk: 0 -> 1787826375 00002000:00010000:3.0:1787826375.758925:0:30694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x102:0x0] updating lvb ctime from disk: 1787826375 -> 1787826376 00002000:00010000:3.0:1787826375.758927:0:30694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x102:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1787826375.758995:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563717504:12345-192.168.203.39@tcp:2:lfs.0 Request processed in 371us (585us total) trans 17179869598 rc 0/0 00000100:00100000:3.0:1787826375.759004:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1819 00000100:00100000:2.0:1787826375.760988:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826375.761316:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563717632 00000100:00100000:1.0:1787826375.761327:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563717632 00000100:00100000:1.0:1787826375.761390:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1820 00000100:00100000:1.0:1787826375.761401:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb96940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563717632:12345-192.168.203.39@tcp:2:lfs.0 00002000:00010000:1.0:1787826375.761595:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x103:0x0] updating lvb size from disk: 3700000 -> 3700000 00002000:00010000:1.0:1787826375.761599:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x103:0x0] updating lvb mtime from disk: 1787826375 -> 1787826375 00002000:00010000:1.0:1787826375.761602:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x103:0x0] updating lvb atime from disk: 0 -> 1787826375 00002000:00010000:1.0:1787826375.761605:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x103:0x0] updating lvb ctime from disk: 1787826375 -> 1787826376 00002000:00010000:1.0:1787826375.761608:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x103:0x0] updating lvb blocks from disk: 40 -> 40 00000100:00100000:1.0:1787826375.761796:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb96940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2404:x1874670563717632:12345-192.168.203.39@tcp:2:lfs.0 Request processed in 396us (819us total) trans 17179869599 rc 0/0 00000100:00100000:1.0:1787826375.761805:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1820 00000100:00100000:1.0:1787826375.764229:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826375.764332:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563717888 00000100:00100000:0.0:1787826375.764343:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563717888 00000100:00100000:0.0:1787826375.764405:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1009 00000100:00100000:0.0:1787826375.764416:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:53034:x1874670563717888:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:0.0:1787826375.764546:0:14257:0:(mdt_open.c:2504:mdt_close_resync_done()) ### [0x200000405:0x14:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7400/0x22153cd396b80455 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x14:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04cf expref: 35 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.764611:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a838400/0x22153cd396b80520 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.764628:0:14257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05124400/0x22153cd396b80478 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04d6 expref: 35 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.764891:0:14257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a838400/0x22153cd396b80520 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.764935:0:14257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05124400/0x22153cd396b80478 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04d6 expref: 35 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.764950:0:14257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05124400/0x22153cd396b80478 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04d6 expref: 35 pid: 9966 timeout: 1421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826375.764968:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03984000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585183872:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826375.765070:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf09f7dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826375.771420:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03984000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585183872:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826375.771514:0:14257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a838400/0x22153cd396b80520 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826375.773007:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826375.773104:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563718016 00000100:00100000:2.0:1787826375.773115:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563718016 00010000:00010000:2.0:1787826375.773166:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05124400/0x22153cd396b80478 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04d6 expref: 36 pid: 9966 timeout: 1421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826375.773212:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 975 00000100:00100000:2.0:1787826375.773222:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:2402:x1874670563718016:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826375.773240:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826375.773247:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05124400/0x22153cd396b80478 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04d6 expref: 36 pid: 9966 timeout: 1421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.773262:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05124400/0x22153cd396b80478 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04d6 expref: 36 pid: 9966 timeout: 1421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.773293:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05124400/0x22153cd396b80478 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04d6 expref: 36 pid: 9966 timeout: 1421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.773314:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:2.0:1787826375.773321:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a838400/0x22153cd396b80520 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.773334:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a838400/0x22153cd396b80520 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.773343:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a838400/0x22153cd396b80520 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.773382:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826375.773447:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:2402:x1874670563718016:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 226us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826375.773465:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 975 00010000:00010000:0.0:1787826375.773588:0:14257:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a838400/0x22153cd396b80520 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.773597:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a838400/0x22153cd396b80520 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787826375.773905:0:14257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].7, 88 off8784 00000004:00080000:0.0:1787826375.773914:0:14257:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1321785442251ns, next at 0ns, rc = 0 00000040:00080000:0.0:1787826375.773944:0:14257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].8, 88 off8872 00000004:00080000:0.0:1787826375.773949:0:14257:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1321785477443ns, next at 0ns, rc = 0 00000040:00080000:0.0:1787826375.773973:0:14257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].7, 88 off8760 00000004:00080000:0.0:1787826375.773978:0:14257:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1321785505946ns, next at 1309127889395ns, rc = 0 00000040:00080000:0.0:1787826375.773993:0:14257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].8, 88 off8848 00000004:00080000:0.0:1787826375.773996:0:14257:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1321785524769ns, next at 1309127889395ns, rc = 0 00000001:00080000:1.0:1787826375.776846:0:34481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934647 is committed 00000004:00080000:1.0:1787826375.776863:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:1.0:1787826375.776878:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000004:00080000:1.0:1787826375.776883:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000004:00080000:1.0:1787826375.776898:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000004:00010000:1.0:1787826375.776984:0:14257:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c28f7d6a reply state 00000000358a705b transno 8589934647 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a838400/0x22153cd396b80520 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.777013:0:14257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a838400/0x22153cd396b80520 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.777024:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:1.0:1787826375.777027:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1787826375.777033:0:14257:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787826375.777042:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:1.0:1787826375.777045:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787826375.777054:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7400/0x22153cd396b80455 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x14:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04cf expref: 25 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1787826375.777192:0:14257:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1787826375.777205:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:53034:x1874670563717888:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 12790us (12989us total) trans 8589934647 rc 0/0 00000100:00100000:1.0:1787826375.777216:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1009 00000100:00100000:0.0:1787826375.777990:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce039861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585184128:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787826375.778070:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826375.778118:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787826375.778124:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03986940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585184000:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787826375.778149:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826375.778184:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585184128 00000100:00100000:0.0:1787826375.778192:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585184128 00000100:00100000:0.0:1787826375.778235:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585184000 00000100:00100000:0.0:1787826375.778238:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585184000 00000100:00100000:0.0:1787826375.778261:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1821 00000100:00100000:0.0:1787826375.778270:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03987840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:3645:x1874670585184128:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1787826375.778453:0:8545:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x103:0x0] updating lvb size from disk: 3700000 -> 3700000 00002000:00010000:0.0:1787826375.778468:0:8545:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x103:0x0] updating lvb mtime from disk: 1787826375 -> 1787826375 00002000:00010000:0.0:1787826375.778489:0:8545:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x103:0x0] updating lvb atime from disk: 1787826375 -> 1787826375 00002000:00010000:0.0:1787826375.778493:0:8545:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x103:0x0] updating lvb ctime from disk: 1787826376 -> 1787826376 00002000:00010000:0.0:1787826375.778495:0:8545:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x103:0x0] updating lvb blocks from disk: 40 -> 40 00000100:00100000:0.0:1787826375.778536:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03987840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3645:x1874670585184128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 266us (466us total) trans 17179869600 rc 0/0 00000100:00100000:0.0:1787826375.778543:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1821 00000100:00100000:0.0:1787826375.778560:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1822 00000100:00100000:0.0:1787826375.778566:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce039852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:3645:x1874670585184000:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1787826375.778617:0:8545:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x102:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1787826375.778620:0:8545:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x102:0x0] updating lvb mtime from disk: 1787826375 -> 1787826375 00002000:00010000:0.0:1787826375.778623:0:8545:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x102:0x0] updating lvb atime from disk: 1787826375 -> 1787826375 00002000:00010000:0.0:1787826375.778625:0:8545:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x102:0x0] updating lvb ctime from disk: 1787826376 -> 1787826376 00002000:00010000:0.0:1787826375.778627:0:8545:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x102:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1787826375.778664:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce039852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3645:x1874670585184000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 97us (513us total) trans 17179869601 rc 0/0 00000100:00100000:0.0:1787826375.778670:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1822 00000004:00080000:0.0:1787826375.778715:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce03986940/2, rc 0, transno 17179869601 00000100:00100000:0.0:1787826375.778723:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03986940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585184000:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1787826375.778733:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce039861c0/2, rc 0, transno 17179869600 00000100:00100000:0.0:1787826375.778736:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce039861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585184128:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787826375.779008:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3fb95a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585184256:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787826375.779044:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826375.779067:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787826375.779073:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3abc30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585184384:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787826375.779093:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826375.779122:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585184256 00000100:00100000:2.0:1787826375.779126:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585184256 00000100:00100000:2.0:1787826375.779159:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585184384 00000100:00100000:2.0:1787826375.779162:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585184384 00000100:00100000:2.0:1787826375.779183:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1823 00000100:00100000:2.0:1787826375.779190:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1874670585184256:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1787826375.779274:0:8435:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x102:0x0] updating lvb size from disk: 1069056 -> 1069056 00002000:00010000:2.0:1787826375.779277:0:8435:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x102:0x0] updating lvb mtime from disk: 1787826376 -> 1787826376 00002000:00010000:2.0:1787826375.779280:0:8435:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x102:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787826375.779283:0:8435:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x102:0x0] updating lvb ctime from disk: 1787826376 -> 1787826376 00002000:00010000:2.0:1787826375.779285:0:8435:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x102:0x0] updating lvb blocks from disk: 48 -> 48 00000100:00100000:2.0:1787826375.779315:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3646:x1874670585184256:12345-0@lo:2:osp-syn-0-0.0 Request processed in 126us (271us total) trans 21474836930 rc 0/0 00000100:00100000:2.0:1787826375.779322:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1823 00000100:00100000:2.0:1787826375.779338:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1824 00000100:00100000:2.0:1787826375.779344:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1874670585184384:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1787826375.779392:0:8435:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x103:0x0] updating lvb size from disk: 3700000 -> 3700000 00002000:00010000:2.0:1787826375.779396:0:8435:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x103:0x0] updating lvb mtime from disk: 1787826376 -> 1787826376 00002000:00010000:2.0:1787826375.779399:0:8435:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x103:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787826375.779401:0:8435:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x103:0x0] updating lvb ctime from disk: 1787826376 -> 1787826376 00002000:00010000:2.0:1787826375.779404:0:8435:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x103:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1787826375.779426:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3646:x1874670585184384:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (332us total) trans 21474836931 rc 0/0 00000100:00100000:2.0:1787826375.779433:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1824 00000100:00100000:2.0:1787826375.779501:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836922 gen 2 00000004:00080000:2.0:1787826375.779506:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce0300cb40, transno 21474836919 00000004:00080000:2.0:1787826375.779516:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce0300de00, transno 21474836920 00000004:00080000:2.0:1787826375.779519:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf41c84b40, transno 21474836921 00000004:00080000:2.0:1787826375.779522:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf41c87c00, transno 21474836922 00000100:00100000:2.0:1787826375.779529:0:3646:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff90cf3abc30c0 x1874670585184384/t21474836931(21474836931) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1787826391 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1787826375.779540:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3abc30c0/2, rc 0, transno 21474836931 00000100:00100000:2.0:1787826375.779545:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3abc30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585184384:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1787826375.779556:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3fb95a40/2, rc 0, transno 21474836930 00000100:00100000:2.0:1787826375.779560:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3fb95a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585184256:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1787826375.779672:0:34500:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 2 in progress, 0 in flight, 4 done 00010000:00010000:0.0:1787826375.779999:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a838400/0x22153cd396b80520 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.780011:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a838400/0x22153cd396b80520 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.780020:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a838400/0x22153cd396b80520 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.780028:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a838400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826375.780034:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a838400/0x22153cd396b80520 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.780043:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a838400/0x22153cd396b80520 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.780064:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:0.0:1787826375.780067:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826375.780073:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a838400/0x22153cd396b80520 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.780081:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a838400/0x22153cd396b80520 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.786097:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7a00/0x22153cd396b804be lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.786120:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7a00/0x22153cd396b804be lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.786130:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7a00/0x22153cd396b804be lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.786138:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3abd7a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826375.786144:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7a00/0x22153cd396b804be lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.786154:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7a00/0x22153cd396b804be lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.786177:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:3.0:1787826375.786181:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826375.786187:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7a00/0x22153cd396b804be lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.786195:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7a00/0x22153cd396b804be lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.786214:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125a00/0x22153cd396b804da lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.786222:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125a00/0x22153cd396b804da lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.786233:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125a00/0x22153cd396b804da lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.786239:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05125a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826375.786242:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125a00/0x22153cd396b804da lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.786249:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125a00/0x22153cd396b804da lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.786257:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:3.0:1787826375.786260:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826375.786263:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125a00/0x22153cd396b804da lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.786270:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125a00/0x22153cd396b804da lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.786280:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401c00/0x22153cd396b804ef lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.786286:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401c00/0x22153cd396b804ef lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.786292:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401c00/0x22153cd396b804ef lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.786298:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826375.786301:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401c00/0x22153cd396b804ef lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.786312:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401c00/0x22153cd396b804ef lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.786320:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:3.0:1787826375.786323:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826375.786327:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401c00/0x22153cd396b804ef lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.786333:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401c00/0x22153cd396b804ef lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.786344:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125800/0x22153cd396b80504 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.786351:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125800/0x22153cd396b80504 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.786358:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125800/0x22153cd396b80504 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.786364:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05125800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826375.786366:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125800/0x22153cd396b80504 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.786373:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125800/0x22153cd396b80504 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.786380:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:3.0:1787826375.786383:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826375.786385:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125800/0x22153cd396b80504 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.786396:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125800/0x22153cd396b80504 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.786407:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b8050b lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.786413:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b8050b lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.786421:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b8050b lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.786426:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826375.786429:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b8050b lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.786435:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b8050b lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.786442:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:3.0:1787826375.786444:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826375.786447:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b8050b lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.786453:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b8050b lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826375.787005:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826375.787098:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563718144 00000100:00100000:2.0:1787826375.787111:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563718144 00000100:00100000:2.0:1787826375.787201:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3441 00000100:00100000:2.0:1787826375.787212:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:53034:x1874670563718144:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826375.787240:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826375.787262:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6400/0x22153cd396b80527 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab052a expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.787331:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6400/0x22153cd396b80527 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab052a expref: 20 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.787347:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6400/0x22153cd396b80527 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab052a expref: 20 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.787367:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:2.0:1787826375.787369:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826375.787373:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3abd6400, rc 0) 00000100:00100000:2.0:1787826375.787441:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:53034:x1874670563718144:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 231us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826375.787449:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3441 00000100:00100000:0.0:1787826375.790261:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826375.790344:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563718400 00000100:00100000:1.0:1787826375.790355:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563718400 00000100:00100000:1.0:1787826375.790420:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1010 00000100:00100000:1.0:1787826375.790430:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03984b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:53034:x1874670563718400:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:1.0:1787826375.790763:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03984b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:53034:x1874670563718400:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 333us (515us total) trans 8589934648 rc 0/0 00000100:00100000:1.0:1787826375.790774:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1010 00000100:00100000:3.0:1787826375.813227:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826375.813344:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563718656 00000100:00100000:2.0:1787826375.813357:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563718656 00000100:00100000:2.0:1787826375.813572:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3442 00000100:00100000:2.0:1787826375.813584:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce063061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:53036:x1874670563718656:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826375.813614:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826375.813746:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7000/0x22153cd396b8052e lrc: 2/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0531 expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.813895:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6a00/0x22153cd396b80535 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.813913:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6a00/0x22153cd396b80535 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.813928:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6a00/0x22153cd396b80535 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.813945:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6800/0x22153cd396b8053c lrc: 3/1,0 mode: --/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.813953:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6800/0x22153cd396b8053c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.813961:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6800/0x22153cd396b8053c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.814099:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7e00/0x22153cd396b80543 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.814110:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7e00/0x22153cd396b80543 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.814118:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7e00/0x22153cd396b80543 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826375.814129:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x14:0x0]: returning size 3700000 00010000:00010000:2.0:1787826375.814220:0:32404:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6a00/0x22153cd396b80535 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.814229:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6a00/0x22153cd396b80535 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.814236:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6a00/0x22153cd396b80535 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.814244:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6a00/0x22153cd396b80535 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.814251:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3abd6a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826375.814255:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6a00/0x22153cd396b80535 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.814263:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6a00/0x22153cd396b80535 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.814277:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0x0 (ffff90cf39e67500) 00010000:00010000:2.0:1787826375.814280:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826375.814285:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6a00/0x22153cd396b80535 lrc: 3/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.814293:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6a00/0x22153cd396b80535 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.814310:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6800/0x22153cd396b8053c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.814317:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6800/0x22153cd396b8053c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.814324:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6800/0x22153cd396b8053c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.814329:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3abd6800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826375.814332:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6800/0x22153cd396b8053c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.814337:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6800/0x22153cd396b8053c lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.814343:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0xe1e61496 (ffff90cf1859a600) 00010000:00010000:2.0:1787826375.814345:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826375.814348:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6800/0x22153cd396b8053c lrc: 2/0,0 mode: --/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.814354:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6800/0x22153cd396b8053c lrc: 0/0,0 mode: --/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.814400:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7000/0x22153cd396b8052e lrc: 0/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0531 expref: 24 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.814416:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7e00/0x22153cd396b80543 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0531 expref: 23 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.814431:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:2.0:1787826375.814434:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826375.814437:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3abd7e00, rc 0) 00000100:00100000:2.0:1787826375.814997:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce063061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+23:53036:x1874670563718656:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1412us (1781us total) trans 8589934649 rc 0/0 00000100:00100000:2.0:1787826375.815007:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3442 00000100:00100000:0.0:1787826375.858236:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826375.858285:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826375.858390:0:25426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563718784 00000100:00100000:1.0:1787826375.858403:0:25426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563718784 00000100:00100000:1.0:1787826375.858527:0:25426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563718912 00000100:00100000:1.0:1787826375.858531:0:25426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563718912 00000100:00100000:1.0:1787826375.858571:0:25426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 705 00000100:00100000:1.0:1787826375.858582:0:25426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce039870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2401:x1874670563718784:12345-192.168.203.39@tcp:3:lfs.0 00010000:00010000:1.0:1787826375.858642:0:25426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000028b46bd7/0x22153cd396b80551 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.858668:0:25426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000595c07c9/0x22153cd396b80512 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab051c expref: 16 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.858678:0:25426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x102:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826375.858683:0:25426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x102:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826375.858689:0:25426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028b46bd7/0x22153cd396b80551 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.858736:0:25426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000595c07c9/0x22153cd396b80512 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab051c expref: 16 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.858752:0:25426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000595c07c9/0x22153cd396b80512 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab051c expref: 16 pid: 28853 timeout: 1421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826375.858768:0:25426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0300cb40 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0001_UUID:25426:1874670585184512:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826375.858865:0:25426:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2069ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1787826375.859038:0:20692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 706 00000100:00100000:3.0:1787826375.859050:0:20692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03985e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2401:x1874670563718912:12345-192.168.203.39@tcp:3:lfs.0 00010000:00010000:3.0:1787826375.859072:0:20692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c3d097e2/0x22153cd396b80558 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.859086:0:20692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fa1d1988/0x22153cd396b80519 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0523 expref: 16 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.859094:0:20692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x103:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826375.859097:0:20692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x103:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826375.859101:0:20692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3d097e2/0x22153cd396b80558 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x103:0x0].0x0 rrc: 3 type: EXT [1048576->3702783] (req 1048576->3702783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.859122:0:20692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fa1d1988/0x22153cd396b80519 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0523 expref: 16 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.859132:0:20692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fa1d1988/0x22153cd396b80519 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0523 expref: 16 pid: 8437 timeout: 1421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826375.859142:0:20692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce06304780 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:20692:1874670585184640:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826375.859168:0:20692:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f5e7240 going to sleep for 11 seconds 00000100:00100000:2.0:1787826375.863154:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826375.863218:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826375.863329:0:20692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce06304780 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:20692:1874670585184640:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826375.863363:0:20692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c3d097e2/0x22153cd396b80558 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x103:0x0].0x0 rrc: 3 type: EXT [1048576->3702783] (req 1048576->3702783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826375.863450:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563719040 00000100:00100000:0.0:1787826375.863468:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563719040 00010000:00010000:0.0:1787826375.863558:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000595c07c9/0x22153cd396b80512 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab051c expref: 17 pid: 28853 timeout: 1421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826375.863588:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563719168 00000100:00100000:0.0:1787826375.863591:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563719168 00010000:00010000:0.0:1787826375.863602:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fa1d1988/0x22153cd396b80519 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0523 expref: 18 pid: 8437 timeout: 1421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826375.863733:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 976 00000100:00100000:0.0:1787826375.863745:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+18:2404:x1874670563719040:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826375.863764:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826375.863792:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000595c07c9/0x22153cd396b80512 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab051c expref: 18 pid: 28853 timeout: 1421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.863805:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000595c07c9/0x22153cd396b80512 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab051c expref: 18 pid: 28853 timeout: 1421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.863838:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x102:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826375.863843:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x102:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826375.863850:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000028b46bd7/0x22153cd396b80551 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x102:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.863867:0:10340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028b46bd7/0x22153cd396b80551 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x102:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.863887:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826375.863954:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+18:2404:x1874670563719040:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 211us (815us total) trans 0 rc 0/0 00010000:00010000:1.0:1787826375.864026:0:25426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000595c07c9/0x22153cd396b80512 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab051c expref: 18 pid: 28853 timeout: 1421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826375.864050:0:25426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0300cb40 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0001_UUID:25426:1874670585184512:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826375.864064:0:25426:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000028b46bd7/0x22153cd396b80551 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.864074:0:25426:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000028b46bd7/0x22153cd396b80551 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.864081:0:25426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028b46bd7/0x22153cd396b80551 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826375.866889:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 977 00000100:00100000:3.0:1787826375.866915:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+18:2404:x1874670563719168:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826375.866941:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826375.866973:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fa1d1988/0x22153cd396b80519 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0523 expref: 18 pid: 8437 timeout: 1421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.866994:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fa1d1988/0x22153cd396b80519 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0523 expref: 18 pid: 8437 timeout: 1421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.867023:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa1d1988/0x22153cd396b80519 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0523 expref: 18 pid: 8437 timeout: 1421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.867044:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x103:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826375.867049:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x103:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826375.867055:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c3d097e2/0x22153cd396b80558 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x103:0x0].0x0 rrc: 3 type: EXT [1048576->3702783] (req 1048576->3702783) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.867067:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3d097e2/0x22153cd396b80558 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x103:0x0].0x0 rrc: 3 type: EXT [1048576->3702783] (req 1048576->3702783) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.867098:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826375.867143:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+17:2404:x1874670563719168:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 241us (3925us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826375.867153:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 977 00010000:00010000:3.0:1787826375.867199:0:20692:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c3d097e2/0x22153cd396b80558 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [1048576->3702783] (req 1048576->3702783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826375.867209:0:20692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3d097e2/0x22153cd396b80558 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [1048576->3702783] (req 1048576->3702783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826375.867806:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 976 00010000:00010000:1.0:1787826375.912006:0:25426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000028b46bd7/0x22153cd396b80551 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.912033:0:25426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028b46bd7/0x22153cd396b80551 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.912044:0:25426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028b46bd7/0x22153cd396b80551 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.912053:0:25426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05124200 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:1.0:1787826375.912059:0:25426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028b46bd7/0x22153cd396b80551 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.912070:0:25426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028b46bd7/0x22153cd396b80551 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.912100:0:25426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028b46bd7/0x22153cd396b80551 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826375.912110:0:25426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028b46bd7/0x22153cd396b80551 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826375.912231:0:25426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce039870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2401:x1874670563718784:12345-192.168.203.39@tcp:3:lfs.0 Request processed in 53643us (54001us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1787826375.912245:0:25426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 705 00010000:00010000:2.0:1787826375.918617:0:20692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c3d097e2/0x22153cd396b80558 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [1048576->3702783] (req 1048576->3702783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.918657:0:20692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c3d097e2/0x22153cd396b80558 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [1048576->3702783] (req 1048576->3702783) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.918667:0:20692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c3d097e2/0x22153cd396b80558 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [1048576->3702783] (req 1048576->3702783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.918676:0:20692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401c00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826375.918682:0:20692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3d097e2/0x22153cd396b80558 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [1048576->3702783] (req 1048576->3702783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.918692:0:20692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3d097e2/0x22153cd396b80558 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [1048576->3702783] (req 1048576->3702783) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.918717:0:20692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c3d097e2/0x22153cd396b80558 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [1048576->3702783] (req 1048576->3702783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.918726:0:20692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3d097e2/0x22153cd396b80558 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [1048576->3702783] (req 1048576->3702783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826375.918863:0:20692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03985e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2401:x1874670563718912:12345-192.168.203.39@tcp:3:lfs.0 Request processed in 59808us (60569us total) trans 0 rc 2651424/2651424 00000100:00100000:2.0:1787826375.918876:0:20692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 706 00000100:00100000:0.0:1787826375.965210:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826375.965332:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563719296 00000100:00100000:2.0:1787826375.965345:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563719296 00000100:00100000:2.0:1787826375.965418:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1825 00000100:00100000:2.0:1787826375.965430:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce039843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2404:x1874670563719296:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826375.965454:0:14864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826375.965531:0:14864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb167c78/0x22153cd396b8055f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0538 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787826375.965569:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x102:0x0] initial LVB size: 1048576, mtime: 0x6a9010c7, atime: 0x6a9010c7, ctime: 0x6a9010c8, blocks: 0x8 00010000:00010000:2.0:1787826375.965594:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x102:0x0].0x0 since=1321s v=(0 0) 00010000:00010000:2.0:1787826375.965600:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x102:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826375.965614:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb167c78/0x22153cd396b8055f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0538 expref: 14 pid: 14864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.965650:0:14864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000eb167c78/0x22153cd396b8055f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0538 expref: 14 pid: 14864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826375.965666:0:14864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3abd7000, rc 0) 00000100:00100000:2.0:1787826375.965735:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce039843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563719296:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 306us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826375.965743:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1825 00000100:00100000:3.0:1787826375.969439:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826375.969616:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563719424 00000100:00100000:0.0:1787826375.969629:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563719424 00000100:00100000:0.0:1787826375.969711:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1826 00000100:00100000:0.0:1787826375.969723:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06304780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563719424:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826375.969747:0:8545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826375.969774:0:8545:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2cecd7f/0x22153cd396b80566 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab053f expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826375.969807:0:8545:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x103:0x0] initial LVB size: 3700000, mtime: 0x6a9010c7, atime: 0x6a9010c7, ctime: 0x6a9010c8, blocks: 0x28 00010000:00010000:0.0:1787826375.969834:0:8545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x103:0x0].0x0 since=1321s v=(0 0) 00010000:00010000:0.0:1787826375.969839:0:8545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x103:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826375.969852:0:8545:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2cecd7f/0x22153cd396b80566 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab053f expref: 15 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.969871:0:8545:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e2cecd7f/0x22153cd396b80566 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab053f expref: 15 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826375.969892:0:8545:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05661000, rc 0) 00000100:00100000:0.0:1787826375.970115:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06304780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2404:x1874670563719424:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 393us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826375.970124:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1826 00000100:00100000:0.0:1787826375.985464:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826375.985592:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563719680 00000100:00100000:1.0:1787826375.985612:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563719680 00000100:00100000:1.0:1787826375.985821:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1011 00000100:00100000:1.0:1787826375.985832:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf10474850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+23:53036:x1874670563719680:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:1.0:1787826375.986197:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf10474850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:53036:x1874670563719680:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 365us (755us total) trans 8589934650 rc 0/0 00000100:00100000:1.0:1787826375.986205:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1011 00010000:00010000:0.0:1787826376.004139:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826376.017766:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826376.017931:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563719936 00000100:00100000:0.0:1787826376.017944:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563719936 00000100:00100000:0.0:1787826376.018027:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3443 00000100:00100000:0.0:1787826376.018039:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:53039:x1874670563719936:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826376.018070:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826376.018097:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661e00/0x22153cd396b8056d lrc: 2/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0546 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.018252:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660400/0x22153cd396b80574 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.018276:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660400/0x22153cd396b80574 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.018290:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660400/0x22153cd396b80574 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826376.018303:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x14:0x0]: returning size 3700000 00010000:00010000:0.0:1787826376.018439:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661e00/0x22153cd396b8056d lrc: 0/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0546 expref: 27 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.018542:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660400/0x22153cd396b80574 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0546 expref: 26 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.018554:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:0.0:1787826376.018557:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787826376.018562:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05660400, rc 0) 00000100:00100000:0.0:1787826376.018653:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:53039:x1874670563719936:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 615us (902us total) trans 8589934651 rc 0/0 00000100:00100000:0.0:1787826376.018661:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3443 00000100:00100000:3.0:1787826376.057734:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826376.057930:0:25425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563720064 00000100:00100000:1.0:1787826376.057945:0:25425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563720064 00000100:00100000:1.0:1787826376.058052:0:25425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 707 00000100:00100000:1.0:1787826376.058063:0:25425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06306940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2401:x1874670563720064:12345-192.168.203.39@tcp:3:lfs.0 00010000:00010000:1.0:1787826376.058107:0:25425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000028b46bd7/0x22153cd396b80582 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.058131:0:25425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e42b1469/0x22153cd396b804b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1069056->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04f9 expref: 12 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.058150:0:25425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x102:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787826376.058156:0:25425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x102:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826376.058161:0:25425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028b46bd7/0x22153cd396b80582 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.058204:0:25425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e42b1469/0x22153cd396b804b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1069056->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04f9 expref: 12 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.058225:0:25425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e42b1469/0x22153cd396b804b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1069056->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04f9 expref: 12 pid: 8436 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826376.058244:0:25425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0300fc00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0000_UUID:25425:1874670585184768:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826376.059059:0:25425:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2069f480 going to sleep for 11 seconds 00000100:00100000:2.0:1787826376.061421:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826376.061579:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826376.061698:0:25425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0300fc00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0000_UUID:25425:1874670585184768:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826376.061734:0:25425:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000028b46bd7/0x22153cd396b80582 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826376.061917:0:25424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563720192 00000100:00100000:1.0:1787826376.061927:0:25424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563720192 00000100:00100000:1.0:1787826376.062017:0:25424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 708 00000100:00100000:1.0:1787826376.062028:0:25424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2402:x1874670563720192:12345-192.168.203.39@tcp:3:lfs.0 00010000:00010000:1.0:1787826376.062069:0:25424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a3adc48c/0x22153cd396b80589 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.062089:0:25424:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000086914dcf/0x22153cd396b804c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0500 expref: 13 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.062099:0:25424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x103:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787826376.062106:0:25424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x103:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826376.062112:0:25424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3adc48c/0x22153cd396b80589 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [2097152->3702783] (req 2097152->3702783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.062163:0:25424:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000086914dcf/0x22153cd396b804c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0500 expref: 13 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.062179:0:25424:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000086914dcf/0x22153cd396b804c5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0500 expref: 13 pid: 30696 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826376.062196:0:25424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0300cb40 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_007:lustre-OST0000_UUID:25424:1874670585184896:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826376.062295:0:25424:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2069f480 going to sleep for 11 seconds 00000100:00100000:3.0:1787826376.062554:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563720320 00000100:00100000:3.0:1787826376.062561:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563720320 00010000:00010000:3.0:1787826376.062589:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e42b1469/0x22153cd396b804b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1069056->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04f9 expref: 14 pid: 8436 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826376.062627:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 978 00000100:00100000:3.0:1787826376.062635:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf076da450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2403:x1874670563720320:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826376.064197:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826376.064234:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e42b1469/0x22153cd396b804b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1069056->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04f9 expref: 14 pid: 8436 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.064255:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e42b1469/0x22153cd396b804b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1069056->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04f9 expref: 14 pid: 8436 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.064284:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e42b1469/0x22153cd396b804b7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x102:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1069056->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab04f9 expref: 14 pid: 8436 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.064307:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x102:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826376.064312:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x102:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826376.064319:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000028b46bd7/0x22153cd396b80582 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.064332:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028b46bd7/0x22153cd396b80582 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.064811:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826376.064882:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf076da450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2403:x1874670563720320:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 2245us (3301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826376.064893:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 978 00010000:00010000:0.0:1787826376.065431:0:25425:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000028b46bd7/0x22153cd396b80582 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.065446:0:25425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028b46bd7/0x22153cd396b80582 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826376.068713:0:25424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0300cb40 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_007:lustre-OST0000_UUID:25424:1874670585184896:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826376.068811:0:25424:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a3adc48c/0x22153cd396b80589 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [2097152->3702783] (req 2097152->3702783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826376.070010:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826376.071862:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563720448 00000100:00100000:1.0:1787826376.071879:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563720448 00010000:00010000:1.0:1787826376.071988:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000086914dcf/0x22153cd396b804c5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0500 expref: 14 pid: 30696 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826376.072043:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 979 00000100:00100000:1.0:1787826376.072054:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563720448:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826376.072083:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826376.072244:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000086914dcf/0x22153cd396b804c5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0500 expref: 14 pid: 30696 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.072264:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000086914dcf/0x22153cd396b804c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0500 expref: 14 pid: 30696 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.072368:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086914dcf/0x22153cd396b804c5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x103:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0500 expref: 14 pid: 30696 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.072390:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x103:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826376.072395:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x103:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826376.072402:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a3adc48c/0x22153cd396b80589 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [2097152->3702783] (req 2097152->3702783) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.072415:0:10340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3adc48c/0x22153cd396b80589 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [2097152->3702783] (req 2097152->3702783) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.072453:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826376.072513:0:25424:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a3adc48c/0x22153cd396b80589 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [2097152->3702783] (req 2097152->3702783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.072527:0:25424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a3adc48c/0x22153cd396b80589 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [2097152->3702783] (req 2097152->3702783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826376.072538:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2404:x1874670563720448:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 484us (2534us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826376.072552:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 979 00010000:00010000:0.0:1787826376.090860:0:25425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000028b46bd7/0x22153cd396b80582 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.090888:0:25425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028b46bd7/0x22153cd396b80582 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.090897:0:25425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028b46bd7/0x22153cd396b80582 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.090906:0:25425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05124200 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826376.090912:0:25425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028b46bd7/0x22153cd396b80582 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.090922:0:25425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028b46bd7/0x22153cd396b80582 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.090945:0:25425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028b46bd7/0x22153cd396b80582 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.090953:0:25425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028b46bd7/0x22153cd396b80582 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826376.091119:0:25425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06306940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2401:x1874670563720064:12345-192.168.203.39@tcp:3:lfs.0 Request processed in 33050us (33394us total) trans 0 rc 1069056/1069056 00000100:00100000:0.0:1787826376.091132:0:25425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 707 00010000:00010000:0.0:1787826376.103680:0:25424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a3adc48c/0x22153cd396b80589 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [2097152->3702783] (req 2097152->3702783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.103710:0:25424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a3adc48c/0x22153cd396b80589 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [2097152->3702783] (req 2097152->3702783) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.103720:0:25424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a3adc48c/0x22153cd396b80589 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [2097152->3702783] (req 2097152->3702783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.103729:0:25424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05125800 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826376.103735:0:25424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3adc48c/0x22153cd396b80589 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [2097152->3702783] (req 2097152->3702783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.103747:0:25424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3adc48c/0x22153cd396b80589 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [2097152->3702783] (req 2097152->3702783) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.103772:0:25424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a3adc48c/0x22153cd396b80589 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [2097152->3702783] (req 2097152->3702783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.103781:0:25424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3adc48c/0x22153cd396b80589 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [2097152->3702783] (req 2097152->3702783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826376.103966:0:25424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2402:x1874670563720192:12345-192.168.203.39@tcp:3:lfs.0 Request processed in 41932us (42551us total) trans 0 rc 1602848/1602848 00000100:00100000:0.0:1787826376.103979:0:25424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 708 00000100:00100000:3.0:1787826376.153298:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826376.153354:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826376.153525:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563720576 00000100:00100000:2.0:1787826376.153538:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563720576 00000100:00100000:2.0:1787826376.153607:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563720704 00000100:00100000:2.0:1787826376.153610:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563720704 00000100:00100000:2.0:1787826376.153655:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1827 00000100:00100000:2.0:1787826376.153666:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06304b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2403:x1874670563720576:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826376.153689:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826376.153716:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000979bdcbe/0x22153cd396b80590 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab054d expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787826376.153749:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x102:0x0] initial LVB size: 1069056, mtime: 0x6a9010c8, atime: 0x0, ctime: 0x6a9010c8, blocks: 0x30 00010000:00010000:2.0:1787826376.153776:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x102:0x0].0x0 since=1322s v=(0 0) 00010000:00010000:2.0:1787826376.153782:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x102:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826376.153796:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000979bdcbe/0x22153cd396b80590 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab054d expref: 12 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.153818:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000979bdcbe/0x22153cd396b80590 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab054d expref: 12 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.153833:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0b55c600, rc 0) 00000100:00100000:2.0:1787826376.154027:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06304b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563720576:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 362us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826376.154035:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1827 00000100:00100000:2.0:1787826376.154057:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1828 00000100:00100000:2.0:1787826376.154064:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06306d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2403:x1874670563720704:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826376.154071:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826376.154083:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089ccfe43/0x22153cd396b80597 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0554 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787826376.154097:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x103:0x0] initial LVB size: 3700000, mtime: 0x6a9010c8, atime: 0x0, ctime: 0x6a9010c8, blocks: 0x0 00010000:00010000:2.0:1787826376.154105:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x103:0x0].0x0 since=1322s v=(0 0) 00010000:00010000:2.0:1787826376.154109:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x103:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826376.154117:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089ccfe43/0x22153cd396b80597 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0554 expref: 12 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.154131:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000089ccfe43/0x22153cd396b80597 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0554 expref: 12 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.154139:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0b55ce00, rc 0) 00000100:00100000:2.0:1787826376.154160:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06306d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563720704:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 97us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826376.154165:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1828 00000100:00100000:2.0:1787826376.190687:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826376.191060:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826376.191715:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563720832 00000100:00100000:1.0:1787826376.191729:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563720832 00000100:00100000:3.0:1787826376.191976:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563720960 00000100:00100000:3.0:1787826376.191981:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563720960 00000100:00100000:3.0:1787826376.192039:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 341 00000100:00100000:3.0:1787826376.192051:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:42221:x1874670563720832:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826376.192072:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1787826376.192125:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089ccfe43/0x22153cd396b80597 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0554 expref: 12 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.192168:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000979bdcbe/0x22153cd396b80590 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab054d expref: 11 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.192181:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826376.192261:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:42221:x1874670563720832:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 212us (1588us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826376.192270:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 341 00000100:00100000:3.0:1787826376.192291:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 342 00000100:00100000:3.0:1787826376.192297:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:49796:x1874670563720960:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826376.192306:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1787826376.192329:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2cecd7f/0x22153cd396b80566 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab053f expref: 15 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.192357:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb167c78/0x22153cd396b8055f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0538 expref: 14 pid: 14864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.192370:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826376.192391:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:49796:x1874670563720960:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 93us (1331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826376.192398:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 342 00000100:00100000:2.0:1787826376.243442:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826376.244204:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563721216 00000100:00100000:0.0:1787826376.244219:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563721216 00000100:00100000:0.0:1787826376.244293:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3444 00000100:00100000:0.0:1787826376.244305:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:53047:x1874670563721216:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826376.244341:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826376.244371:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661e00/0x22153cd396b8059e lrc: 2/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab055b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.244578:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661200/0x22153cd396b805a5 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.244597:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7e00/0x22153cd396b80543 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0531 expref: 27 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.244606:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661200/0x22153cd396b805a5 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x14:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.244667:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7e00/0x22153cd396b80543 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0531 expref: 27 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.244683:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7e00/0x22153cd396b80543 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0531 expref: 27 pid: 32404 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826376.244708:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03985a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1874670585185024:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826376.244883:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf09f7da80 going to sleep for 11 seconds 00000100:00100000:2.0:1787826376.251095:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826376.251311:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563721344 00000100:00100000:1.0:1787826376.251324:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563721344 00010000:00010000:1.0:1787826376.251385:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7e00/0x22153cd396b80543 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0531 expref: 28 pid: 32404 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826376.251436:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 980 00000100:00100000:1.0:1787826376.251449:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+28:2403:x1874670563721344:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826376.251540:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826376.251550:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7e00/0x22153cd396b80543 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0531 expref: 28 pid: 32404 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.251565:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7e00/0x22153cd396b80543 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0531 expref: 28 pid: 32404 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.251596:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:1.0:1787826376.251602:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661200/0x22153cd396b805a5 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x14:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.251614:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661200/0x22153cd396b805a5 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x14:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.251622:0:10340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661200/0x22153cd396b805a5 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x14:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.251656:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826376.251732:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+28:2403:x1874670563721344:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 284us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826376.251740:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 980 00010000:00010000:0.0:1787826376.252377:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd7e00/0x22153cd396b80543 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0531 expref: 27 pid: 32404 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826376.252401:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03985a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1874670585185024:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826376.252429:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661200/0x22153cd396b805a5 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x14:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.252445:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661200/0x22153cd396b805a5 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x14:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.252451:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661200/0x22153cd396b805a5 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x14:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826376.252538:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x14:0x0]: returning size 3700000 00010000:00010000:0.0:1787826376.252732:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661e00/0x22153cd396b8059e lrc: 0/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab055b expref: 28 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.252750:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661200/0x22153cd396b805a5 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x14:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab055b expref: 27 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.252759:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:0.0:1787826376.252763:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787826376.252766:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05661200, rc 0) 00000100:00100000:0.0:1787826376.252832:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:53047:x1874670563721216:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 8528us (9404us total) trans 8589934652 rc 0/0 00000100:00100000:0.0:1787826376.252841:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3444 00000100:00100000:2.0:1787826376.258234:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826376.258570:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563721472 00000100:00100000:1.0:1787826376.258584:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563721472 00000100:00100000:2.0:1787826376.258911:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3445 00000100:00100000:2.0:1787826376.258926:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:53047:x1874670563721472:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826376.258958:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826376.258987:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d200/0x22153cd396b805b3 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0562 expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.259262:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c800/0x22153cd396b805ba lrc: 3/1,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.259280:0:9966:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661200/0x22153cd396b805a5 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x14:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab055b expref: 28 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.259290:0:9966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c800/0x22153cd396b805ba lrc: 4/1,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.259336:0:9966:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661200/0x22153cd396b805a5 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x14:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab055b expref: 28 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.259352:0:9966:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661200/0x22153cd396b805a5 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x14:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab055b expref: 28 pid: 6519 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826376.259369:0:9966:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf41c87840 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9966:1874670585185152:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826376.260295:0:9966:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce05b569c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826376.264569:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826376.264671:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563721600 00000100:00100000:0.0:1787826376.264683:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563721600 00010000:00010000:0.0:1787826376.264739:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661200/0x22153cd396b805a5 lrc: 5/0,0 mode: CW/CW res: [0x200000405:0x14:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab055b expref: 29 pid: 6519 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826376.264793:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 981 00000100:00100000:0.0:1787826376.264805:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c84b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+29:2404:x1874670563721600:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826376.264827:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826376.264838:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661200/0x22153cd396b805a5 lrc: 5/0,0 mode: CW/CW res: [0x200000405:0x14:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab055b expref: 29 pid: 6519 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.264853:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661200/0x22153cd396b805a5 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x14:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab055b expref: 29 pid: 6519 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.264885:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:0.0:1787826376.264892:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c800/0x22153cd396b805ba lrc: 3/1,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.264915:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c800/0x22153cd396b805ba lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.264925:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c800/0x22153cd396b805ba lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.264950:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826376.265024:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c84b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+29:2404:x1874670563721600:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 220us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826376.265033:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 981 00010000:00010000:1.0:1787826376.266369:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661200/0x22153cd396b805a5 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x14:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab055b expref: 28 pid: 6519 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826376.266397:0:9966:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf41c87840 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9966:1874670585185152:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826376.266426:0:9966:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c800/0x22153cd396b805ba lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.266437:0:9966:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c800/0x22153cd396b805ba lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.266443:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c800/0x22153cd396b805ba lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826376.266568:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x14:0x0]: returning size 3700000 00000004:00200000:1.0:1787826376.266574:0:9966:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826376.266601:0:9966:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c800/0x22153cd396b805ba lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.266805:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d200/0x22153cd396b805b3 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0562 expref: 28 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.266825:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c800/0x22153cd396b805ba lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0562 expref: 27 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.266836:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:1.0:1787826376.266839:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826376.266843:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0b55c800, rc 0) 00000100:00100000:1.0:1787826376.267015:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:53047:x1874670563721472:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 8093us (8797us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826376.267025:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3445 00000100:00100000:2.0:1787826376.272252:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826376.272309:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826376.273197:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563721728 00000100:00100000:1.0:1787826376.273212:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563721728 00000100:00100000:1.0:1787826376.273284:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563721856 00000100:00100000:1.0:1787826376.273288:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563721856 00000100:00100000:1.0:1787826376.273324:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1829 00000100:00100000:1.0:1787826376.273335:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c87c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2403:x1874670563721728:12345-192.168.203.39@tcp:1:lfs.0 00002000:00010000:1.0:1787826376.273415:0:30696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x102:0x0] initial LVB size: 1048576, mtime: 0x6a9010c7, atime: 0x6a9010c7, ctime: 0x6a9010c8, blocks: 0x8 00010000:00010000:1.0:1787826376.273427:0:30696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086914dcf/0x22153cd396b805c1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.273447:0:30696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x102:0x0].0x0 since=1322s v=(0 0) 00010000:00010000:1.0:1787826376.273452:0:30696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x102:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826376.273494:0:30696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086914dcf/0x22153cd396b805c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.273511:0:30696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000086914dcf/0x22153cd396b805c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.273532:0:30696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086914dcf/0x22153cd396b805c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.273541:0:30696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000086914dcf/0x22153cd396b805c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.273549:0:30696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000086914dcf/0x22153cd396b805c1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.273556:0:30696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05124e00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:1.0:1787826376.273561:0:30696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000086914dcf/0x22153cd396b805c1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.273570:0:30696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000086914dcf/0x22153cd396b805c1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.273589:0:30696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000086914dcf/0x22153cd396b805c1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.273599:0:30696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000086914dcf/0x22153cd396b805c1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826376.273951:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1830 00000100:00100000:2.0:1787826376.273964:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c87840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2403:x1874670563721856:12345-192.168.203.39@tcp:1:lfs.0 00002000:00010000:2.0:1787826376.273996:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x103:0x0] initial LVB size: 3700000, mtime: 0x6a9010c7, atime: 0x6a9010c7, ctime: 0x6a9010c8, blocks: 0x28 00010000:00010000:2.0:1787826376.274002:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa735346/0x22153cd396b805c8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.274012:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x103:0x0].0x0 since=1322s v=(0 0) 00010000:00010000:2.0:1787826376.274015:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x103:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826376.274020:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa735346/0x22153cd396b805c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.274031:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa735346/0x22153cd396b805c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.274043:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa735346/0x22153cd396b805c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.274051:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aa735346/0x22153cd396b805c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.274059:0:14864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aa735346/0x22153cd396b805c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.274067:0:14864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0b55d600 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826376.274069:0:14864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa735346/0x22153cd396b805c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.274093:0:14864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa735346/0x22153cd396b805c8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.274105:0:14864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aa735346/0x22153cd396b805c8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.274112:0:14864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa735346/0x22153cd396b805c8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826376.274407:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c87c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2403:x1874670563721728:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 1072us (2171us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826376.274416:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1829 00000100:00100000:2.0:1787826376.276213:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c87840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2403:x1874670563721856:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 2241us (3892us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826376.276226:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1830 00000100:00100000:2.0:1787826376.283338:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826376.283982:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563722112 00000100:00100000:3.0:1787826376.283997:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563722112 00000100:00100000:3.0:1787826376.284532:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3446 00000100:00100000:3.0:1787826376.284549:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:53047:x1874670563722112:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:3.0:1787826376.284645:0:32404:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826376.284695:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b8038a lrc: 0/0,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab047b expref: 27 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.284718:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:3.0:1787826376.284725:0:32404:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826376.284770:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b805cf lrc: 3/0,1 mode: --/EX res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.284786:0:32404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c800/0x22153cd396b805ba lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0562 expref: 26 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.284795:0:32404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6400/0x22153cd396b80527 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab052a expref: 26 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.284805:0:32404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660400/0x22153cd396b80574 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0546 expref: 26 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.284813:0:32404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b805cf lrc: 6/0,1 mode: --/EX res: [0x200000405:0x14:0x0].0x0 bits 0x2a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.284855:0:32404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660400/0x22153cd396b80574 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0546 expref: 26 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.284872:0:32404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660400/0x22153cd396b80574 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0546 expref: 26 pid: 6520 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826376.284890:0:32404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce06305e00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:32404:1874670585185280:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826376.285237:0:32404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6400/0x22153cd396b80527 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab052a expref: 26 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.285249:0:32404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6400/0x22153cd396b80527 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab052a expref: 26 pid: 8247 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826376.285258:0:32404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce06304000 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:32404:1874670585185408:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826376.285295:0:32404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c800/0x22153cd396b805ba lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0562 expref: 26 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.285305:0:32404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c800/0x22153cd396b805ba lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0562 expref: 26 pid: 9966 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826376.285320:0:32404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce063070c0 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:32404:1874670585185536:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826376.285346:0:32404:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f5e76c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826376.291396:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826376.291433:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826376.291516:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563722496 00000100:00100000:3.0:1787826376.291528:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563722496 00010000:00010000:3.0:1787826376.291585:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6400/0x22153cd396b80527 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab052a expref: 27 pid: 8247 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826376.291630:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 982 00000100:00100000:3.0:1787826376.291653:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06307c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:2404:x1874670563722496:12345-192.168.203.39@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787826376.291790:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563722368 00000100:00100000:1.0:1787826376.291795:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563722368 00000100:00100000:1.0:1787826376.291833:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1012 00000100:00100000:1.0:1787826376.291841:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06304f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+28:49796:x1874670563722368:12345-192.168.203.39@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787826376.292385:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06304f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+29:49796:x1874670563722368:12345-192.168.203.39@tcp:35:ldlm_bl.0 Request processed in 542us (1001us total) trans 8589934653 rc 0/0 00000100:00100000:1.0:1787826376.292394:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1012 00010000:00010000:3.0:1787826376.292530:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826376.292541:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6400/0x22153cd396b80527 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab052a expref: 28 pid: 8247 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.292557:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6400/0x22153cd396b80527 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab052a expref: 28 pid: 8247 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.292588:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:3.0:1787826376.292595:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b805cf lrc: 3/0,1 mode: --/EX res: [0x200000405:0x14:0x0].0x0 bits 0x2a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.292606:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b805cf lrc: 3/0,1 mode: --/EX res: [0x200000405:0x14:0x0].0x0 bits 0x2a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.292612:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b805cf lrc: 3/0,1 mode: --/EX res: [0x200000405:0x14:0x0].0x0 bits 0x2a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.292621:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826376.292641:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06307c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+28:2404:x1874670563722496:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 992us (1207us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826376.292650:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 982 00000100:00100000:2.0:1787826376.293212:0:32404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce06305e00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:32404:1874670585185280:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826376.293228:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3abd6400/0x22153cd396b80527 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab052a expref: 28 pid: 8247 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826376.293246:0:32404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce06304000 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:32404:1874670585185408:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826376.293255:0:32404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce063070c0 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:32404:1874670585185536:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826376.293286:0:32404:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b805cf lrc: 3/0,1 mode: --/EX res: [0x200000405:0x14:0x0].0x0 bits 0x2a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826376.293357:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826376.293604:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563722624 00000100:00100000:3.0:1787826376.293611:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563722624 00010000:00010000:3.0:1787826376.293644:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c800/0x22153cd396b805ba lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0562 expref: 27 pid: 9966 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826376.295535:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 983 00000100:00100000:3.0:1787826376.295566:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf076da850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:2404:x1874670563722624:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826376.295592:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826376.295605:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c800/0x22153cd396b805ba lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0562 expref: 27 pid: 9966 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.295622:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c800/0x22153cd396b805ba lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0562 expref: 27 pid: 9966 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.295649:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c800/0x22153cd396b805ba lrc: 0/0,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0562 expref: 27 pid: 9966 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.295680:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:3.0:1787826376.295686:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b805cf lrc: 3/0,1 mode: --/EX res: [0x200000405:0x14:0x0].0x0 bits 0x2a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.295694:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b805cf lrc: 3/0,1 mode: --/EX res: [0x200000405:0x14:0x0].0x0 bits 0x2a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.295702:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b805cf lrc: 3/0,1 mode: --/EX res: [0x200000405:0x14:0x0].0x0 bits 0x2a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.295709:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826376.295796:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf076da850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:2404:x1874670563722624:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 246us (2438us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826376.295805:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 983 00000100:00100000:2.0:1787826376.300655:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826376.301241:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563722752 00000100:00100000:0.0:1787826376.301254:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563722752 00010000:00010000:0.0:1787826376.301307:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660400/0x22153cd396b80574 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0546 expref: 26 pid: 6520 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826376.301352:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 984 00000100:00100000:0.0:1787826376.301361:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:2404:x1874670563722752:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826376.301380:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826376.301388:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660400/0x22153cd396b80574 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0546 expref: 26 pid: 6520 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.301404:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660400/0x22153cd396b80574 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0546 expref: 26 pid: 6520 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.301433:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660400/0x22153cd396b80574 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0546 expref: 26 pid: 6520 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.301450:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:0.0:1787826376.301492:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b805cf lrc: 3/0,1 mode: --/EX res: [0x200000405:0x14:0x0].0x0 bits 0x2a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.301504:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b805cf lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0x2a/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.301513:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b805cf lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0x2a/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.301543:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826376.301611:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:2404:x1874670563722752:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 250us (981us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826376.301619:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 984 00010000:00010000:2.0:1787826376.302697:0:32404:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b805cf lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0x2a/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.302713:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b805cf lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0x2a/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826376.303019:0:32404:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000073b877ec reply state 000000006efc6f38 transno 8589934654 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b805cf lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0x2a/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.303040:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b805cf lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2a/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.303049:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:2.0:1787826376.303052:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2a 00000100:00100000:2.0:1787826376.303056:0:32404:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826376.303186:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:53047:x1874670563722112:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 18639us (19859us total) trans 8589934654 rc 0/0 00000100:00100000:2.0:1787826376.303196:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3446 00000100:00100000:2.0:1787826376.311580:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826376.312038:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563723008 00000100:00100000:0.0:1787826376.312051:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563723008 00000100:00100000:0.0:1787826376.312250:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1013 00000100:00100000:0.0:1787826376.312264:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:53047:x1874670563723008:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:0.0:1787826376.312649:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:53047:x1874670563723008:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 386us (1081us total) trans 8589934655 rc 0/0 00000100:00100000:0.0:1787826376.312658:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1013 00000100:00100000:1.0:1787826376.328321:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826376.329209:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563723136 00000100:00100000:2.0:1787826376.329225:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563723136 00000100:00100000:2.0:1787826376.329359:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3447 00000100:00100000:2.0:1787826376.329372:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:53048:x1874670563723136:12345-192.168.203.39@tcp:101:truncate.0 00010000:00010000:2.0:1787826376.329405:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826376.329434:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c000/0x22153cd396b805d6 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0569 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.329570:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55de00/0x22153cd396b805dd lrc: 3/1,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.329597:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55de00/0x22153cd396b805dd lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.329611:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55de00/0x22153cd396b805dd lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.329630:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55ca00/0x22153cd396b805e4 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.329647:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55ca00/0x22153cd396b805e4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.329655:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55ca00/0x22153cd396b805e4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.332006:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c400/0x22153cd396b805eb lrc: 3/1,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.332040:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c400/0x22153cd396b805eb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.332055:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c400/0x22153cd396b805eb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826376.333266:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x14:0x0]: returning size 3700000 00000004:00200000:2.0:1787826376.333277:0:16564:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826376.333313:0:16564:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c400/0x22153cd396b805eb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.333333:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c400/0x22153cd396b805eb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.333349:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55de00/0x22153cd396b805dd lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.333355:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55de00/0x22153cd396b805dd lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.333363:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55de00/0x22153cd396b805dd lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.333369:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0b55de00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826376.333374:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55de00/0x22153cd396b805dd lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.333382:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55de00/0x22153cd396b805dd lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.333400:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0x0 (ffff90cf39e67500) 00010000:00010000:2.0:1787826376.333404:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826376.333409:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55de00/0x22153cd396b805dd lrc: 2/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.333416:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55de00/0x22153cd396b805dd lrc: 0/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.333436:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55ca00/0x22153cd396b805e4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.333442:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55ca00/0x22153cd396b805e4 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.333448:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55ca00/0x22153cd396b805e4 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.333467:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0b55ca00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826376.335242:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55ca00/0x22153cd396b805e4 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.335269:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55ca00/0x22153cd396b805e4 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.335290:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0xe1e61496 (ffff90cf1859a200) 00010000:00010000:2.0:1787826376.335293:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826376.335299:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55ca00/0x22153cd396b805e4 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.335306:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55ca00/0x22153cd396b805e4 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.335385:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c000/0x22153cd396b805d6 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0569 expref: 29 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.335403:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c400/0x22153cd396b805eb lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0569 expref: 28 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.335412:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:2.0:1787826376.335415:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826376.335418:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0b55c400, rc 0) 00000100:00100000:2.0:1787826376.335563:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+28:53048:x1874670563723136:12345-192.168.203.39@tcp:101:truncate.0 Request processed in 6192us (7257us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826376.335574:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3447 00000100:00100000:2.0:1787826376.344683:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826376.345563:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563723264 00000100:00100000:0.0:1787826376.345579:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563723264 00000100:00100000:0.0:1787826376.345734:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3448 00000100:00100000:0.0:1787826376.345755:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+28:53048:x1874670563723264:12345-192.168.203.39@tcp:101:truncate.0 00010000:00010000:0.0:1787826376.346202:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826376.346235:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660800/0x22153cd396b805f2 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0570 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.346280:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661e00/0x22153cd396b805f9 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.346296:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661e00/0x22153cd396b805f9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.346309:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661e00/0x22153cd396b805f9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.347431:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660800/0x22153cd396b805f2 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0570 expref: 30 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.348165:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661e00/0x22153cd396b805f9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0570 expref: 29 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.348181:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:0.0:1787826376.348185:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787826376.348190:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05661e00, rc 0) 00000100:00100000:0.0:1787826376.348371:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+29:53048:x1874670563723264:12345-192.168.203.39@tcp:101:truncate.0 Request processed in 2616us (3704us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826376.348382:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3448 00000100:00100000:0.0:1787826376.353204:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826376.353369:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563723520 00000100:00100000:1.0:1787826376.353382:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563723520 00000100:00100000:1.0:1787826376.353466:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3449 00000100:00100000:1.0:1787826376.353518:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03985a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+29:53048:x1874670563723520:12345-192.168.203.39@tcp:36:truncate.0 00010000:00010000:1.0:1787826376.353596:0:9966:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826376.353636:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c400/0x22153cd396b805eb lrc: 0/0,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0569 expref: 29 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.353668:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:1.0:1787826376.353675:0:9966:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826376.354187:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125a00/0x22153cd396b80600 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.354208:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125a00/0x22153cd396b80600 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.354220:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125a00/0x22153cd396b80600 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787826376.354277:0:9966:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934656 00000004:00010000:1.0:1787826376.354307:0:9966:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005e793979 reply state 0000000037f558d6 transno 8589934657 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125a00/0x22153cd396b80600 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.354321:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125a00/0x22153cd396b80600 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.354328:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:1.0:1787826376.354331:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826376.354334:0:9966:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826376.354506:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03985a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:53048:x1874670563723520:12345-192.168.203.39@tcp:36:truncate.0 Request processed in 958us (1284us total) trans 8589934657 rc 0/0 00000100:00100000:1.0:1787826376.354516:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3449 00000020:00080000:1.0:1787826376.354522:0:9966:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787826376.358398:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826376.358566:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563723648 00000100:00100000:3.0:1787826376.358579:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563723648 00000100:00100000:3.0:1787826376.358849:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3450 00000100:00100000:3.0:1787826376.358862:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:53048:x1874670563723648:12345-192.168.203.39@tcp:101:truncate.0 00010000:00010000:3.0:1787826376.358894:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826376.358933:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b80607 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0577 expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.359008:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b80607 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0577 expref: 32 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.359025:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b80607 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0577 expref: 32 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.359046:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:3.0:1787826376.359050:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826376.359053:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401e00, rc 0) 00000100:00100000:3.0:1787826376.359139:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+32:53048:x1874670563723648:12345-192.168.203.39@tcp:101:truncate.0 Request processed in 280us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826376.359149:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3450 00000100:00100000:3.0:1787826376.363589:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826376.363790:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563723904 00000100:00100000:0.0:1787826376.363803:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563723904 00000100:00100000:0.0:1787826376.363873:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3451 00000100:00100000:0.0:1787826376.363885:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06307c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+32:53048:x1874670563723904:12345-192.168.203.39@tcp:101:truncate.0 00010000:00010000:0.0:1787826376.363922:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826376.363926:0:16564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787826376.363966:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b80607 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0577 expref: 32 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.363991:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:0.0:1787826376.363998:0:16564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826376.364016:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661000/0x22153cd396b8060e lrc: 2/0,0 mode: --/EX res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab057e expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.364095:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660c00/0x22153cd396b80615 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.364114:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660c00/0x22153cd396b80615 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.364125:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660c00/0x22153cd396b80615 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787826376.364435:0:16564:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].9, 88 off8960 00000004:00080000:0.0:1787826376.364447:0:16564:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1322375975154ns, next at 0ns, rc = 0 00000040:00080000:0.0:1787826376.364514:0:16564:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].10, 88 off9048 00000004:00080000:0.0:1787826376.364520:0:16564:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1322376048157ns, next at 0ns, rc = 0 00000040:00080000:0.0:1787826376.364538:0:16564:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].9, 88 off8936 00000004:00080000:0.0:1787826376.364546:0:16564:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1322376073872ns, next at 1309127889395ns, rc = 0 00000040:00080000:0.0:1787826376.364562:0:16564:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].10, 88 off9024 00000004:00080000:0.0:1787826376.364567:0:16564:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1322376095070ns, next at 1309127889395ns, rc = 0 00000001:00080000:2.0:1787826376.367895:0:34481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934658 is committed 00000004:00080000:2.0:1787826376.367925:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 11 committed 00000004:00080000:2.0:1787826376.367947:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 10 committed 00000004:00080000:2.0:1787826376.367950:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 10 committed 00000004:00080000:2.0:1787826376.367995:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000100:00100000:3.0:1787826376.368154:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce06307480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585185664:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787826376.368254:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826376.368306:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787826376.368313:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce06305680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585185792:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787826376.368337:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826376.368381:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585185664 00000100:00100000:3.0:1787826376.368390:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585185664 00000100:00100000:3.0:1787826376.368448:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585185792 00000100:00100000:3.0:1787826376.368451:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585185792 00000100:00100000:3.0:1787826376.368516:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1831 00000100:00100000:3.0:1787826376.368527:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06307840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3644:x1874670585185664:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787826376.368768:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06307840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3644:x1874670585185664:12345-0@lo:2:osp-syn-0-0.0 Request processed in 232us (504us total) trans 21474836932 rc 0/0 00000100:00100000:3.0:1787826376.368778:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1831 00000100:00100000:3.0:1787826376.368801:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1832 00000100:00100000:3.0:1787826376.368808:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce063070c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3644:x1874670585185792:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787826376.368881:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce063070c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3644:x1874670585185792:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (542us total) trans 21474836933 rc 0/0 00000100:00100000:3.0:1787826376.368888:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1832 00000004:00080000:3.0:1787826376.368938:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce06305680/2, rc 0, transno 21474836933 00000100:00100000:3.0:1787826376.368945:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce06305680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585185792:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1787826376.368956:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce06307480/2, rc 0, transno 21474836932 00000100:00100000:3.0:1787826376.368960:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce06307480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585185664:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1787826376.369508:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b805cf lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.369522:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b805cf lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2a/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.369530:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b805cf lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2a/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.369537:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826376.369543:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b805cf lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2a/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.369551:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b805cf lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2a/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.369571:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:0.0:1787826376.369574:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2a 00010000:00010000:0.0:1787826376.369579:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b805cf lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2a/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.369586:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b805cf lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2a/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.369607:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125a00/0x22153cd396b80600 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.369613:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125a00/0x22153cd396b80600 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.369755:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125a00/0x22153cd396b80600 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.369839:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05125a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826376.369842:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125a00/0x22153cd396b80600 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.369849:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125a00/0x22153cd396b80600 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.369858:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:0.0:1787826376.369861:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826376.369864:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125a00/0x22153cd396b80600 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.369869:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125a00/0x22153cd396b80600 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826376.369999:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0300e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585185920:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787826376.370055:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826376.370159:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787826376.370166:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0300c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585186048:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787826376.370192:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826376.370532:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585185920 00000100:00100000:1.0:1787826376.370541:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585185920 00000100:00100000:1.0:1787826376.370595:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585186048 00000100:00100000:1.0:1787826376.370599:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585186048 00000100:00100000:1.0:1787826376.370623:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1833 00000100:00100000:1.0:1787826376.370842:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06304000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3646:x1874670585185920:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787826376.371065:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06304000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3646:x1874670585185920:12345-0@lo:2:osp-syn-1-0.0 Request processed in 228us (1009us total) trans 17179869602 rc 0/0 00000100:00100000:3.0:1787826376.371402:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1834 00000100:00100000:3.0:1787826376.371416:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06305e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3646:x1874670585186048:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787826376.371543:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06305e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+15:3646:x1874670585186048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 133us (1350us total) trans 17179869603 rc 0/0 00000100:00100000:3.0:1787826376.371551:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1834 00000100:00100000:1.0:1787826376.372380:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1833 00000004:00080000:1.0:1787826376.372450:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce0300c3c0/2, rc 0, transno 17179869603 00000100:00100000:1.0:1787826376.372468:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0300c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585186048:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1787826376.372515:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce0300e580/2, rc 0, transno 17179869602 00000100:00100000:1.0:1787826376.372519:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0300e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585185920:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1787826376.372861:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660c00/0x22153cd396b80615 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab057e expref: 21 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.372877:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:2.0:1787826376.372881:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1787826376.372973:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661000/0x22153cd396b8060e lrc: 0/0,0 mode: --/EX res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab057e expref: 21 pid: 16564 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.373000:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660c00/0x22153cd396b80615 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab057e expref: 20 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.373038:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:2.0:1787826376.373042:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1787826376.373044:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05660c00, rc 0) 00000100:00100000:2.0:1787826376.373236:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06307c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:53048:x1874670563723904:12345-192.168.203.39@tcp:101:truncate.0 Request processed in 9351us (9659us total) trans 8589934658 rc 0/0 00000100:00100000:2.0:1787826376.373245:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3451 00000100:00100000:0.0:1787826376.380794:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826376.381138:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563724032 00000100:00100000:2.0:1787826376.381151:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563724032 00000100:00100000:2.0:1787826376.381230:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1835 00000100:00100000:2.0:1787826376.381242:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03985680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:53048:x1874670563724032:12345-192.168.203.39@tcp:101:truncate.0 00010000:00010000:2.0:1787826376.381266:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826376.381292:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8aefba1/0x22153cd396b8061c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0585 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787826376.381328:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x102:0x0] initial LVB size: 1069056, mtime: 0x6a9010c8, atime: 0x0, ctime: 0x6a9010c8, blocks: 0x30 00010000:00010000:2.0:1787826376.381356:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x102:0x0].0x0 since=1322s v=(0 0) 00010000:00010000:2.0:1787826376.381362:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x102:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826376.381374:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8aefba1/0x22153cd396b8061c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000080000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0585 expref: 11 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.381393:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f8aefba1/0x22153cd396b8061c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000080000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0585 expref: 11 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.381408:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0b55c000, rc 0) 00000100:00100000:2.0:1787826376.381517:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03985680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:53048:x1874670563724032:12345-192.168.203.39@tcp:101:truncate.0 Request processed in 276us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826376.381525:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1835 00000100:00100000:1.0:1787826376.385534:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826376.385884:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563724160 00000100:00100000:3.0:1787826376.385896:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563724160 00000100:00100000:3.0:1787826376.386045:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1836 00000100:00100000:3.0:1787826376.386058:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:53048:x1874670563724160:12345-192.168.203.39@tcp:101:truncate.0 00010000:00010000:3.0:1787826376.386220:0:8545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826376.386272:0:8545:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc2068bb/0x22153cd396b80623 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab058c expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826376.386305:0:8545:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x103:0x0] initial LVB size: 3700000, mtime: 0x6a9010c8, atime: 0x0, ctime: 0x6a9010c8, blocks: 0x0 00010000:00010000:3.0:1787826376.386333:0:8545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x103:0x0].0x0 since=1322s v=(0 0) 00010000:00010000:3.0:1787826376.386339:0:8545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x103:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826376.386351:0:8545:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc2068bb/0x22153cd396b80623 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab058c expref: 12 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.386368:0:8545:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dc2068bb/0x22153cd396b80623 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab058c expref: 12 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.386384:0:8545:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400800, rc 0) 00000100:00100000:3.0:1787826376.387308:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:53048:x1874670563724160:12345-192.168.203.39@tcp:101:truncate.0 Request processed in 417us (1028us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826376.387321:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1836 00000100:00100000:3.0:1787826376.390034:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826376.390200:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826376.391299:0:30178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563724288 00000100:00100000:0.0:1787826376.391316:0:30178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563724288 00002000:00010000:0.0:1787826376.391379:0:30178:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/258 (0->18446744073709551615) 00002000:00100000:0.0:1787826376.391385:0:30178:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf3abc1a40 with x1874670563724288 ext(0->18446744073709551615) 00002000:00010000:0.0:1787826376.391403:0:30178:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf3abc1a40. 00000100:00100000:0.0:1787826376.391522:0:30178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563724416 00000100:00100000:0.0:1787826376.391527:0:30178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563724416 00002000:00010000:0.0:1787826376.391542:0:30178:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/259 (0->18446744073709551615) 00002000:00100000:0.0:1787826376.391545:0:30178:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf3abc21c0 with x1874670563724416 ext(0->18446744073709551615) 00002000:00010000:0.0:1787826376.391552:0:30178:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf3abc21c0. 00000100:00100000:0.0:1787826376.391584:0:30178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 709 00000100:00100000:0.0:1787826376.391594:0:30178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2403:x1874670563724288:12345-192.168.203.39@tcp:10:truncate.0 00000100:00100000:1.0:1787826376.393238:0:25422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 710 00000100:00100000:1.0:1787826376.393264:0:25422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2403:x1874670563724416:12345-192.168.203.39@tcp:10:truncate.0 00002000:00010000:0.0:1787826376.399615:0:30178:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x102:0x0] updating lvb size from disk: 1069056 -> 0 00002000:00010000:0.0:1787826376.399646:0:30178:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x102:0x0] updating lvb mtime from disk: 1787826376 -> 1787826376 00002000:00010000:0.0:1787826376.399649:0:30178:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x102:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787826376.399651:0:30178:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x102:0x0] updating lvb ctime from disk: 1787826376 -> 1787826376 00002000:00010000:0.0:1787826376.399654:0:30178:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x102:0x0] updating lvb blocks from disk: 48 -> 0 00000100:00100000:0.0:1787826376.399774:0:30178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2403:x1874670563724288:12345-192.168.203.39@tcp:10:truncate.0 Request processed in 8173us (9748us total) trans 21474836934 rc 0/0 00000100:00100000:0.0:1787826376.399788:0:30178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 709 00002000:00010000:0.0:1787826376.399795:0:30178:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/258 (0->18446744073709551615) 00002000:00100000:0.0:1787826376.399800:0:30178:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf3abc1a40 with x1874670563724288 ext(0->18446744073709551615) 00002000:00010000:0.0:1787826376.399809:0:30178:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf3abc1a40. 00002000:00010000:1.0:1787826376.402781:0:25422:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x103:0x0] updating lvb size from disk: 3700000 -> 0 00002000:00010000:1.0:1787826376.402794:0:25422:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x103:0x0] updating lvb mtime from disk: 1787826376 -> 1787826376 00002000:00010000:1.0:1787826376.402798:0:25422:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x103:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787826376.402800:0:25422:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x103:0x0] updating lvb ctime from disk: 1787826376 -> 1787826376 00002000:00010000:1.0:1787826376.402803:0:25422:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x103:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1787826376.407984:0:25422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2403:x1874670563724416:12345-192.168.203.39@tcp:10:truncate.0 Request processed in 9650us (12701us total) trans 21474836935 rc 0/0 00000100:00100000:1.0:1787826376.408005:0:25422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 710 00002000:00010000:1.0:1787826376.408016:0:25422:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/259 (0->18446744073709551615) 00002000:00100000:1.0:1787826376.408020:0:25422:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf3abc21c0 with x1874670563724416 ext(0->18446744073709551615) 00002000:00010000:1.0:1787826376.408036:0:25422:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf3abc21c0. 00000100:00100000:3.0:1787826376.421933:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826376.422103:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563724672 00000100:00100000:0.0:1787826376.422117:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563724672 00000100:00100000:0.0:1787826376.422197:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3452 00000100:00100000:0.0:1787826376.422210:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:53050:x1874670563724672:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:0.0:1787826376.422242:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826376.422271:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661a00/0x22153cd396b8062a lrc: 2/0,0 mode: --/CW res: [0x200000405:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0593 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.422465:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661c00/0x22153cd396b80631 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.422529:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661c00/0x22153cd396b80631 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.422549:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661c00/0x22153cd396b80631 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.422568:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661800/0x22153cd396b80638 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.422576:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661800/0x22153cd396b80638 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.422583:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661800/0x22153cd396b80638 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.422657:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661400/0x22153cd396b8063f lrc: 3/1,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.422666:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661400/0x22153cd396b8063f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.422673:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661400/0x22153cd396b8063f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826376.422684:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x14:0x0]: returning size 2 00010000:00010000:0.0:1787826376.422802:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661c00/0x22153cd396b80631 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.422810:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661c00/0x22153cd396b80631 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.422818:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661c00/0x22153cd396b80631 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.422825:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661c00/0x22153cd396b80631 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.422833:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05661c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826376.422838:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661c00/0x22153cd396b80631 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.422846:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661c00/0x22153cd396b80631 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.422861:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0x0 (ffff90cf39e67500) 00010000:00010000:0.0:1787826376.422865:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826376.422871:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661c00/0x22153cd396b80631 lrc: 3/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.422878:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661c00/0x22153cd396b80631 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.422895:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661800/0x22153cd396b80638 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.423608:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661800/0x22153cd396b80638 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.423615:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661800/0x22153cd396b80638 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.423621:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05661800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826376.423624:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661800/0x22153cd396b80638 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.423641:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661800/0x22153cd396b80638 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.423657:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0xe1e61496 (ffff90cf371d2d00) 00010000:00010000:0.0:1787826376.423660:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826376.423664:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661800/0x22153cd396b80638 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.423670:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661800/0x22153cd396b80638 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.423735:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661a00/0x22153cd396b8062a lrc: 0/0,0 mode: --/CW res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0593 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.423751:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661400/0x22153cd396b8063f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0593 expref: 22 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.423769:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:0.0:1787826376.423771:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826376.423774:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05661400, rc 0) 00000100:00100000:0.0:1787826376.423869:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:53050:x1874670563724672:12345-192.168.203.39@tcp:101:dd.0 Request processed in 1661us (1952us total) trans 8589934659 rc 0/0 00000100:00100000:0.0:1787826376.423880:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3452 00000100:00100000:0.0:1787826376.436032:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826376.436260:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563724928 00000100:00100000:1.0:1787826376.436273:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563724928 00000100:00100000:1.0:1787826376.436351:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1014 00000100:00100000:1.0:1787826376.436362:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03987c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:53050:x1874670563724928:12345-192.168.203.39@tcp:35:dd.0 00000001:00080000:1.0:1787826376.436753:0:14257:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934660 00000100:00100000:1.0:1787826376.436914:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03987c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:53050:x1874670563724928:12345-192.168.203.39@tcp:35:dd.0 Request processed in 553us (897us total) trans 8589934661 rc 0/0 00000100:00100000:1.0:1787826376.436924:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1014 00000020:00080000:1.0:1787826376.436931:0:14257:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787826376.461269:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826376.461522:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563725184 00000100:00100000:0.0:1787826376.461536:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563725184 00000100:00100000:0.0:1787826376.461613:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3453 00000100:00100000:0.0:1787826376.461625:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:53051:x1874670563725184:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826376.461674:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826376.461706:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661a00/0x22153cd396b8064d lrc: 2/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab059a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.462189:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661800/0x22153cd396b80654 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.462208:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661400/0x22153cd396b8063f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0593 expref: 25 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.462217:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661800/0x22153cd396b80654 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x14:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.462258:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661400/0x22153cd396b8063f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0593 expref: 25 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.462274:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661400/0x22153cd396b8063f lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0593 expref: 25 pid: 6519 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826376.462290:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03984b40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1874670585186176:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826376.462390:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf09f7da80 going to sleep for 11 seconds 00000100:00100000:0.0:1787826376.468848:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03984b40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1874670585186176:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826376.468893:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661800/0x22153cd396b80654 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x14:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826376.470022:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826376.470123:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563725312 00000100:00100000:3.0:1787826376.470133:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563725312 00010000:00010000:3.0:1787826376.470183:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661400/0x22153cd396b8063f lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0593 expref: 26 pid: 6519 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826376.470231:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 985 00000100:00100000:3.0:1787826376.470243:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:2404:x1874670563725312:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826376.470263:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826376.470272:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661400/0x22153cd396b8063f lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0593 expref: 26 pid: 6519 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.470286:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661400/0x22153cd396b8063f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0593 expref: 26 pid: 6519 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.470317:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661400/0x22153cd396b8063f lrc: 0/0,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0593 expref: 26 pid: 6519 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.470339:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:3.0:1787826376.470346:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661800/0x22153cd396b80654 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x14:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.470357:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661800/0x22153cd396b80654 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x14:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.470365:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661800/0x22153cd396b80654 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x14:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.470405:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826376.470551:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:2404:x1874670563725312:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 309us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826376.470560:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 985 00010000:00010000:0.0:1787826376.470997:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661800/0x22153cd396b80654 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x14:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.471007:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661800/0x22153cd396b80654 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x14:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826376.471032:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x14:0x0]: returning size 2110464 00010000:00010000:0.0:1787826376.471223:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661a00/0x22153cd396b8064d lrc: 0/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab059a expref: 26 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.471244:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661800/0x22153cd396b80654 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x14:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab059a expref: 25 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.471252:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:0.0:1787826376.471255:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787826376.471258:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05661800, rc 0) 00000100:00100000:0.0:1787826376.471311:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:53051:x1874670563725184:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 9689us (10058us total) trans 8589934662 rc 0/0 00000100:00100000:0.0:1787826376.471320:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3453 00000100:00100000:1.0:1787826376.478906:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826376.479046:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563725440 00000100:00100000:3.0:1787826376.479059:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563725440 00000100:00100000:3.0:1787826376.479147:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3454 00000100:00100000:3.0:1787826376.479159:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce039770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:53051:x1874670563725440:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826376.479191:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826376.479219:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b80662 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab05a1 expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.479344:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b80669 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.479363:0:32404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661800/0x22153cd396b80654 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x14:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab059a expref: 26 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.479372:0:32404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b80669 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.479423:0:32404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661800/0x22153cd396b80654 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x14:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab059a expref: 26 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.479439:0:32404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661800/0x22153cd396b80654 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x14:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab059a expref: 26 pid: 6520 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826376.479468:0:32404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3abc0b40 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:32404:1874670585186304:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826376.479607:0:32404:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f5e76c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826376.483055:0:32404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3abc0b40 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:32404:1874670585186304:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826376.483106:0:32404:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b80669 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826376.483219:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826376.483320:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563725568 00000100:00100000:1.0:1787826376.483329:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563725568 00010000:00010000:1.0:1787826376.483381:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661800/0x22153cd396b80654 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x14:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab059a expref: 27 pid: 6520 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826376.483425:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 986 00000100:00100000:1.0:1787826376.483435:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:2404:x1874670563725568:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826376.483514:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826376.483525:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661800/0x22153cd396b80654 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x14:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab059a expref: 27 pid: 6520 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.483538:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661800/0x22153cd396b80654 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x14:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab059a expref: 27 pid: 6520 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.483565:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661800/0x22153cd396b80654 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x14:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab059a expref: 27 pid: 6520 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.483588:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:1.0:1787826376.483593:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b80669 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.483603:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b80669 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.483611:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b80669 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.484061:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826376.484176:0:32404:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b80669 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.484184:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b80669 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826376.484254:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x14:0x0]: returning size 2110464 00000004:00200000:3.0:1787826376.484260:0:32404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826376.484286:0:32404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b80669 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.484326:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b80662 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05a1 expref: 27 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.484344:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b80669 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05a1 expref: 26 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.484358:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:3.0:1787826376.484360:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826376.484363:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400200, rc 0) 00000100:00100000:3.0:1787826376.484443:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce039770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:53051:x1874670563725440:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 5285us (5561us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826376.484463:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3454 00000100:00100000:1.0:1787826376.484605:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:2404:x1874670563725568:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 1171us (1387us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826376.484614:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 986 00000100:00100000:2.0:1787826376.490025:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826376.490312:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563725824 00000100:00100000:0.0:1787826376.490327:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563725824 00000100:00100000:0.0:1787826376.490405:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3455 00000100:00100000:0.0:1787826376.490418:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:53051:x1874670563725824:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826376.490446:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826376.490751:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660a00/0x22153cd396b80670 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab05a8 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.492730:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660600/0x22153cd396b80677 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.492770:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660600/0x22153cd396b80677 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x14:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.492786:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660600/0x22153cd396b80677 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x14:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826376.492806:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x14:0x0]: returning size 2110464 00010000:00010000:0.0:1787826376.492974:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660a00/0x22153cd396b80670 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05a8 expref: 28 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.492997:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660600/0x22153cd396b80677 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x14:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05a8 expref: 27 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.493007:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:0.0:1787826376.493011:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787826376.493015:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05660600, rc 0) 00000100:00100000:0.0:1787826376.493244:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:53051:x1874670563725824:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 2827us (3230us total) trans 8589934663 rc 0/0 00000100:00100000:0.0:1787826376.493256:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3455 00000100:00100000:3.0:1787826376.496706:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826376.496777:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826376.497012:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563725952 00000100:00100000:1.0:1787826376.497026:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563725952 00000100:00100000:1.0:1787826376.497103:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563726080 00000100:00100000:1.0:1787826376.497106:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563726080 00000100:00100000:1.0:1787826376.497141:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1837 00000100:00100000:1.0:1787826376.497153:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2403:x1874670563725952:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:1.0:1787826376.497215:0:30695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f3bdd7b/0x22153cd396b80685 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.497241:0:30695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f8aefba1/0x22153cd396b8061c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000080000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0585 expref: 15 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.497252:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x102:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826376.497258:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x102:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826376.497264:0:30695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f3bdd7b/0x22153cd396b80685 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.497309:0:30695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f8aefba1/0x22153cd396b8061c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000080000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0585 expref: 15 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.497325:0:30695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f8aefba1/0x22153cd396b8061c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x70000480000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0585 expref: 15 pid: 8437 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826376.497343:0:30695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03976940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:30695:1874670585186432:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826376.497440:0:30695:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2069f480 going to sleep for 11 seconds 00000100:00100000:0.0:1787826376.497705:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1838 00000100:00100000:0.0:1787826376.497719:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c84b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2403:x1874670563726080:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:0.0:1787826376.497744:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3083a9a/0x22153cd396b8068c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.497770:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dc2068bb/0x22153cd396b80623 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab058c expref: 15 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.497779:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x103:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826376.497782:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x103:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826376.497786:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3083a9a/0x22153cd396b8068c lrc: 4/0,1 mode: --/PW res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.497814:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dc2068bb/0x22153cd396b80623 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x50000080000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab058c expref: 15 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.497824:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dc2068bb/0x22153cd396b80623 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x70000480000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab058c expref: 15 pid: 8545 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826376.497835:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03984b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1874670585186560:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826376.497869:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf09f7dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826376.502442:0:30695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03976940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:30695:1874670585186432:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826376.502542:0:30695:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000f3bdd7b/0x22153cd396b80685 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826376.503240:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03984b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1874670585186560:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826376.503260:0:8436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e3083a9a/0x22153cd396b8068c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826376.505599:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826376.505909:0:30172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563726208 00000100:00100000:1.0:1787826376.505922:0:30172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563726208 00002000:00100000:1.0:1787826376.505991:0:30172:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x102:0x0] (2088960->2097151) req@ffff90ce01fde940 x1874670563726208/t0(0) o4->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:732/0 lens 8680/0 e 0 to 0 dl 1787826387 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826376.506005:0:30172:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce01fde940 with x1874670563726208 ext(2088960->2097151) 00010000:00010000:1.0:1787826376.506017:0:30172:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000f8aefba1/0x22153cd396b8061c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000480000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0585 expref: 16 pid: 8437 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.506034:0:30172:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000f8aefba1/0x22153cd396b8061c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000480000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0585 expref: 16 pid: 8437 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826376.506043:0:30172:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90ce01fde940 00000100:00100000:1.0:1787826376.506093:0:30172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 20 00000100:00100000:1.0:1787826376.506105:0:30172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fde940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2403:x1874670563726208:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:1.0:1787826376.508338:0:30172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fde940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+18:2403:x1874670563726208:12345-192.168.203.39@tcp:4:dd.0 Request processed in 2219us (2737us total) trans 21474836936 rc 0/0 00000100:00100000:1.0:1787826376.508358:0:30172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 20 00002000:00100000:1.0:1787826376.508374:0:30172:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x102:0x0] (2088960->2097151) req@ffff90ce01fde940 x1874670563726208/t21474836936(0) o4->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:732/0 lens 8680/448 e 0 to 0 dl 1787826387 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826376.508386:0:30172:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce01fde940 with x1874670563726208 ext(2088960->2097151) 00010000:00010000:1.0:1787826376.508398:0:30172:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000f8aefba1/0x22153cd396b8061c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000480000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0585 expref: 18 pid: 8437 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.508412:0:30172:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000f8aefba1/0x22153cd396b8061c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000480000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0585 expref: 18 pid: 8437 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826376.508419:0:30172:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90ce01fde940 00000100:00100000:1.0:1787826376.510376:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826376.510738:0:30174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563726336 00000100:00100000:0.0:1787826376.510752:0:30174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563726336 00002000:00100000:0.0:1787826376.510818:0:30174:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x280000401:0x103:0x0] (2097152->2110463) req@ffff90ce03975680 x1874670563726336/t0(0) o4->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:732/0 lens 13800/0 e 0 to 0 dl 1787826387 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826376.510830:0:30174:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce03975680 with x1874670563726336 ext(2097152->2110463) 00010000:00010000:0.0:1787826376.510842:0:30174:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000dc2068bb/0x22153cd396b80623 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab058c expref: 18 pid: 8545 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.510858:0:30174:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000dc2068bb/0x22153cd396b80623 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab058c expref: 18 pid: 8545 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826376.510874:0:30174:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90ce03975680 00000100:00100000:0.0:1787826376.510919:0:30174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21 00000100:00100000:0.0:1787826376.510931:0:30174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03975680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+18:2403:x1874670563726336:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1787826376.512814:0:30174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03975680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:2403:x1874670563726336:12345-192.168.203.39@tcp:4:dd.0 Request processed in 1690us (2255us total) trans 21474836937 rc 0/0 00000100:00100000:0.0:1787826376.512832:0:30174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21 00002000:00100000:0.0:1787826376.512845:0:30174:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x280000401:0x103:0x0] (2097152->2110463) req@ffff90ce03975680 x1874670563726336/t21474836937(0) o4->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:732/0 lens 13800/448 e 0 to 0 dl 1787826387 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826376.512856:0:30174:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce03975680 with x1874670563726336 ext(2097152->2110463) 00010000:00010000:0.0:1787826376.512866:0:30174:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000dc2068bb/0x22153cd396b80623 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab058c expref: 20 pid: 8545 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.512880:0:30174:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000dc2068bb/0x22153cd396b80623 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab058c expref: 20 pid: 8545 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826376.512889:0:30174:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90ce03975680 00000100:00100000:2.0:1787826376.518558:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826376.518747:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826376.519183:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563726464 00000100:00100000:1.0:1787826376.519196:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563726464 00010000:00010000:1.0:1787826376.519254:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f8aefba1/0x22153cd396b8061c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000480000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0585 expref: 20 pid: 8437 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826376.519305:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563726592 00000100:00100000:1.0:1787826376.519309:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563726592 00010000:00010000:1.0:1787826376.519329:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dc2068bb/0x22153cd396b80623 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab058c expref: 21 pid: 8545 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826376.519360:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 987 00000100:00100000:1.0:1787826376.519372:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fded00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:2402:x1874670563726464:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826376.519393:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787826376.519420:0:6505:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x102:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:1.0:1787826376.519424:0:6505:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x102:0x0] updating lvb mtime from disk: 1787826376 -> 1787826377 00002000:00010000:1.0:1787826376.519428:0:6505:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x102:0x0] updating lvb ctime from disk: 1787826376 -> 1787826377 00002000:00010000:1.0:1787826376.519430:0:6505:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x102:0x0] updating lvb blocks from disk: 0 -> 16 00010000:00010000:1.0:1787826376.519439:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f8aefba1/0x22153cd396b8061c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000480000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0585 expref: 21 pid: 8437 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.519467:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f8aefba1/0x22153cd396b8061c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000480000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0585 expref: 21 pid: 8437 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.519539:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8aefba1/0x22153cd396b8061c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x102:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801480000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0585 expref: 21 pid: 8437 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.519564:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x102:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826376.519570:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x102:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826376.519577:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000f3bdd7b/0x22153cd396b80685 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.519590:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f3bdd7b/0x22153cd396b80685 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826376.519794:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 988 00000100:00100000:2.0:1787826376.519805:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:2404:x1874670563726592:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826376.519815:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787826376.519826:0:10340:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x103:0x0] updating lvb size from disk: 0 -> 2110464 00002000:00010000:2.0:1787826376.519828:0:10340:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x103:0x0] updating lvb mtime from disk: 1787826376 -> 1787826377 00002000:00010000:2.0:1787826376.519831:0:10340:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x103:0x0] updating lvb ctime from disk: 1787826376 -> 1787826377 00002000:00010000:2.0:1787826376.519834:0:10340:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x103:0x0] updating lvb blocks from disk: 0 -> 32 00010000:00010000:2.0:1787826376.519839:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dc2068bb/0x22153cd396b80623 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab058c expref: 20 pid: 8545 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.519850:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dc2068bb/0x22153cd396b80623 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x50000480000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab058c expref: 20 pid: 8545 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.519864:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc2068bb/0x22153cd396b80623 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x103:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x44801480000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab058c expref: 20 pid: 8545 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.519876:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x103:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826376.519879:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x103:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826376.519884:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e3083a9a/0x22153cd396b8068c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.519893:0:10340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3083a9a/0x22153cd396b8068c lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.520058:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826376.520137:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:2404:x1874670563726592:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 334us (1389us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826376.520147:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 988 00010000:00010000:2.0:1787826376.520184:0:8436:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e3083a9a/0x22153cd396b8068c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.520194:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3083a9a/0x22153cd396b8068c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.520224:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3083a9a/0x22153cd396b8068c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.520234:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3083a9a/0x22153cd396b8068c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.520243:0:8436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3083a9a/0x22153cd396b8068c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.520251:0:8436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05661c00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826376.520257:0:8436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3083a9a/0x22153cd396b8068c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.520268:0:8436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3083a9a/0x22153cd396b8068c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.520281:0:8436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3083a9a/0x22153cd396b8068c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.520289:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3083a9a/0x22153cd396b8068c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826376.520347:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c84b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+18:2403:x1874670563726080:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 22633us (23570us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826376.520356:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1838 00010000:00010000:1.0:1787826376.521246:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826376.521305:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fded00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+17:2402:x1874670563726464:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 1930us (2762us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826376.521315:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 987 00010000:00010000:2.0:1787826376.522530:0:30695:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000f3bdd7b/0x22153cd396b80685 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.522552:0:30695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f3bdd7b/0x22153cd396b80685 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.522585:0:30695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f3bdd7b/0x22153cd396b80685 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.522594:0:30695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000f3bdd7b/0x22153cd396b80685 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.522603:0:30695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000f3bdd7b/0x22153cd396b80685 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.522611:0:30695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05124800 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826376.522616:0:30695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000f3bdd7b/0x22153cd396b80685 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.522863:0:30695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000f3bdd7b/0x22153cd396b80685 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.522889:0:30695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000f3bdd7b/0x22153cd396b80685 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.522960:0:30695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f3bdd7b/0x22153cd396b80685 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826376.523142:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2403:x1874670563725952:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 25986us (26447us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826376.523153:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1837 00000100:00100000:2.0:1787826376.530405:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826376.530615:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563726848 00000100:00100000:0.0:1787826376.530629:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563726848 00000100:00100000:1.0:1787826376.531059:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3456 00000100:00100000:1.0:1787826376.531072:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:53051:x1874670563726848:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:1.0:1787826376.531160:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1787826376.531199:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660c00/0x22153cd396b80615 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab057e expref: 27 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.531230:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b80669 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05a1 expref: 26 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.531244:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:1.0:1787826376.531252:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826376.531294:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05124600/0x22153cd396b80693 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.531312:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05124600/0x22153cd396b80693 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.531324:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05124600/0x22153cd396b80693 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787826376.531684:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].11, 88 off9136 00000004:00080000:1.0:1787826376.531695:0:6519:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1322543222792ns, next at 0ns, rc = 0 00000040:00080000:1.0:1787826376.531723:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].12, 88 off9224 00000004:00080000:1.0:1787826376.531728:0:6519:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1322543256219ns, next at 0ns, rc = 0 00000040:00080000:1.0:1787826376.531752:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].11, 88 off9112 00000004:00080000:1.0:1787826376.531767:0:6519:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1322543284126ns, next at 1309127889395ns, rc = 0 00000040:00080000:1.0:1787826376.531790:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].12, 88 off9200 00000004:00080000:1.0:1787826376.531794:0:6519:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1322543322429ns, next at 1309127889395ns, rc = 0 00000001:00080000:3.0:1787826376.537547:0:34481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934664 is committed 00000004:00080000:3.0:1787826376.537568:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 13 committed 00000004:00080000:3.0:1787826376.537588:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 12 committed 00000004:00080000:3.0:1787826376.537591:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 12 committed 00000004:00080000:3.0:1787826376.537607:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 11 committed 00000100:00100000:2.0:1787826376.537802:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fdc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585186816:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787826376.537894:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826376.538153:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03984b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585186944:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787826376.538197:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03984000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585187072:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787826376.538223:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826376.538789:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585187072 00000100:00100000:1.0:1787826376.538800:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585187072 00000100:00100000:1.0:1787826376.538858:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585186816 00000100:00100000:1.0:1787826376.538861:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585186816 00000100:00100000:1.0:1787826376.538885:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1839 00000100:00100000:1.0:1787826376.538895:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8ade00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3647:x1874670585187072:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787826376.538996:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1840 00000100:00100000:3.0:1787826376.539006:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fde580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3645:x1874670585186816:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787826376.539401:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826376.539468:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585186944 00000100:00100000:0.0:1787826376.539495:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585186944 00000100:00100000:0.0:1787826376.539528:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1841 00000100:00100000:0.0:1787826376.539536:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aad5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+11:3646:x1874670585186944:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787826376.539762:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aad5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3646:x1874670585186944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 226us (360us total) trans 21474836939 rc 0/0 00000100:00100000:0.0:1787826376.539771:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1841 00000004:00080000:0.0:1787826376.539828:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce03984b40/2, rc 0, transno 21474836939 00000100:00100000:0.0:1787826376.539835:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03984b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585186944:0@lo:2:osp-syn-0-0.0 00000004:00010000:0.0:1787826376.540223:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fa93076c reply state 0000000009bda2b0 transno 8589934664 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05124600/0x22153cd396b80693 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.540251:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05124600/0x22153cd396b80693 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.540263:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:0.0:1787826376.540267:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1787826376.540272:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1787826376.540376:0:6519:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1787826376.540393:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:53051:x1874670563726848:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 9321us (10003us total) trans 8589934664 rc 0/0 00000100:00100000:0.0:1787826376.540402:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3456 00000100:00100000:2.0:1787826376.540564:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787826376.540576:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fdf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585186688:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787826376.540620:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826376.540673:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585186688 00000100:00100000:2.0:1787826376.540678:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585186688 00000100:00100000:2.0:1787826376.540710:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1842 00000100:00100000:2.0:1787826376.540717:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fde1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+16:3645:x1874670585186688:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787826376.540842:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fde1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+17:3645:x1874670585186688:12345-0@lo:2:osp-syn-1-0.0 Request processed in 124us (220us total) trans 17179869605 rc 0/0 00000100:00100000:2.0:1787826376.540849:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1842 00000004:00080000:2.0:1787826376.540892:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce01fdf840/2, rc 0, transno 17179869605 00000100:00100000:2.0:1787826376.540909:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fdf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585186688:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787826376.543690:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fde580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+16:3645:x1874670585186816:12345-0@lo:2:osp-syn-1-0.0 Request processed in 4670us (5780us total) trans 17179869604 rc 0/0 00000100:00100000:3.0:1787826376.543708:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1840 00000004:00080000:0.0:1787826376.544026:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce01fdc3c0/2, rc 0, transno 17179869604 00000100:00100000:0.0:1787826376.544035:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fdc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585186816:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787826376.544561:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826376.544657:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563726976 00000100:00100000:0.0:1787826376.544666:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563726976 00000100:00100000:0.0:1787826376.544737:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3457 00000100:00100000:0.0:1787826376.544749:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:53051:x1874670563726976:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826376.544783:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826376.544811:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660a00/0x22153cd396b8069a lrc: 2/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab05af expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.544887:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660a00/0x22153cd396b8069a lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05af expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.544917:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660a00/0x22153cd396b8069a lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05af expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.544940:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:0.0:1787826376.544944:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826376.544949:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05660a00, rc 0) 00000100:00100000:0.0:1787826376.545022:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:53051:x1874670563726976:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 275us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826376.545030:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3457 00000100:00100000:1.0:1787826376.545988:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8ade00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:3647:x1874670585187072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 7088us (7756us total) trans 21474836938 rc 0/0 00000100:00100000:1.0:1787826376.546002:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1839 00010000:00010000:1.0:1787826376.546049:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05124600/0x22153cd396b80693 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.546059:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05124600/0x22153cd396b80693 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.546067:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05124600/0x22153cd396b80693 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.546073:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05124600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826376.546079:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05124600/0x22153cd396b80693 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.546207:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05124600/0x22153cd396b80693 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.546226:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:1.0:1787826376.546230:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826376.546235:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05124600/0x22153cd396b80693 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.546241:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05124600/0x22153cd396b80693 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787826376.546398:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce03984000/2, rc 0, transno 21474836938 00000100:00100000:0.0:1787826376.546406:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03984000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585187072:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787826376.550216:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826376.550352:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563727104 00000100:00100000:3.0:1787826376.550365:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563727104 00000100:00100000:3.0:1787826376.550511:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3458 00000100:00100000:3.0:1787826376.550524:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:53051:x1874670563727104:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826376.550553:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826376.550580:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b806a1 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab05b6 expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.550872:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400e00/0x22153cd396b806a8 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.550891:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400e00/0x22153cd396b806a8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.550971:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400e00/0x22153cd396b806a8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826376.551007:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x14:0x0]: returning size 2110464 00000004:00200000:3.0:1787826376.551012:0:32404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826376.551035:0:32404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400e00/0x22153cd396b806a8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.551067:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b806a1 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05b6 expref: 23 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.551153:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400e00/0x22153cd396b806a8 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05b6 expref: 22 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.551164:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:3.0:1787826376.551167:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826376.551171:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400e00, rc 0) 00000100:00100000:3.0:1787826376.551312:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:53051:x1874670563727104:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 790us (1110us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826376.551324:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3458 00000100:00100000:3.0:1787826376.556281:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826376.556642:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563727232 00000100:00100000:2.0:1787826376.556656:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563727232 00000100:00100000:2.0:1787826376.556734:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1843 00000100:00100000:2.0:1787826376.556747:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c84780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2402:x1874670563727232:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826376.556776:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826376.556807:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c54eb30/0x22153cd396b806af lrc: 2/0,0 mode: --/PR res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab05bd expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787826376.556842:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x102:0x0] initial LVB size: 2097152, mtime: 0x6a9010c9, atime: 0x0, ctime: 0x6a9010c9, blocks: 0x10 00010000:00010000:2.0:1787826376.556868:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x102:0x0].0x0 since=1322s v=(0 0) 00010000:00010000:2.0:1787826376.556873:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x102:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826376.556888:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c54eb30/0x22153cd396b806af lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05bd expref: 17 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.557058:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006c54eb30/0x22153cd396b806af lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05bd expref: 17 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.557078:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0b55d200, rc 0) 00000100:00100000:2.0:1787826376.557232:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c84780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+17:2402:x1874670563727232:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 488us (965us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826376.557241:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1843 00000100:00100000:2.0:1787826376.559652:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826376.559789:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563727360 00000100:00100000:0.0:1787826376.559802:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563727360 00000100:00100000:0.0:1787826376.559876:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1844 00000100:00100000:0.0:1787826376.559890:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fde580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+17:2402:x1874670563727360:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826376.559923:0:14864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826376.559950:0:14864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cb54982/0x22153cd396b806b6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab05c4 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826376.559989:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x103:0x0] initial LVB size: 2110464, mtime: 0x6a9010c9, atime: 0x0, ctime: 0x6a9010c9, blocks: 0x20 00010000:00010000:0.0:1787826376.560017:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x103:0x0].0x0 since=1322s v=(0 0) 00010000:00010000:0.0:1787826376.560023:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x103:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826376.560037:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cb54982/0x22153cd396b806b6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05c4 expref: 18 pid: 14864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.560058:0:14864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cb54982/0x22153cd396b806b6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05c4 expref: 18 pid: 14864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.560073:0:14864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05661a00, rc 0) 00000100:00100000:0.0:1787826376.560282:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fde580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+18:2402:x1874670563727360:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 394us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826376.560292:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1844 00000100:00100000:0.0:1787826376.640405:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826376.640589:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563727488 00000100:00100000:3.0:1787826376.640602:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563727488 00000100:00100000:3.0:1787826376.640841:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1845 00000100:00100000:3.0:1787826376.640853:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+18:2404:x1874670563727488:12345-192.168.203.39@tcp:23:lfs.0 00000100:00100000:3.0:1787826376.641017:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+18:2404:x1874670563727488:12345-192.168.203.39@tcp:23:lfs.0 Request processed in 166us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826376.641025:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1845 00000100:00100000:0.0:1787826376.642813:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826376.648205:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563727616 00000100:00100000:3.0:1787826376.648225:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563727616 00000100:00100000:3.0:1787826376.650831:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1846 00000100:00100000:3.0:1787826376.650866:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8ae580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+18:2404:x1874670563727616:12345-192.168.203.39@tcp:23:lfs.0 00000100:00100000:3.0:1787826376.651044:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8ae580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+18:2404:x1874670563727616:12345-192.168.203.39@tcp:23:lfs.0 Request processed in 196us (8239us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826376.651055:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1846 00000100:00100000:0.0:1787826376.665815:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826376.665913:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826376.669578:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563727744 00000100:00100000:3.0:1787826376.669601:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563727744 00000100:00100000:1.0:1787826376.669826:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563727872 00000100:00100000:1.0:1787826376.669832:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563727872 00000100:00100000:1.0:1787826376.669914:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1847 00000100:00100000:1.0:1787826376.669926:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8acb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:2404:x1874670563727872:12345-192.168.203.39@tcp:23:lfs.0 00000100:00100000:1.0:1787826376.670188:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8acb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:2404:x1874670563727872:12345-192.168.203.39@tcp:23:lfs.0 Request processed in 264us (4274us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826376.670197:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1847 00000100:00100000:1.0:1787826376.670512:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1848 00000100:00100000:1.0:1787826376.670521:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8afc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+18:2404:x1874670563727744:12345-192.168.203.39@tcp:23:lfs.0 00000100:00100000:1.0:1787826376.670578:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8afc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+18:2404:x1874670563727744:12345-192.168.203.39@tcp:23:lfs.0 Request processed in 59us (4778us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826376.670585:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1848 00000100:00100000:2.0:1787826376.676156:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826376.676331:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563728128 00000100:00100000:0.0:1787826376.676344:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563728128 00000100:00100000:0.0:1787826376.676919:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3459 00000100:00100000:0.0:1787826376.676935:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:53051:x1874670563728128:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:0.0:1787826376.677013:0:16564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826376.677064:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400e00/0x22153cd396b806a8 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05b6 expref: 22 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.677095:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:0.0:1787826376.677102:0:16564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826376.677782:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660200/0x22153cd396b806bd lrc: 3/0,1 mode: --/PW res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.677802:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660200/0x22153cd396b806bd lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.677814:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660200/0x22153cd396b806bd lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787826376.677879:0:16564:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934665 00000004:00010000:0.0:1787826376.677907:0:16564:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000325a2418 reply state 000000009143da74 transno 8589934666 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660200/0x22153cd396b806bd lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.677921:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660200/0x22153cd396b806bd lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.677928:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:0.0:1787826376.677931:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826376.677935:0:16564:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787826376.678088:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:53051:x1874670563728128:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 1155us (1945us total) trans 8589934666 rc 0/0 00000100:00100000:0.0:1787826376.678097:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3459 00000020:00080000:0.0:1787826376.678104:0:16564:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787826376.681982:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826376.682163:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563728256 00000100:00100000:2.0:1787826376.682175:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563728256 00000100:00100000:2.0:1787826376.682247:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1849 00000100:00100000:2.0:1787826376.682259:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8af840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:53051:x1874670563728256:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826376.682839:0:14864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826376.682869:0:14864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050118d3b/0x22153cd396b806c4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab05cb expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787826376.682912:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x102:0x0] initial LVB size: 1048576, mtime: 0x6a9010c7, atime: 0x6a9010c7, ctime: 0x6a9010c8, blocks: 0x8 00010000:00010000:2.0:1787826376.682941:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x102:0x0].0x0 since=1322s v=(0 0) 00010000:00010000:2.0:1787826376.682946:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x102:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826376.682959:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050118d3b/0x22153cd396b806c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05cb expref: 14 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.682980:0:14864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000050118d3b/0x22153cd396b806c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05cb expref: 14 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.682995:0:14864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0b55da00, rc 0) 00000100:00100000:2.0:1787826376.683096:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8af840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:53051:x1874670563728256:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 838us (1127us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826376.683105:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1849 00000100:00100000:3.0:1787826376.685613:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826376.685812:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563728384 00000100:00100000:0.0:1787826376.685826:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563728384 00000100:00100000:0.0:1787826376.685898:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1850 00000100:00100000:0.0:1787826376.685910:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c85a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:53051:x1874670563728384:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826376.685935:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826376.685959:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fdfb56e8/0x22153cd396b806cb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab05d2 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826376.685993:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x103:0x0] initial LVB size: 3700000, mtime: 0x6a9010c7, atime: 0x6a9010c7, ctime: 0x6a9010c8, blocks: 0x28 00010000:00010000:0.0:1787826376.686036:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x103:0x0].0x0 since=1322s v=(0 0) 00010000:00010000:0.0:1787826376.686043:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x103:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826376.686054:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fdfb56e8/0x22153cd396b806cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05d2 expref: 15 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.686073:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fdfb56e8/0x22153cd396b806cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05d2 expref: 15 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.686088:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05660e00, rc 0) 00000100:00100000:0.0:1787826376.686157:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c85a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:53051:x1874670563728384:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 249us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826376.686163:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1850 00000100:00100000:3.0:1787826376.693691:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826376.693835:0:30176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563728512 00000100:00100000:0.0:1787826376.693849:0:30176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563728512 00002000:00010000:0.0:1787826376.693906:0:30176:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/259 (1048576->18446744073709551615) 00002000:00100000:0.0:1787826376.693911:0:30176:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf41c87480 with x1874670563728512 ext(1048576->18446744073709551615) 00002000:00010000:0.0:1787826376.693928:0:30176:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90cf41c87480. 00000100:00100000:0.0:1787826376.694039:0:30176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 711 00000100:00100000:0.0:1787826376.694052:0:30176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2403:x1874670563728512:12345-192.168.203.39@tcp:10:lfs.0 00002000:00010000:0.0:1787826376.696447:0:30176:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x103:0x0] updating lvb size from disk: 3700000 -> 1048576 00002000:00010000:0.0:1787826376.696505:0:30176:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x103:0x0] updating lvb mtime from disk: 1787826375 -> 1787826377 00002000:00010000:0.0:1787826376.696509:0:30176:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x103:0x0] updating lvb atime from disk: 1787826375 -> 1787826375 00002000:00010000:0.0:1787826376.696511:0:30176:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x103:0x0] updating lvb ctime from disk: 1787826376 -> 1787826377 00002000:00010000:0.0:1787826376.696513:0:30176:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x103:0x0] updating lvb blocks from disk: 40 -> 0 00000100:00100000:0.0:1787826376.696621:0:30176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2403:x1874670563728512:12345-192.168.203.39@tcp:10:lfs.0 Request processed in 2564us (2938us total) trans 17179869606 rc 0/0 00000100:00100000:0.0:1787826376.696634:0:30176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 711 00002000:00010000:0.0:1787826376.696640:0:30176:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/259 (1048576->18446744073709551615) 00002000:00100000:0.0:1787826376.696644:0:30176:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf41c87480 with x1874670563728512 ext(1048576->18446744073709551615) 00002000:00010000:0.0:1787826376.696652:0:30176:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90cf41c87480. 00000100:00100000:1.0:1787826376.707308:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826376.707398:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563728640 00000100:00100000:0.0:1787826376.707412:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563728640 00000100:00100000:0.0:1787826376.707560:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3460 00000100:00100000:0.0:1787826376.707574:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03977c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:53051:x1874670563728640:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826376.707612:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826376.707640:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660800/0x22153cd396b806d2 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab05d9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.707768:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661000/0x22153cd396b806d9 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.707786:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661000/0x22153cd396b806d9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.707800:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661000/0x22153cd396b806d9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826376.707833:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x14:0x0]: returning size 1048576 00000004:00200000:0.0:1787826376.707839:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826376.707863:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661000/0x22153cd396b806d9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.707894:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660800/0x22153cd396b806d2 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05d9 expref: 26 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.707931:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661000/0x22153cd396b806d9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05d9 expref: 25 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.707946:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:0.0:1787826376.707949:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826376.707954:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05661000, rc 0) 00000100:00100000:0.0:1787826376.708033:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03977c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:53051:x1874670563728640:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 463us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826376.708041:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3460 00000100:00100000:0.0:1787826376.711816:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826376.711863:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826376.714719:0:30188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563728896 00000100:00100000:1.0:1787826376.714742:0:30188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563728896 00000100:00100000:1.0:1787826376.714896:0:30188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563728768 00000100:00100000:1.0:1787826376.714909:0:30188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563728768 00000100:00100000:1.0:1787826376.714995:0:30188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 712 00000100:00100000:1.0:1787826376.715009:0:30188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:2404:x1874670563728896:12345-192.168.203.39@tcp:3:lfs.0 00010000:00010000:1.0:1787826376.715089:0:30188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009c21779c/0x22153cd396b806e0 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.715113:0:30188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x103:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826376.715118:0:30188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x103:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826376.715127:0:30188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c21779c/0x22153cd396b806e0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [2097152->2113535] (req 2097152->2113535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.715144:0:30188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c21779c/0x22153cd396b806e0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [2097152->2113535] (req 2097152->2113535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.715300:0:30188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009c21779c/0x22153cd396b806e0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [2097152->2113535] (req 2097152->2113535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.715311:0:30188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c21779c/0x22153cd396b806e0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [2097152->2113535] (req 2097152->2113535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.715320:0:30188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c21779c/0x22153cd396b806e0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [2097152->2113535] (req 2097152->2113535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.715328:0:30188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05125e00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:1.0:1787826376.715332:0:30188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c21779c/0x22153cd396b806e0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [2097152->2113535] (req 2097152->2113535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.715343:0:30188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c21779c/0x22153cd396b806e0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [2097152->2113535] (req 2097152->2113535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.715373:0:30188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c21779c/0x22153cd396b806e0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [2097152->2113535] (req 2097152->2113535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.715381:0:30188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c21779c/0x22153cd396b806e0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [2097152->2113535] (req 2097152->2113535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826376.715515:0:30188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:2404:x1874670563728896:12345-192.168.203.39@tcp:3:lfs.0 Request processed in 508us (3713us total) trans 0 rc 13312/13312 00000100:00100000:1.0:1787826376.715525:0:30188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 712 00000100:00100000:1.0:1787826376.715555:0:30188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 713 00000100:00100000:1.0:1787826376.715563:0:30188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8ad680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+18:2404:x1874670563728768:12345-192.168.203.39@tcp:3:lfs.0 00010000:00010000:1.0:1787826376.715611:0:30188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000048600c3/0x22153cd396b806e7 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.715621:0:30188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x102:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826376.715633:0:30188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x102:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826376.715638:0:30188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000048600c3/0x22153cd396b806e7 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [2088960->2097151] (req 2088960->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.715648:0:30188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000048600c3/0x22153cd396b806e7 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [2088960->2097151] (req 2088960->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.715698:0:30188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000048600c3/0x22153cd396b806e7 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [2088960->2097151] (req 2088960->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.715708:0:30188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000048600c3/0x22153cd396b806e7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [2088960->2097151] (req 2088960->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.715715:0:30188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000048600c3/0x22153cd396b806e7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [2088960->2097151] (req 2088960->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.715722:0:30188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05124000 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:1.0:1787826376.715725:0:30188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000048600c3/0x22153cd396b806e7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [2088960->2097151] (req 2088960->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.715738:0:30188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000048600c3/0x22153cd396b806e7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [2088960->2097151] (req 2088960->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.715749:0:30188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000048600c3/0x22153cd396b806e7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [2088960->2097151] (req 2088960->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.715756:0:30188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000048600c3/0x22153cd396b806e7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [2088960->2097151] (req 2088960->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826376.715788:0:30188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8ad680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+18:2404:x1874670563728768:12345-192.168.203.39@tcp:3:lfs.0 Request processed in 226us (3923us total) trans 0 rc 8192/8192 00000100:00100000:1.0:1787826376.715796:0:30188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 713 00000100:00100000:3.0:1787826376.727099:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826376.728262:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563729024 00000100:00100000:1.0:1787826376.728281:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563729024 00000100:00100000:1.0:1787826376.728388:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 714 00000100:00100000:1.0:1787826376.728408:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2403:x1874670563729024:12345-192.168.203.39@tcp:4:lfs.0 00010000:00010000:1.0:1787826376.728464:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a83c9ce/0x22153cd396b806ee lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.728508:0:8442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fdfb56e8/0x22153cd396b806cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05d2 expref: 16 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.728518:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x103:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826376.728525:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x103:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826376.728531:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a83c9ce/0x22153cd396b806ee lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 3 type: EXT [2088960->2113535] (req 2088960->2113535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.728582:0:8442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fdfb56e8/0x22153cd396b806cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05d2 expref: 16 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.728599:0:8442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fdfb56e8/0x22153cd396b806cb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05d2 expref: 16 pid: 8437 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826376.728619:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03977480 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:8442:1874670585187200:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826376.728732:0:8442:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf087ac3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826376.734999:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826376.735035:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563729152 00000100:00100000:1.0:1787826376.735046:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563729152 00010000:00010000:1.0:1787826376.735099:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fdfb56e8/0x22153cd396b806cb lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05d2 expref: 17 pid: 8437 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826376.735156:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 989 00000100:00100000:1.0:1787826376.735177:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce039752c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+17:2403:x1874670563729152:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826376.735198:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826376.735229:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fdfb56e8/0x22153cd396b806cb lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05d2 expref: 17 pid: 8437 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.735247:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fdfb56e8/0x22153cd396b806cb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05d2 expref: 17 pid: 8437 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.735279:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x103:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826376.735286:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x103:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826376.735293:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007a83c9ce/0x22153cd396b806ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 4 type: EXT [2088960->2113535] (req 2088960->2113535) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.735305:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a83c9ce/0x22153cd396b806ee lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 4 type: EXT [2088960->2113535] (req 2088960->2113535) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.735334:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826376.735401:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce039752c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+17:2403:x1874670563729152:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 235us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826376.735409:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 989 00010000:00010000:3.0:1787826376.737536:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fdfb56e8/0x22153cd396b806cb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05d2 expref: 16 pid: 8437 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826376.737570:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03977480 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:8442:1874670585187200:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826376.737607:0:8442:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007a83c9ce/0x22153cd396b806ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [2088960->2113535] (req 2088960->2113535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.737621:0:8442:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007a83c9ce/0x22153cd396b806ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [2088960->2113535] (req 2088960->2113535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.737884:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a83c9ce/0x22153cd396b806ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [2088960->2113535] (req 2088960->2113535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787826376.750920:0:27651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179869607 is committed 00000001:00080000:1.0:1787826376.750952:0:27651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179869605 is committed 00002000:00010000:3.0:1787826376.751187:0:8442:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x103:0x0] updating lvb size from disk: 1048576 -> 2113536 00002000:00010000:3.0:1787826376.751193:0:8442:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x103:0x0] updating lvb blocks from disk: 0 -> 48 00010000:00010000:3.0:1787826376.751210:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a83c9ce/0x22153cd396b806ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [2088960->2113535] (req 2088960->2113535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.751226:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a83c9ce/0x22153cd396b806ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [2088960->2113535] (req 2088960->2113535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.751236:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a83c9ce/0x22153cd396b806ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [2088960->2113535] (req 2088960->2113535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.751244:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05125600 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826376.751250:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a83c9ce/0x22153cd396b806ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [2088960->2113535] (req 2088960->2113535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.751261:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a83c9ce/0x22153cd396b806ee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [2088960->2113535] (req 2088960->2113535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.751293:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a83c9ce/0x22153cd396b806ee lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [2088960->2113535] (req 2088960->2113535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.751302:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a83c9ce/0x22153cd396b806ee lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [2088960->2113535] (req 2088960->2113535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826376.751449:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+6:2403:x1874670563729024:12345-192.168.203.39@tcp:4:lfs.0 Request processed in 23036us (24357us total) trans 17179869607 rc 0/0 00000100:00100000:3.0:1787826376.751527:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 714 00000100:00100000:1.0:1787826376.772278:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826376.772696:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563729408 00000100:00100000:2.0:1787826376.772710:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563729408 00000100:00100000:2.0:1787826376.772786:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3461 00000100:00100000:2.0:1787826376.772798:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03976d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:53051:x1874670563729408:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:2.0:1787826376.772871:0:8247:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826376.772906:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661000/0x22153cd396b806d9 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05d9 expref: 25 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.772930:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:2.0:1787826376.772937:0:8247:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826376.773411:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d400/0x22153cd396b806f5 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.773432:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d400/0x22153cd396b806f5 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.773444:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d400/0x22153cd396b806f5 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787826376.773621:0:8247:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934667 00000004:00010000:2.0:1787826376.773650:0:8247:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d5f14470 reply state 000000007966b2d1 transno 8589934668 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d400/0x22153cd396b806f5 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.773664:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d400/0x22153cd396b806f5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.773670:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:2.0:1787826376.773673:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826376.773676:0:8247:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826376.773803:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03976d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:53051:x1874670563729408:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 1005us (1540us total) trans 8589934668 rc 0/0 00000100:00100000:2.0:1787826376.773812:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3461 00000020:00080000:2.0:1787826376.773818:0:8247:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787826376.776744:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826376.777019:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563729536 00000100:00100000:2.0:1787826376.777034:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563729536 00000100:00100000:2.0:1787826376.777103:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1851 00000100:00100000:2.0:1787826376.777113:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8ac780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+6:53051:x1874670563729536:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826376.777130:0:30398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826376.777150:0:30398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000979bdcbe/0x22153cd396b806fc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab05e0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787826376.777799:0:30398:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x103:0x0] initial LVB size: 2113536, mtime: 0x6a9010c9, atime: 0x6a9010c7, ctime: 0x6a9010c9, blocks: 0x30 00010000:00010000:2.0:1787826376.777825:0:30398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x103:0x0].0x0 since=1322s v=(0 0) 00010000:00010000:2.0:1787826376.777830:0:30398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x103:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826376.777843:0:30398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000979bdcbe/0x22153cd396b806fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05e0 expref: 7 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.777860:0:30398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000979bdcbe/0x22153cd396b806fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05e0 expref: 7 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.777875:0:30398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0b55c600, rc 0) 00000100:00100000:2.0:1787826376.779065:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8ac780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:53051:x1874670563729536:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1946us (2330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826376.779076:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1851 00000100:00100000:0.0:1787826376.781826:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826376.781926:0:25425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563729664 00000100:00100000:1.0:1787826376.781940:0:25425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563729664 00002000:00010000:1.0:1787826376.781988:0:25425:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/259 (2110464->18446744073709551615) 00002000:00100000:1.0:1787826376.781993:0:25425:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf3a8ac3c0 with x1874670563729664 ext(2110464->18446744073709551615) 00002000:00010000:1.0:1787826376.782007:0:25425:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90cf3a8ac3c0. 00000100:00100000:1.0:1787826376.782045:0:25425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 715 00000100:00100000:1.0:1787826376.782056:0:25425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2401:x1874670563729664:12345-192.168.203.39@tcp:10:lfs.0 00002000:00010000:1.0:1787826376.782369:0:25425:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x103:0x0] updating lvb size from disk: 2113536 -> 2110464 00002000:00010000:1.0:1787826376.782374:0:25425:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x103:0x0] updating lvb mtime from disk: 1787826377 -> 1787826377 00002000:00010000:1.0:1787826376.782377:0:25425:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x103:0x0] updating lvb atime from disk: 1787826375 -> 1787826375 00002000:00010000:1.0:1787826376.782379:0:25425:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x103:0x0] updating lvb ctime from disk: 1787826377 -> 1787826377 00002000:00010000:1.0:1787826376.782382:0:25425:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x103:0x0] updating lvb blocks from disk: 48 -> 48 00000100:00100000:1.0:1787826376.782446:0:25425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2401:x1874670563729664:12345-192.168.203.39@tcp:10:lfs.0 Request processed in 391us (635us total) trans 17179869608 rc 0/0 00000100:00100000:1.0:1787826376.782464:0:25425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 715 00002000:00010000:1.0:1787826376.782469:0:25425:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/259 (2110464->18446744073709551615) 00002000:00100000:1.0:1787826376.782747:0:25425:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf3a8ac3c0 with x1874670563729664 ext(2110464->18446744073709551615) 00002000:00010000:1.0:1787826376.782754:0:25425:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90cf3a8ac3c0. 00000100:00100000:1.0:1787826376.808770:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826376.808916:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563729920 00000100:00100000:3.0:1787826376.808935:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563729920 00000100:00100000:3.0:1787826376.808994:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3462 00000100:00100000:3.0:1787826376.809004:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03975e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:53051:x1874670563729920:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:3.0:1787826376.809118:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b80703 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.809135:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b80703 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.809148:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b80703 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826376.809444:0:32404:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002989c22f reply state 000000009b3aef75 transno 8589934669 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b80703 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.809469:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b80703 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.809528:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:3.0:1787826376.809531:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826376.809535:0:32404:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826376.809630:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03975e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+29:53051:x1874670563729920:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 627us (869us total) trans 8589934669 rc 0/0 00000100:00100000:3.0:1787826376.809638:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3462 00000100:00100000:3.0:1787826376.814858:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826376.814988:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563730048 00000100:00100000:2.0:1787826376.815002:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563730048 00000100:00100000:2.0:1787826376.815073:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1852 00000100:00100000:2.0:1787826376.815082:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c86d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+18:53051:x1874670563730048:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826376.815100:0:30695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826376.815117:0:30695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089ccfe43/0x22153cd396b8070a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab05e7 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.815146:0:30695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006c54eb30/0x22153cd396b806af lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05bd expref: 19 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.815155:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x102:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826376.815159:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x102:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826376.815164:0:30695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089ccfe43/0x22153cd396b8070a lrc: 4/0,0 mode: --/PW res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05e7 expref: 19 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.815200:0:30695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006c54eb30/0x22153cd396b806af lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05bd expref: 19 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.815215:0:30695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006c54eb30/0x22153cd396b806af lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05bd expref: 19 pid: 8436 timeout: 1422 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826376.815229:0:30695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aa85e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:30695:1874670585187328:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826376.815327:0:30695:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce05b560c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826376.821458:0:30695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aa85e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:30695:1874670585187328:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826376.821552:0:30695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000089ccfe43/0x22153cd396b8070a lrc: 3/0,0 mode: --/PW res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05e7 expref: 19 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.821584:0:30695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0b55ce00, rc 0) 00000100:00100000:2.0:1787826376.821664:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c86d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:53051:x1874670563730048:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 6581us (6837us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826376.821675:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1852 00000100:00100000:2.0:1787826376.823653:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826376.824038:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563730176 00000100:00100000:0.0:1787826376.824051:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563730176 00010000:00010000:0.0:1787826376.824106:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006c54eb30/0x22153cd396b806af lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05bd expref: 19 pid: 8436 timeout: 1422 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826376.824227:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 990 00000100:00100000:0.0:1787826376.824240:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf08ab8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:2404:x1874670563730176:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826376.824261:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826376.824291:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006c54eb30/0x22153cd396b806af lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x102:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05bd expref: 19 pid: 8436 timeout: 1422 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.824306:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006c54eb30/0x22153cd396b806af lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x102:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05bd expref: 19 pid: 8436 timeout: 1422 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.824335:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c54eb30/0x22153cd396b806af lrc: 0/0,0 mode: --/PR res: [0x280000401:0x102:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05bd expref: 19 pid: 8436 timeout: 1422 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.824369:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x102:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826376.824374:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x102:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826376.824384:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000089ccfe43/0x22153cd396b8070a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05e7 expref: 18 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.824396:0:10341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089ccfe43/0x22153cd396b8070a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05e7 expref: 18 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.824443:0:10341:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000089ccfe43/0x22153cd396b8070a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05e7 expref: 18 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826376.824538:0:10341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a8aed00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10341:1874670585187456:192.168.203.39@tcp:105: 00000100:00100000:0.0:1787826376.824656:0:10341:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf09f7d240 going to sleep for 11 seconds 00000100:00100000:0.0:1787826376.831100:0:10341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a8aed00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10341:1874670585187456:192.168.203.39@tcp:105: 00010000:00010000:0.0:1787826376.831138:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826376.831211:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf08ab8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+18:2404:x1874670563730176:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6972us (7571us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826376.831237:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 990 00000100:00100000:3.0:1787826376.838988:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826376.840295:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563730304 00000100:00100000:2.0:1787826376.840313:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563730304 00000100:00100000:2.0:1787826376.840403:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1853 00000100:00100000:2.0:1787826376.840415:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+18:53051:x1874670563730304:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826376.840440:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826376.841433:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c54eb30/0x22153cd396b80711 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab05ee expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.841529:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005cb54982/0x22153cd396b806b6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05c4 expref: 19 pid: 14864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.841551:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x103:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826376.841556:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x103:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826376.841562:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c54eb30/0x22153cd396b80711 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [2097152->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05ee expref: 19 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.841615:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005cb54982/0x22153cd396b806b6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05c4 expref: 19 pid: 14864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.841648:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005cb54982/0x22153cd396b806b6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05c4 expref: 19 pid: 14864 timeout: 1422 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826376.841666:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aa85e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1874670585187584:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826376.841798:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce05b560c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826376.852521:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826376.852962:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aa85e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1874670585187584:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826376.853013:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006c54eb30/0x22153cd396b80711 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [2097152->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05ee expref: 19 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.853042:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0b55d200, rc 0) 00000100:00100000:0.0:1787826376.853122:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:53051:x1874670563730304:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 12709us (14149us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826376.853132:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1853 00000100:00100000:3.0:1787826376.855752:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563730432 00000100:00100000:3.0:1787826376.855944:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563730432 00010000:00010000:3.0:1787826376.856010:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005cb54982/0x22153cd396b806b6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05c4 expref: 19 pid: 14864 timeout: 1422 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826376.856123:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 991 00000100:00100000:3.0:1787826376.856135:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa86940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:2404:x1874670563730432:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826376.856155:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826376.856196:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005cb54982/0x22153cd396b806b6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x103:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05c4 expref: 19 pid: 14864 timeout: 1422 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.856212:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005cb54982/0x22153cd396b806b6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x103:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05c4 expref: 19 pid: 14864 timeout: 1422 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.856251:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cb54982/0x22153cd396b806b6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x103:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05c4 expref: 19 pid: 14864 timeout: 1422 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.856278:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x103:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826376.856283:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x103:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826376.856293:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006c54eb30/0x22153cd396b80711 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05ee expref: 18 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.856306:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c54eb30/0x22153cd396b80711 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05ee expref: 18 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.856365:0:6503:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006c54eb30/0x22153cd396b80711 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05ee expref: 18 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826376.856382:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf41c87c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6503:1874670585187712:192.168.203.39@tcp:105: 00000100:00100000:3.0:1787826376.856573:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f5e7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826376.862298:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826376.862335:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826376.862869:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563730560 00000100:00100000:0.0:1787826376.862881:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563730560 00000100:00100000:0.0:1787826376.862956:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563730688 00000100:00100000:0.0:1787826376.862961:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563730688 00000100:00100000:0.0:1787826376.862999:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1854 00000100:00100000:0.0:1787826376.863011:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:2404:x1874670563730560:12345-192.168.203.39@tcp:2:lfs.0 00002000:00010000:0.0:1787826376.863224:0:28853:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x102:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1787826376.863237:0:28853:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x102:0x0] updating lvb mtime from disk: 1787826377 -> 1787826377 00002000:00010000:0.0:1787826376.863240:0:28853:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x102:0x0] updating lvb atime from disk: 0 -> 1787826375 00002000:00010000:0.0:1787826376.863242:0:28853:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x102:0x0] updating lvb ctime from disk: 1787826377 -> 1787826377 00002000:00010000:0.0:1787826376.863244:0:28853:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x102:0x0] updating lvb blocks from disk: 16 -> 16 00000100:00100000:0.0:1787826376.863315:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:2404:x1874670563730560:12345-192.168.203.39@tcp:2:lfs.0 Request processed in 306us (1031us total) trans 21474836940 rc 0/0 00000100:00100000:0.0:1787826376.863324:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1854 00000100:00100000:0.0:1787826376.863360:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1855 00000100:00100000:0.0:1787826376.863368:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa84b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:2404:x1874670563730688:12345-192.168.203.39@tcp:2:lfs.0 00002000:00010000:0.0:1787826376.863424:0:28853:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x103:0x0] updating lvb size from disk: 2110464 -> 2110464 00002000:00010000:0.0:1787826376.863427:0:28853:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x103:0x0] updating lvb mtime from disk: 1787826377 -> 1787826377 00002000:00010000:0.0:1787826376.863429:0:28853:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x103:0x0] updating lvb atime from disk: 0 -> 1787826375 00002000:00010000:0.0:1787826376.863431:0:28853:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x103:0x0] updating lvb ctime from disk: 1787826377 -> 1787826377 00002000:00010000:0.0:1787826376.863434:0:28853:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x103:0x0] updating lvb blocks from disk: 32 -> 32 00000100:00100000:0.0:1787826376.863466:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa84b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:2404:x1874670563730688:12345-192.168.203.39@tcp:2:lfs.0 Request processed in 99us (1130us total) trans 21474836941 rc 0/0 00000100:00100000:0.0:1787826376.863510:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1855 00000100:00100000:3.0:1787826376.863662:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf41c87c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6503:1874670585187712:192.168.203.39@tcp:105: 00010000:00010000:3.0:1787826376.863696:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826376.863757:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa86940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:2404:x1874670563730432:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 7624us (11287us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826376.863768:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 991 00000100:00100000:0.0:1787826376.870194:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826376.870547:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563730944 00000100:00100000:1.0:1787826376.870561:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563730944 00000100:00100000:1.0:1787826376.870921:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1015 00000100:00100000:1.0:1787826376.870936:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+29:53051:x1874670563730944:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:1.0:1787826376.871022:0:6521:0:(mdt_open.c:2504:mdt_close_resync_done()) ### [0x200000405:0x14:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660600/0x22153cd396b80677 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x14:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05a8 expref: 29 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.871084:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125a00/0x22153cd396b80718 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.871099:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660a00/0x22153cd396b8069a lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05af expref: 29 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.871110:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125a00/0x22153cd396b80718 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.871152:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660a00/0x22153cd396b8069a lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05af expref: 29 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826376.872845:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660a00/0x22153cd396b8069a lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05af expref: 29 pid: 6520 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826376.873339:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03977840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1874670585187840:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826376.874096:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2069f480 going to sleep for 11 seconds 00000100:00100000:1.0:1787826376.883342:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826376.884112:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03977840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1874670585187840:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826376.884151:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125a00/0x22153cd396b80718 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826376.884359:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563731072 00000100:00100000:2.0:1787826376.884369:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563731072 00010000:00010000:2.0:1787826376.884423:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660a00/0x22153cd396b8069a lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05af expref: 30 pid: 6520 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826376.884517:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 992 00000100:00100000:2.0:1787826376.884538:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce039761c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:2403:x1874670563731072:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826376.884558:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826376.884566:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660a00/0x22153cd396b8069a lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05af expref: 30 pid: 6520 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.884581:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660a00/0x22153cd396b8069a lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05af expref: 30 pid: 6520 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.884608:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660a00/0x22153cd396b8069a lrc: 0/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05af expref: 30 pid: 6520 timeout: 1422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.884736:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:2.0:1787826376.884743:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125a00/0x22153cd396b80718 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.884756:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125a00/0x22153cd396b80718 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.884764:0:10340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125a00/0x22153cd396b80718 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.884791:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826376.885055:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce039761c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+29:2403:x1874670563731072:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 527us (1727us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826376.885065:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 992 00010000:00010000:0.0:1787826376.885890:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125a00/0x22153cd396b80718 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.885903:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125a00/0x22153cd396b80718 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787826376.887057:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].13, 88 off9312 00000004:00080000:0.0:1787826376.887075:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1322898603317ns, next at 0ns, rc = 0 00000040:00080000:0.0:1787826376.887119:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].14, 88 off9400 00000004:00080000:0.0:1787826376.887124:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1322898652037ns, next at 0ns, rc = 0 00000040:00080000:0.0:1787826376.887157:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].13, 88 off9288 00000004:00080000:0.0:1787826376.888325:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1322899850185ns, next at 1309127889395ns, rc = 0 00000040:00080000:0.0:1787826376.888774:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].14, 88 off9376 00000004:00080000:0.0:1787826376.888788:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1322900316126ns, next at 1309127889395ns, rc = 0 00000001:00080000:2.0:1787826376.897193:0:34481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934670 is committed 00000004:00080000:2.0:1787826376.897215:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 15 committed 00000004:00080000:2.0:1787826376.897296:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 14 committed 00010000:00010000:0.0:1787826376.897358:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660200/0x22153cd396b806bd lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.897375:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660200/0x22153cd396b806bd lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.897384:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660200/0x22153cd396b806bd lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.897391:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05660200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826376.897398:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660200/0x22153cd396b806bd lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.897407:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660200/0x22153cd396b806bd lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.897429:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:0.0:1787826376.897433:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826376.897439:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660200/0x22153cd396b806bd lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.897445:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660200/0x22153cd396b806bd lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.897517:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d400/0x22153cd396b806f5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.897525:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d400/0x22153cd396b806f5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.897541:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d400/0x22153cd396b806f5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.897552:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0b55d400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826376.897555:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d400/0x22153cd396b806f5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.897560:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d400/0x22153cd396b806f5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.897570:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:0.0:1787826376.897572:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826376.897575:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d400/0x22153cd396b806f5 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.897581:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d400/0x22153cd396b806f5 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.897593:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b80703 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.897600:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b80703 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.897606:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b80703 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.897612:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826376.897615:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b80703 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.897637:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b80703 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.897652:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:0.0:1787826376.897654:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826376.897657:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b80703 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.897663:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b80703 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826376.898555:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf41c87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585187968:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787826376.899159:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826376.899514:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585187968 00000100:00100000:1.0:1787826376.899525:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585187968 00000100:00100000:1.0:1787826376.899608:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1856 00000100:00100000:1.0:1787826376.899620:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8ae940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:3644:x1874670585187968:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787826376.899843:0:30694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x102:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1787826376.899847:0:30694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x102:0x0] updating lvb mtime from disk: 1787826377 -> 1787826377 00002000:00010000:1.0:1787826376.899856:0:30694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x102:0x0] updating lvb atime from disk: 1787826375 -> 1787826375 00002000:00010000:1.0:1787826376.899859:0:30694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x102:0x0] updating lvb ctime from disk: 1787826377 -> 1787826377 00002000:00010000:1.0:1787826376.899861:0:30694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x102:0x0] updating lvb blocks from disk: 16 -> 16 00000004:00080000:2.0:1787826376.900387:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 14 committed 00000004:00080000:2.0:1787826376.900403:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 13 committed 00000100:00100000:2.0:1787826376.900540:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aa870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585188224:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787826376.900591:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826376.900644:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787826376.900652:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aa86580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585188352:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787826376.900676:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826376.900716:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585188224 00000100:00100000:2.0:1787826376.900720:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585188224 00000100:00100000:2.0:1787826376.900756:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585188352 00000100:00100000:2.0:1787826376.900760:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585188352 00000100:00100000:2.0:1787826376.900782:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1857 00000100:00100000:2.0:1787826376.900792:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa87c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3646:x1874670585188224:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1787826376.900924:0:30695:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x102:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1787826376.900928:0:30695:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x102:0x0] updating lvb mtime from disk: 1787826375 -> 1787826375 00002000:00010000:2.0:1787826376.900930:0:30695:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x102:0x0] updating lvb atime from disk: 1787826375 -> 1787826375 00002000:00010000:2.0:1787826376.900933:0:30695:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x102:0x0] updating lvb ctime from disk: 1787826376 -> 1787826376 00002000:00010000:2.0:1787826376.900935:0:30695:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x102:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1787826376.900972:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa87c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:3646:x1874670585188224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 181us (379us total) trans 17179869609 rc 0/0 00000100:00100000:2.0:1787826376.900980:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1857 00000100:00100000:2.0:1787826376.901000:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1858 00000100:00100000:2.0:1787826376.901007:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3646:x1874670585188352:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1787826376.901062:0:30695:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x103:0x0] updating lvb size from disk: 2110464 -> 2110464 00002000:00010000:2.0:1787826376.901065:0:30695:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x103:0x0] updating lvb mtime from disk: 1787826377 -> 1787826377 00002000:00010000:2.0:1787826376.901067:0:30695:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x103:0x0] updating lvb atime from disk: 1787826375 -> 1787826375 00002000:00010000:2.0:1787826376.901070:0:30695:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x103:0x0] updating lvb ctime from disk: 1787826377 -> 1787826377 00002000:00010000:2.0:1787826376.901072:0:30695:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x103:0x0] updating lvb blocks from disk: 48 -> 48 00000100:00100000:2.0:1787826376.901100:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:3646:x1874670585188352:12345-0@lo:2:osp-syn-1-0.0 Request processed in 93us (422us total) trans 17179869610 rc 0/0 00000100:00100000:2.0:1787826376.901107:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1858 00000100:00100000:2.0:1787826376.901149:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869605 gen 2 00000004:00080000:2.0:1787826376.901155:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3fb97c00, transno 17179869589 00000004:00080000:2.0:1787826376.901501:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf361e5a40, transno 17179869591 00000004:00080000:2.0:1787826376.901506:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf361e4780, transno 17179869592 00000004:00080000:2.0:1787826376.901509:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3f82da40, transno 17179869596 00000004:00080000:2.0:1787826376.901512:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3f82d680, transno 17179869597 00000004:00080000:2.0:1787826376.901515:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce039861c0, transno 17179869600 00000004:00080000:2.0:1787826376.901519:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce03986940, transno 17179869601 00000004:00080000:2.0:1787826376.901522:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce0300e580, transno 17179869602 00000004:00080000:2.0:1787826376.901525:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce0300c3c0, transno 17179869603 00000004:00080000:2.0:1787826376.901528:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce01fdc3c0, transno 17179869604 00000004:00080000:2.0:1787826376.901530:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce01fdf840, transno 17179869605 00000100:00100000:2.0:1787826376.901538:0:3646:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff90cf3aa86580 x1874670585188352/t17179869610(17179869610) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1787826392 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1787826376.901552:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3aa86580/2, rc 0, transno 17179869610 00000100:00100000:2.0:1787826376.901558:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aa86580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585188352:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1787826376.901574:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3aa870c0/2, rc 0, transno 17179869609 00000100:00100000:2.0:1787826376.901578:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aa870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585188224:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1787826376.901793:0:34502:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 2 in progress, 0 in flight, 11 done 00000100:00100000:2.0:1787826376.902386:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf41c87840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585188096:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787826376.902466:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826376.902994:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585188096 00000100:00100000:2.0:1787826376.903005:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585188096 00000100:00100000:2.0:1787826376.903069:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1859 00000100:00100000:2.0:1787826376.903080:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa84f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3645:x1874670585188096:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1787826376.903252:0:28853:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x103:0x0] updating lvb size from disk: 2110464 -> 2110464 00002000:00010000:2.0:1787826376.903256:0:28853:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x103:0x0] updating lvb mtime from disk: 1787826377 -> 1787826377 00002000:00010000:2.0:1787826376.903259:0:28853:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x103:0x0] updating lvb atime from disk: 1787826375 -> 1787826375 00002000:00010000:2.0:1787826376.903261:0:28853:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x103:0x0] updating lvb ctime from disk: 1787826377 -> 1787826377 00002000:00010000:2.0:1787826376.903263:0:28853:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x103:0x0] updating lvb blocks from disk: 32 -> 32 00000100:00100000:2.0:1787826376.903313:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa84f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3645:x1874670585188096:12345-0@lo:2:osp-syn-0-0.0 Request processed in 236us (863us total) trans 21474836943 rc 0/0 00000100:00100000:2.0:1787826376.903321:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1859 00000004:00080000:2.0:1787826376.903375:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf41c87840/2, rc 0, transno 21474836943 00000100:00100000:2.0:1787826376.903381:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf41c87840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585188096:0@lo:2:osp-syn-0-0.0 00000004:00010000:2.0:1787826376.903437:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dc89dafa reply state 00000000318691be transno 8589934670 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125a00/0x22153cd396b80718 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.903490:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125a00/0x22153cd396b80718 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.903501:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:2.0:1787826376.903505:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1787826376.903510:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787826376.903516:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:2.0:1787826376.903518:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787826376.903526:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660600/0x22153cd396b80677 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x14:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05a8 expref: 20 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1787826376.904327:0:6521:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1787826376.904413:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:53051:x1874670563730944:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 33477us (34230us total) trans 8589934670 rc 0/0 00000100:00100000:2.0:1787826376.904428:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1015 00010000:00010000:2.0:1787826376.907743:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125a00/0x22153cd396b80718 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.907764:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125a00/0x22153cd396b80718 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.907772:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125a00/0x22153cd396b80718 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.907779:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05125a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826376.907784:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125a00/0x22153cd396b80718 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.907793:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125a00/0x22153cd396b80718 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.907814:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:2.0:1787826376.907818:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826376.907823:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125a00/0x22153cd396b80718 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.907829:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125a00/0x22153cd396b80718 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826376.909044:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826376.909208:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563731200 00000100:00100000:2.0:1787826376.909219:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563731200 00000100:00100000:2.0:1787826376.909302:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3463 00000100:00100000:2.0:1787826376.909315:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:53051:x1874670563731200:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826376.909359:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826376.909387:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d600/0x22153cd396b8071f lrc: 2/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab05f5 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.909502:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d600/0x22153cd396b8071f lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05f5 expref: 20 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.909519:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d600/0x22153cd396b8071f lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05f5 expref: 20 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826376.909804:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:2.0:1787826376.909809:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826376.909814:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0b55d600, rc 0) 00000100:00100000:2.0:1787826376.909889:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:53051:x1874670563731200:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 576us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826376.909897:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3463 00000100:00100000:1.0:1787826376.913024:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8ae940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3644:x1874670585187968:12345-0@lo:2:osp-syn-0-0.0 Request processed in 13391us (13852us total) trans 21474836942 rc 0/0 00000100:00100000:1.0:1787826376.913041:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1856 00000004:00080000:0.0:1787826376.913602:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf41c87c00/2, rc 0, transno 21474836942 00000100:00100000:0.0:1787826376.913613:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf41c87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585187968:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787826376.915332:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826376.916088:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563731456 00000100:00100000:1.0:1787826376.916102:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563731456 00000100:00100000:1.0:1787826376.916179:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1016 00000100:00100000:1.0:1787826376.916189:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf10477850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:53051:x1874670563731456:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:1.0:1787826376.916922:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf10477850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:53051:x1874670563731456:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 660us (1525us total) trans 8589934671 rc 0/0 00000100:00100000:1.0:1787826376.916934:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1016 00000100:00100000:2.0:1787826376.963150:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826376.963690:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563731712 00000100:00100000:0.0:1787826376.963702:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563731712 00000100:00100000:3.0:1787826376.964143:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787826376.964340:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f82da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585188480:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826376.964517:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826376.965018:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585188480 00000100:00100000:2.0:1787826376.965026:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585188480 00000100:00100000:2.0:1787826376.965089:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1367 00000100:00100000:2.0:1787826376.965102:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3645:x1874670585188480:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787826376.965153:0:7796:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445957632 avail 1299718144 00000100:00100000:2.0:1787826376.967078:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3645:x1874670585188480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1967us (2549us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826376.967094:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1367 00000100:00100000:3.0:1787826376.968527:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 8589934617 gen 2 00000004:00080000:3.0:1787826376.968549:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934617 committed transno 8589934617 00000100:00100000:3.0:1787826376.968627:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f82da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585188480:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826376.969570:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787826376.969591:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03976580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585188608:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787826376.969869:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826376.971646:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585188608 00000100:00100000:2.0:1787826376.971665:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585188608 00000100:00100000:2.0:1787826376.971741:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1368 00000100:00100000:2.0:1787826376.971753:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf07dbcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874670585188608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787826376.971805:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446236160 avail 1299996672 00000100:00100000:2.0:1787826376.971913:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf07dbcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874670585188608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 162us (2045us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826376.971922:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1368 00000100:00100000:0.0:1787826376.972683:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3464 00000100:00100000:0.0:1787826376.972699:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:53052:x1874670563731712:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826376.972720:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826376.972747:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660200/0x22153cd396b80726 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab05fc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.973122:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661200/0x22153cd396b8072d lrc: 3/1,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.973140:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661200/0x22153cd396b8072d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.973153:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661200/0x22153cd396b8072d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.973176:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660800/0x22153cd396b80734 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.973183:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660800/0x22153cd396b80734 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.973190:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660800/0x22153cd396b80734 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.973304:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661200/0x22153cd396b8072d lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.973312:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661200/0x22153cd396b8072d lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.973318:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661200/0x22153cd396b8072d lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.973325:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661200/0x22153cd396b8072d lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.973331:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05661200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826376.973336:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661200/0x22153cd396b8072d lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.973345:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661200/0x22153cd396b8072d lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.973360:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0x0 (ffff90cf39e67500) 00010000:00010000:0.0:1787826376.973364:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826376.973369:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661200/0x22153cd396b8072d lrc: 3/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.973377:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661200/0x22153cd396b8072d lrc: 0/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.973394:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660800/0x22153cd396b80734 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.973401:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660800/0x22153cd396b80734 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.973408:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660800/0x22153cd396b80734 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.973622:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05660800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826376.973627:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660800/0x22153cd396b80734 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.973633:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660800/0x22153cd396b80734 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.973643:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0xe1e61496 (ffff90cf371d2a00) 00010000:00010000:0.0:1787826376.973646:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826376.973648:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660800/0x22153cd396b80734 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.973654:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660800/0x22153cd396b80734 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.973702:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660200/0x22153cd396b80726 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05fc expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.973733:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0x0 (ffff90cf39e67500) 00010000:00010000:0.0:1787826376.973735:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787826376.973739:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660200/0x22153cd396b80726 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05fc expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826376.973749:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05660200, rc 0) 00000100:00100000:0.0:1787826376.974009:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:53052:x1874670563731712:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1315us (10875us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826376.974018:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3464 00000100:00100000:1.0:1787826376.974027:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03976580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585188608:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826376.976245:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a8ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585189120:0@lo:400:kworker.0 00000100:00100000:0.0:1787826376.976336:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826376.976383:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fdf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874670585189632:0@lo:400:kworker.0 00000100:00100000:0.0:1787826376.976426:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826376.976467:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787826376.976492:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a8af0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585188992:0@lo:400:kworker.0 00000100:00100000:2.0:1787826376.976493:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a8acf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e3c550b8-2c3c-46c3-ad36-671c284167ea:3646:1874670585188736:0@lo:400:kworker.0 00000100:00100000:0.0:1787826376.976516:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826376.976542:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826376.976602:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a8ada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874670585188864:0@lo:400:kworker.0 00000100:00100000:3.0:1787826376.976903:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585189120 00000100:00100000:3.0:1787826376.976914:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585189120 00000100:00100000:3.0:1787826376.976987:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585188992 00000100:00100000:3.0:1787826376.976991:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585188992 00000100:00100000:3.0:1787826376.977021:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 899 00000100:00100000:3.0:1787826376.977034:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1874670585189120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826376.977901:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fdc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1874670585189504:0@lo:400:kworker.0 00000100:00100000:2.0:1787826376.977953:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a8aed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874670585189248:0@lo:400:kworker.0 00000100:00100000:2.0:1787826376.978003:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826376.978027:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fdd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874670585189760:0@lo:400:kworker.0 00000100:00100000:2.0:1787826376.978051:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826376.978101:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585189632 00000100:00100000:2.0:1787826376.978109:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585189632 00000100:00100000:2.0:1787826376.978151:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585189248 00000100:00100000:2.0:1787826376.978154:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585189248 00000100:00100000:0.0:1787826376.978197:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826376.978239:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585189760 00000100:00100000:0.0:1787826376.978243:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585189760 00000100:00100000:0.0:1787826376.978272:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585189504 00000100:00100000:0.0:1787826376.978275:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585189504 00000100:00100000:0.0:1787826376.978299:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1522 00000100:00100000:0.0:1787826376.978307:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874670585189632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826376.978312:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1523 00000100:00100000:2.0:1787826376.978318:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874670585189760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826376.978356:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874670585189632:12345-0@lo:400:kworker.0 Request processed in 50us (1943us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826376.978365:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1522 00000100:00100000:0.0:1787826376.978384:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1524 00000100:00100000:0.0:1787826376.978390:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f877480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874670585189504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826376.982359:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f877480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874670585189504:12345-0@lo:400:kworker.0 Request processed in 3950us (4142us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826376.982376:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1524 00000100:00100000:0.0:1787826376.982568:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1525 00000100:00100000:0.0:1787826376.982585:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874670585189248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826376.982647:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874670585189248:12345-0@lo:400:kworker.0 Request processed in 70us (4644us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826376.983108:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874670585189760:12345-0@lo:400:kworker.0 Request processed in 4787us (5053us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826376.983118:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1523 00000100:00100000:2.0:1787826376.983303:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a8aed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874670585189248:0@lo:400:kworker.0 00000100:00100000:2.0:1787826376.983321:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fdd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874670585189760:0@lo:400:kworker.0 00000100:00100000:1.0:1787826376.983636:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826376.983680:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fdc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874670585189376:0@lo:400:kworker.0 00000100:00100000:1.0:1787826376.983718:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826376.983762:0:34488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585188736 00000100:00100000:2.0:1787826376.983764:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585188864 00000100:00100000:1.0:1787826376.983771:0:34488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585188736 00000100:00100000:2.0:1787826376.983771:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585188864 00000100:00100000:2.0:1787826376.983812:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585189376 00000100:00100000:2.0:1787826376.983815:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585189376 00000100:00100000:1.0:1787826376.983843:0:34488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787826376.983853:0:34488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf39ccf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3c550b8-2c3c-46c3-ad36-671c284167ea+24:3646:x1874670585188736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826376.983901:0:34488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf39ccf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3c550b8-2c3c-46c3-ad36-671c284167ea+24:3646:x1874670585188736:12345-0@lo:400:kworker.0 Request processed in 50us (7358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826376.983908:0:34488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787826376.983955:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a8acf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e3c550b8-2c3c-46c3-ad36-671c284167ea:3646:1874670585188736:0@lo:400:kworker.0 00000100:00100000:3.0:1787826376.983965:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1874670585189120:12345-0@lo:400:kworker.0 Request processed in 6930us (7626us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826376.983978:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 899 00000100:00100000:3.0:1787826376.984005:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 900 00000100:00100000:3.0:1787826376.984015:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1874670585188992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826376.984051:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1874670585188992:12345-0@lo:400:kworker.0 Request processed in 39us (7534us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826376.984057:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 900 00000100:00100000:2.0:1787826376.984133:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1526 00000100:00100000:2.0:1787826376.984141:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03976580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874670585188864:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787826376.984302:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787826376.984309:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787826376.984312:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787826376.984315:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826376.984331:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1527 00000100:00100000:3.0:1787826376.984340:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03974f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874670585189376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826376.984547:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03974f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874670585189376:12345-0@lo:400:kworker.0 Request processed in 208us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826376.984555:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1527 00000100:00100000:3.0:1787826376.984718:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826376.984740:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563731968 00000100:00100000:3.0:1787826376.984746:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563731968 00000100:00100000:3.0:1787826376.984773:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3465 00000100:00100000:3.0:1787826376.984780:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:53052:x1874670563731968:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826376.984796:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826376.984822:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b8073b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0603 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826376.985088:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x13:0x0]: returning size 4096 00000100:00100000:2.0:1787826376.985300:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03976580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874670585188864:12345-0@lo:400:kworker.0 Request processed in 1158us (1665us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826376.985309:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1526 00000100:00100000:0.0:1787826376.985354:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1525 00010000:00010000:3.0:1787826376.985743:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b8073b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0603 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.985763:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ce01f45300) 00010000:00010000:3.0:1787826376.985767:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787826376.985772:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b8073b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0603 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826376.985788:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401a00, rc 0) 00000100:00100000:0.0:1787826376.987558:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a8af0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585188992:0@lo:400:kworker.0 00000100:00100000:0.0:1787826376.987604:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fdc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1874670585189504:0@lo:400:kworker.0 00000100:00100000:0.0:1787826376.987619:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a8ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585189120:0@lo:400:kworker.0 00000100:00100000:0.0:1787826376.987633:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fdf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874670585189632:0@lo:400:kworker.0 00000100:00100000:3.0:1787826376.987963:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:53052:x1874670563731968:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 3178us (3241us total) trans 8589934672 rc 301/301 00000100:00100000:3.0:1787826376.987974:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3465 00000100:00100000:1.0:1787826376.988125:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a8ada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874670585188864:0@lo:400:kworker.0 00000100:00100000:1.0:1787826376.988143:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fdc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874670585189376:0@lo:400:kworker.0 00000100:00100000:0.0:1787826377.001358:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826377.001511:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563732096 00000100:00100000:3.0:1787826377.001525:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563732096 00000100:00100000:3.0:1787826377.001622:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3466 00000100:00100000:3.0:1787826377.001647:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f877840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:53052:x1874670563732096:12345-192.168.203.39@tcp:34:lfs.0 00000100:00080000:0.0:1787826377.001706:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787826377.001756:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b80749 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.001784:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b80749 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.001800:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b80749 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.001819:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b80750 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.001827:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b80750 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.001845:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b80750 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.002121:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b80757 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.002131:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b80757 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.002140:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b80757 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826377.002190:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x14:0x0]: returning size 2110464 00000004:00200000:3.0:1787826377.002195:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826377.002210:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b80757 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.002225:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b80749 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.002235:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b80749 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.002241:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b80749 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.002247:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826377.002252:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b80749 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.002260:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b80749 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.002275:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0x0 (ffff90cf39e67500) 00010000:00010000:3.0:1787826377.002278:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826377.002284:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b80749 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.002290:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b80749 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.002306:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b80750 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.002311:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b80750 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.002317:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b80750 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.002322:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826377.002325:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b80750 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.002331:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b80750 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.002338:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0xe1e61496 (ffff90cf39656f00) 00010000:00010000:3.0:1787826377.002341:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826377.002343:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b80750 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.002350:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b80750 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.002369:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b80757 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.002375:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b80757 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.002382:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b80757 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.002387:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826377.002390:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b80757 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.002396:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b80757 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.002403:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:3.0:1787826377.002405:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826377.002409:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b80757 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.002415:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b80757 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826377.003042:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f877840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:53052:x1874670563732096:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 1390us (1698us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826377.003054:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3466 00000100:00100000:3.0:1787826377.008140:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826377.008541:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563732352 00000100:00100000:2.0:1787826377.008556:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563732352 00000100:00100000:2.0:1787826377.008647:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1017 00000100:00100000:2.0:1787826377.008662:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:53052:x1874670563732352:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:2.0:1787826377.008978:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+23:53052:x1874670563732352:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 319us (853us total) trans 8589934673 rc 0/0 00000100:00100000:2.0:1787826377.008988:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1017 00010000:00010000:2.0:1787826377.028097:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826377.057785:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826377.059082:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563732608 00000100:00100000:2.0:1787826377.059102:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563732608 00000100:00100000:2.0:1787826377.059200:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3467 00000100:00100000:2.0:1787826377.059212:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+23:53054:x1874670563732608:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826377.060495:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826377.061232:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c000/0x22153cd396b8075e lrc: 2/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab060a expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.063111:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c800/0x22153cd396b80765 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.063141:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c800/0x22153cd396b80765 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.063156:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c800/0x22153cd396b80765 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.063190:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c200/0x22153cd396b8076c lrc: 3/1,0 mode: --/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.063198:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c200/0x22153cd396b8076c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.063205:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c200/0x22153cd396b8076c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.064828:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c400/0x22153cd396b80773 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.065228:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c400/0x22153cd396b80773 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.065246:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c400/0x22153cd396b80773 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826377.065266:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x14:0x0]: returning size 2110464 00010000:00010000:2.0:1787826377.065408:0:8247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c800/0x22153cd396b80765 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.065417:0:8247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c800/0x22153cd396b80765 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.065424:0:8247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c800/0x22153cd396b80765 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.065431:0:8247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0b55c800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826377.065436:0:8247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c800/0x22153cd396b80765 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.065459:0:8247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c800/0x22153cd396b80765 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.065507:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0x0 (ffff90cf39e67500) 00010000:00010000:2.0:1787826377.065512:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826377.065518:0:8247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c800/0x22153cd396b80765 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.065525:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c800/0x22153cd396b80765 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.067228:0:8247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c200/0x22153cd396b8076c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.067239:0:8247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c200/0x22153cd396b8076c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.067247:0:8247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c200/0x22153cd396b8076c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.067254:0:8247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0b55c200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826377.067259:0:8247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c200/0x22153cd396b8076c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.067268:0:8247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c200/0x22153cd396b8076c lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.067285:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0xe1e61496 (ffff90cf39e67200) 00010000:00010000:2.0:1787826377.067289:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826377.067294:0:8247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c200/0x22153cd396b8076c lrc: 2/0,0 mode: --/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.067305:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c200/0x22153cd396b8076c lrc: 0/0,0 mode: --/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.067399:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c000/0x22153cd396b8075e lrc: 0/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab060a expref: 26 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.067417:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c400/0x22153cd396b80773 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab060a expref: 25 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.067425:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:2.0:1787826377.067428:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826377.067431:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0b55c400, rc 0) 00000100:00100000:2.0:1787826377.070151:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:53054:x1874670563732608:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 10922us (12381us total) trans 8589934674 rc 0/0 00000100:00100000:2.0:1787826377.070177:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3467 00000100:00100000:0.0:1787826377.079184:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826377.079426:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563732736 00000100:00100000:2.0:1787826377.079442:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563732736 00000100:00100000:2.0:1787826377.079578:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1860 00000100:00100000:2.0:1787826377.079592:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f876580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:2404:x1874670563732736:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:2.0:1787826377.079669:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8aefba1/0x22153cd396b80781 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.079696:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000089ccfe43/0x22153cd396b8070a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05e7 expref: 20 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.079707:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x102:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787826377.079713:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x102:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826377.079719:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8aefba1/0x22153cd396b80781 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.079762:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000089ccfe43/0x22153cd396b8070a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05e7 expref: 20 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.079779:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000089ccfe43/0x22153cd396b8070a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05e7 expref: 20 pid: 30695 timeout: 1423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826377.079796:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aa85a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1874670585189888:192.168.203.39@tcp:104: 00000100:00080000:0.0:1787826377.080309:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826377.080427:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce05b56480 going to sleep for 11 seconds 00000100:00100000:3.0:1787826377.083832:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826377.084365:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563732864 00000100:00100000:2.0:1787826377.084379:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563732864 00000100:00100000:2.0:1787826377.084468:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1861 00000100:00100000:2.0:1787826377.084821:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:2404:x1874670563732864:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:3.0:1787826377.085184:0:30398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b80788 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.085211:0:30398:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006c54eb30/0x22153cd396b80711 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05ee expref: 21 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.085222:0:30398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x103:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787826377.085227:0:30398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x103:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826377.085233:0:30398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b80788 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.085280:0:30398:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006c54eb30/0x22153cd396b80711 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05ee expref: 21 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.085295:0:30398:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006c54eb30/0x22153cd396b80711 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05ee expref: 21 pid: 8436 timeout: 1423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826377.085321:0:30398:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f82ed00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:30398:1874670585190016:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826377.085441:0:30398:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f5e7840 going to sleep for 11 seconds 00000100:00100000:2.0:1787826377.091944:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aa85a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1874670585189888:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826377.091990:0:8436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f8aefba1/0x22153cd396b80781 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826377.092293:0:30398:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f82ed00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:30398:1874670585190016:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826377.092312:0:30398:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b80788 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826377.094749:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826377.095105:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563732992 00000100:00100000:0.0:1787826377.095119:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563732992 00010000:00010000:0.0:1787826377.095188:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000089ccfe43/0x22153cd396b8070a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05e7 expref: 22 pid: 30695 timeout: 1423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826377.095249:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 993 00000100:00100000:0.0:1787826377.095260:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:2404:x1874670563732992:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826377.095280:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826377.095309:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000089ccfe43/0x22153cd396b8070a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05e7 expref: 22 pid: 30695 timeout: 1423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.095326:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000089ccfe43/0x22153cd396b8070a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05e7 expref: 22 pid: 30695 timeout: 1423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.095356:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089ccfe43/0x22153cd396b8070a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x102:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05e7 expref: 22 pid: 30695 timeout: 1423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.095380:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x102:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826377.095385:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x102:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826377.095392:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f8aefba1/0x22153cd396b80781 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.095404:0:10341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8aefba1/0x22153cd396b80781 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.095446:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826377.095595:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:2404:x1874670563732992:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 336us (860us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826377.095604:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 993 00010000:00010000:2.0:1787826377.097561:0:8436:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f8aefba1/0x22153cd396b80781 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.097587:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8aefba1/0x22153cd396b80781 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.097654:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8aefba1/0x22153cd396b80781 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.097665:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f8aefba1/0x22153cd396b80781 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.097674:0:8436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f8aefba1/0x22153cd396b80781 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.097683:0:8436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0b55c000 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826377.097691:0:8436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8aefba1/0x22153cd396b80781 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.097702:0:8436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8aefba1/0x22153cd396b80781 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.097729:0:8436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f8aefba1/0x22153cd396b80781 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.097738:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8aefba1/0x22153cd396b80781 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826377.097879:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f876580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:2404:x1874670563732736:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 18285us (18713us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826377.098280:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1860 00000100:00100000:3.0:1787826377.104379:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826377.104524:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563733120 00000100:00100000:0.0:1787826377.105012:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563733120 00010000:00010000:0.0:1787826377.105071:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006c54eb30/0x22153cd396b80711 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05ee expref: 20 pid: 8436 timeout: 1423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826377.105315:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 994 00000100:00100000:0.0:1787826377.105329:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:2404:x1874670563733120:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826377.105350:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826377.105379:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006c54eb30/0x22153cd396b80711 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05ee expref: 20 pid: 8436 timeout: 1423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.105397:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006c54eb30/0x22153cd396b80711 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05ee expref: 20 pid: 8436 timeout: 1423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.105428:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c54eb30/0x22153cd396b80711 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x103:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05ee expref: 20 pid: 8436 timeout: 1423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.105460:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x103:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826377.105466:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x103:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826377.105537:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b80788 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.105552:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b80788 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.105586:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826377.105676:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:2404:x1874670563733120:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 349us (1311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826377.105685:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 994 00010000:00010000:2.0:1787826377.107417:0:30398:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b80788 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.107443:0:30398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b80788 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.107510:0:30398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b80788 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.107520:0:30398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b80788 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.107539:0:30398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b80788 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.107548:0:30398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400c00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826377.107553:0:30398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b80788 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.107563:0:30398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b80788 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.107587:0:30398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b80788 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.107596:0:30398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b80788 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826377.107722:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+18:2404:x1874670563732864:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 23190us (23901us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826377.107733:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1861 00000100:00100000:0.0:1787826377.114382:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826377.114844:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563733376 00000100:00100000:2.0:1787826377.114978:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563733376 00000100:00100000:2.0:1787826377.115107:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3468 00000100:00100000:2.0:1787826377.115120:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f877c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:53054:x1874670563733376:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:2.0:1787826377.115212:0:9966:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826377.115250:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661e00/0x22153cd396b805f9 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0570 expref: 25 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.115274:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:2.0:1787826377.115280:0:9966:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826377.115308:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c200/0x22153cd396b8078f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.115324:0:9966:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c400/0x22153cd396b80773 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab060a expref: 24 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.115334:0:9966:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d600/0x22153cd396b8071f lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05f5 expref: 24 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.115343:0:9966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c200/0x22153cd396b8078f lrc: 5/0,1 mode: --/EX res: [0x200000405:0x14:0x0].0x0 bits 0x2a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.115383:0:9966:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d600/0x22153cd396b8071f lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05f5 expref: 24 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.115400:0:9966:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d600/0x22153cd396b8071f lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05f5 expref: 24 pid: 16564 timeout: 1423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826377.115416:0:9966:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aa85a40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9966:1874670585190144:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826377.116017:0:9966:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c400/0x22153cd396b80773 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab060a expref: 24 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.116031:0:9966:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c400/0x22153cd396b80773 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab060a expref: 24 pid: 8247 timeout: 1423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826377.116041:0:9966:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aa87480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9966:1874670585190272:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826377.118862:0:9966:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce05b56600 going to sleep for 11 seconds 00000100:00100000:0.0:1787826377.122577:0:9966:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aa85a40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9966:1874670585190144:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826377.122800:0:9966:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aa87480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9966:1874670585190272:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826377.122840:0:9966:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c200/0x22153cd396b8078f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x14:0x0].0x0 bits 0x2a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826377.122957:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826377.123017:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826377.123052:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563733504 00000100:00100000:0.0:1787826377.123061:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563733504 00010000:00010000:0.0:1787826377.123120:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d600/0x22153cd396b8071f lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05f5 expref: 25 pid: 16564 timeout: 1423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826377.123155:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563733632 00000100:00100000:0.0:1787826377.123158:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563733632 00000100:00100000:2.0:1787826377.123176:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 995 00010000:00010000:0.0:1787826377.123181:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c400/0x22153cd396b80773 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab060a expref: 26 pid: 8247 timeout: 1423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826377.123187:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa87840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:2404:x1874670563733504:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826377.123207:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787826377.123210:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 996 00000100:00100000:0.0:1787826377.123215:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:2402:x1874670563733632:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826377.123215:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d600/0x22153cd396b8071f lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05f5 expref: 26 pid: 16564 timeout: 1423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.123224:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826377.123228:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c400/0x22153cd396b80773 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab060a expref: 26 pid: 8247 timeout: 1423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.123239:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c400/0x22153cd396b80773 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab060a expref: 26 pid: 8247 timeout: 1423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.123271:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c400/0x22153cd396b80773 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab060a expref: 26 pid: 8247 timeout: 1423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.123292:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:0.0:1787826377.123297:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c200/0x22153cd396b8078f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x14:0x0].0x0 bits 0x2a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.123643:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c200/0x22153cd396b8078f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x14:0x0].0x0 bits 0x2a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.123652:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c200/0x22153cd396b8078f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x14:0x0].0x0 bits 0x2a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.123659:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826377.123693:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d600/0x22153cd396b8071f lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05f5 expref: 25 pid: 16564 timeout: 1423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.123709:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d600/0x22153cd396b8071f lrc: 0/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05f5 expref: 25 pid: 16564 timeout: 1423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826377.123835:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:2402:x1874670563733632:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 617us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826377.123845:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 996 00010000:00010000:2.0:1787826377.123996:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:2.0:1787826377.124001:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c200/0x22153cd396b8078f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x14:0x0].0x0 bits 0x2a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.124010:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c200/0x22153cd396b8078f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0x2a/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.124018:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c200/0x22153cd396b8078f lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0x2a/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.124055:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826377.124078:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa87840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+23:2404:x1874670563733504:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 893us (1122us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826377.124086:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 995 00010000:00010000:1.0:1787826377.124508:0:9966:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c200/0x22153cd396b8078f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0x2a/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826377.124517:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c200/0x22153cd396b8078f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0x2a/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826377.125031:0:9966:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c583cca4 reply state 00000000912a97a5 transno 8589934675 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c200/0x22153cd396b8078f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0x2a/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826377.125052:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c200/0x22153cd396b8078f lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2a/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826377.125061:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:1.0:1787826377.125063:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2a 00000100:00100000:1.0:1787826377.125067:0:9966:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826377.127354:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f877c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:53054:x1874670563733376:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 12220us (12970us total) trans 8589934675 rc 0/0 00000100:00100000:1.0:1787826377.127368:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3468 00000100:00100000:2.0:1787826377.132422:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826377.132539:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563733888 00000100:00100000:1.0:1787826377.132552:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563733888 00000100:00100000:1.0:1787826377.132643:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1018 00000100:00100000:1.0:1787826377.132655:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa85a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:53054:x1874670563733888:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:1.0:1787826377.133545:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa85a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:53054:x1874670563733888:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 886us (1144us total) trans 8589934676 rc 0/0 00000100:00100000:1.0:1787826377.133558:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1018 00000100:00100000:0.0:1787826377.165208:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826377.165363:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563734016 00000100:00100000:3.0:1787826377.165377:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563734016 00000100:00100000:3.0:1787826377.165468:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3469 00000100:00100000:3.0:1787826377.165515:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f875e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:53055:x1874670563734016:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826377.165997:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826377.166031:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b80796 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0611 expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.166124:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b8079d lrc: 3/1,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.166142:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b8079d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.166156:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b8079d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.166172:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b807a4 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.166180:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b807a4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.166187:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b807a4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.166505:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b807ab lrc: 3/1,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.166515:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b807ab lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.166521:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b807ab lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826377.167024:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x14:0x0]: returning size 2110464 00000004:00200000:3.0:1787826377.167031:0:32404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826377.167057:0:32404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b807ab lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.167072:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b807ab lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.167083:0:32404:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b8079d lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.167089:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b8079d lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.167096:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b8079d lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.167107:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b8079d lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.167114:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826377.167118:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b8079d lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.167128:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b8079d lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.167142:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0x0 (ffff90cf39e67500) 00010000:00010000:3.0:1787826377.167145:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826377.167150:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b8079d lrc: 3/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.167157:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b8079d lrc: 0/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.167174:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b807a4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.167179:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b807a4 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.167184:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b807a4 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.167189:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826377.167192:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b807a4 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.167202:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b807a4 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.167208:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0xe1e61496 (ffff90cf39656f00) 00010000:00010000:3.0:1787826377.167211:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826377.167214:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b807a4 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.167219:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b807a4 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.167373:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b80796 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0611 expref: 27 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.167390:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b807ab lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0611 expref: 26 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.167398:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:3.0:1787826377.167400:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826377.167402:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400c00, rc 0) 00000100:00100000:3.0:1787826377.168275:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f875e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:53055:x1874670563734016:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 2752us (3071us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826377.168287:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3469 00000100:00100000:0.0:1787826377.174588:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826377.175549:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563734272 00000100:00100000:2.0:1787826377.175565:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563734272 00000100:00100000:2.0:1787826377.175659:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3470 00000100:00100000:2.0:1787826377.175671:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f875680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:53055:x1874670563734272:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826377.175697:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826377.175726:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c800/0x22153cd396b807b2 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0618 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.176256:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55de00/0x22153cd396b807b9 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.176277:0:16564:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b807ab lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0611 expref: 27 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.176294:0:16564:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55de00/0x22153cd396b807b9 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x14:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.176341:0:16564:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b807ab lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0611 expref: 27 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.176359:0:16564:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b807ab lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0611 expref: 27 pid: 32404 timeout: 1423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826377.176376:0:16564:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aa85e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:16564:1874670585190400:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826377.176551:0:16564:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce05b56480 going to sleep for 11 seconds 00000100:00100000:0.0:1787826377.182124:0:16564:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aa85e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:16564:1874670585190400:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826377.182167:0:16564:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55de00/0x22153cd396b807b9 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x14:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826377.183918:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826377.184283:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563734400 00000100:00100000:3.0:1787826377.184295:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563734400 00010000:00010000:3.0:1787826377.184346:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b807ab lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0611 expref: 28 pid: 32404 timeout: 1423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826377.184402:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 997 00000100:00100000:3.0:1787826377.184412:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf08abb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+28:2403:x1874670563734400:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826377.184433:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826377.184441:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b807ab lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0611 expref: 28 pid: 32404 timeout: 1423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.184465:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b807ab lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0611 expref: 28 pid: 32404 timeout: 1423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.184835:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b807ab lrc: 0/0,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0611 expref: 28 pid: 32404 timeout: 1423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.184856:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:3.0:1787826377.184862:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55de00/0x22153cd396b807b9 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x14:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.184873:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55de00/0x22153cd396b807b9 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x14:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.184883:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55de00/0x22153cd396b807b9 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x14:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.184967:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826377.185096:0:16564:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55de00/0x22153cd396b807b9 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x14:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.185104:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55de00/0x22153cd396b807b9 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x14:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826377.185127:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x14:0x0]: returning size 2110464 00010000:00010000:0.0:1787826377.185297:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c800/0x22153cd396b807b2 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0618 expref: 29 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.185314:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55de00/0x22153cd396b807b9 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x14:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0618 expref: 28 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.185322:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:0.0:1787826377.185324:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787826377.185327:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0b55de00, rc 0) 00000100:00100000:3.0:1787826377.185370:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf08abb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+28:2403:x1874670563734400:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 959us (1463us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826377.185379:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 997 00000100:00100000:0.0:1787826377.187046:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f875680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:53055:x1874670563734272:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 11364us (12460us total) trans 8589934677 rc 0/0 00000100:00100000:0.0:1787826377.187059:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3470 00000100:00100000:0.0:1787826377.193840:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826377.194046:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563734528 00000100:00100000:2.0:1787826377.194059:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563734528 00000100:00100000:2.0:1787826377.194157:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3471 00000100:00100000:2.0:1787826377.194168:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f874f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:53055:x1874670563734528:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826377.194199:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826377.194234:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c400/0x22153cd396b807c7 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab061f expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.194353:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d200/0x22153cd396b807ce lrc: 3/1,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.194370:0:8247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55de00/0x22153cd396b807b9 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x14:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0618 expref: 28 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.194380:0:8247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d200/0x22153cd396b807ce lrc: 4/1,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.194427:0:8247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55de00/0x22153cd396b807b9 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x14:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0618 expref: 28 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.194442:0:8247:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55de00/0x22153cd396b807b9 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x14:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0618 expref: 28 pid: 16564 timeout: 1423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826377.194868:0:8247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aa86940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8247:1874670585190528:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826377.195033:0:8247:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce05b560c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826377.200073:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826377.200236:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563734656 00000100:00100000:3.0:1787826377.200249:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563734656 00010000:00010000:3.0:1787826377.200304:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55de00/0x22153cd396b807b9 lrc: 5/0,0 mode: CW/CW res: [0x200000405:0x14:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0618 expref: 29 pid: 16564 timeout: 1423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826377.200357:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 998 00000100:00100000:3.0:1787826377.200369:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+29:2404:x1874670563734656:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826377.200390:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826377.200399:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55de00/0x22153cd396b807b9 lrc: 5/0,0 mode: CW/CW res: [0x200000405:0x14:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0618 expref: 29 pid: 16564 timeout: 1423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.200416:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55de00/0x22153cd396b807b9 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x14:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0618 expref: 29 pid: 16564 timeout: 1423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.200458:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:3.0:1787826377.200464:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d200/0x22153cd396b807ce lrc: 3/1,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.200500:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d200/0x22153cd396b807ce lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.200510:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d200/0x22153cd396b807ce lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.200546:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826377.200637:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+29:2404:x1874670563734656:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 264us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826377.200646:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 998 00010000:00010000:0.0:1787826377.204376:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55de00/0x22153cd396b807b9 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x14:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0618 expref: 28 pid: 16564 timeout: 1423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826377.204409:0:8247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aa86940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8247:1874670585190528:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826377.204441:0:8247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d200/0x22153cd396b807ce lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.204465:0:8247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d200/0x22153cd396b807ce lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.204492:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d200/0x22153cd396b807ce lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826377.204836:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x14:0x0]: returning size 2110464 00000004:00200000:0.0:1787826377.204843:0:8247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826377.204944:0:8247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d200/0x22153cd396b807ce lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.204993:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c400/0x22153cd396b807c7 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab061f expref: 28 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.205012:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d200/0x22153cd396b807ce lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab061f expref: 27 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.205022:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:0.0:1787826377.205026:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826377.205030:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0b55d200, rc 0) 00000100:00100000:0.0:1787826377.205178:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f874f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:53055:x1874670563734528:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 11009us (11353us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826377.205188:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3471 00000100:00100000:2.0:1787826377.210155:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826377.210307:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563734912 00000100:00100000:1.0:1787826377.210321:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563734912 00000100:00100000:1.0:1787826377.210440:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3472 00000100:00100000:1.0:1787826377.210464:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa87840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:53055:x1874670563734912:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826377.210518:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826377.210562:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125800/0x22153cd396b807d5 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0626 expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826377.211084:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05124200/0x22153cd396b807dc lrc: 3/0,1 mode: --/PW res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826377.211105:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05124200/0x22153cd396b807dc lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x14:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826377.211119:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05124200/0x22153cd396b807dc lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x14:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826377.211134:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x14:0x0]: returning size 2110464 00010000:00010000:1.0:1787826377.211280:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125800/0x22153cd396b807d5 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0626 expref: 30 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826377.211303:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05124200/0x22153cd396b807dc lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x14:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0626 expref: 29 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826377.211315:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:1.0:1787826377.211318:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787826377.211322:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05124200, rc 0) 00000100:00100000:1.0:1787826377.211405:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa87840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+29:53055:x1874670563734912:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 955us (1265us total) trans 8589934678 rc 0/0 00000100:00100000:1.0:1787826377.211414:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3472 00000100:00100000:1.0:1787826377.220299:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826377.220346:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826377.220420:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563735040 00000100:00100000:2.0:1787826377.220432:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563735040 00000100:00100000:2.0:1787826377.220536:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563735168 00000100:00100000:2.0:1787826377.220539:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563735168 00000100:00100000:2.0:1787826377.220575:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1862 00000100:00100000:2.0:1787826377.220586:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03975a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:2401:x1874670563735040:12345-192.168.203.39@tcp:1:lfs.0 00002000:00010000:2.0:1787826377.220687:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x102:0x0] initial LVB size: 2097152, mtime: 0x6a9010c9, atime: 0x6a9010c7, ctime: 0x6a9010c9, blocks: 0x10 00010000:00010000:2.0:1787826377.220700:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000084ef313/0x22153cd396b807ea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.220837:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x102:0x0].0x0 since=1323s v=(0 0) 00010000:00010000:2.0:1787826377.220843:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x102:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826377.220862:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000084ef313/0x22153cd396b807ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.220882:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000084ef313/0x22153cd396b807ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.220904:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000084ef313/0x22153cd396b807ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.220914:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000084ef313/0x22153cd396b807ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.220923:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000084ef313/0x22153cd396b807ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.220932:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0b55dc00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826377.220937:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000084ef313/0x22153cd396b807ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.220947:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000084ef313/0x22153cd396b807ea lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.220968:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000084ef313/0x22153cd396b807ea lrc: 2/0,0 mode: --/PW res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.220978:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000084ef313/0x22153cd396b807ea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826377.221084:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03975a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:2401:x1874670563735040:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 498us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826377.221093:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1862 00000100:00100000:2.0:1787826377.221118:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1863 00000100:00100000:2.0:1787826377.221126:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce039761c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+18:2401:x1874670563735168:12345-192.168.203.39@tcp:1:lfs.0 00002000:00010000:2.0:1787826377.221151:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x103:0x0] initial LVB size: 2110464, mtime: 0x6a9010c9, atime: 0x6a9010c7, ctime: 0x6a9010c9, blocks: 0x20 00010000:00010000:2.0:1787826377.221158:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005072d7ff/0x22153cd396b807f1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.221167:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x103:0x0].0x0 since=1323s v=(0 0) 00010000:00010000:2.0:1787826377.221171:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x103:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826377.221175:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005072d7ff/0x22153cd396b807f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.221185:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005072d7ff/0x22153cd396b807f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.221197:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005072d7ff/0x22153cd396b807f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.221205:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005072d7ff/0x22153cd396b807f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.221213:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005072d7ff/0x22153cd396b807f1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.221220:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0b55d400 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826377.221224:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005072d7ff/0x22153cd396b807f1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.221239:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005072d7ff/0x22153cd396b807f1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.221250:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005072d7ff/0x22153cd396b807f1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.221258:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005072d7ff/0x22153cd396b807f1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826377.221292:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce039761c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+18:2401:x1874670563735168:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 167us (945us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826377.221299:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1863 00000100:00100000:2.0:1787826377.226297:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826377.226346:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563735424 00000100:00100000:2.0:1787826377.226359:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563735424 00000100:00100000:2.0:1787826377.226430:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3473 00000100:00100000:2.0:1787826377.226443:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa85e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+29:53055:x1874670563735424:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:2.0:1787826377.226558:0:32404:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826377.226599:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d200/0x22153cd396b807ce lrc: 0/0,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab061f expref: 29 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.226641:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:2.0:1787826377.226657:0:32404:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826377.226699:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d800/0x22153cd396b807f8 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.226721:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d800/0x22153cd396b807f8 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.226734:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d800/0x22153cd396b807f8 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787826377.228218:0:32404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].15, 88 off9488 00000004:00080000:2.0:1787826377.228313:0:32404:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1323239840467ns, next at 0ns, rc = 0 00000040:00080000:2.0:1787826377.228396:0:32404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].16, 88 off9576 00000004:00080000:2.0:1787826377.228402:0:32404:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1323239929984ns, next at 0ns, rc = 0 00000040:00080000:2.0:1787826377.229574:0:32404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].15, 88 off9464 00000004:00080000:2.0:1787826377.229595:0:32404:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1323241123115ns, next at 1309127889395ns, rc = 0 00000040:00080000:2.0:1787826377.229638:0:32404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].16, 88 off9552 00000004:00080000:2.0:1787826377.229645:0:32404:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1323241173859ns, next at 1309127889395ns, rc = 0 00000001:00080000:0.0:1787826377.234176:0:34481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934679 is committed 00000004:00080000:0.0:1787826377.234196:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 17 committed 00000004:00080000:0.0:1787826377.234213:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 16 committed 00000004:00080000:0.0:1787826377.234216:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 16 committed 00010000:00010000:1.0:1787826377.234277:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c200/0x22153cd396b8078f lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826377.234292:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c200/0x22153cd396b8078f lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2a/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826377.234301:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c200/0x22153cd396b8078f lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2a/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826377.234308:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0b55c200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826377.234313:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c200/0x22153cd396b8078f lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2a/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826377.234321:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c200/0x22153cd396b8078f lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2a/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826377.234342:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:1.0:1787826377.234346:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2a 00010000:00010000:1.0:1787826377.234353:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c200/0x22153cd396b8078f lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2a/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826377.234359:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c200/0x22153cd396b8078f lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2a/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826377.235042:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aa86940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585190656:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787826377.235138:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1787826377.235339:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 15 committed 00000100:00100000:0.0:1787826377.235405:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fdc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585190784:0@lo:2:osp-syn-0-0.0 00000004:00010000:3.0:1787826377.235458:0:32404:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a78acd80 reply state 0000000035b85bea transno 8589934679 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d800/0x22153cd396b807f8 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826377.235549:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826377.235614:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585190656 00000100:00100000:1.0:1787826377.235641:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585190656 00010000:00010000:3.0:1787826377.235684:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d800/0x22153cd396b807f8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.235694:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:3.0:1787826377.235697:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1787826377.235700:0:32404:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826377.235716:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585190784 00000100:00100000:1.0:1787826377.235719:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585190784 00000100:00100000:1.0:1787826377.235743:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1864 00000100:00100000:1.0:1787826377.235752:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03977840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3647:x1874670585190656:12345-0@lo:2:osp-syn-0-0.0 00000100:00080000:0.0:1787826377.235802:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787826377.236202:0:32404:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1787826377.236218:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa85e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:53055:x1874670563735424:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 9777us (9936us total) trans 8589934679 rc 0/0 00000100:00100000:3.0:1787826377.236229:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3473 00010000:00010000:2.0:1787826377.236274:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d800/0x22153cd396b807f8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826377.236277:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1787826377.236284:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d800/0x22153cd396b807f8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826377.236285:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fdc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585191040:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1787826377.236292:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d800/0x22153cd396b807f8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.236299:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0b55d800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826377.236304:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d800/0x22153cd396b807f8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.236312:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d800/0x22153cd396b807f8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.236330:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:2.0:1787826377.236334:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826377.236337:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d800/0x22153cd396b807f8 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826377.236338:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fdf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585190912:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1787826377.236344:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d800/0x22153cd396b807f8 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826377.236376:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1865 00000100:00100000:2.0:1787826377.236600:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+15:3644:x1874670585190784:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787826377.237511:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03977840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+16:3647:x1874670585190656:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1756us (2369us total) trans 21474836944 rc 0/0 00000100:00100000:1.0:1787826377.237521:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1864 00000100:00100000:3.0:1787826377.237705:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826377.240426:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585191040 00000100:00100000:1.0:1787826377.240457:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585191040 00000100:00100000:1.0:1787826377.240563:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1866 00000100:00100000:1.0:1787826377.240578:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3647:x1874670585191040:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1787826377.241105:0:8437:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x103:0x0] updating lvb size from disk: 2110464 -> 2110464 00002000:00010000:1.0:1787826377.241111:0:8437:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x103:0x0] updating lvb mtime from disk: 1787826377 -> 1787826377 00002000:00010000:1.0:1787826377.241114:0:8437:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x103:0x0] updating lvb atime from disk: 1787826375 -> 1787826375 00002000:00010000:1.0:1787826377.241116:0:8437:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x103:0x0] updating lvb ctime from disk: 1787826377 -> 1787826377 00002000:00010000:1.0:1787826377.241119:0:8437:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x103:0x0] updating lvb blocks from disk: 48 -> 48 00000100:00100000:0.0:1787826377.241220:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826377.241292:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+15:3644:x1874670585190784:12345-0@lo:2:osp-syn-0-0.0 Request processed in 4696us (5673us total) trans 21474836945 rc 0/0 00000100:00100000:2.0:1787826377.241304:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1865 00000100:00100000:2.0:1787826377.241328:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585190912 00000100:00100000:2.0:1787826377.241332:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585190912 00000004:00080000:0.0:1787826377.241336:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce01fdc780/2, rc 0, transno 21474836945 00000100:00100000:0.0:1787826377.241344:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fdc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585190784:0@lo:2:osp-syn-0-0.0 00000100:00080000:0.0:1787826377.241363:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826377.241363:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1867 00000100:00100000:2.0:1787826377.241369:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f874000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:3645:x1874670585190912:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1787826377.241442:0:28853:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x102:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1787826377.241454:0:28853:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x102:0x0] updating lvb mtime from disk: 1787826375 -> 1787826375 00002000:00010000:2.0:1787826377.241457:0:28853:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x102:0x0] updating lvb atime from disk: 1787826375 -> 1787826375 00002000:00010000:2.0:1787826377.241459:0:28853:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x102:0x0] updating lvb ctime from disk: 1787826376 -> 1787826376 00002000:00010000:2.0:1787826377.241462:0:28853:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x102:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1787826377.241521:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f874000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3645:x1874670585190912:12345-0@lo:2:osp-syn-1-0.0 Request processed in 152us (302us total) trans 17179869612 rc 0/0 00000100:00100000:2.0:1787826377.241539:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1867 00000004:00080000:0.0:1787826377.241814:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce01fdf840/2, rc 0, transno 17179869612 00000100:00100000:0.0:1787826377.241822:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fdf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585190912:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1787826377.245814:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3aa86940/2, rc 0, transno 21474836944 00000100:00100000:3.0:1787826377.246535:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aa86940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585190656:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787826377.247591:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826377.247862:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3647:x1874670585191040:12345-0@lo:2:osp-syn-1-0.0 Request processed in 7276us (10145us total) trans 17179869611 rc 0/0 00000100:00100000:1.0:1787826377.247877:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1866 00000004:00080000:2.0:1787826377.248175:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce01fdc3c0/2, rc 0, transno 17179869611 00000100:00100000:2.0:1787826377.248183:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fdc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585191040:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787826377.248831:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563735552 00000100:00100000:3.0:1787826377.248841:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563735552 00000100:00100000:3.0:1787826377.248985:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3474 00000100:00100000:3.0:1787826377.248996:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:53055:x1874670563735552:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826377.249027:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826377.249056:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b807ff lrc: 2/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab062d expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.249137:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b807ff lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab062d expref: 20 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.249155:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b807ff lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab062d expref: 20 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.249180:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:3.0:1787826377.249183:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826377.249188:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400c00, rc 0) 00000100:00100000:3.0:1787826377.249382:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:53055:x1874670563735552:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 387us (1798us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826377.249389:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3474 00000100:00100000:0.0:1787826377.255324:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826377.255819:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563735680 00000100:00100000:2.0:1787826377.255834:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563735680 00000100:00100000:2.0:1787826377.255991:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3475 00000100:00100000:2.0:1787826377.256003:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f876940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:53055:x1874670563735680:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826377.256033:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826377.256062:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d800/0x22153cd396b80806 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0634 expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.256195:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d400/0x22153cd396b8080d lrc: 3/1,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.256213:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d400/0x22153cd396b8080d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.256240:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d400/0x22153cd396b8080d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826377.256274:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x14:0x0]: returning size 2110464 00000004:00200000:2.0:1787826377.256279:0:8247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826377.256303:0:8247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d400/0x22153cd396b8080d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.256334:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d800/0x22153cd396b80806 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0634 expref: 22 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.256356:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d400/0x22153cd396b8080d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0634 expref: 21 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.256372:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:2.0:1787826377.256376:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826377.256380:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0b55d400, rc 0) 00000100:00100000:2.0:1787826377.257129:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f876940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:53055:x1874670563735680:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1122us (1815us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826377.257139:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3475 00000100:00100000:0.0:1787826377.267001:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826377.267084:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826377.267199:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563735936 00000100:00100000:3.0:1787826377.267213:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563735936 00000100:00100000:3.0:1787826377.267375:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563735808 00000100:00100000:3.0:1787826377.267380:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563735808 00000100:00100000:1.0:1787826377.274014:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1868 00000100:00100000:1.0:1787826377.274055:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f876d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:2404:x1874670563735936:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826377.274085:0:8545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826377.274115:0:8545:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a3adc48c/0x22153cd396b80814 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0642 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826377.274152:0:8545:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x103:0x0] initial LVB size: 2110464, mtime: 0x6a9010c9, atime: 0x6a9010c7, ctime: 0x6a9010c9, blocks: 0x20 00010000:00010000:1.0:1787826377.274185:0:8545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x103:0x0].0x0 since=1323s v=(0 0) 00010000:00010000:1.0:1787826377.274191:0:8545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x103:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826377.274205:0:8545:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3adc48c/0x22153cd396b80814 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0642 expref: 20 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826377.275431:0:8545:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a3adc48c/0x22153cd396b80814 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0642 expref: 20 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826377.275494:0:8545:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05125800, rc 0) 00000100:00100000:1.0:1787826377.275639:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f876d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:2404:x1874670563735936:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1600us (8648us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826377.275657:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1868 00000100:00100000:1.0:1787826377.275710:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1869 00000100:00100000:1.0:1787826377.275723:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f874780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:2404:x1874670563735808:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826377.275740:0:8545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826377.275758:0:8545:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e42b1469/0x22153cd396b8081b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab063b expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826377.275783:0:8545:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x102:0x0] initial LVB size: 2097152, mtime: 0x6a9010c9, atime: 0x6a9010c7, ctime: 0x6a9010c9, blocks: 0x10 00010000:00010000:1.0:1787826377.275803:0:8545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x102:0x0].0x0 since=1323s v=(0 0) 00010000:00010000:1.0:1787826377.275808:0:8545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x102:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826377.275819:0:8545:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e42b1469/0x22153cd396b8081b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab063b expref: 20 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826377.275835:0:8545:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e42b1469/0x22153cd396b8081b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab063b expref: 20 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826377.275845:0:8545:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05124a00, rc 0) 00000100:00100000:1.0:1787826377.277102:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f874780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:2404:x1874670563735808:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1375us (10009us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826377.277113:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1869 00000100:00100000:1.0:1787826377.353429:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826377.353516:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563736064 00000100:00100000:1.0:1787826377.353517:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826377.353538:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563736064 00000100:00100000:2.0:1787826377.353613:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563736192 00000100:00100000:2.0:1787826377.353617:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563736192 00000100:00100000:2.0:1787826377.353669:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1870 00000100:00100000:0.0:1787826377.353689:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1871 00000100:00100000:2.0:1787826377.353697:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce039752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:2404:x1874670563736064:12345-192.168.203.39@tcp:23:lfs.0 00000100:00100000:0.0:1787826377.353698:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03977480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:2404:x1874670563736192:12345-192.168.203.39@tcp:23:lfs.0 00000100:00100000:0.0:1787826377.361653:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03977480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:2404:x1874670563736192:12345-192.168.203.39@tcp:23:lfs.0 Request processed in 7937us (8116us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826377.361673:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1871 00000100:00100000:2.0:1787826377.364792:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce039752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:2404:x1874670563736064:12345-192.168.203.39@tcp:23:lfs.0 Request processed in 11096us (11376us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826377.364812:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1870 00000100:00100000:1.0:1787826377.368520:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826377.368576:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826377.369173:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563736320 00000100:00100000:0.0:1787826377.369188:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563736320 00000100:00100000:0.0:1787826377.369263:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563736448 00000100:00100000:0.0:1787826377.369268:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563736448 00000100:00100000:0.0:1787826377.369308:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1872 00000100:00100000:0.0:1787826377.369320:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03976940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:2401:x1874670563736320:12345-192.168.203.39@tcp:23:lfs.0 00000100:00100000:0.0:1787826377.369468:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03976940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:2401:x1874670563736320:12345-192.168.203.39@tcp:23:lfs.0 Request processed in 150us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826377.369508:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1872 00000100:00100000:0.0:1787826377.369541:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1873 00000100:00100000:0.0:1787826377.369549:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f05e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:2401:x1874670563736448:12345-192.168.203.39@tcp:23:lfs.0 00000100:00100000:0.0:1787826377.369585:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f05e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:2401:x1874670563736448:12345-192.168.203.39@tcp:23:lfs.0 Request processed in 38us (1010us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826377.369592:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1873 00000100:00100000:0.0:1787826377.374626:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826377.374795:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563736576 00000100:00100000:3.0:1787826377.374809:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563736576 00000100:00100000:3.0:1787826377.374927:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 716 00000100:00100000:3.0:1787826377.374941:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f874b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2403:x1874670563736576:12345-192.168.203.39@tcp:22:lfs.0 00002000:00010000:3.0:1787826377.376160:0:8441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x102:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1787826377.376170:0:8441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x102:0x0] updating lvb mtime from disk: 1787826375 -> 1787826376 00002000:00010000:3.0:1787826377.376172:0:8441:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x102:0x0] updating lvb atime from disk: 1787826375 -> 1787826375 00002000:00010000:3.0:1787826377.376175:0:8441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x102:0x0] updating lvb ctime from disk: 1787826376 -> 1787826376 00002000:00010000:3.0:1787826377.376177:0:8441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x102:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:3.0:1787826377.376261:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f874b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670563736576:12345-192.168.203.39@tcp:22:lfs.0 Request processed in 1320us (1662us total) trans 17179869613 rc 0/0 00000100:00100000:3.0:1787826377.376273:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 716 00000100:00080000:0.0:1787826377.377405:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826377.416154:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826377.417270:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563736832 00000100:00100000:0.0:1787826377.417286:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563736832 00000100:00100000:0.0:1787826377.417382:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3476 00000100:00100000:0.0:1787826377.417396:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:53055:x1874670563736832:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:0.0:1787826377.417515:0:9966:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826377.418914:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d400/0x22153cd396b8080d lrc: 0/0,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0634 expref: 21 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.418949:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:0.0:1787826377.418956:0:9966:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826377.419038:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660200/0x22153cd396b80822 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.419055:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660200/0x22153cd396b80822 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.419067:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660200/0x22153cd396b80822 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826377.419228:0:9966:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001a649adc reply state 00000000bdb7965e transno 8589934680 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660200/0x22153cd396b80822 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.419242:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660200/0x22153cd396b80822 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.419249:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:0.0:1787826377.419252:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826377.419255:0:9966:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787826377.419391:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:53055:x1874670563736832:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 1997us (3251us total) trans 8589934680 rc 0/0 00000100:00100000:0.0:1787826377.419400:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3476 00000100:00100000:1.0:1787826377.423029:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826377.423248:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563736960 00000100:00100000:2.0:1787826377.423261:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563736960 00000100:00100000:2.0:1787826377.423331:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1874 00000100:00100000:2.0:1787826377.423343:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f043c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:53055:x1874670563736960:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826377.423366:0:28853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826377.423388:0:28853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047d516be/0x22153cd396b80829 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0649 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.423429:0:28853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e42b1469/0x22153cd396b8081b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab063b expref: 21 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.423455:0:28853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x102:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826377.423461:0:28853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x102:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826377.423467:0:28853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047d516be/0x22153cd396b80829 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0649 expref: 21 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.423554:0:28853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e42b1469/0x22153cd396b8081b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab063b expref: 21 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.423570:0:28853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e42b1469/0x22153cd396b8081b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab063b expref: 21 pid: 8545 timeout: 1423 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826377.423593:0:28853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a8ada40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28853:1874670585191168:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826377.424009:0:28853:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce05b56540 going to sleep for 11 seconds 00000100:00100000:3.0:1787826377.429384:0:28853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a8ada40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28853:1874670585191168:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826377.429439:0:28853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000047d516be/0x22153cd396b80829 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0649 expref: 21 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.429511:0:28853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0b55cc00, rc 0) 00000100:00100000:3.0:1787826377.429590:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f043c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:53055:x1874670563736960:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 6248us (6575us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826377.429601:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1874 00000100:00100000:3.0:1787826377.444830:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826377.445246:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563737088 00000100:00100000:2.0:1787826377.445260:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563737088 00010000:00010000:2.0:1787826377.445318:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e42b1469/0x22153cd396b8081b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab063b expref: 21 pid: 8545 timeout: 1423 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826377.445374:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 999 00000100:00100000:2.0:1787826377.445386:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:2403:x1874670563737088:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826377.445407:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826377.445435:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e42b1469/0x22153cd396b8081b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x102:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab063b expref: 21 pid: 8545 timeout: 1423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.445468:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e42b1469/0x22153cd396b8081b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x102:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab063b expref: 21 pid: 8545 timeout: 1423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.445533:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e42b1469/0x22153cd396b8081b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x102:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab063b expref: 21 pid: 8545 timeout: 1423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.445555:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x102:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826377.445561:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x102:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826377.445571:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000047d516be/0x22153cd396b80829 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0649 expref: 20 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.445582:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047d516be/0x22153cd396b80829 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0649 expref: 20 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.446039:0:6504:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000047d516be/0x22153cd396b80829 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0649 expref: 20 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826377.446060:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a8ac000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6504:1874670585191296:192.168.203.39@tcp:105: 00000100:00100000:2.0:1787826377.446164:0:6504:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce05b56d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787826377.450414:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826377.450544:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563737216 00000100:00100000:3.0:1787826377.450556:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563737216 00000100:00100000:3.0:1787826377.450645:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1875 00000100:00100000:3.0:1787826377.450664:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f06580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:53055:x1874670563737216:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826377.450698:0:30695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826377.450723:0:30695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d612c5b/0x22153cd396b80830 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0650 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.450766:0:30695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a3adc48c/0x22153cd396b80814 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0642 expref: 22 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.450778:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x103:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826377.450784:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x103:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826377.450791:0:30695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d612c5b/0x22153cd396b80830 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [2097152->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0650 expref: 22 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.450839:0:30695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a3adc48c/0x22153cd396b80814 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0642 expref: 22 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.451030:0:30695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a3adc48c/0x22153cd396b80814 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0642 expref: 22 pid: 8545 timeout: 1423 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826377.451049:0:30695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f82c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:30695:1874670585191424:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826377.451157:0:30695:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f5e7900 going to sleep for 11 seconds 00000100:00100000:2.0:1787826377.451617:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a8ac000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6504:1874670585191296:192.168.203.39@tcp:105: 00010000:00010000:2.0:1787826377.451661:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826377.452074:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:2403:x1874670563737088:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6688us (7455us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826377.452086:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 999 00000100:00100000:3.0:1787826377.458934:0:30695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f82c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:30695:1874670585191424:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826377.458984:0:30695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006d612c5b/0x22153cd396b80830 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [2097152->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0650 expref: 21 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.459013:0:30695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400000, rc 0) 00000100:00100000:3.0:1787826377.459093:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f06580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:53055:x1874670563737216:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 8430us (8692us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826377.459104:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1875 00000100:00100000:1.0:1787826377.465180:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826377.465301:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563737344 00000100:00100000:3.0:1787826377.465313:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563737344 00010000:00010000:3.0:1787826377.465372:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a3adc48c/0x22153cd396b80814 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0642 expref: 21 pid: 8545 timeout: 1423 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826377.465429:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1000 00000100:00100000:3.0:1787826377.465440:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f04b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:2403:x1874670563737344:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826377.465528:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826377.465561:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a3adc48c/0x22153cd396b80814 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x103:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0642 expref: 21 pid: 8545 timeout: 1423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.465586:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a3adc48c/0x22153cd396b80814 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x103:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0642 expref: 21 pid: 8545 timeout: 1423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.465631:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3adc48c/0x22153cd396b80814 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x103:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0642 expref: 21 pid: 8545 timeout: 1423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.466740:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x103:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826377.466746:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x103:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826377.467065:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006d612c5b/0x22153cd396b80830 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0650 expref: 20 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.467082:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d612c5b/0x22153cd396b80830 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0650 expref: 20 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.467152:0:6503:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006d612c5b/0x22153cd396b80830 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0650 expref: 20 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826377.467170:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f82c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6503:1874670585191552:192.168.203.39@tcp:105: 00000100:00100000:3.0:1787826377.467304:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f5e7900 going to sleep for 11 seconds 00000100:00100000:3.0:1787826377.473388:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f82c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6503:1874670585191552:192.168.203.39@tcp:105: 00010000:00010000:3.0:1787826377.473420:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826377.473541:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f04b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:2403:x1874670563737344:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 8101us (8934us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826377.473559:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1000 00000100:00100000:2.0:1787826377.479418:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f82c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585191680:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826377.479557:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826377.480053:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585191680 00000100:00100000:1.0:1787826377.480063:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585191680 00000100:00100000:1.0:1787826377.480132:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 750 00000100:00100000:1.0:1787826377.480143:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874670585191680:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787826377.480181:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 135895872 pending 73728 free 3919204352 avail 3687682048 00000100:00100000:1.0:1787826377.480242:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874670585191680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826377.480250:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 750 00000100:00100000:1.0:1787826377.480334:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f82c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585191680:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826377.480357:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787826377.480364:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce04f04780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585192064:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826377.480392:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826377.480422:0:12021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585192064 00000100:00100000:1.0:1787826377.480426:0:12021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585192064 00000100:00100000:1.0:1787826377.480464:0:12021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 751 00000100:00100000:1.0:1787826377.480495:0:12021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f052c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3647:x1874670585192064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787826377.480515:0:12021:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 126401344 pending 0 free 3920265216 avail 3688742912 00000100:00100000:1.0:1787826377.480550:0:12021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f052c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3647:x1874670585192064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826377.480560:0:12021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 751 00000100:00100000:1.0:1787826377.480594:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce04f04780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585192064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787826377.480923:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce04f06d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585191936:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787826377.480962:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826377.480982:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787826377.480989:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f82c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585191808:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826377.481015:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826377.481044:0:25628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585191936 00000100:00100000:0.0:1787826377.481048:0:25628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585191936 00000100:00100000:0.0:1787826377.481075:0:25628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585191808 00000100:00100000:0.0:1787826377.481078:0:25628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585191808 00000100:00100000:0.0:1787826377.481098:0:25628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 752 00000100:00100000:0.0:1787826377.481104:0:25628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8743c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+15:3645:x1874670585191936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787826377.481117:0:25628:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 135895872 pending 73728 free 3919204352 avail 3687682048 00000100:00100000:0.0:1787826377.481149:0:25628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8743c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+15:3645:x1874670585191936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826377.481156:0:25628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 752 00000100:00100000:0.0:1787826377.481173:0:25628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 753 00000100:00100000:0.0:1787826377.481180:0:25628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8761c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874670585191808:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787826377.481190:0:25628:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 126401344 pending 0 free 3920265216 avail 3688742912 00000100:00100000:0.0:1787826377.481214:0:25628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8761c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874670585191808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 35us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826377.481220:0:25628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 753 00000100:00100000:0.0:1787826377.481253:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f82c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585191808:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826377.481267:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce04f06d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585191936:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787826377.483691:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826377.483745:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826377.484013:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563737472 00000100:00100000:3.0:1787826377.484026:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563737472 00000100:00100000:3.0:1787826377.484094:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563737600 00000100:00100000:3.0:1787826377.484098:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563737600 00000100:00100000:3.0:1787826377.484128:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1876 00000100:00100000:3.0:1787826377.484140:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8af0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:2404:x1874670563737472:12345-192.168.203.39@tcp:2:lfs.0 00002000:00010000:3.0:1787826377.484343:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x102:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1787826377.484348:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x102:0x0] updating lvb mtime from disk: 1787826377 -> 1787826377 00002000:00010000:3.0:1787826377.484350:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x102:0x0] updating lvb atime from disk: 1787826375 -> 1787826375 00002000:00010000:3.0:1787826377.484352:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x102:0x0] updating lvb ctime from disk: 1787826377 -> 1787826377 00002000:00010000:3.0:1787826377.484355:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x102:0x0] updating lvb blocks from disk: 16 -> 16 00000100:00100000:3.0:1787826377.484422:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8af0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:2404:x1874670563737472:12345-192.168.203.39@tcp:2:lfs.0 Request processed in 284us (745us total) trans 21474836946 rc 0/0 00000100:00100000:3.0:1787826377.484432:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1876 00000100:00100000:3.0:1787826377.484468:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1877 00000100:00100000:3.0:1787826377.484516:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aad6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:2403:x1874670563737600:12345-192.168.203.39@tcp:2:lfs.0 00002000:00010000:3.0:1787826377.484574:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x103:0x0] updating lvb size from disk: 2110464 -> 2110464 00002000:00010000:3.0:1787826377.484577:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x103:0x0] updating lvb mtime from disk: 1787826377 -> 1787826377 00002000:00010000:3.0:1787826377.484580:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x103:0x0] updating lvb atime from disk: 1787826375 -> 1787826375 00002000:00010000:3.0:1787826377.484582:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x103:0x0] updating lvb ctime from disk: 1787826377 -> 1787826377 00002000:00010000:3.0:1787826377.484585:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x103:0x0] updating lvb blocks from disk: 32 -> 32 00000100:00100000:3.0:1787826377.484608:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aad6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:2403:x1874670563737600:12345-192.168.203.39@tcp:2:lfs.0 Request processed in 93us (863us total) trans 21474836947 rc 0/0 00000100:00100000:3.0:1787826377.484615:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1877 00000100:00100000:1.0:1787826377.499148:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826377.499468:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563737856 00000100:00100000:3.0:1787826377.499522:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563737856 00000100:00100000:3.0:1787826377.499591:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1019 00000100:00100000:3.0:1787826377.499602:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f04780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:53055:x1874670563737856:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:3.0:1787826377.499825:0:6522:0:(mdt_open.c:2504:mdt_close_resync_done()) ### [0x200000405:0x14:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05124200/0x22153cd396b807dc lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x14:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0626 expref: 22 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.499889:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b80837 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.499903:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b807ff lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab062d expref: 22 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.499914:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b80837 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.499957:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b807ff lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab062d expref: 22 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.499973:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b807ff lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab062d expref: 22 pid: 16564 timeout: 1423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826377.499993:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f82f840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585192192:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826377.500106:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f5e7900 going to sleep for 11 seconds 00000100:00100000:1.0:1787826377.507725:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826377.507845:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f82f840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585192192:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826377.507881:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b80837 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826377.508019:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563737984 00000100:00100000:2.0:1787826377.508028:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563737984 00010000:00010000:2.0:1787826377.508080:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b807ff lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab062d expref: 23 pid: 16564 timeout: 1423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826377.508123:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1001 00000100:00100000:2.0:1787826377.508135:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+23:2403:x1874670563737984:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826377.508155:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826377.508164:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b807ff lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab062d expref: 23 pid: 16564 timeout: 1423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.508178:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b807ff lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab062d expref: 23 pid: 16564 timeout: 1423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.508208:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b807ff lrc: 0/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab062d expref: 23 pid: 16564 timeout: 1423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.508227:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:2.0:1787826377.508233:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b80837 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.508245:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b80837 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.508258:0:10340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b80837 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.508404:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826377.508432:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b80837 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.508455:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b80837 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826377.508537:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:2403:x1874670563737984:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 394us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826377.508546:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1001 00000040:00080000:3.0:1787826377.508884:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].17, 88 off9664 00000004:00080000:3.0:1787826377.508894:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1323520421585ns, next at 0ns, rc = 0 00000040:00080000:3.0:1787826377.508964:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].18, 88 off9752 00000004:00080000:3.0:1787826377.508972:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1323520499851ns, next at 0ns, rc = 0 00000040:00080000:3.0:1787826377.508999:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].17, 88 off9640 00000004:00080000:3.0:1787826377.509004:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1323520531881ns, next at 1309127889395ns, rc = 0 00000040:00080000:3.0:1787826377.509032:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].18, 88 off9728 00000004:00080000:3.0:1787826377.509037:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1323520564896ns, next at 1309127889395ns, rc = 0 00000001:00080000:2.0:1787826377.512763:0:34481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934681 is committed 00000004:00080000:2.0:1787826377.512783:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 19 committed 00000004:00080000:2.0:1787826377.512807:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 18 committed 00000004:00080000:2.0:1787826377.512811:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 18 committed 00000004:00080000:2.0:1787826377.512866:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 17 committed 00010000:00010000:0.0:1787826377.512996:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660200/0x22153cd396b80822 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.513016:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660200/0x22153cd396b80822 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.513026:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660200/0x22153cd396b80822 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.513035:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05660200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826377.513063:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660200/0x22153cd396b80822 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.513074:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660200/0x22153cd396b80822 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.513099:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:0.0:1787826377.513103:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826377.513110:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660200/0x22153cd396b80822 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826377.513110:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000042869b23 reply state 00000000679f7141 transno 8589934681 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b80837 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.513125:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660200/0x22153cd396b80822 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.513136:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b80837 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826377.513158:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787826377.513182:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f82f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585192320:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1787826377.513197:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:3.0:1787826377.513201:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1787826377.513206:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787826377.513214:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:3.0:1787826377.513216:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787826377.513224:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05124200/0x22153cd396b807dc lrc: 0/0,0 mode: --/PW res: [0x200000405:0x14:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0626 expref: 19 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826377.513283:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787826377.513352:0:6522:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1787826377.513371:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f04780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:53055:x1874670563737856:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 13771us (14235us total) trans 8589934681 rc 0/0 00000100:00100000:3.0:1787826377.513383:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1019 00000100:00100000:2.0:1787826377.513418:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585192320 00010000:00010000:3.0:1787826377.513429:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b80837 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826377.513431:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585192320 00010000:00010000:3.0:1787826377.513439:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b80837 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.513459:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b80837 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.513466:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826377.513492:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b80837 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.513501:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b80837 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.513511:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf06894e00) 00000100:00100000:2.0:1787826377.513515:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1878 00010000:00010000:3.0:1787826377.513516:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826377.513521:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b80837 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826377.513530:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f876580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3646:x1874670585192320:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1787826377.513530:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b80837 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787826377.513716:0:8545:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x102:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1787826377.513720:0:8545:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x102:0x0] updating lvb mtime from disk: 1787826376 -> 1787826376 00002000:00010000:2.0:1787826377.513723:0:8545:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x102:0x0] updating lvb atime from disk: 1787826375 -> 1787826375 00002000:00010000:2.0:1787826377.513725:0:8545:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x102:0x0] updating lvb ctime from disk: 1787826376 -> 1787826376 00002000:00010000:2.0:1787826377.513727:0:8545:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x102:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1787826377.514104:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f82ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585192576:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787826377.514144:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826377.514186:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787826377.514194:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce04f04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585192448:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787826377.514219:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826377.514254:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585192576 00000100:00100000:0.0:1787826377.514259:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585192576 00000100:00100000:0.0:1787826377.514532:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585192448 00000100:00100000:0.0:1787826377.514536:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585192448 00000100:00100000:0.0:1787826377.514560:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1879 00000100:00100000:0.0:1787826377.514568:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:3645:x1874670585192576:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1787826377.514676:0:28853:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x103:0x0] updating lvb size from disk: 2110464 -> 2110464 00000100:00100000:1.0:1787826377.516067:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787826377.516089:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce04f061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585192704:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787826377.516156:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826377.516221:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585192704 00000100:00100000:1.0:1787826377.516228:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585192704 00002000:00010000:0.0:1787826377.516492:0:28853:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x103:0x0] updating lvb mtime from disk: 1787826377 -> 1787826377 00002000:00010000:0.0:1787826377.516495:0:28853:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x103:0x0] updating lvb atime from disk: 1787826375 -> 1787826375 00002000:00010000:0.0:1787826377.516497:0:28853:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x103:0x0] updating lvb ctime from disk: 1787826377 -> 1787826377 00002000:00010000:0.0:1787826377.516499:0:28853:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x103:0x0] updating lvb blocks from disk: 48 -> 48 00000100:00100000:1.0:1787826377.516660:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1880 00000100:00100000:1.0:1787826377.516672:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f874000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+16:3645:x1874670585192448:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787826377.516842:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x102:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1787826377.516846:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x102:0x0] updating lvb mtime from disk: 1787826377 -> 1787826377 00002000:00010000:1.0:1787826377.516848:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x102:0x0] updating lvb atime from disk: 1787826375 -> 1787826375 00002000:00010000:1.0:1787826377.516851:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x102:0x0] updating lvb ctime from disk: 1787826377 -> 1787826377 00002000:00010000:1.0:1787826377.516853:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x102:0x0] updating lvb blocks from disk: 16 -> 16 00000100:00100000:1.0:1787826377.516910:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f874000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+17:3645:x1874670585192448:12345-0@lo:2:osp-syn-0-0.0 Request processed in 227us (2676us total) trans 21474836948 rc 0/0 00000100:00100000:1.0:1787826377.516917:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1880 00000100:00100000:1.0:1787826377.516939:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1881 00000100:00100000:1.0:1787826377.516945:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f05a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+16:3647:x1874670585192704:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787826377.517002:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x103:0x0] updating lvb size from disk: 2110464 -> 2110464 00002000:00010000:1.0:1787826377.517006:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x103:0x0] updating lvb mtime from disk: 1787826377 -> 1787826377 00002000:00010000:1.0:1787826377.517008:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x103:0x0] updating lvb atime from disk: 1787826375 -> 1787826375 00002000:00010000:1.0:1787826377.517010:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x103:0x0] updating lvb ctime from disk: 1787826377 -> 1787826377 00002000:00010000:1.0:1787826377.517013:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x103:0x0] updating lvb blocks from disk: 32 -> 32 00000100:00100000:1.0:1787826377.517041:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f05a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+17:3647:x1874670585192704:12345-0@lo:2:osp-syn-0-0.0 Request processed in 96us (885us total) trans 21474836949 rc 0/0 00000100:00100000:1.0:1787826377.517047:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1881 00000100:00100000:2.0:1787826377.524763:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f876580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3646:x1874670585192320:12345-0@lo:2:osp-syn-1-0.0 Request processed in 11224us (11466us total) trans 17179869614 rc 0/0 00000100:00100000:2.0:1787826377.524783:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1878 00000004:00080000:0.0:1787826377.526258:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3f82f840/2, rc 0, transno 17179869614 00000100:00100000:0.0:1787826377.526603:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f82f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585192320:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1787826377.530057:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce04f04000/2, rc 0, transno 21474836948 00000100:00100000:3.0:1787826377.530079:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce04f04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585192448:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787826377.533249:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:3645:x1874670585192576:12345-0@lo:2:osp-syn-1-0.0 Request processed in 18667us (19089us total) trans 17179869615 rc 0/0 00000100:00100000:0.0:1787826377.533280:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1879 00000004:00080000:3.0:1787826377.534918:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3f82ed00/2, rc 0, transno 17179869615 00000100:00100000:3.0:1787826377.534934:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f82ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585192576:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1787826377.535208:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce04f061c0/2, rc 0, transno 21474836949 00000100:00100000:2.0:1787826377.535214:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce04f061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585192704:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787826377.536333:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826377.536460:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563738112 00000100:00100000:2.0:1787826377.536496:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563738112 00000100:00100000:2.0:1787826377.536569:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3477 00000100:00100000:2.0:1787826377.536582:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+18:53055:x1874670563738112:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826377.536614:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826377.536774:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d800/0x22153cd396b8083e lrc: 2/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0657 expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.537116:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d800/0x22153cd396b8083e lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0657 expref: 19 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.537136:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d800/0x22153cd396b8083e lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0657 expref: 19 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.537161:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf39e67900) 00010000:00010000:2.0:1787826377.537165:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826377.537170:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0b55d800, rc 0) 00000100:00100000:2.0:1787826377.537256:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:53055:x1874670563738112:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 676us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826377.537265:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3477 00000100:00100000:3.0:1787826377.547814:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826377.548102:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563738368 00000100:00100000:1.0:1787826377.548115:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563738368 00000100:00100000:1.0:1787826377.548253:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1020 00000100:00100000:1.0:1787826377.548277:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:53055:x1874670563738368:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:1.0:1787826377.548666:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:53055:x1874670563738368:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 400us (866us total) trans 8589934682 rc 0/0 00000100:00100000:1.0:1787826377.548675:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1020 00000100:00100000:0.0:1787826377.579880:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826377.579985:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563738624 00000100:00100000:3.0:1787826377.579999:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563738624 00000100:00100000:3.0:1787826377.580082:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3478 00000100:00100000:3.0:1787826377.580095:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f876d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:53056:x1874670563738624:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826377.580126:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826377.580154:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b80845 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab065e expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.580254:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b8084c lrc: 3/1,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.580272:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b8084c lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.580288:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b8084c lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.580307:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400e00/0x22153cd396b80853 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.580314:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400e00/0x22153cd396b80853 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.580321:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400e00/0x22153cd396b80853 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.580422:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b8084c lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.580436:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b8084c lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.580454:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b8084c lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.580462:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826377.580467:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b8084c lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.580533:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b8084c lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.580549:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0x0 (ffff90cf39e67500) 00010000:00010000:3.0:1787826377.580552:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826377.580558:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b8084c lrc: 2/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.580564:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b8084c lrc: 0/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.580578:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400e00/0x22153cd396b80853 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.580584:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400e00/0x22153cd396b80853 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.580589:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400e00/0x22153cd396b80853 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.580594:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400e00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826377.580598:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400e00/0x22153cd396b80853 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.580604:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400e00/0x22153cd396b80853 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.580610:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0xe1e61496 (ffff90cf39656f00) 00010000:00010000:3.0:1787826377.580613:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826377.580615:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400e00/0x22153cd396b80853 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.580620:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400e00/0x22153cd396b80853 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.580665:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b80845 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab065e expref: 21 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.580677:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0x0 (ffff90cf39e67500) 00010000:00010000:3.0:1787826377.580680:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787826377.580683:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b80845 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab065e expref: 21 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.580692:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401000, rc 0) 00000100:00100000:3.0:1787826377.580778:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f876d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:53056:x1874670563738624:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 686us (914us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826377.580788:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3478 00000100:00100000:3.0:1787826377.586806:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826377.586933:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563738880 00000100:00100000:2.0:1787826377.586946:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563738880 00000100:00100000:2.0:1787826377.587027:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3479 00000100:00100000:2.0:1787826377.587040:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:53056:x1874670563738880:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826377.587068:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826377.587097:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55dc00/0x22153cd396b8085a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0665 expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826377.587246:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x13:0x0]: returning size 4096 00010000:00010000:2.0:1787826377.587385:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55dc00/0x22153cd396b8085a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0665 expref: 22 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.587403:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ce01f45300) 00010000:00010000:2.0:1787826377.587407:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787826377.587413:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55dc00/0x22153cd396b8085a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0665 expref: 22 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.587431:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0b55dc00, rc 0) 00000100:00100000:2.0:1787826377.587578:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:53056:x1874670563738880:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 539us (788us total) trans 8589934683 rc 301/301 00000100:00100000:2.0:1787826377.587587:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3479 00000100:00100000:1.0:1787826377.592929:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826377.593032:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563739008 00000100:00100000:0.0:1787826377.593045:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563739008 00000100:00100000:0.0:1787826377.593126:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3480 00000100:00100000:0.0:1787826377.593138:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f07c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:53056:x1874670563739008:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:0.0:1787826377.593246:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660200/0x22153cd396b80868 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.593266:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660200/0x22153cd396b80868 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.593281:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660200/0x22153cd396b80868 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.593299:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660a00/0x22153cd396b8086f lrc: 3/1,0 mode: --/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.593307:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660a00/0x22153cd396b8086f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.593314:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660a00/0x22153cd396b8086f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.593407:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661a00/0x22153cd396b80876 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.593558:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661a00/0x22153cd396b80876 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.593565:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661a00/0x22153cd396b80876 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826377.593620:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x14:0x0]: returning size 2110464 00000004:00200000:0.0:1787826377.593626:0:9966:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826377.593642:0:9966:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661a00/0x22153cd396b80876 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.593660:0:9966:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660200/0x22153cd396b80868 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.593668:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660200/0x22153cd396b80868 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.593675:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660200/0x22153cd396b80868 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.593687:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660200/0x22153cd396b80868 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.593693:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05660200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826377.593698:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660200/0x22153cd396b80868 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.593706:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660200/0x22153cd396b80868 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.593720:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0x0 (ffff90cf39e67500) 00010000:00010000:0.0:1787826377.593724:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826377.593730:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660200/0x22153cd396b80868 lrc: 3/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.593854:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660200/0x22153cd396b80868 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.593874:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660a00/0x22153cd396b8086f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.593880:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660a00/0x22153cd396b8086f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.593886:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660a00/0x22153cd396b8086f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.593890:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05660a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826377.593893:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660a00/0x22153cd396b8086f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.593904:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660a00/0x22153cd396b8086f lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.593914:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0xe1e61496 (ffff90cf371d2a00) 00010000:00010000:0.0:1787826377.593916:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826377.593920:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660a00/0x22153cd396b8086f lrc: 2/0,0 mode: --/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.593926:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660a00/0x22153cd396b8086f lrc: 0/0,0 mode: --/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.593942:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661a00/0x22153cd396b80876 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.593949:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661a00/0x22153cd396b80876 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.593954:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661a00/0x22153cd396b80876 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.593959:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05661a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826377.593962:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661a00/0x22153cd396b80876 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.593968:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661a00/0x22153cd396b80876 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.593976:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf39e67900) 00010000:00010000:0.0:1787826377.593978:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826377.593981:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661a00/0x22153cd396b80876 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.593992:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661a00/0x22153cd396b80876 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826377.594105:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f07c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:53056:x1874670563739008:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 967us (1189us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826377.594114:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3480 00000100:00100000:1.0:1787826377.597619:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826377.597761:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563739264 00000100:00100000:3.0:1787826377.597774:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563739264 00000100:00100000:3.0:1787826377.597850:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1021 00000100:00100000:3.0:1787826377.597863:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf10476850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:53056:x1874670563739264:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:3.0:1787826377.598163:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf10476850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:53056:x1874670563739264:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 301us (558us total) trans 8589934684 rc 0/0 00000100:00100000:3.0:1787826377.598171:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1021 00000100:00100000:3.0:1787826377.651870:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826377.652179:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563739520 00000100:00100000:2.0:1787826377.652193:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563739520 00000100:00100000:2.0:1787826377.652327:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3481 00000100:00100000:2.0:1787826377.652341:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:53059:x1874670563739520:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826377.652373:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826377.652399:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55dc00/0x22153cd396b8087d lrc: 2/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab066c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.652567:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d200/0x22153cd396b80884 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.652585:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d200/0x22153cd396b80884 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.652599:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d200/0x22153cd396b80884 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.652621:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c200/0x22153cd396b8088b lrc: 3/1,0 mode: --/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.654022:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c200/0x22153cd396b8088b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.654038:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c200/0x22153cd396b8088b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.654231:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c400/0x22153cd396b80892 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.654241:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c400/0x22153cd396b80892 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.654249:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c400/0x22153cd396b80892 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826377.654262:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x14:0x0]: returning size 2110464 00010000:00010000:2.0:1787826377.654554:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d200/0x22153cd396b80884 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.654564:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d200/0x22153cd396b80884 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.654571:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d200/0x22153cd396b80884 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.654578:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d200/0x22153cd396b80884 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.654585:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0b55d200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826377.654591:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d200/0x22153cd396b80884 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.654600:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d200/0x22153cd396b80884 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.654615:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0x0 (ffff90cf39e67500) 00010000:00010000:2.0:1787826377.654619:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826377.654625:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d200/0x22153cd396b80884 lrc: 3/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.654640:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d200/0x22153cd396b80884 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.654657:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c200/0x22153cd396b8088b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.654663:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c200/0x22153cd396b8088b lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.654669:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c200/0x22153cd396b8088b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.654676:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0b55c200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826377.654679:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c200/0x22153cd396b8088b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.654685:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c200/0x22153cd396b8088b lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.654693:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0xe1e61496 (ffff90cf39e67700) 00010000:00010000:2.0:1787826377.654695:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826377.654698:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c200/0x22153cd396b8088b lrc: 2/0,0 mode: --/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.654704:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c200/0x22153cd396b8088b lrc: 0/0,0 mode: --/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.657756:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55dc00/0x22153cd396b8087d lrc: 0/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab066c expref: 25 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.657803:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c400/0x22153cd396b80892 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab066c expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.657815:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf39e67900) 00010000:00010000:2.0:1787826377.657819:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826377.657823:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0b55c400, rc 0) 00000100:00100000:2.0:1787826377.657940:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:53059:x1874670563739520:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 5600us (6203us total) trans 8589934685 rc 0/0 00000100:00100000:2.0:1787826377.657951:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3481 00000100:00100000:1.0:1787826377.764641:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826377.766008:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826377.766515:0:25422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563739648 00000100:00100000:1.0:1787826377.766529:0:25422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563739648 00000100:00100000:1.0:1787826377.766636:0:25422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563739776 00000100:00100000:1.0:1787826377.766640:0:25422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563739776 00000100:00100000:1.0:1787826377.766684:0:25422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 717 00000100:00100000:1.0:1787826377.766695:0:25422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f04f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563739648:12345-192.168.203.39@tcp:3:lfs.0 00010000:00010000:1.0:1787826377.766740:0:25422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f453621b/0x22153cd396b808a0 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826377.766768:0:25422:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000050118d3b/0x22153cd396b806c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05cb expref: 10 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826377.766778:0:25422:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x102:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787826377.766785:0:25422:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x102:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826377.766790:0:25422:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f453621b/0x22153cd396b808a0 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826377.766837:0:25422:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000050118d3b/0x22153cd396b806c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05cb expref: 10 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826377.766855:0:25422:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000050118d3b/0x22153cd396b806c4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05cb expref: 10 pid: 14864 timeout: 1423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826377.766872:0:25422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce04f06940 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0001_UUID:25422:1874670585192832:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826377.766999:0:25422:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f67e840 going to sleep for 11 seconds 00000100:00100000:0.0:1787826377.767244:0:30172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 718 00000100:00100000:0.0:1787826377.767257:0:30172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670563739776:12345-192.168.203.39@tcp:3:lfs.0 00010000:00010000:0.0:1787826377.767290:0:30172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000005cb54982/0x22153cd396b808a7 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.767303:0:30172:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000979bdcbe/0x22153cd396b806fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05e0 expref: 10 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.767311:0:30172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x103:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787826377.767314:0:30172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x103:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826377.767317:0:30172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005cb54982/0x22153cd396b808a7 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x103:0x0].0x0 rrc: 3 type: EXT [1048576->2113535] (req 1048576->2113535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.767343:0:30172:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000979bdcbe/0x22153cd396b806fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05e0 expref: 10 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.767353:0:30172:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000979bdcbe/0x22153cd396b806fc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05e0 expref: 10 pid: 30398 timeout: 1423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826377.767370:0:30172:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f874780 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0001_UUID:30172:1874670585192960:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826377.767410:0:30172:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf09f7de40 going to sleep for 11 seconds 00000100:00100000:0.0:1787826377.772548:0:30172:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f874780 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0001_UUID:30172:1874670585192960:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826377.772591:0:30172:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005cb54982/0x22153cd396b808a7 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x103:0x0].0x0 rrc: 3 type: EXT [1048576->2113535] (req 1048576->2113535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826377.779174:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826377.779226:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826377.779340:0:25422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce04f06940 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0001_UUID:25422:1874670585192832:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826377.779378:0:25422:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f453621b/0x22153cd396b808a0 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826377.783958:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563739904 00000100:00100000:0.0:1787826377.783980:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563739904 00010000:00010000:0.0:1787826377.784055:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000050118d3b/0x22153cd396b806c4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05cb expref: 11 pid: 14864 timeout: 1423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826377.784166:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563740032 00000100:00100000:0.0:1787826377.784172:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563740032 00010000:00010000:0.0:1787826377.784189:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000979bdcbe/0x22153cd396b806fc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05e0 expref: 12 pid: 30398 timeout: 1423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826377.784311:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1002 00000100:00100000:3.0:1787826377.784326:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa85a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563739904:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826377.784347:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826377.784376:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000050118d3b/0x22153cd396b806c4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05cb expref: 12 pid: 14864 timeout: 1423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.784392:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000050118d3b/0x22153cd396b806c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05cb expref: 12 pid: 14864 timeout: 1423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.784421:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050118d3b/0x22153cd396b806c4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05cb expref: 12 pid: 14864 timeout: 1423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.784456:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x102:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826377.784462:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x102:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826377.784469:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f453621b/0x22153cd396b808a0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.784578:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f453621b/0x22153cd396b808a0 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.784744:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826377.784839:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa85a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2403:x1874670563739904:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 515us (5679us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826377.784849:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1002 00000100:00100000:3.0:1787826377.784877:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1003 00000100:00100000:3.0:1787826377.784886:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563740032:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826377.784896:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826377.784909:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000979bdcbe/0x22153cd396b806fc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05e0 expref: 10 pid: 30398 timeout: 1423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.784920:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000979bdcbe/0x22153cd396b806fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05e0 expref: 10 pid: 30398 timeout: 1423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.784935:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000979bdcbe/0x22153cd396b806fc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab05e0 expref: 10 pid: 30398 timeout: 1423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.784948:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x103:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826377.784952:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x103:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826377.784957:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005cb54982/0x22153cd396b808a7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x103:0x0].0x0 rrc: 3 type: EXT [1048576->2113535] (req 1048576->2113535) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 30172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.784966:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005cb54982/0x22153cd396b808a7 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x103:0x0].0x0 rrc: 3 type: EXT [1048576->2113535] (req 1048576->2113535) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 30172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.784993:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826377.785014:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563740032:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 130us (5787us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826377.785021:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1003 00010000:00010000:0.0:1787826377.786535:0:30172:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005cb54982/0x22153cd396b808a7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [1048576->2113535] (req 1048576->2113535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.786554:0:30172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005cb54982/0x22153cd396b808a7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [1048576->2113535] (req 1048576->2113535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.791855:0:25422:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f453621b/0x22153cd396b808a0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826377.792853:0:25422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f453621b/0x22153cd396b808a0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.827196:0:30172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000005cb54982/0x22153cd396b808a7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [1048576->2113535] (req 1048576->2113535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.827232:0:30172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005cb54982/0x22153cd396b808a7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [1048576->2113535] (req 1048576->2113535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.827242:0:30172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005cb54982/0x22153cd396b808a7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [1048576->2113535] (req 1048576->2113535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.827250:0:30172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05661a00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826377.827256:0:30172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005cb54982/0x22153cd396b808a7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [1048576->2113535] (req 1048576->2113535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.827279:0:30172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005cb54982/0x22153cd396b808a7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [1048576->2113535] (req 1048576->2113535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.827305:0:30172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005cb54982/0x22153cd396b808a7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [1048576->2113535] (req 1048576->2113535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.827314:0:30172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005cb54982/0x22153cd396b808a7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [1048576->2113535] (req 1048576->2113535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826377.827554:0:30172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670563739776:12345-192.168.203.39@tcp:3:lfs.0 Request processed in 60294us (61549us total) trans 0 rc 1061888/1061888 00000100:00100000:0.0:1787826377.827567:0:30172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 718 00010000:00010000:3.0:1787826377.836160:0:25422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f453621b/0x22153cd396b808a0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.836187:0:25422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f453621b/0x22153cd396b808a0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.836196:0:25422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f453621b/0x22153cd396b808a0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.836205:0:25422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05124c00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826377.836210:0:25422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f453621b/0x22153cd396b808a0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.836220:0:25422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f453621b/0x22153cd396b808a0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.836245:0:25422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f453621b/0x22153cd396b808a0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.836253:0:25422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f453621b/0x22153cd396b808a0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826377.836397:0:25422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f04f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2404:x1874670563739648:12345-192.168.203.39@tcp:3:lfs.0 Request processed in 69696us (71765us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1787826377.836410:0:25422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 717 00000100:00100000:1.0:1787826377.864356:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826377.864423:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826377.864593:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563740160 00000100:00100000:0.0:1787826377.864607:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563740160 00000100:00100000:0.0:1787826377.864672:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563740288 00000100:00100000:0.0:1787826377.864676:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563740288 00000100:00100000:0.0:1787826377.864716:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1882 00000100:00100000:0.0:1787826377.864727:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f06940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2401:x1874670563740160:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826377.864752:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826377.864783:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005cb54982/0x22153cd396b808ae lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0673 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826377.864816:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1883 00002000:00010000:0.0:1787826377.864819:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x102:0x0] initial LVB size: 1048576, mtime: 0x6a9010c8, atime: 0x6a9010c7, ctime: 0x6a9010c8, blocks: 0x0 00000100:00100000:1.0:1787826377.864825:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f07840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2401:x1874670563740288:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826377.864832:0:14864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826377.864843:0:14864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a3adc48c/0x22153cd396b808b5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab067a expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.864845:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x102:0x0].0x0 since=1323s v=(0 0) 00010000:00010000:0.0:1787826377.864850:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x102:0x0].0x0 since=0s v=(0 0) 00002000:00010000:1.0:1787826377.864857:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x103:0x0] initial LVB size: 2110464, mtime: 0x6a9010c9, atime: 0x6a9010c7, ctime: 0x6a9010c9, blocks: 0x30 00010000:00010000:0.0:1787826377.864864:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005cb54982/0x22153cd396b808ae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0673 expref: 10 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826377.864866:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x103:0x0].0x0 since=1323s v=(0 0) 00010000:00010000:1.0:1787826377.864870:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x103:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826377.864875:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3adc48c/0x22153cd396b808b5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab067a expref: 10 pid: 14864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.864883:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005cb54982/0x22153cd396b808ae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0673 expref: 10 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826377.864884:0:14864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a3adc48c/0x22153cd396b808b5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab067a expref: 10 pid: 14864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.864899:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05661a00, rc 0) 00010000:00010000:1.0:1787826377.864899:0:14864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05125800, rc 0) 00000100:00100000:0.0:1787826377.867330:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f06940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2401:x1874670563740160:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 2584us (2967us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826377.867346:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1882 00000100:00100000:1.0:1787826377.867497:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f07840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2401:x1874670563740288:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 2647us (3047us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826377.867506:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1883 00000100:00100000:2.0:1787826377.871696:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826377.872620:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826377.873164:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563740544 00000100:00100000:0.0:1787826377.873178:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563740544 00000100:00100000:0.0:1787826377.873282:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1528 00000100:00100000:0.0:1787826377.873294:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8acf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:2402:x1874670563740544:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1787826377.873401:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8acf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:2402:x1874670563740544:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 108us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826377.873409:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1528 00000100:00080000:1.0:1787826377.874513:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787826377.876834:0:34487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563740416 00000100:00100000:3.0:1787826377.876852:0:34487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563740416 00000100:00100000:3.0:1787826377.876931:0:34487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 86 00000100:00100000:3.0:1787826377.876941:0:34487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf39ccc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:307626ff-a376-4faf-93e0-9f55b723d964+10:2402:x1874670563740416:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1787826377.877062:0:34487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf39ccc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:307626ff-a376-4faf-93e0-9f55b723d964+10:2402:x1874670563740416:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 122us (5380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826377.877071:0:34487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 86 00000100:00100000:2.0:1787826377.882430:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826377.882644:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563740800 00000100:00100000:1.0:1787826377.882656:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563740800 00000100:00100000:1.0:1787826377.882729:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1022 00000100:00100000:1.0:1787826377.882742:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:53059:x1874670563740800:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:1.0:1787826377.883267:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:53059:x1874670563740800:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 525us (861us total) trans 8589934686 rc 0/0 00000100:00100000:1.0:1787826377.883277:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1022 00000100:00100000:2.0:1787826377.916053:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826377.916231:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563741056 00000100:00100000:0.0:1787826377.916245:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563741056 00000100:00100000:0.0:1787826377.916324:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3482 00000100:00100000:0.0:1787826377.916335:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:53063:x1874670563741056:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826377.916367:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826377.916394:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660a00/0x22153cd396b808bc lrc: 2/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0681 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.916678:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660200/0x22153cd396b808c3 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.916697:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660200/0x22153cd396b808c3 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.916719:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660200/0x22153cd396b808c3 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826377.916734:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x14:0x0]: returning size 2110464 00010000:00010000:0.0:1787826377.916951:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660a00/0x22153cd396b808bc lrc: 0/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0681 expref: 28 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.917051:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660200/0x22153cd396b808c3 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0681 expref: 27 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.917061:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf39e67900) 00010000:00010000:0.0:1787826377.917065:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787826377.917068:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05660200, rc 0) 00000100:00100000:0.0:1787826377.917150:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:53063:x1874670563741056:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 816us (1176us total) trans 8589934687 rc 0/0 00000100:00100000:0.0:1787826377.917163:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3482 00000100:00100000:2.0:1787826377.957914:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826377.957973:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826377.958781:0:30175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563741184 00000100:00100000:3.0:1787826377.958796:0:30175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563741184 00000100:00100000:0.0:1787826377.958810:0:30174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563741312 00000100:00100000:0.0:1787826377.958817:0:30174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563741312 00000100:00100000:3.0:1787826377.958905:0:30175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 719 00000100:00100000:0.0:1787826377.958914:0:30174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 720 00000100:00100000:3.0:1787826377.958921:0:30175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+23:2401:x1874670563741184:12345-192.168.203.39@tcp:3:lfs.0 00000100:00100000:0.0:1787826377.958930:0:30174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8ae580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+23:2401:x1874670563741312:12345-192.168.203.39@tcp:3:lfs.0 00010000:00010000:3.0:1787826377.958978:0:30175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008343e43a/0x22153cd396b808d1 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.959005:0:30175:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000047d516be/0x22153cd396b80829 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0649 expref: 23 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.959014:0:30175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x102:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826377.959020:0:30175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x102:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826377.959024:0:30175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008343e43a/0x22153cd396b808d1 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.959059:0:30174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d9012eb8/0x22153cd396b808d8 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.959077:0:30174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006d612c5b/0x22153cd396b80830 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0650 expref: 23 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.959078:0:30175:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000047d516be/0x22153cd396b80829 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0649 expref: 23 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.959092:0:30174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x103:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826377.959099:0:30174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x103:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826377.959105:0:30174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9012eb8/0x22153cd396b808d8 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [2097152->2113535] (req 2097152->2113535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.959113:0:30175:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000047d516be/0x22153cd396b80829 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0649 expref: 23 pid: 28853 timeout: 1423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.959131:0:30174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006d612c5b/0x22153cd396b80830 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0650 expref: 23 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826377.959147:0:30175:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aa84b40 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_013:lustre-OST0000_UUID:30175:1874670585193088:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826377.959148:0:30174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006d612c5b/0x22153cd396b80830 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0650 expref: 23 pid: 30695 timeout: 1423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826377.959165:0:30174:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f874780 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_012:lustre-OST0000_UUID:30174:1874670585193216:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826377.959267:0:30175:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f5e76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826377.959277:0:30174:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf09f7da80 going to sleep for 11 seconds 00000100:00100000:2.0:1787826377.963676:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826377.963722:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826377.963819:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563741440 00000100:00100000:1.0:1787826377.963830:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563741440 00010000:00010000:1.0:1787826377.963882:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000047d516be/0x22153cd396b80829 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0649 expref: 24 pid: 28853 timeout: 1423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826377.963929:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563741568 00000100:00100000:1.0:1787826377.963932:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563741568 00010000:00010000:1.0:1787826377.963946:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006d612c5b/0x22153cd396b80830 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0650 expref: 25 pid: 30695 timeout: 1423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826377.963977:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1004 00000100:00100000:1.0:1787826377.963988:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf10a51850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:2402:x1874670563741440:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826377.964009:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826377.964038:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000047d516be/0x22153cd396b80829 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0649 expref: 25 pid: 28853 timeout: 1423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826377.964054:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000047d516be/0x22153cd396b80829 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0649 expref: 25 pid: 28853 timeout: 1423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826377.964087:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x102:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826377.964092:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x102:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826377.964099:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008343e43a/0x22153cd396b808d1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x102:0x0].0x0 rrc: 4 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 30175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826377.964110:0:10340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008343e43a/0x22153cd396b808d1 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x102:0x0].0x0 rrc: 4 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 30175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826377.964135:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826377.964195:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf10a51850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:2402:x1874670563741440:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 208us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826377.964203:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1004 00000100:00100000:1.0:1787826377.964262:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1005 00000100:00100000:1.0:1787826377.964268:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8acb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:2402:x1874670563741568:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826377.964276:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826377.964287:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006d612c5b/0x22153cd396b80830 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0650 expref: 24 pid: 30695 timeout: 1423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826377.964298:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006d612c5b/0x22153cd396b80830 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0650 expref: 24 pid: 30695 timeout: 1423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826377.964311:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x103:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826377.964315:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x103:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826377.964319:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9012eb8/0x22153cd396b808d8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x103:0x0].0x0 rrc: 4 type: EXT [2097152->2113535] (req 2097152->2113535) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 30174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826377.964327:0:10340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9012eb8/0x22153cd396b808d8 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x103:0x0].0x0 rrc: 4 type: EXT [2097152->2113535] (req 2097152->2113535) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 30174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826377.964340:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826377.964358:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8acb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:2402:x1874670563741568:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 90us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826377.964364:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1005 00010000:00010000:0.0:1787826377.964832:0:30174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d612c5b/0x22153cd396b80830 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0650 expref: 23 pid: 30695 timeout: 1423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826377.964852:0:30174:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f874780 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_012:lustre-OST0000_UUID:30174:1874670585193216:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826377.964878:0:30174:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d9012eb8/0x22153cd396b808d8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [2097152->2113535] (req 2097152->2113535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.964889:0:30174:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d9012eb8/0x22153cd396b808d8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [2097152->2113535] (req 2097152->2113535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.964898:0:30174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9012eb8/0x22153cd396b808d8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [2097152->2113535] (req 2097152->2113535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.965035:0:30174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d9012eb8/0x22153cd396b808d8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [2097152->2113535] (req 2097152->2113535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.965046:0:30174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9012eb8/0x22153cd396b808d8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [2097152->2113535] (req 2097152->2113535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.965056:0:30174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9012eb8/0x22153cd396b808d8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [2097152->2113535] (req 2097152->2113535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.965063:0:30174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05660a00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826377.965068:0:30174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9012eb8/0x22153cd396b808d8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [2097152->2113535] (req 2097152->2113535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.965079:0:30174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9012eb8/0x22153cd396b808d8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [2097152->2113535] (req 2097152->2113535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.965094:0:30174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9012eb8/0x22153cd396b808d8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [2097152->2113535] (req 2097152->2113535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826377.965102:0:30174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9012eb8/0x22153cd396b808d8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [2097152->2113535] (req 2097152->2113535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826377.965174:0:30174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8ae580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:2401:x1874670563741312:12345-192.168.203.39@tcp:3:lfs.0 Request processed in 6250us (7199us total) trans 0 rc 13312/13312 00000100:00100000:0.0:1787826377.965184:0:30174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 720 00010000:00010000:3.0:1787826377.966710:0:30175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047d516be/0x22153cd396b80829 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0649 expref: 21 pid: 28853 timeout: 1423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826377.966731:0:30175:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aa84b40 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_013:lustre-OST0000_UUID:30175:1874670585193088:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826377.966759:0:30175:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008343e43a/0x22153cd396b808d1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.966769:0:30175:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008343e43a/0x22153cd396b808d1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.966773:0:30175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008343e43a/0x22153cd396b808d1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.983518:0:30175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008343e43a/0x22153cd396b808d1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.983557:0:30175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008343e43a/0x22153cd396b808d1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.983568:0:30175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008343e43a/0x22153cd396b808d1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.983577:0:30175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401000 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826377.983583:0:30175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008343e43a/0x22153cd396b808d1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.983595:0:30175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008343e43a/0x22153cd396b808d1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.983626:0:30175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008343e43a/0x22153cd396b808d1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826377.983636:0:30175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008343e43a/0x22153cd396b808d1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826377.983771:0:30175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:2401:x1874670563741184:12345-192.168.203.39@tcp:3:lfs.0 Request processed in 24848us (25864us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1787826377.983784:0:30175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 719 00000100:00100000:2.0:1787826378.047638:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826378.047886:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00010000:00010000:1.0:1787826378.054684:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826378.055469:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563741696 00000100:00100000:0.0:1787826378.055503:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563741696 00000100:00100000:0.0:1787826378.055587:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563741824 00000100:00100000:0.0:1787826378.055592:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563741824 00000100:00100000:2.0:1787826378.055903:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1884 00000100:00100000:2.0:1787826378.055930:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8afc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:2403:x1874670563741696:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826378.055953:0:30696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826378.055982:0:30696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9e5b8b8/0x22153cd396b808df lrc: 2/0,0 mode: --/PR res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0688 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787826378.056014:0:30696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x102:0x0] initial LVB size: 2097152, mtime: 0x6a9010c9, atime: 0x6a9010c7, ctime: 0x6a9010c9, blocks: 0x10 00010000:00010000:2.0:1787826378.056038:0:30696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x102:0x0].0x0 since=1324s v=(0 0) 00010000:00010000:2.0:1787826378.056043:0:30696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x102:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826378.056057:0:30696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9e5b8b8/0x22153cd396b808df lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0688 expref: 22 pid: 30696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826378.056086:0:30696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9e5b8b8/0x22153cd396b808df lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0688 expref: 22 pid: 30696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826378.056102:0:30696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834400, rc 0) 00000100:00100000:3.0:1787826378.056114:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1885 00000100:00100000:3.0:1787826378.056128:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8af840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:2403:x1874670563741824:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826378.056137:0:30694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826378.056150:0:30694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008343e43a/0x22153cd396b808e6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab068f expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826378.056167:0:30694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x103:0x0] initial LVB size: 2110464, mtime: 0x6a9010c9, atime: 0x6a9010c7, ctime: 0x6a9010c9, blocks: 0x20 00010000:00010000:3.0:1787826378.056179:0:30694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x103:0x0].0x0 since=1324s v=(0 0) 00010000:00010000:3.0:1787826378.056183:0:30694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x103:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1787826378.056188:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8afc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+23:2403:x1874670563741696:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 262us (8574us total) trans 0 rc 0/0 00010000:00010000:3.0:1787826378.056194:0:30694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008343e43a/0x22153cd396b808e6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab068f expref: 23 pid: 30694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826378.056202:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1884 00010000:00010000:3.0:1787826378.056215:0:30694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008343e43a/0x22153cd396b808e6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab068f expref: 23 pid: 30694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826378.056225:0:30694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401000, rc 0) 00000100:00100000:3.0:1787826378.056251:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8af840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:2403:x1874670563741824:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 127us (8365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826378.056258:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1885 00000100:00100000:1.0:1787826378.090070:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826378.090193:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826378.090340:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563741952 00000100:00100000:2.0:1787826378.090342:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563742080 00000100:00100000:2.0:1787826378.090353:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563742080 00000100:00100000:3.0:1787826378.090353:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563741952 00000100:00100000:2.0:1787826378.090427:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 343 00000100:00100000:2.0:1787826378.090436:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:42221:x1874670563742080:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826378.090468:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1787826378.090550:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008343e43a/0x22153cd396b808e6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab068f expref: 22 pid: 30694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826378.090589:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9e5b8b8/0x22153cd396b808df lrc: 0/0,0 mode: --/PR res: [0x280000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0688 expref: 21 pid: 30696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826378.090606:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826378.090617:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 344 00000100:00100000:3.0:1787826378.090629:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f04b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:49796:x1874670563741952:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826378.090641:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1787826378.090678:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005cb54982/0x22153cd396b808ae lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0673 expref: 9 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826378.090687:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:42221:x1874670563742080:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 249us (491us total) trans 0 rc 0/0 00010000:00010000:3.0:1787826378.090726:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3adc48c/0x22153cd396b808b5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab067a expref: 8 pid: 14864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826378.090746:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826378.090770:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f04b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:49796:x1874670563741952:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 145us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826378.090778:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 344 00000100:00100000:2.0:1787826378.090816:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 343 00010000:00010000:3.0:1787826379.077677:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826380.099847:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787826381.064872:0:26205:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836949 is committed 00000001:00080000:0.0:1787826381.064908:0:26205:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836947 is committed 00010000:00010000:2.0:1787826381.126526:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826382.084132:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787826382.084154:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce04f04780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585193344:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826382.084224:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826382.084751:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585193344 00000100:00100000:1.0:1787826382.084759:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585193344 00000100:00100000:1.0:1787826382.084816:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1369 00000100:00100000:1.0:1787826382.084826:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f874780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3646:x1874670585193344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787826382.084860:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445957632 avail 1299718144 00000100:00100000:1.0:1787826382.084910:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f874780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3646:x1874670585193344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826382.084917:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1369 00000100:00100000:1.0:1787826382.084960:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce04f04780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585193344:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826382.085436:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aa84f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874670585193600:0@lo:400:kworker.0 00000100:00100000:3.0:1787826382.085492:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826382.085516:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aa84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1874670585194112:0@lo:400:kworker.0 00000100:00100000:3.0:1787826382.085540:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826382.085557:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585194624:0@lo:400:kworker.0 00000100:00100000:3.0:1787826382.085581:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826382.085732:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aa87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585193856:0@lo:400:kworker.0 00000100:00100000:2.0:1787826382.085783:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aa84b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585193728:0@lo:400:kworker.0 00000100:00100000:2.0:1787826382.085912:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585193600 00000100:00100000:2.0:1787826382.085917:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585193600 00000100:00100000:2.0:1787826382.085948:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585194112 00000100:00100000:2.0:1787826382.085950:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585194112 00000100:00100000:2.0:1787826382.085980:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1529 00000100:00100000:2.0:1787826382.085987:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03977840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874670585193600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826382.086025:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03977840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874670585193600:12345-0@lo:400:kworker.0 Request processed in 38us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826382.086031:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1529 00000100:00100000:2.0:1787826382.086188:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1530 00000100:00100000:2.0:1787826382.086196:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874670585194112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826382.086225:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874670585194112:12345-0@lo:400:kworker.0 Request processed in 30us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826382.086231:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1530 00000100:00080000:2.0:1787826382.086252:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826382.086505:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aa861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e3c550b8-2c3c-46c3-ad36-671c284167ea:3644:1874670585193472:0@lo:400:kworker.0 00000100:00100000:1.0:1787826382.086542:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826382.086569:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aa85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874670585193984:0@lo:400:kworker.0 00000100:00100000:2.0:1787826382.086690:0:34488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585193472 00000100:00100000:2.0:1787826382.086695:0:34488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585193472 00000100:00100000:2.0:1787826382.086726:0:34488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787826382.086733:0:34488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf39ccc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3c550b8-2c3c-46c3-ad36-671c284167ea+24:3644:x1874670585193472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826382.086908:0:34488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf39ccc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3c550b8-2c3c-46c3-ad36-671c284167ea+24:3644:x1874670585193472:12345-0@lo:400:kworker.0 Request processed in 175us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826382.086914:0:34488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787826382.086959:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585194624 00000100:00100000:2.0:1787826382.086964:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585194624 00000100:00100000:2.0:1787826382.086994:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 901 00000100:00100000:2.0:1787826382.087000:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce039752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874670585194624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826382.087031:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce039752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874670585194624:12345-0@lo:400:kworker.0 Request processed in 32us (1450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826382.087050:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 901 00000100:00080000:2.0:1787826382.087079:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826382.087100:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826382.087121:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fde1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874670585194240:0@lo:400:kworker.0 00000100:00100000:2.0:1787826382.087141:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826382.087155:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03975a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585194752:0@lo:400:kworker.0 00000100:00100000:2.0:1787826382.087174:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826382.087202:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585194240 00000100:00100000:2.0:1787826382.087205:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585194240 00000100:00100000:2.0:1787826382.087233:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1531 00000100:00100000:2.0:1787826382.087239:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8af0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874670585194240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826382.087273:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8af0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874670585194240:12345-0@lo:400:kworker.0 Request processed in 35us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826382.087280:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1531 00000100:00100000:2.0:1787826382.087295:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585193728 00000100:00100000:2.0:1787826382.087298:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585193728 00000100:00100000:2.0:1787826382.087318:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585194752 00000100:00100000:2.0:1787826382.087320:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585194752 00000100:00100000:2.0:1787826382.087340:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 902 00000100:00100000:2.0:1787826382.087346:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8ae940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3646:x1874670585193728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826382.087371:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8ae940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3646:x1874670585193728:12345-0@lo:400:kworker.0 Request processed in 26us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826382.087377:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 902 00000100:00100000:2.0:1787826382.087387:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 903 00000100:00100000:2.0:1787826382.087392:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8ada40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3646:x1874670585194752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826382.087427:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8ada40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3646:x1874670585194752:12345-0@lo:400:kworker.0 Request processed in 21us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826382.087433:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 903 00000100:00080000:2.0:1787826382.087455:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787826382.087458:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787826382.087460:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787826382.087506:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aa84b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585193728:0@lo:400:kworker.0 00000100:00100000:2.0:1787826382.087518:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fde1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874670585194240:0@lo:400:kworker.0 00000100:00100000:2.0:1787826382.087527:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03975a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585194752:0@lo:400:kworker.0 00000100:00100000:2.0:1787826382.087564:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826382.087584:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fde580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1874670585194368:0@lo:400:kworker.0 00000100:00100000:2.0:1787826382.087619:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826382.087636:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce039761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874670585194880:0@lo:400:kworker.0 00000100:00100000:2.0:1787826382.087655:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826382.087680:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585193856 00000100:00100000:2.0:1787826382.087683:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585193856 00000100:00100000:2.0:1787826382.087711:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 904 00000100:00100000:2.0:1787826382.087717:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fde1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3647:x1874670585193856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826382.087750:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fde1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3647:x1874670585193856:12345-0@lo:400:kworker.0 Request processed in 33us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826382.087756:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 904 00000100:00100000:2.0:1787826382.087770:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585194368 00000100:00100000:2.0:1787826382.087773:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585194368 00000100:00100000:2.0:1787826382.087805:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585194880 00000100:00100000:2.0:1787826382.087808:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585194880 00000100:00100000:2.0:1787826382.087825:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1532 00000100:00100000:2.0:1787826382.087831:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874670585194368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826382.087858:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874670585194368:12345-0@lo:400:kworker.0 Request processed in 27us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826382.087863:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1532 00000100:00100000:2.0:1787826382.087874:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1533 00000100:00100000:2.0:1787826382.087879:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecaf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874670585194880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826382.087903:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecaf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874670585194880:12345-0@lo:400:kworker.0 Request processed in 24us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826382.087908:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1533 00000100:00080000:2.0:1787826382.087930:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787826382.087934:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826382.087950:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aa87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585193856:0@lo:400:kworker.0 00000100:00100000:2.0:1787826382.087961:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fde580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1874670585194368:0@lo:400:kworker.0 00000100:00100000:2.0:1787826382.087970:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce039761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874670585194880:0@lo:400:kworker.0 00000100:00100000:1.0:1787826382.091233:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826382.091291:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fdcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585194496:0@lo:400:kworker.0 00000100:00100000:1.0:1787826382.091342:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826382.091363:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a8ac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585195008:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787826382.091388:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826382.091443:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aa861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e3c550b8-2c3c-46c3-ad36-671c284167ea:3644:1874670585193472:0@lo:400:kworker.0 00000100:00100000:1.0:1787826382.091500:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585194496 00000100:00100000:1.0:1787826382.091506:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585194496 00000100:00100000:1.0:1787826382.092408:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585195008 00000100:00100000:1.0:1787826382.092426:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585195008 00000100:00100000:1.0:1787826382.092443:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1370 00000100:00100000:1.0:1787826382.092453:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f05e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1874670585194496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826382.092550:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f05e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1874670585194496:12345-0@lo:400:kworker.0 Request processed in 98us (1206us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826382.092557:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1370 00000100:00100000:1.0:1787826382.092574:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1371 00000100:00100000:1.0:1787826382.092581:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874670585195008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787826382.092615:0:7796:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446236160 avail 1299996672 00000100:00100000:1.0:1787826382.092648:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874670585195008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (1258us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826382.092654:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1371 00000100:00100000:1.0:1787826382.092697:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fdcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585194496:0@lo:400:kworker.0 00000100:00100000:1.0:1787826382.092711:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a8ac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585195008:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787826382.093314:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585193984 00000100:00100000:2.0:1787826382.093321:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585193984 00000100:00100000:2.0:1787826382.093380:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1534 00000100:00100000:2.0:1787826382.093388:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f04780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874670585193984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826382.093456:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f04780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874670585193984:12345-0@lo:400:kworker.0 Request processed in 69us (2230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826382.093463:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1534 00000100:00100000:2.0:1787826382.093538:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aa85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874670585193984:0@lo:400:kworker.0 00000100:00080000:1.0:1787826382.093780:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787826382.094202:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836949 gen 2 00000004:00080000:2.0:1787826382.094208:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3fb95a40, transno 21474836930 00000004:00080000:2.0:1787826382.094258:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3abc30c0, transno 21474836931 00000004:00080000:2.0:1787826382.094391:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce06307480, transno 21474836932 00000004:00080000:2.0:1787826382.094395:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce06305680, transno 21474836933 00000004:00080000:2.0:1787826382.094397:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce03984000, transno 21474836938 00000004:00080000:2.0:1787826382.094400:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce03984b40, transno 21474836939 00000004:00080000:2.0:1787826382.094402:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf41c87c00, transno 21474836942 00000004:00080000:2.0:1787826382.094405:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf41c87840, transno 21474836943 00000004:00080000:2.0:1787826382.094407:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3aa86940, transno 21474836944 00000004:00080000:2.0:1787826382.094410:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce01fdc780, transno 21474836945 00000004:00080000:2.0:1787826382.094422:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce04f04000, transno 21474836948 00000004:00080000:2.0:1787826382.094425:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce04f061c0, transno 21474836949 00000100:00100000:2.0:1787826382.094432:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585194624:0@lo:400:kworker.0 00000004:00080000:1.0:1787826382.094546:0:34500:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 10 done 00000100:00100000:2.0:1787826382.096236:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aa84f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874670585193600:0@lo:400:kworker.0 00000100:00100000:2.0:1787826382.096254:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aa84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1874670585194112:0@lo:400:kworker.0 00010000:00010000:1.0:1787826382.148597:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826382.596037:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787826382.596069:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a9acb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585195264:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826382.596168:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826382.596234:0:25628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585195264 00000100:00100000:0.0:1787826382.596242:0:25628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585195264 00000100:00100000:0.0:1787826382.596306:0:25628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 754 00000100:00100000:0.0:1787826382.596316:0:25628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9ae580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874670585195264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787826382.596355:0:25628:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 135822144 pending 0 free 3919204352 avail 3687682048 00000100:00100000:0.0:1787826382.596422:0:25628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9ae580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874670585195264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826382.596431:0:25628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 754 00000100:00100000:0.0:1787826382.596518:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a9acb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585195264:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826382.596824:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce04f04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585195136:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826382.596843:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787826382.596863:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf1ecaed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585195392:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787826382.596897:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826382.596981:0:12021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585195136 00000100:00100000:0.0:1787826382.596988:0:12021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585195136 00000100:00100000:0.0:1787826382.597055:0:12021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 755 00000100:00100000:0.0:1787826382.597065:0:12021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874670585195136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787826382.597085:0:12021:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 135822144 pending 0 free 3919204352 avail 3687682048 00000100:00100000:3.0:1787826382.603769:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03976940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585195520:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826382.605159:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826382.606849:0:12021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874670585195136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 9780us (9949us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826382.606863:0:12021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 755 00000100:00100000:0.0:1787826382.606889:0:12021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585195392 00000100:00100000:0.0:1787826382.606898:0:12021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585195392 00000100:00100000:0.0:1787826382.606940:0:12021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 756 00000100:00100000:0.0:1787826382.606948:0:12021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+11:3646:x1874670585195392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787826382.606979:0:12021:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 126401344 pending 0 free 3920265216 avail 3688742912 00000100:00100000:0.0:1787826382.607025:0:12021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+11:3646:x1874670585195392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (1874us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826382.607032:0:12021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 756 00000100:00100000:0.0:1787826382.607154:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf1ecaed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585195392:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826382.607851:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce04f04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585195136:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787826382.608379:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826382.610716:0:12021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585195520 00000100:00100000:1.0:1787826382.610737:0:12021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585195520 00000100:00100000:0.0:1787826382.610889:0:12021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 757 00000100:00100000:0.0:1787826382.610902:0:12021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce039761c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874670585195520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787826382.610929:0:12021:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 126401344 pending 0 free 3920265216 avail 3688742912 00000100:00100000:0.0:1787826382.611008:0:12021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce039761c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874670585195520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 108us (2635us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826382.611016:0:12021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 757 00000100:00100000:3.0:1787826382.611661:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03976940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585195520:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826382.991033:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826382.991089:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826382.991113:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826382.991142:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826382.991166:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826382.991204:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563742720 00000100:00100000:3.0:1787826382.991216:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563742720 00000100:00100000:3.0:1787826382.991299:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563742592 00000100:00100000:3.0:1787826382.991303:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563742592 00000100:00100000:3.0:1787826382.991333:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 905 00000100:00100000:3.0:1787826382.991346:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03975a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2402:x1874670563742720:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1787826382.991464:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03975a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2402:x1874670563742720:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 119us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826382.991497:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 905 00000100:00100000:3.0:1787826382.991521:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 906 00000100:00100000:3.0:1787826382.991529:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf07964780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+5:2402:x1874670563742592:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1787826382.991559:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf07964780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+5:2402:x1874670563742592:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 31us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826382.991566:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 906 00000100:00080000:3.0:1787826382.991657:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787826382.991664:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826382.991955:0:34487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563742208 00000100:00100000:0.0:1787826382.991961:0:34487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563742208 00000100:00100000:0.0:1787826382.992000:0:34487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 88 00000100:00100000:0.0:1787826382.992007:0:34487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf03de0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:307626ff-a376-4faf-93e0-9f55b723d964+10:2402:x1874670563742208:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1787826382.992040:0:34487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf03de0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:307626ff-a376-4faf-93e0-9f55b723d964+10:2402:x1874670563742208:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 34us (1025us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826382.992047:0:34487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 88 00000100:00100000:2.0:1787826382.995997:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563742464 00000100:00100000:2.0:1787826382.996018:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563742464 00000100:00100000:2.0:1787826382.996125:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563742336 00000100:00100000:2.0:1787826382.996128:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563742336 00000100:00080000:3.0:1787826382.996187:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787826382.996193:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787826382.996234:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1535 00000100:00100000:2.0:1787826382.996247:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03976940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:2402:x1874670563742464:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1787826382.996301:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1536 00000100:00100000:0.0:1787826382.996314:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf07966d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:2402:x1874670563742336:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1787826382.996515:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf07966d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:2402:x1874670563742336:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 203us (5370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826382.996522:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03976940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:2402:x1874670563742464:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 274us (5429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826382.996530:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1536 00000100:00100000:2.0:1787826382.996538:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1535 00000100:00100000:1.0:1787826383.085422:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826383.085541:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563742976 00000100:00100000:3.0:1787826383.085554:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563742976 00000100:00100000:3.0:1787826383.085647:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1023 00000100:00100000:3.0:1787826383.085660:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:53494:x1874670563742976:12345-192.168.203.39@tcp:35:rm.0 00000100:00100000:3.0:1787826383.085985:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+28:53494:x1874670563742976:12345-192.168.203.39@tcp:35:rm.0 Request processed in 327us (587us total) trans 8589934688 rc 0/0 00000100:00100000:3.0:1787826383.085994:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1023 00000100:00100000:1.0:1787826383.093285:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826383.093422:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563743232 00000100:00100000:3.0:1787826383.093435:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563743232 00000100:00100000:3.0:1787826383.093539:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3483 00000100:00100000:3.0:1787826383.093551:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f06580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+28:53494:x1874670563743232:12345-192.168.203.39@tcp:36:rm.0 00010000:00010000:3.0:1787826383.093741:0:9966:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787826383.093782:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55c400/0x22153cd396b80892 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab066c expref: 28 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826383.093808:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660200/0x22153cd396b808c3 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0681 expref: 27 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826383.093825:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0b55d800/0x22153cd396b8083e lrc: 0/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0657 expref: 26 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826383.093837:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf39e67900) 00010000:00010000:3.0:1787826383.093850:0:9966:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826383.093878:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b808ed lrc: 3/0,1 mode: --/CW res: [0x200000405:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826383.093895:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b808ed lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826383.093906:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b808ed lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826383.093920:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400e00/0x22153cd396b808f4 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826383.093927:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400e00/0x22153cd396b808f4 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826383.093933:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400e00/0x22153cd396b808f4 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826383.094033:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b808fb lrc: 3/0,1 mode: --/EX res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826383.094046:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b808fb lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826383.094053:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b808fb lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787826383.094377:0:9966:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].19, 64 off9816 00000004:00080000:3.0:1787826383.094390:0:9966:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1329105918268ns, next at 1330105915187ns, rc = 0 00000040:00080000:3.0:1787826383.094416:0:9966:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].20, 64 off9880 00000040:00080000:3.0:1787826383.094443:0:9966:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].19, 64 off9792 00000004:00080000:3.0:1787826383.094452:0:9966:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1329105980773ns, next at 1330105977068ns, rc = 0 00000040:00080000:3.0:1787826383.094464:0:9966:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].20, 64 off9856 00010000:00010000:3.0:1787826383.094552:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b80902 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826383.094563:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b80902 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826383.094571:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b80902 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826383.097016:0:9966:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b80902 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826383.097050:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b80902 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826383.097059:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b80902 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826383.097093:0:9966:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787826383.097138:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b808fb lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826383.097145:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b808fb lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826383.097150:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b808fb lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826383.097155:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826383.097159:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b808fb lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826383.097168:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b808fb lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826383.097187:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf39656000) 00010000:00010000:3.0:1787826383.097190:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787826383.097195:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b808fb lrc: 2/0,0 mode: --/EX res: [0x200000405:0x14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826383.097202:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b808fb lrc: 0/0,0 mode: --/EX res: [0x200000405:0x14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826383.097229:0:9966:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b808ed lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826383.097235:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b808ed lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826383.097240:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b808ed lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826383.097245:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b808ed lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826383.097251:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826383.097254:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b808ed lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826383.097260:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b808ed lrc: 5/0,0 mode: CW/CW res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826383.097268:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0x0 (ffff90cf39e67500) 00010000:00010000:3.0:1787826383.097271:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826383.097274:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b808ed lrc: 3/0,0 mode: --/CW res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826383.097281:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b808ed lrc: 0/0,0 mode: --/CW res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826383.097292:0:9966:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a49bd153 reply state 0000000062f73757 transno 8589934689 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400e00/0x22153cd396b808f4 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826383.097307:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400e00/0x22153cd396b808f4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826383.097314:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0xe1e61496 (ffff90cf39656800) 00010000:00010000:3.0:1787826383.097317:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826383.097320:0:9966:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826383.097453:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f06580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:53494:x1874670563743232:12345-192.168.203.39@tcp:36:rm.0 Request processed in 3897us (4178us total) trans 8589934689 rc 0/0 00000100:00100000:3.0:1787826383.097464:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3483 00010000:00010000:2.0:1787826383.097761:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826383.097771:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b80902 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826383.097778:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400200 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826383.097782:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b80902 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826383.097789:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b80902 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826383.097801:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff90cf39656000) 00010000:00010000:2.0:1787826383.097803:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787826383.097807:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b80902 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826383.097817:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b80902 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826383.097838:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826383.097840:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826383.097842:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787826383.108108:0:34481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934688 is committed 00000001:00080000:2.0:1787826383.122377:0:27651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179869615 is committed 00000001:00080000:2.0:1787826383.122401:0:27651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179869613 is committed 00010000:00010000:1.0:1787826383.173936:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826384.195635:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787826384.964167:0:35702:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 50c: punch_hole/mmap_write stale other mirrors ========================================================== 06:26:23 (1787826383) 00000100:00100000:3.0:1787826385.073151:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826385.073271:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563743360 00000100:00100000:0.0:1787826385.073282:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563743360 00000100:00100000:0.0:1787826385.073378:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3484 00000100:00080000:3.0:1787826385.073384:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787826385.073403:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf07966940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:53651:x1874670563743360:12345-192.168.203.39@tcp:41:stat.0 00000004:00000024:0.0:1787826385.073509:0:8247:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 7839469568 avail 7376424960 00000100:00100000:0.0:1787826385.073625:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf07966940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:53651:x1874670563743360:12345-192.168.203.39@tcp:41:stat.0 Request processed in 236us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826385.073633:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3484 00000100:00100000:1.0:1787826385.125268:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826385.125357:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563743488 00000100:00100000:0.0:1787826385.125371:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563743488 00000100:00100000:0.0:1787826385.125489:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3485 00000100:00100000:0.0:1787826385.125504:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f06d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:53655:x1874670563743488:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826385.125531:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826385.125558:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661e00/0x22153cd396b80909 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0696 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.125811:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661800/0x22153cd396b80910 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.125830:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661800/0x22153cd396b80910 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.125846:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661800/0x22153cd396b80910 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.125865:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661400/0x22153cd396b80917 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7b0e8b47 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.125872:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661400/0x22153cd396b80917 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7b0e8b47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.125880:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661400/0x22153cd396b80917 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7b0e8b47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.126054:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661800/0x22153cd396b80910 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.126063:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661800/0x22153cd396b80910 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.126069:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661800/0x22153cd396b80910 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.126080:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661800/0x22153cd396b80910 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.126086:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05661800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826385.126091:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661800/0x22153cd396b80910 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.126099:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661800/0x22153cd396b80910 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.126113:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ce01f45300) 00010000:00010000:0.0:1787826385.126116:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826385.126121:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661800/0x22153cd396b80910 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.126128:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661800/0x22153cd396b80910 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.126143:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661400/0x22153cd396b80917 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7b0e8b47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.126149:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661400/0x22153cd396b80917 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7b0e8b47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.126154:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661400/0x22153cd396b80917 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7b0e8b47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.126159:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05661400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826385.126162:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661400/0x22153cd396b80917 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7b0e8b47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.126172:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661400/0x22153cd396b80917 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7b0e8b47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.126179:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7b0e8b47 (ffff90cf371d2100) 00010000:00010000:0.0:1787826385.126182:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826385.126184:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661400/0x22153cd396b80917 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7b0e8b47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.126190:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661400/0x22153cd396b80917 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7b0e8b47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.126229:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661e00/0x22153cd396b80909 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0696 expref: 21 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.126240:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ce01f45300) 00010000:00010000:0.0:1787826385.126242:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826385.126246:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661e00/0x22153cd396b80909 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0696 expref: 21 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.126256:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05661e00, rc 0) 00000100:00100000:0.0:1787826385.126337:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f06d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:53655:x1874670563743488:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 836us (1083us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826385.126346:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3485 00000100:00100000:3.0:1787826385.133022:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826385.133156:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563743744 00000100:00100000:0.0:1787826385.133169:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563743744 00000100:00100000:0.0:1787826385.133242:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3486 00000100:00100000:0.0:1787826385.133253:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb95a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:53655:x1874670563743744:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:0.0:1787826385.133328:0:16564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826385.133366:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf01519e00/0x22153cd396b802b8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab043c expref: 20 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.133403:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ce01f45300) 00010000:00010000:0.0:1787826385.133409:0:16564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826385.133503:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661200/0x22153cd396b8091e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.133520:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661200/0x22153cd396b8091e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.133532:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661200/0x22153cd396b8091e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.133551:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660800/0x22153cd396b80925 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7b0e8b47 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.133558:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660800/0x22153cd396b80925 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7b0e8b47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.133564:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660800/0x22153cd396b80925 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7b0e8b47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826385.133787:0:16564:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a9acb40 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:16564:1874670585195648:0@lo:700:mdt00_005.0 00000100:00100000:0.0:1787826385.133853:0:16564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826385.133917:0:16564:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf117b0240 going to sleep for 11 seconds 00000100:00100000:3.0:1787826385.136557:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585195648 00000100:00100000:3.0:1787826385.136575:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585195648 00000100:00100000:3.0:1787826385.136647:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787826385.136658:0:6528:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 2 min 2 max 256 00000100:00100000:3.0:1787826385.136660:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+5:16564:x1874670585195648:12345-0@lo:700:mdt00_005.0 00000100:00100000:0.0:1787826385.136674:0:6528:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0002' 00000100:00100000:3.0:1787826385.136802:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+5:16564:x1874670585195648:12345-0@lo:700:mdt00_005.0 Request processed in 145us (2948us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826385.136811:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787826385.136993:0:16564:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a9acb40 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:16564:1874670585195648:0@lo:700:mdt00_005.0 00000040:00080000:0.0:1787826385.137258:0:16564:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787826385.137281:0:16564:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x1:0x0].3, 64 off32960 00000004:00080000:0.0:1787826385.137290:0:16564:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff90cf117b0000 with version 5 00000004:00080000:3.0:1787826385.137356:0:34498:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff90cf39def9c0 version 5 rpc_version 5 00000040:00080000:0.0:1787826385.137359:0:16564:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787826385.137372:0:16564:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x1:0x0].4, 64 off33024 00000004:00080000:0.0:1787826385.137376:0:16564:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff90cf117b0e40 with version 6 00000020:00100000:3.0:1787826385.137407:0:34498:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787826385.137418:0:34498:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff90cf3fb943c0 x1874670585195904/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1312/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826385.137448:0:34498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3fb943c0 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:34498:1874670585195904:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826385.137550:0:34498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826385.137594:0:34498:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a2c000 going to sleep for 11 seconds 00000100:00100000:0.0:1787826385.140676:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585195904 00000100:00100000:0.0:1787826385.140697:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585195904 00000100:00100000:0.0:1787826385.140798:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1372 00000100:00100000:0.0:1787826385.140809:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:34498:x1874670585195904:12345-0@lo:1000:osp_up1-0.0 00000040:00080000:2.0:1787826385.146193:0:16564:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787826385.146256:0:16564:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x1:0x0].2, 64 off32896 00000040:00080000:2.0:1787826385.147086:0:16564:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000bd0:0x2:0x0].1, 2160 off34928 00000040:00080000:2.0:1787826385.147267:0:16564:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000405:0x2:0x0].1, 2360 off35128 00000004:00080000:2.0:1787826385.147279:0:16564:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff90cf117b0240 with version 7 00000001:00080000:1.0:1787826385.157388:0:7449:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967657 is committed 00000100:00100000:1.0:1787826385.157588:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:34498:x1874670585195904:12345-0@lo:1000:osp_up1-0.0 Request processed in 16774us (20031us total) trans 4294967657 rc 0/0 00000100:00100000:1.0:1787826385.157605:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1372 00000004:00080000:1.0:1787826385.158026:0:34498:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967657 committed transno 4294967657 00000100:00100000:1.0:1787826385.158035:0:34498:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967657 gen 2 00000100:00100000:1.0:1787826385.158061:0:34498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3fb943c0 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:34498:1874670585195904:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1787826385.158098:0:34498:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff90cf39def9c0 version 6 rpc_version 6 00000020:00100000:1.0:1787826385.158135:0:34498:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787826385.158146:0:34498:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff90cf3a8ac780 x1874670585196160/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1312/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787826385.158173:0:34498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a8ac780 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:34498:1874670585196160:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787826385.158229:0:34498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826385.158285:0:34498:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3aaf5cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826385.158307:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585196160 00000100:00100000:1.0:1787826385.158315:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585196160 00000100:00100000:1.0:1787826385.158364:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1373 00000100:00100000:1.0:1787826385.158374:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:34498:x1874670585196160:12345-0@lo:1000:osp_up1-0.0 00000001:00080000:3.0:1787826385.170117:0:7449:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967658 is committed 00000100:00100000:1.0:1787826385.170442:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:34498:x1874670585196160:12345-0@lo:1000:osp_up1-0.0 Request processed in 12064us (12208us total) trans 4294967658 rc 0/0 00000100:00100000:1.0:1787826385.170458:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1373 00000004:00080000:3.0:1787826385.171182:0:34498:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967658 committed transno 4294967658 00000100:00100000:3.0:1787826385.171191:0:34498:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967658 gen 2 00000100:00100000:3.0:1787826385.171217:0:34498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a8ac780 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:34498:1874670585196160:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1787826385.171252:0:34498:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff90cf39def9c0 version 7 rpc_version 7 00000020:00100000:3.0:1787826385.171301:0:34498:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787826385.171309:0:34498:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff90cf3fb96d00 x1874670585196416/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826385.171335:0:34498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3fb96d00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:34498:1874670585196416:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826385.171406:0:34498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826385.171457:0:34498:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a2c780 going to sleep for 11 seconds 00000100:00100000:3.0:1787826385.171499:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585196416 00000100:00100000:3.0:1787826385.171508:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585196416 00000100:00100000:3.0:1787826385.171561:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1374 00000100:00100000:3.0:1787826385.171586:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:34498:x1874670585196416:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826385.172666:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:34498:x1874670585196416:12345-0@lo:1000:osp_up1-0.0 Request processed in 1077us (1257us total) trans 4294967659 rc 0/0 00000100:00100000:3.0:1787826385.172678:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1374 00000100:00100000:3.0:1787826385.172765:0:34498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3fb96d00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:34498:1874670585196416:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1787826385.174023:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b8092c lrc: 3/0,1 mode: --/PW res: [0x200000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.174047:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b8092c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.174060:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b8092c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.174083:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b80933 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.174090:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b80933 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.174096:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b80933 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.174141:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf2f400800/0x22153cd396b8093a lrc: 3/0,1 mode: --/PW res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.174148:0:16564:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf2f400800/0x22153cd396b8093a lrc: 3/0,1 mode: --/PW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.174159:0:16564:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf2f400800/0x22153cd396b8093a lrc: 3/0,1 mode: --/PW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826385.174182:0:16564:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3fb94f00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:16564:1874670585196544:0@lo:101:mdt00_005.0 00000100:00100000:3.0:1787826385.174243:0:16564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826385.174300:0:16564:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a2c780 going to sleep for 11 seconds 00000100:00100000:1.0:1787826385.174508:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585196544 00000100:00100000:1.0:1787826385.174517:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585196544 00000100:00100000:1.0:1787826385.174694:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1375 00000100:00100000:1.0:1787826385.174706:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb97c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:16564:x1874670585196544:12345-0@lo:101:mdt00_005.0 00010000:00010000:1.0:1787826385.174728:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826385.174748:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124c00/0x22153cd396b80941 lrc: 2/0,0 mode: --/PW res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x22153cd396b8093a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.174775:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124c00/0x22153cd396b80941 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x22153cd396b8093a expref: 7 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.174791:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124c00/0x22153cd396b80941 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x22153cd396b8093a expref: 7 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.174800:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff90cf3ab61b00) 00010000:00010000:1.0:1787826385.174804:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826385.174808:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05124c00, rc 0) 00000100:00100000:1.0:1787826385.174859:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb97c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:16564:x1874670585196544:12345-0@lo:101:mdt00_005.0 Request processed in 156us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826385.174866:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1375 00000100:00100000:1.0:1787826385.174911:0:16564:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3fb94f00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:16564:1874670585196544:0@lo:101:mdt00_005.0 00010000:00010000:1.0:1787826385.174930:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf2f400800/0x22153cd396b8093a lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x22153cd396b80941 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.174942:0:16564:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf2f400800/0x22153cd396b8093a lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x22153cd396b80941 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826385.174967:0:16564:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000043747860 reply state 00000000dcd22f49 transno 8589934690 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b80933 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.174980:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b80933 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.174986:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x1:0x0].0x0 (ffff90cf06894900) 00010000:00010000:1.0:1787826385.174989:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826385.174992:0:16564:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787826385.174999:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf2f400800/0x22153cd396b8093a lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x22153cd396b80941 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.175007:0:16564:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf2f400800/0x22153cd396b8093a lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x22153cd396b80941 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787826385.175020:0:16564:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000405:0x1:0x0] 00000004:00010000:1.0:1787826385.175027:0:16564:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000043747860 reply state 00000000dcd22f49 transno 8589934690 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b8092c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.175040:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b8092c lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.175046:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x0 (ffff90cf06894100) 00010000:00010000:1.0:1787826385.175048:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826385.175049:0:16564:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:1.0:1787826385.175055:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x17:0x0]: returning size 4096 00010000:00010000:1.0:1787826385.175064:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661200/0x22153cd396b8091e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.175070:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661200/0x22153cd396b8091e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.175076:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661200/0x22153cd396b8091e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.175083:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05661200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826385.175087:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661200/0x22153cd396b8091e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.175095:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661200/0x22153cd396b8091e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.175107:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ce01f45300) 00010000:00010000:1.0:1787826385.175109:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826385.175113:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661200/0x22153cd396b8091e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.175119:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661200/0x22153cd396b8091e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826385.175138:0:16564:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000043747860 reply state 00000000dcd22f49 transno 8589934690 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660800/0x22153cd396b80925 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7b0e8b47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.175145:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660800/0x22153cd396b80925 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7b0e8b47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.175151:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7b0e8b47 (ffff90cf371d2900) 00010000:00010000:1.0:1787826385.175153:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826385.175155:0:16564:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:1.0:1787826385.175239:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb95a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:53655:x1874670563743744:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 41985us (42231us total) trans 8589934690 rc 0/0 00000100:00100000:1.0:1787826385.175247:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3486 00000100:00100000:0.0:1787826385.196287:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826385.196419:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563743872 00000100:00100000:2.0:1787826385.196433:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563743872 00000100:00100000:2.0:1787826385.196540:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3487 00000100:00100000:2.0:1787826385.196554:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9acb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:53656:x1874670563743872:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826385.196583:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826385.196610:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b80948 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab069d expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.196696:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8094f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.196714:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8094f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.196732:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8094f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826385.196789:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787826385.196793:0:9966:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826385.196817:0:9966:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8094f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.196848:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b80948 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab069d expref: 23 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.196867:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8094f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab069d expref: 22 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.196877:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ce01f45300) 00010000:00010000:2.0:1787826385.196880:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787826385.196884:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835c00, rc 0) 00000100:00100000:2.0:1787826385.196963:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9acb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:53656:x1874670563743872:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 413us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826385.196970:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3487 00000100:00100000:1.0:1787826385.202447:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826385.202587:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563744000 00000100:00100000:2.0:1787826385.202600:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563744000 00000100:00100000:2.0:1787826385.202670:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3488 00000100:00100000:2.0:1787826385.202684:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aaf1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:53656:x1874670563744000:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826385.202711:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826385.202737:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b80956 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab06a4 expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.202825:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8095d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.202843:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8095d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.202856:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8095d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.202869:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835200/0x22153cd396b80964 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7b0e8b47 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.202876:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835200/0x22153cd396b80964 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7b0e8b47 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.202881:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835200/0x22153cd396b80964 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7b0e8b47 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.202986:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835e00/0x22153cd396b8096b lrc: 3/1,0 mode: --/PR res: [0x200000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.202995:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835e00/0x22153cd396b8096b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.203002:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835e00/0x22153cd396b8096b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826385.203105:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x17:0x0]: returning size 4096 00000004:00200000:2.0:1787826385.203111:0:32404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:2.0:1787826385.203138:0:32404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835e00/0x22153cd396b8096b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.203160:0:32404:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8095d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.203167:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8095d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.203174:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8095d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.203182:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8095d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.203190:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826385.203195:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8095d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.203203:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8095d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.203220:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ce01f45300) 00010000:00010000:2.0:1787826385.203224:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826385.203229:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8095d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.203236:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8095d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.203249:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835200/0x22153cd396b80964 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7b0e8b47 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.203254:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835200/0x22153cd396b80964 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7b0e8b47 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.203261:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835200/0x22153cd396b80964 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7b0e8b47 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.203266:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826385.203268:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835200/0x22153cd396b80964 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7b0e8b47 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.203275:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835200/0x22153cd396b80964 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7b0e8b47 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.203282:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7b0e8b47 (ffff90cf371d2900) 00010000:00010000:2.0:1787826385.203285:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826385.203300:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835200/0x22153cd396b80964 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7b0e8b47 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.203307:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835200/0x22153cd396b80964 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7b0e8b47 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.203337:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b80956 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab06a4 expref: 24 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.203355:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835e00/0x22153cd396b8096b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab06a4 expref: 23 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.203363:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x0 (ffff90cf06894100) 00010000:00010000:2.0:1787826385.203365:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787826385.203369:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835e00, rc 0) 00000100:00100000:2.0:1787826385.203465:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aaf1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+23:53656:x1874670563744000:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 783us (1033us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826385.203512:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3488 00000100:00100000:3.0:1787826385.208915:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826385.209963:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563744128 00000100:00100000:0.0:1787826385.209981:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563744128 00000100:00100000:0.0:1787826385.210074:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3489 00000100:00100000:0.0:1787826385.210087:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb96940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+23:53656:x1874670563744128:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826385.210114:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826385.210142:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661800/0x22153cd396b80972 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab06ab expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.210222:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660e00/0x22153cd396b80979 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.210240:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660e00/0x22153cd396b80979 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.210255:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660e00/0x22153cd396b80979 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826385.210318:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd0:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787826385.210324:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1787826385.210370:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661800/0x22153cd396b80972 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab06ab expref: 25 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.210402:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660e00/0x22153cd396b80979 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab06ab expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.210412:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x1:0x0].0x0 (ffff90cf06894900) 00010000:00010000:0.0:1787826385.210415:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787826385.210419:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05660e00, rc 0) 00000100:00100000:0.0:1787826385.210814:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb96940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:53656:x1874670563744128:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 729us (1914us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826385.210823:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3489 00000100:00100000:0.0:1787826385.214156:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826385.214228:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563744256 00000100:00100000:1.0:1787826385.214240:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563744256 00000100:00100000:1.0:1787826385.214329:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3490 00000100:00100000:1.0:1787826385.214341:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9afc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:53656:x1874670563744256:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826385.214370:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826385.214406:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125e00/0x22153cd396b80980 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab06b2 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787826385.214602:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1787826385.214715:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124a00/0x22153cd396b80987 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.214735:0:16564:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124c00/0x22153cd396b80941 lrc: 2/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x22153cd396b8093a expref: 6 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.214746:0:16564:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124a00/0x22153cd396b80987 lrc: 4/1,0 mode: --/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.214807:0:16564:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124c00/0x22153cd396b80941 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x22153cd396b8093a expref: 6 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826385.214826:0:16564:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aaf1680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:16564:1874670585196672:0@lo:104: 00000100:00100000:1.0:1787826385.214894:0:16564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826385.214956:0:16564:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce02700780 going to sleep for 11 seconds 00000100:00100000:3.0:1787826385.215022:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585196672 00000100:00100000:3.0:1787826385.215027:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585196672 00000100:00100000:3.0:1787826385.215070:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787826385.215078:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aaf0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:16564:x1874670585196672:12345-0@lo:104: 00010000:00010000:3.0:1787826385.215093:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf2f400800/0x22153cd396b8093a lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x22153cd396b80941 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.215165:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787826385.215171:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aaf0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:16564:x1874670585196672:12345-0@lo:104: Request processed in 95us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826385.215178:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00010000:1.0:1787826385.215283:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826385.215291:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf2f400800/0x22153cd396b8093a lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x22153cd396b80941 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.215300:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400800 already unused, calling callback (ffffffffc18ffee0) 00010000:00010000:1.0:1787826385.215307:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf2f400800/0x22153cd396b8093a lrc: 4/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x22153cd396b80941 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826385.215318:0:6506:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf2f400800/0x22153cd396b8093a lrc: 4/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x22153cd396b80941 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.215352:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf2f400800/0x22153cd396b8093a lrc: 2/0,0 mode: --/PW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x22153cd396b80941 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.215358:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787826385.215400:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf2f400800/0x22153cd396b8093a lrc: 1/0,0 mode: --/PW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x22153cd396b80941 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.215409:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf2f400800/0x22153cd396b8093a lrc: 0/0,0 mode: --/PW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x22153cd396b80941 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.215436:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826385.215438:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826385.215440:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826385.215449:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787826385.215452:0:16564:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aaf1680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:16564:1874670585196672:0@lo:104: 00000100:00100000:1.0:1787826385.215461:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aaf3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585196800:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787826385.215599:0:16564:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124a00/0x22153cd396b80987 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826385.215741:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826385.215823:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585196800 00000100:00100000:0.0:1787826385.215828:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585196800 00010000:00010000:0.0:1787826385.215863:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124c00/0x22153cd396b80941 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x22153cd396b8093a expref: 7 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826385.215894:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1006 00000100:00100000:0.0:1787826385.215902:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aaf21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+7:3644:x1874670585196800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787826385.215915:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:3.0:1787826385.218256:0:7449:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967659 is committed 00010000:00010000:0.0:1787826385.218457:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124c00/0x22153cd396b80941 lrc: 0/0,0 mode: --/PW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x22153cd396b8093a expref: 6 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.218685:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff90cf3ab61b00) 00010000:00010000:0.0:1787826385.218692:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124a00/0x22153cd396b80987 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.218704:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124a00/0x22153cd396b80987 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.218713:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124a00/0x22153cd396b80987 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.218840:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826385.218942:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aaf21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874670585196800:12345-0@lo:103:ldlm_bl.0 Request processed in 3038us (3198us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826385.218954:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1006 00000100:00100000:3.0:1787826385.219071:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aaf3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585196800:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787826385.219125:0:16564:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124a00/0x22153cd396b80987 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.219134:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124a00/0x22153cd396b80987 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826385.219211:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787826385.219218:0:16564:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1787826385.219272:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125e00/0x22153cd396b80980 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab06b2 expref: 24 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.219288:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124a00/0x22153cd396b80987 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab06b2 expref: 23 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.219296:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff90cf3ab61b00) 00010000:00010000:1.0:1787826385.219299:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787826385.219302:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05124a00, rc 0) 00000100:00100000:1.0:1787826385.219408:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9afc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+23:53656:x1874670563744256:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 5069us (5268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826385.219416:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3490 00010000:00010000:1.0:1787826385.220891:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826385.222834:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826385.225748:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563744384 00000100:00100000:2.0:1787826385.225769:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563744384 00000100:00100000:2.0:1787826385.225862:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3491 00000100:00100000:2.0:1787826385.225872:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9af840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+23:53656:x1874670563744384:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826385.225899:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826385.225927:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835800/0x22153cd396b8098e lrc: 2/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab06b9 expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.226020:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835200/0x22153cd396b80995 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.226037:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835200/0x22153cd396b80995 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.226050:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835200/0x22153cd396b80995 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.226068:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835a00/0x22153cd396b8099c lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.226075:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835a00/0x22153cd396b8099c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.226082:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835a00/0x22153cd396b8099c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.226170:0:9966:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835200/0x22153cd396b80995 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.226182:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835200/0x22153cd396b80995 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.226188:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835200/0x22153cd396b80995 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.226195:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835200/0x22153cd396b80995 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.226201:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826385.226206:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835200/0x22153cd396b80995 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.226213:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835200/0x22153cd396b80995 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.226228:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff90cf3ab61b00) 00010000:00010000:2.0:1787826385.226231:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826385.226236:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835200/0x22153cd396b80995 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.226242:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835200/0x22153cd396b80995 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.226259:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835a00/0x22153cd396b8099c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.226265:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835a00/0x22153cd396b8099c lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.226270:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835a00/0x22153cd396b8099c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.226276:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826385.226279:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835a00/0x22153cd396b8099c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.226284:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835a00/0x22153cd396b8099c lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.226298:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x98a5b8df (ffff90cf39e67e00) 00010000:00010000:2.0:1787826385.226300:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826385.226303:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835a00/0x22153cd396b8099c lrc: 2/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.226309:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835a00/0x22153cd396b8099c lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.226347:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835800/0x22153cd396b8098e lrc: 1/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab06b9 expref: 24 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.226357:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff90cf3ab61b00) 00010000:00010000:2.0:1787826385.226360:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826385.226363:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835800/0x22153cd396b8098e lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab06b9 expref: 24 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.226372:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835800, rc 0) 00000100:00100000:2.0:1787826385.226505:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9af840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+23:53656:x1874670563744384:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 634us (3737us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826385.226514:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3491 00000100:00100000:3.0:1787826385.229954:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826385.239115:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563744512 00000100:00100000:2.0:1787826385.239137:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563744512 00000100:00100000:2.0:1787826385.239229:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3492 00000100:00100000:2.0:1787826385.239241:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb94f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:53656:x1874670563744512:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826385.239267:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826385.239295:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b809a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab06c0 expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.239380:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835600/0x22153cd396b809aa lrc: 3/1,0 mode: --/PR res: [0x200000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.239408:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835600/0x22153cd396b809aa lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.239422:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835600/0x22153cd396b809aa lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826385.239575:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x17:0x0]: returning size 4096 00000004:00200000:2.0:1787826385.239581:0:32404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:2.0:1787826385.239606:0:32404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835600/0x22153cd396b809aa lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.239639:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b809a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab06c0 expref: 26 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.239660:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835600/0x22153cd396b809aa lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab06c0 expref: 25 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.239669:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x0 (ffff90cf06894100) 00010000:00010000:2.0:1787826385.239673:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787826385.239677:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835600, rc 0) 00000100:00100000:2.0:1787826385.239758:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb94f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:53656:x1874670563744512:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 519us (9818us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826385.239768:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3492 00000100:00100000:0.0:1787826385.251751:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826385.252993:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563744768 00000100:00100000:2.0:1787826385.253012:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563744768 00000100:00100000:2.0:1787826385.253107:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3493 00000100:00100000:2.0:1787826385.253119:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9af0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+23:53656:x1874670563744768:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826385.253148:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826385.253151:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787826385.253190:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124a00/0x22153cd396b80987 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab06b2 expref: 23 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.253217:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff90cf3ab61b00) 00010000:00010000:2.0:1787826385.253231:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826385.253251:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b809b1 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab06c7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.253406:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835800/0x22153cd396b809b8 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.253423:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835800/0x22153cd396b809b8 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.253433:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835800/0x22153cd396b809b8 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.253449:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835a00/0x22153cd396b809bf lrc: 3/0,1 mode: --/PW res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.253456:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835a00/0x22153cd396b809bf lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.253462:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835a00/0x22153cd396b809bf lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.254922:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661a00/0x22153cd396b809c6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.254952:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661a00/0x22153cd396b809c6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.254964:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661a00/0x22153cd396b809c6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826385.254978:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0xd:0x0]: returning size 0 00010000:00010000:0.0:1787826385.255022:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835800/0x22153cd396b809b8 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.255031:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835800/0x22153cd396b809b8 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.255040:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835800/0x22153cd396b809b8 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.255049:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835800/0x22153cd396b809b8 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.255057:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826385.255063:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835800/0x22153cd396b809b8 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.255072:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835800/0x22153cd396b809b8 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.255088:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff90cf39e67e00) 00010000:00010000:0.0:1787826385.255092:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826385.255098:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835800/0x22153cd396b809b8 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.255106:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835800/0x22153cd396b809b8 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826385.255126:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000087469470 reply state 00000000f9476c90 transno 4294967660 ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835a00/0x22153cd396b809bf lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.255140:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835a00/0x22153cd396b809bf lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.255147:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x98a5b8df (ffff90cf39e67300) 00010000:00010000:0.0:1787826385.255150:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826385.255154:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787826385.255201:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b809b1 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab06c7 expref: 25 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.255227:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661a00/0x22153cd396b809c6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab06c7 expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.255236:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xd:0x0].0x0 (ffff90cf371d2100) 00010000:00010000:0.0:1787826385.255239:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826385.255241:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05661a00, rc 0) 00000100:00100000:0.0:1787826385.255340:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9af0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:53656:x1874670563744768:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 2222us (3603us total) trans 4294967660 rc 0/0 00000100:00100000:0.0:1787826385.255349:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3493 00000100:00100000:0.0:1787826385.259888:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826385.262518:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563745024 00000100:00100000:1.0:1787826385.262539:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563745024 00000100:00100000:1.0:1787826385.262648:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3494 00000100:00100000:1.0:1787826385.262662:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:53656:x1874670563745024:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826385.262706:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826385.262734:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125e00/0x22153cd396b809d4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab06ce expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.262885:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125c00/0x22153cd396b809db lrc: 3/0,1 mode: --/EX res: [0x240000404:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.262904:0:16564:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661a00/0x22153cd396b809c6 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab06c7 expref: 26 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.262915:0:16564:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125c00/0x22153cd396b809db lrc: 4/0,1 mode: --/EX res: [0x240000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.262962:0:16564:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661a00/0x22153cd396b809c6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab06c7 expref: 26 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.262979:0:16564:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661a00/0x22153cd396b809c6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab06c7 expref: 26 pid: 6519 timeout: 1431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826385.262996:0:16564:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aaf3c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:16564:1874670585196928:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826385.263106:0:16564:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce027009c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826385.271829:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826385.272339:0:16564:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aaf3c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:16564:1874670585196928:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826385.272378:0:16564:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125c00/0x22153cd396b809db lrc: 3/0,1 mode: --/EX res: [0x240000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826385.272456:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563745152 00000100:00100000:2.0:1787826385.272465:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563745152 00010000:00010000:2.0:1787826385.272684:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661a00/0x22153cd396b809c6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab06c7 expref: 27 pid: 6519 timeout: 1431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826385.272790:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1007 00000100:00100000:0.0:1787826385.272804:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb943c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:2404:x1874670563745152:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826385.272825:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826385.272834:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661a00/0x22153cd396b809c6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab06c7 expref: 27 pid: 6519 timeout: 1431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.272849:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661a00/0x22153cd396b809c6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab06c7 expref: 27 pid: 6519 timeout: 1431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.272878:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661a00/0x22153cd396b809c6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab06c7 expref: 27 pid: 6519 timeout: 1431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.272897:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xd:0x0].0x0 (ffff90cf371d2100) 00010000:00010000:0.0:1787826385.272903:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125c00/0x22153cd396b809db lrc: 3/0,1 mode: --/EX res: [0x240000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.272918:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125c00/0x22153cd396b809db lrc: 3/0,1 mode: EX/EX res: [0x240000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.272927:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125c00/0x22153cd396b809db lrc: 4/0,1 mode: EX/EX res: [0x240000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.272960:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826385.273136:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb943c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:2404:x1874670563745152:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 334us (1322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826385.273145:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1007 00010000:00010000:1.0:1787826385.273216:0:16564:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125c00/0x22153cd396b809db lrc: 3/0,1 mode: EX/EX res: [0x240000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.273224:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125c00/0x22153cd396b809db lrc: 3/0,1 mode: EX/EX res: [0x240000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826385.273255:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0xd:0x0]: returning size 0 00000004:00080000:1.0:1787826385.273555:0:16564:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x24:0x0], index 0: 0 00000004:00080000:1.0:1787826385.273564:0:16564:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x22:0x0], index 1: 0 00000004:00080000:1.0:1787826385.273570:0:16564:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x23:0x0], index 1: 0 00000004:00080000:1.0:1787826385.273574:0:16564:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x25:0x0], index 0: 0 00010000:00010000:1.0:1787826385.273714:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125c00/0x22153cd396b809db lrc: 3/0,1 mode: EX/EX res: [0x240000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.273723:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125c00/0x22153cd396b809db lrc: 2/0,0 mode: EX/EX res: [0x240000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.273729:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125c00/0x22153cd396b809db lrc: 3/0,0 mode: EX/EX res: [0x240000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.273736:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05125c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826385.273741:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125c00/0x22153cd396b809db lrc: 3/0,0 mode: EX/EX res: [0x240000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.273749:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125c00/0x22153cd396b809db lrc: 4/0,0 mode: EX/EX res: [0x240000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.273761:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xd:0x0].0x0 (ffff90cf371d2100) 00010000:00010000:1.0:1787826385.273765:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826385.273769:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125c00/0x22153cd396b809db lrc: 2/0,0 mode: --/EX res: [0x240000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.273775:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125c00/0x22153cd396b809db lrc: 0/0,0 mode: --/EX res: [0x240000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.273834:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125e00/0x22153cd396b809d4 lrc: 1/0,0 mode: --/CR res: [0x240000404:0xd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab06ce expref: 26 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.273846:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xd:0x0].0x0 (ffff90cf371d2100) 00010000:00010000:1.0:1787826385.273849:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787826385.273852:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125e00/0x22153cd396b809d4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0xd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab06ce expref: 26 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.273867:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05125e00, rc 0) 00000100:00100000:1.0:1787826385.273902:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:53656:x1874670563745024:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 11244us (14031us total) trans 4294967661 rc 301/301 00000100:00100000:1.0:1787826385.273911:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3494 00000100:00100000:0.0:1787826385.277089:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826385.277171:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563745408 00000100:00100000:1.0:1787826385.277184:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563745408 00000100:00100000:1.0:1787826385.277266:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1024 00000100:00100000:1.0:1787826385.277278:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:53656:x1874670563745408:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:1.0:1787826385.277760:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:53656:x1874670563745408:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 416us (618us total) trans 4294967662 rc 0/0 00000100:00100000:1.0:1787826385.277770:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1024 00000100:00100000:2.0:1787826385.279960:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826385.280049:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563745664 00000100:00100000:3.0:1787826385.280062:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563745664 00000100:00100000:3.0:1787826385.280133:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1025 00000100:00100000:3.0:1787826385.280144:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecaed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:53656:x1874670563745664:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:3.0:1787826385.280450:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecaed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:53656:x1874670563745664:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 307us (502us total) trans 4294967663 rc 0/0 00000100:00100000:3.0:1787826385.280464:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1025 00000100:00100000:3.0:1787826385.318680:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826385.318872:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563745920 00000100:00100000:2.0:1787826385.318884:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563745920 00000100:00100000:2.0:1787826385.318990:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3495 00000100:00100000:2.0:1787826385.319001:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:53658:x1874670563745920:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826385.319031:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826385.319058:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834600/0x22153cd396b809e9 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab06d5 expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.319160:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834200/0x22153cd396b809f0 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.319176:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834200/0x22153cd396b809f0 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.319189:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834200/0x22153cd396b809f0 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.319201:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835200/0x22153cd396b809f7 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.319214:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835200/0x22153cd396b809f7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.319221:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835200/0x22153cd396b809f7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.319309:0:9966:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834200/0x22153cd396b809f0 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.319317:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834200/0x22153cd396b809f0 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.319323:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834200/0x22153cd396b809f0 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.319330:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834200/0x22153cd396b809f0 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.319336:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826385.319341:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834200/0x22153cd396b809f0 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.319349:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834200/0x22153cd396b809f0 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.319363:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff90cf39e67200) 00010000:00010000:2.0:1787826385.319366:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826385.319372:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834200/0x22153cd396b809f0 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.319378:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834200/0x22153cd396b809f0 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.319403:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835200/0x22153cd396b809f7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.319410:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835200/0x22153cd396b809f7 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.319416:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835200/0x22153cd396b809f7 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.319423:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826385.319426:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835200/0x22153cd396b809f7 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.319432:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835200/0x22153cd396b809f7 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.319440:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x98a5b8df (ffff90cf39e67300) 00010000:00010000:2.0:1787826385.319443:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826385.319445:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835200/0x22153cd396b809f7 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.319451:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835200/0x22153cd396b809f7 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.319534:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834600/0x22153cd396b809e9 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab06d5 expref: 28 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.319545:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff90cf39e67200) 00010000:00010000:2.0:1787826385.319548:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787826385.319552:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834600/0x22153cd396b809e9 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab06d5 expref: 28 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.319648:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834600, rc 0) 00000100:00100000:2.0:1787826385.319855:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:53658:x1874670563745920:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 854us (1387us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826385.319863:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3495 00000100:00100000:0.0:1787826385.332715:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826385.337095:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563746176 00000100:00100000:2.0:1787826385.337116:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563746176 00000100:00100000:2.0:1787826385.337204:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3496 00000100:00100000:2.0:1787826385.337217:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:53658:x1874670563746176:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826385.337247:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826385.337270:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b809fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab06dc expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826385.337850:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x17:0x0]: returning size 4096 00010000:00010000:2.0:1787826385.337981:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b809fe lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab06dc expref: 27 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.337999:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ce01f45300) 00010000:00010000:2.0:1787826385.338002:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787826385.338007:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b809fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab06dc expref: 27 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.338034:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834600, rc 0) 00000100:00100000:2.0:1787826385.338123:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:53658:x1874670563746176:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 908us (5424us total) trans 8589934691 rc 301/301 00000100:00100000:2.0:1787826385.338131:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3496 00000100:00100000:0.0:1787826385.345780:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826385.353817:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563746304 00000100:00100000:3.0:1787826385.353838:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563746304 00000100:00100000:3.0:1787826385.353937:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3497 00000100:00100000:3.0:1787826385.353950:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:53658:x1874670563746304:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:3.0:1787826385.354057:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b80a0c lrc: 3/1,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.354079:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b80a0c lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.354092:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b80a0c lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.354105:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b80a13 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.354112:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b80a13 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.354118:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b80a13 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.354222:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401c00/0x22153cd396b80a1a lrc: 3/1,0 mode: --/PR res: [0x240000404:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.354230:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401c00/0x22153cd396b80a1a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.354237:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401c00/0x22153cd396b80a1a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826385.354287:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0xd:0x0]: returning size 0 00000004:00200000:3.0:1787826385.354292:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826385.354307:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401c00/0x22153cd396b80a1a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.354326:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b80a0c lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.354333:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b80a0c lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.354339:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b80a0c lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.354346:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b80a0c lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.354352:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826385.354357:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b80a0c lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.354365:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b80a0c lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.354380:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff90cf11768c00) 00010000:00010000:3.0:1787826385.354383:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826385.354915:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b80a0c lrc: 3/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.354929:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b80a0c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.354961:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b80a13 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.355026:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b80a13 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.355033:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b80a13 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.355038:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401e00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826385.355041:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b80a13 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.355047:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b80a13 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.355058:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x98a5b8df (ffff90cf39e67300) 00010000:00010000:3.0:1787826385.355061:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826385.355065:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b80a13 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.355070:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b80a13 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.355079:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401c00/0x22153cd396b80a1a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.355085:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401c00/0x22153cd396b80a1a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.355090:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401c00/0x22153cd396b80a1a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.355095:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826385.355098:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401c00/0x22153cd396b80a1a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.355103:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401c00/0x22153cd396b80a1a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.355111:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xd:0x0].0x0 (ffff90cf11768400) 00010000:00010000:3.0:1787826385.355113:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826385.355116:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401c00/0x22153cd396b80a1a lrc: 2/0,0 mode: --/PR res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.355122:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401c00/0x22153cd396b80a1a lrc: 0/0,0 mode: --/PR res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826385.355248:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:53658:x1874670563746304:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 1296us (9479us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826385.355258:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3497 00000100:00100000:0.0:1787826385.363172:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826385.363306:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563746560 00000100:00100000:1.0:1787826385.363319:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563746560 00000100:00100000:1.0:1787826385.363579:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1026 00000100:00100000:1.0:1787826385.363594:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9ad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:53658:x1874670563746560:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:1.0:1787826385.363914:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9ad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:53658:x1874670563746560:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 324us (756us total) trans 8589934692 rc 0/0 00000100:00100000:1.0:1787826385.363924:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1026 00000100:00100000:0.0:1787826385.385210:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826385.385304:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563746816 00000100:00100000:1.0:1787826385.385317:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563746816 00000100:00100000:1.0:1787826385.385466:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3498 00000100:00100000:1.0:1787826385.385523:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:53661:x1874670563746816:12345-192.168.203.39@tcp:101:fallocate.0 00010000:00010000:1.0:1787826385.385551:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826385.385593:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125e00/0x22153cd396b80a21 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab06e3 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.385700:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125c00/0x22153cd396b80a28 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.385718:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125c00/0x22153cd396b80a28 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.385732:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125c00/0x22153cd396b80a28 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.385743:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125a00/0x22153cd396b80a2f lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.385752:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125a00/0x22153cd396b80a2f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.385759:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125a00/0x22153cd396b80a2f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.386103:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124400/0x22153cd396b80a36 lrc: 3/1,0 mode: --/PR res: [0x240000404:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.386114:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124400/0x22153cd396b80a36 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.386121:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124400/0x22153cd396b80a36 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826385.386133:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0xd:0x0]: returning size 0 00010000:00010000:1.0:1787826385.386234:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125c00/0x22153cd396b80a28 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.386244:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125c00/0x22153cd396b80a28 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.386251:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125c00/0x22153cd396b80a28 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.386258:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05125c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826385.386262:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125c00/0x22153cd396b80a28 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.386270:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125c00/0x22153cd396b80a28 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.386284:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff90cf3ab61500) 00010000:00010000:1.0:1787826385.386287:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826385.386292:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125c00/0x22153cd396b80a28 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.386299:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125c00/0x22153cd396b80a28 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.386315:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125a00/0x22153cd396b80a2f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.386321:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125a00/0x22153cd396b80a2f lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.386330:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125a00/0x22153cd396b80a2f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.386336:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05125a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826385.386338:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125a00/0x22153cd396b80a2f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.386344:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125a00/0x22153cd396b80a2f lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.386350:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x98a5b8df (ffff90cf39e67300) 00010000:00010000:1.0:1787826385.386353:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826385.386355:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125a00/0x22153cd396b80a2f lrc: 2/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.386361:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125a00/0x22153cd396b80a2f lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.386438:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125e00/0x22153cd396b80a21 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab06e3 expref: 30 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.386458:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124400/0x22153cd396b80a36 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab06e3 expref: 29 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.386466:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xd:0x0].0x0 (ffff90cf3ab61a00) 00010000:00010000:1.0:1787826385.386468:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826385.386508:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05124400, rc 0) 00000100:00100000:1.0:1787826385.386766:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+29:53661:x1874670563746816:12345-192.168.203.39@tcp:101:fallocate.0 Request processed in 1246us (1569us total) trans 4294967664 rc 0/0 00000100:00100000:1.0:1787826385.386780:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3498 00000100:00100000:0.0:1787826385.398955:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826385.399604:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563747072 00000100:00100000:2.0:1787826385.399618:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563747072 00000100:00100000:2.0:1787826385.399743:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3499 00000100:00100000:2.0:1787826385.399752:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9ae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+29:53661:x1874670563747072:12345-192.168.203.39@tcp:101:fallocate.0 00010000:00010000:2.0:1787826385.399787:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826385.399791:0:9966:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787826385.399830:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124400/0x22153cd396b80a36 lrc: 0/0,0 mode: --/PR res: [0x240000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab06e3 expref: 29 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.399868:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xd:0x0].0x0 (ffff90cf3ab61a00) 00010000:00010000:2.0:1787826385.399881:0:9966:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826385.399903:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834600/0x22153cd396b80a44 lrc: 2/0,0 mode: --/EX res: [0x240000404:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab06ea expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.399973:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835200/0x22153cd396b80a4b lrc: 3/0,1 mode: --/EX res: [0x240000404:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.399990:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835200/0x22153cd396b80a4b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0xd:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.400002:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835200/0x22153cd396b80a4b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0xd:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787826385.400313:0:9966:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].20, 88 off9688 00000004:00080000:2.0:1787826385.400325:0:9966:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1331411852550ns, next at 1201607267971ns, rc = 0 00000040:00080000:2.0:1787826385.400367:0:9966:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].18, 88 off9512 00000004:00080000:2.0:1787826385.400373:0:9966:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1331411901178ns, next at 1201610029598ns, rc = 0 00000040:00080000:2.0:1787826385.400414:0:9966:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].19, 88 off9600 00000004:00080000:2.0:1787826385.400419:0:9966:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1331411947416ns, next at 1201610029598ns, rc = 0 00000040:00080000:2.0:1787826385.400430:0:9966:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].21, 88 off9776 00000004:00080000:2.0:1787826385.400434:0:9966:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1331411962211ns, next at 1201607267971ns, rc = 0 00000001:00080000:2.0:1787826385.404217:0:7449:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967665 is committed 00000004:00080000:2.0:1787826385.404233:0:7449:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 23 committed 00000004:00080000:2.0:1787826385.404251:0:7449:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 20 committed 00000004:00080000:2.0:1787826385.404263:0:7449:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 19 committed 00000004:00080000:2.0:1787826385.404265:0:7449:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 22 committed 00010000:00010000:2.0:1787826385.404373:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835200/0x22153cd396b80a4b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0xd:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab06ea expref: 25 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.404404:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xd:0x0].0x0 (ffff90cf39e67200) 00010000:00010000:2.0:1787826385.404408:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1787826385.404434:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834600/0x22153cd396b80a44 lrc: 0/0,0 mode: --/EX res: [0x240000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab06ea expref: 25 pid: 9966 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826385.404673:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aaf3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585197056:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1787826385.404763:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826385.404815:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787826385.404821:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aaf30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585197184:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1787826385.404855:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826385.404893:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585197056 00000100:00100000:1.0:1787826385.404902:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585197056 00000100:00100000:1.0:1787826385.404965:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585197184 00000100:00100000:1.0:1787826385.404968:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585197184 00000100:00100000:1.0:1787826385.404992:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1886 00000100:00100000:1.0:1787826385.405002:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aaf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+6:3646:x1874670585197056:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1787826385.405198:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1887 00000100:00100000:1.0:1787826385.405206:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aaf2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3646:x1874670585197184:12345-0@lo:2:osp-syn-0-1.0 00000100:00080000:1.0:1787826385.405283:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787826385.405783:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835a00/0x22153cd396b809bf lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.405796:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835a00/0x22153cd396b809bf lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.405806:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835a00/0x22153cd396b809bf lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.405813:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826385.405819:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835a00/0x22153cd396b809bf lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.405833:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835a00/0x22153cd396b809bf lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.405858:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x98a5b8df (ffff90cf39e67300) 00010000:00010000:3.0:1787826385.405861:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826385.405866:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835a00/0x22153cd396b809bf lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.405873:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835a00/0x22153cd396b809bf lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826385.405974:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce06305680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585197440:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1787826385.406026:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826385.406060:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787826385.406065:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce06307480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585197312:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1787826385.406087:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826385.406117:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585197440 00000100:00100000:3.0:1787826385.406122:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585197440 00000100:00100000:3.0:1787826385.406165:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585197312 00000100:00100000:3.0:1787826385.406168:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585197312 00000100:00100000:3.0:1787826385.406189:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1888 00000100:00100000:3.0:1787826385.406195:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06304f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+6:3645:x1874670585197440:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1787826385.406366:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1889 00000100:00100000:3.0:1787826385.406374:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06304780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+6:3645:x1874670585197312:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:2.0:1787826385.406829:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835200/0x22153cd396b80a4b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0xd:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab06ea expref: 23 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.406880:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xd:0x0].0x0 (ffff90cf39e67200) 00010000:00010000:2.0:1787826385.406883:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1787826385.406887:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835200, rc 0) 00000100:00100000:2.0:1787826385.406957:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9ae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+23:53661:x1874670563747072:12345-192.168.203.39@tcp:101:fallocate.0 Request processed in 7205us (8018us total) trans 4294967665 rc 0/0 00000100:00100000:2.0:1787826385.406966:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3499 00000100:00080000:1.0:1787826385.407093:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826385.407372:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aaf2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+7:3646:x1874670585197184:12345-0@lo:2:osp-syn-0-1.0 Request processed in 2166us (2514us total) trans 21474836950 rc 0/0 00000100:00100000:1.0:1787826385.407381:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1887 00000004:00080000:1.0:1787826385.407448:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3aaf30c0/2, rc 0, transno 21474836950 00000100:00100000:1.0:1787826385.407455:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aaf30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585197184:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1787826385.407606:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aaf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+7:3646:x1874670585197056:12345-0@lo:2:osp-syn-0-1.0 Request processed in 2606us (2843us total) trans 21474836951 rc 0/0 00000100:00100000:1.0:1787826385.407613:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1886 00000004:00080000:1.0:1787826385.407641:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3aaf3c00/2, rc 0, transno 21474836951 00000100:00100000:1.0:1787826385.407647:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aaf3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585197056:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1787826385.408021:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06304f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+7:3645:x1874670585197440:12345-0@lo:2:osp-syn-1-1.0 Request processed in 1825us (1994us total) trans 17179869616 rc 0/0 00000100:00100000:3.0:1787826385.408029:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1888 00000004:00080000:3.0:1787826385.408062:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce06305680/2, rc 0, transno 17179869616 00000100:00100000:3.0:1787826385.408068:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce06305680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585197440:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1787826385.408466:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06304780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+7:3645:x1874670585197312:12345-0@lo:2:osp-syn-1-1.0 Request processed in 2091us (2375us total) trans 17179869617 rc 0/0 00000100:00100000:1.0:1787826385.408502:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1889 00000004:00080000:3.0:1787826385.409248:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce06307480/2, rc 0, transno 17179869617 00000100:00100000:3.0:1787826385.409258:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce06307480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585197312:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1787826385.415619:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826385.415833:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563747200 00000100:00100000:2.0:1787826385.415855:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563747200 00000100:00100000:2.0:1787826385.415944:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1890 00000100:00100000:2.0:1787826385.415956:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9ade00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+5:53661:x1874670563747200:12345-192.168.203.39@tcp:101:fallocate.0 00010000:00010000:2.0:1787826385.415984:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826385.416017:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c25d1558/0x22153cd396b80a52 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab06f1 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787826385.416054:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826385.416083:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=1331s v=(0 0) 00010000:00010000:2.0:1787826385.416089:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826385.416101:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c25d1558/0x22153cd396b80a52 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab06f1 expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.416126:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c25d1558/0x22153cd396b80a52 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab06f1 expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.416142:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834200, rc 0) 00000100:00100000:2.0:1787826385.416208:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9ade00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+6:53661:x1874670563747200:12345-192.168.203.39@tcp:101:fallocate.0 Request processed in 255us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826385.416217:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1890 00000100:00080000:1.0:1787826385.416529:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826385.420961:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826385.421057:0:25423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563747328 00000100:00100000:2.0:1787826385.421069:0:25423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563747328 00000100:00100000:2.0:1787826385.421158:0:25423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 721 00000100:00100000:2.0:1787826385.421170:0:25423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+6:2404:x1874670563747328:12345-192.168.203.39@tcp:22:fallocate.0 00002000:00010000:2.0:1787826385.421387:0:25423:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x24:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787826385.421402:0:25423:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x24:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1787826385.421405:0:25423:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x24:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787826385.421407:0:25423:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x24:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1787826385.421409:0:25423:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x24:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1787826385.421594:0:25423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2404:x1874670563747328:12345-192.168.203.39@tcp:22:fallocate.0 Request processed in 426us (648us total) trans 21474836952 rc 0/0 00000100:00100000:2.0:1787826385.421604:0:25423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 721 00000100:00100000:1.0:1787826385.426152:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826385.426256:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563747456 00000100:00100000:3.0:1787826385.426270:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563747456 00000100:00100000:3.0:1787826385.427038:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3500 00000100:00100000:3.0:1787826385.427057:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aaf2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+23:53661:x1874670563747456:12345-192.168.203.39@tcp:44:fallocate.0 00000100:00100000:3.0:1787826385.427319:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aaf2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+23:53661:x1874670563747456:12345-192.168.203.39@tcp:44:fallocate.0 Request processed in 268us (1182us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826385.427329:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3500 00000100:00100000:0.0:1787826385.433706:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826385.433796:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563747584 00000100:00100000:2.0:1787826385.433810:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563747584 00000100:00100000:2.0:1787826385.433897:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1891 00000100:00100000:2.0:1787826385.433908:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9ada40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2403:x1874670563747584:12345-192.168.203.39@tcp:16:fallocate.0 00000001:00080000:0.0:1787826385.437439:0:26205:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836952 is committed 00000001:00080000:0.0:1787826385.437589:0:26205:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836951 is committed 00000100:00100000:1.0:1787826385.438079:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826385.438276:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563747712 00000100:00100000:3.0:1787826385.438287:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563747712 00000100:00100000:3.0:1787826385.438366:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1892 00000100:00100000:3.0:1787826385.438376:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aaf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+5:2403:x1874670563747712:12345-192.168.203.39@tcp:16:fallocate.0 00000100:00100000:3.0:1787826385.438548:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aaf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+5:2403:x1874670563747712:12345-192.168.203.39@tcp:16:fallocate.0 Request processed in 173us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826385.438556:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1892 00000100:00080000:1.0:1787826385.438643:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826385.439974:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9ada40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+6:2403:x1874670563747584:12345-192.168.203.39@tcp:16:fallocate.0 Request processed in 6057us (6272us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826385.439986:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1891 00000100:00100000:1.0:1787826385.448246:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826385.448450:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563747968 00000100:00100000:2.0:1787826385.448589:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563747968 00000100:00100000:0.0:1787826385.448991:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1027 00000100:00100000:0.0:1787826385.449007:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf10475c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+23:53661:x1874670563747968:12345-192.168.203.39@tcp:35:fallocate.0 00000100:00100000:0.0:1787826385.449336:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf10475c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:53661:x1874670563747968:12345-192.168.203.39@tcp:35:fallocate.0 Request processed in 333us (1103us total) trans 4294967666 rc 0/0 00000100:00100000:0.0:1787826385.449345:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1027 00000100:00100000:0.0:1787826385.492529:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826385.492692:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563748224 00000100:00100000:3.0:1787826385.492705:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563748224 00000100:00100000:3.0:1787826385.492793:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3501 00000100:00100000:3.0:1787826385.492805:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:53663:x1874670563748224:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826385.492836:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826385.492865:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401c00/0x22153cd396b80a59 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab06f8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.492975:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b80a60 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.492993:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b80a60 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.493006:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b80a60 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.493020:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b80a67 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.493028:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b80a67 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.493036:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b80a67 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.493131:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b80a60 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.493140:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b80a60 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.493147:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b80a60 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.493153:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b80a60 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.493160:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401e00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826385.493165:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b80a60 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.493172:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b80a60 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.493185:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff90cf11768400) 00010000:00010000:3.0:1787826385.493189:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826385.493194:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b80a60 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.493200:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b80a60 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.493215:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b80a67 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.493221:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b80a67 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.493227:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b80a67 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.493232:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826385.493236:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b80a67 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.493242:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b80a67 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.493248:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x98a5b8df (ffff90cf11768c00) 00010000:00010000:3.0:1787826385.493250:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826385.493253:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b80a67 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.493259:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b80a67 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.493296:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401c00/0x22153cd396b80a59 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab06f8 expref: 25 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.493308:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff90cf11768400) 00010000:00010000:3.0:1787826385.493310:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787826385.493314:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401c00/0x22153cd396b80a59 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab06f8 expref: 25 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.493325:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401c00, rc 0) 00000100:00100000:3.0:1787826385.493411:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:53663:x1874670563748224:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 607us (897us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826385.493418:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3501 00000100:00100000:1.0:1787826385.501113:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826385.506975:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563748480 00000100:00100000:0.0:1787826385.506998:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563748480 00000100:00100000:0.0:1787826385.507105:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3502 00000100:00100000:0.0:1787826385.507119:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aaf3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:53663:x1874670563748480:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826385.507206:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826385.507232:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661200/0x22153cd396b80a6e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab06ff expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826385.509646:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x17:0x0]: returning size 4096 00010000:00010000:0.0:1787826385.509804:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661200/0x22153cd396b80a6e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab06ff expref: 29 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.509826:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ce01f45300) 00010000:00010000:0.0:1787826385.509830:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787826385.509846:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661200/0x22153cd396b80a6e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab06ff expref: 29 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.509866:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05661200, rc 0) 00000100:00100000:0.0:1787826385.509968:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aaf3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+28:53663:x1874670563748480:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 2851us (8871us total) trans 8589934693 rc 301/301 00000100:00100000:0.0:1787826385.509979:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3502 00000100:00100000:1.0:1787826385.514434:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826385.514925:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563748608 00000100:00100000:2.0:1787826385.514939:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563748608 00000100:00100000:2.0:1787826385.515025:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3503 00000100:00100000:2.0:1787826385.515039:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aaf1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:53663:x1874670563748608:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:2.0:1787826385.515142:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834600/0x22153cd396b80a7c lrc: 3/1,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.515164:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834600/0x22153cd396b80a7c lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.515178:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834600/0x22153cd396b80a7c lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.515193:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b80a83 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.515201:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b80a83 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.515208:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b80a83 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.515313:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835800/0x22153cd396b80a8a lrc: 3/1,0 mode: --/PR res: [0x240000404:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.515321:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835800/0x22153cd396b80a8a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.515329:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835800/0x22153cd396b80a8a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826385.515380:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0xd:0x0]: returning size 2097153 00000004:00200000:2.0:1787826385.515386:0:9966:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826385.515411:0:9966:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835800/0x22153cd396b80a8a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.515429:0:9966:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834600/0x22153cd396b80a7c lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.515437:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834600/0x22153cd396b80a7c lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.515444:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834600/0x22153cd396b80a7c lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.515451:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834600/0x22153cd396b80a7c lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.515459:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826385.515464:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834600/0x22153cd396b80a7c lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.515522:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834600/0x22153cd396b80a7c lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.515537:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff90cf1859a700) 00010000:00010000:2.0:1787826385.515541:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826385.515547:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834600/0x22153cd396b80a7c lrc: 3/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.515553:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834600/0x22153cd396b80a7c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.515578:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b80a83 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.515585:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b80a83 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.515590:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b80a83 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.516970:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826385.516977:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b80a83 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.516987:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b80a83 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.517004:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x98a5b8df (ffff90cf1859a800) 00010000:00010000:2.0:1787826385.517008:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826385.517012:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b80a83 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.517024:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b80a83 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.517048:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835800/0x22153cd396b80a8a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.517055:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835800/0x22153cd396b80a8a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.517062:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835800/0x22153cd396b80a8a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.517068:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826385.517071:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835800/0x22153cd396b80a8a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.517077:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835800/0x22153cd396b80a8a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.517085:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xd:0x0].0x0 (ffff90cf39e67200) 00010000:00010000:2.0:1787826385.517087:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826385.517090:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835800/0x22153cd396b80a8a lrc: 2/0,0 mode: --/PR res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.517095:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835800/0x22153cd396b80a8a lrc: 0/0,0 mode: --/PR res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826385.517224:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aaf1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:53663:x1874670563748608:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 2185us (2803us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826385.517235:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3503 00000100:00100000:3.0:1787826385.528346:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826385.528454:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563748864 00000100:00100000:1.0:1787826385.528468:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563748864 00000100:00100000:1.0:1787826385.528600:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1028 00000100:00100000:1.0:1787826385.528613:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06304b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+28:53663:x1874670563748864:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:1.0:1787826385.528919:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06304b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+29:53663:x1874670563748864:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 308us (588us total) trans 8589934694 rc 0/0 00000100:00100000:1.0:1787826385.528928:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1028 00000100:00100000:0.0:1787826385.567740:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826385.569080:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563749120 00000100:00100000:3.0:1787826385.569099:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563749120 00000100:00100000:3.0:1787826385.569209:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3504 00000100:00100000:3.0:1787826385.569222:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9ad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:53665:x1874670563749120:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:3.0:1787826385.569250:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826385.569281:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401c00/0x22153cd396b80a91 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0706 expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.569510:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b80a98 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.569535:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b80a98 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.569548:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b80a98 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.569575:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b80a9f lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.569584:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b80a9f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.569590:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b80a9f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.569662:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400a00/0x22153cd396b80aa6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.569672:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400a00/0x22153cd396b80aa6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.569680:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400a00/0x22153cd396b80aa6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826385.569691:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0xd:0x0]: returning size 2097153 00010000:00010000:3.0:1787826385.569895:0:32404:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b80a98 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.569903:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b80a98 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.569910:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b80a98 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.569918:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b80a98 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.569925:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826385.569929:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b80a98 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.569939:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b80a98 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.569953:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff90cf11768400) 00010000:00010000:3.0:1787826385.569957:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826385.569962:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b80a98 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.569970:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b80a98 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.569986:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b80a9f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.569992:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b80a9f lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.569998:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b80a9f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.570004:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401e00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826385.570007:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b80a9f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.570017:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b80a9f lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.570025:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x98a5b8df (ffff90cf11768c00) 00010000:00010000:3.0:1787826385.570027:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826385.570030:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b80a9f lrc: 2/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.570036:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b80a9f lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.570090:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401c00/0x22153cd396b80a91 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0706 expref: 27 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.570108:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400a00/0x22153cd396b80aa6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0706 expref: 26 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.570116:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xd:0x0].0x0 (ffff90cf39e67200) 00010000:00010000:3.0:1787826385.570119:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826385.570122:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400a00, rc 0) 00000100:00100000:3.0:1787826385.570200:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9ad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:53665:x1874670563749120:12345-192.168.203.39@tcp:101:dd.0 Request processed in 980us (2476us total) trans 4294967667 rc 0/0 00000100:00100000:3.0:1787826385.570209:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3504 00000100:00100000:0.0:1787826385.575003:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826385.575289:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563749248 00000100:00100000:3.0:1787826385.575311:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563749248 00000100:00100000:3.0:1787826385.575386:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3505 00000100:00100000:3.0:1787826385.575408:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:53665:x1874670563749248:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:3.0:1787826385.575442:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826385.575468:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401200/0x22153cd396b80ab4 lrc: 2/0,0 mode: --/PR res: [0x240000404:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab070d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.575574:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401c00/0x22153cd396b80abb lrc: 3/1,0 mode: --/PR res: [0x240000404:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.575592:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401c00/0x22153cd396b80abb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.575606:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401c00/0x22153cd396b80abb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.575774:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401200/0x22153cd396b80ab4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab070d expref: 28 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.575796:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401c00/0x22153cd396b80abb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab070d expref: 27 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.575806:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xd:0x0].0x0 (ffff90cf39e67200) 00010000:00010000:3.0:1787826385.575810:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787826385.575814:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401c00, rc 0) 00000100:00100000:3.0:1787826385.575885:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:53665:x1874670563749248:12345-192.168.203.39@tcp:101:dd.0 Request processed in 480us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826385.575893:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3505 00000100:00100000:0.0:1787826385.580655:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826385.580716:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563749504 00000100:00100000:1.0:1787826385.580729:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563749504 00000100:00100000:1.0:1787826385.580830:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3506 00000100:00100000:1.0:1787826385.580842:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:53665:x1874670563749504:12345-192.168.203.39@tcp:36:dd.0 00010000:00010000:1.0:1787826385.580916:0:16564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1787826385.580952:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400a00/0x22153cd396b80aa6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0706 expref: 27 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.580979:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835200/0x22153cd396b80a4b lrc: 0/0,0 mode: --/CR res: [0x240000404:0xd:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab06ea expref: 26 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.580993:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xd:0x0].0x0 (ffff90cf39e67200) 00010000:00010000:1.0:1787826385.580999:0:16564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826385.581229:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125c00/0x22153cd396b80ac2 lrc: 3/0,1 mode: --/PW res: [0x240000404:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.581245:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125c00/0x22153cd396b80ac2 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.581254:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125c00/0x22153cd396b80ac2 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787826385.581301:0:16564:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967668 00000004:00010000:1.0:1787826385.581325:0:16564:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000068608569 reply state 000000009887a6b9 transno 4294967669 ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125c00/0x22153cd396b80ac2 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.581338:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125c00/0x22153cd396b80ac2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.581345:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xd:0x0].0x0 (ffff90cf39e67200) 00010000:00010000:1.0:1787826385.581348:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826385.581350:0:16564:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826385.581512:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+28:53665:x1874670563749504:12345-192.168.203.39@tcp:36:dd.0 Request processed in 633us (834us total) trans 4294967669 rc 0/0 00000100:00100000:1.0:1787826385.581520:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3506 00000020:00080000:1.0:1787826385.581527:0:16564:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787826385.589554:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826385.589634:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563749632 00000100:00100000:1.0:1787826385.589648:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563749632 00000100:00100000:1.0:1787826385.589718:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3507 00000100:00100000:1.0:1787826385.589730:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf13668f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+28:53665:x1874670563749632:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:1.0:1787826385.589763:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826385.589789:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125800/0x22153cd396b80ac9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0714 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.589873:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125800/0x22153cd396b80ac9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0714 expref: 29 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.589891:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125800/0x22153cd396b80ac9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0714 expref: 29 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.589914:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xd:0x0].0x0 (ffff90cf39e67200) 00010000:00010000:1.0:1787826385.589918:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826385.589924:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05125800, rc 0) 00000100:00100000:1.0:1787826385.590002:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf13668f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+29:53665:x1874670563749632:12345-192.168.203.39@tcp:101:dd.0 Request processed in 273us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826385.590009:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3507 00000100:00100000:0.0:1787826385.597194:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826385.597445:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563749760 00000100:00100000:1.0:1787826385.597468:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563749760 00000100:00100000:1.0:1787826385.597568:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1893 00000100:00100000:1.0:1787826385.597579:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf13669e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+5:53665:x1874670563749760:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:1.0:1787826385.597609:0:30398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826385.597634:0:30398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000086914dcf/0x22153cd396b80ad0 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab071b expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826385.597666:0:30398:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826385.597692:0:30398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x22:0x0].0x0 since=1331s v=(0 0) 00010000:00010000:1.0:1787826385.597698:0:30398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826385.597708:0:30398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086914dcf/0x22153cd396b80ad0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab071b expref: 6 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.597728:0:30398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000086914dcf/0x22153cd396b80ad0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab071b expref: 6 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.597741:0:30398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05124e00, rc 0) 00000100:00100000:1.0:1787826385.597816:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf13669e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+6:53665:x1874670563749760:12345-192.168.203.39@tcp:101:dd.0 Request processed in 238us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826385.597823:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1893 00000100:00100000:0.0:1787826385.602046:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826385.603523:0:25426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563749888 00000100:00100000:1.0:1787826385.603540:0:25426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563749888 00002000:00010000:1.0:1787826385.603606:0:25426:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/36 (0->18446744073709551615) 00002000:00100000:1.0:1787826385.603612:0:25426:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf13668b40 with x1874670563749888 ext(0->18446744073709551615) 00002000:00010000:1.0:1787826385.603628:0:25426:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf13668b40. 00000100:00100000:1.0:1787826385.603698:0:25426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 722 00000100:00100000:1.0:1787826385.603709:0:25426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf13668b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+6:2403:x1874670563749888:12345-192.168.203.39@tcp:10:dd.0 00002000:00010000:1.0:1787826385.603931:0:25426:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x24:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787826385.603935:0:25426:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x24:0x0] updating lvb mtime from disk: 0 -> 1787826386 00002000:00010000:1.0:1787826385.603938:0:25426:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x24:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787826385.603940:0:25426:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x24:0x0] updating lvb ctime from disk: 0 -> 1787826386 00002000:00010000:1.0:1787826385.603942:0:25426:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x24:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1787826385.604212:0:25426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf13668b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2403:x1874670563749888:12345-192.168.203.39@tcp:10:dd.0 Request processed in 503us (2180us total) trans 21474836953 rc 0/0 00000100:00100000:1.0:1787826385.604222:0:25426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 722 00002000:00010000:1.0:1787826385.604226:0:25426:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/36 (0->18446744073709551615) 00002000:00100000:1.0:1787826385.604229:0:25426:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf13668b40 with x1874670563749888 ext(0->18446744073709551615) 00002000:00010000:1.0:1787826385.604235:0:25426:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf13668b40. 00000100:00100000:0.0:1787826385.606911:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826385.607054:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563750016 00000100:00100000:3.0:1787826385.607067:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563750016 00002000:00010000:3.0:1787826385.607122:0:8442:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/34 (0->18446744073709551615) 00002000:00100000:3.0:1787826385.607127:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf1366a940 with x1874670563750016 ext(0->18446744073709551615) 00002000:00010000:3.0:1787826385.607145:0:8442:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90cf1366a940. 00000100:00100000:3.0:1787826385.607183:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 723 00000100:00100000:3.0:1787826385.607194:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1366a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+6:2403:x1874670563750016:12345-192.168.203.39@tcp:10:dd.0 00002000:00010000:3.0:1787826385.610064:0:8442:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787826385.610076:0:8442:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787826386 00002000:00010000:3.0:1787826385.610080:0:8442:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787826385.610083:0:8442:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x22:0x0] updating lvb ctime from disk: 0 -> 1787826386 00002000:00010000:3.0:1787826385.610085:0:8442:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1787826385.610200:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1366a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2403:x1874670563750016:12345-192.168.203.39@tcp:10:dd.0 Request processed in 2992us (3290us total) trans 17179869618 rc 0/0 00000100:00100000:3.0:1787826385.610215:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 723 00002000:00010000:3.0:1787826385.610223:0:8442:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/34 (0->18446744073709551615) 00002000:00100000:3.0:1787826385.610227:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf1366a940 with x1874670563750016 ext(0->18446744073709551615) 00002000:00010000:3.0:1787826385.610238:0:8442:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90cf1366a940. 00000100:00100000:0.0:1787826385.625149:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826385.625255:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563750272 00000100:00100000:3.0:1787826385.625269:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563750272 00000100:00100000:3.0:1787826385.625339:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1029 00000100:00100000:3.0:1787826385.625349:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1366b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+29:53665:x1874670563750272:12345-192.168.203.39@tcp:35:dd.0 00000100:00100000:3.0:1787826385.625970:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1366b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:53665:x1874670563750272:12345-192.168.203.39@tcp:35:dd.0 Request processed in 616us (830us total) trans 4294967670 rc 0/0 00000100:00100000:3.0:1787826385.625981:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1029 00000100:00100000:1.0:1787826385.667095:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826385.667199:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563750400 00000100:00100000:3.0:1787826385.667214:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563750400 00000100:00100000:3.0:1787826385.667294:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3508 00000100:00100000:3.0:1787826385.667309:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:53666:x1874670563750400:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826385.667350:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826385.667382:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401200/0x22153cd396b80ad7 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0722 expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.667544:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b80ade lrc: 3/1,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.667696:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b80ade lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.667714:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b80ade lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.667732:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b80ae5 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.667741:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b80ae5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.667749:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b80ae5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.667860:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401400/0x22153cd396b80aec lrc: 3/1,0 mode: --/PR res: [0x240000404:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.667868:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401400/0x22153cd396b80aec lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.667875:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401400/0x22153cd396b80aec lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826385.669378:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0xd:0x0]: returning size 16384 00000004:00200000:3.0:1787826385.669403:0:32404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826385.669444:0:32404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401400/0x22153cd396b80aec lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.669466:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401400/0x22153cd396b80aec lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.669503:0:32404:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b80ade lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.669510:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b80ade lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.669517:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b80ade lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.669525:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b80ade lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.669532:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401e00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826385.669538:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b80ade lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.669546:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b80ade lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.669942:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff90cf11768400) 00010000:00010000:3.0:1787826385.669946:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826385.669953:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b80ade lrc: 3/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.669960:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b80ade lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.669987:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b80ae5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.669994:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b80ae5 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.670001:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b80ae5 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.670007:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826385.670010:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b80ae5 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.670018:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b80ae5 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.670027:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x98a5b8df (ffff90cf11768c00) 00010000:00010000:3.0:1787826385.670030:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826385.670034:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b80ae5 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.670040:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b80ae5 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.670101:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401200/0x22153cd396b80ad7 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0722 expref: 32 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.670118:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401400/0x22153cd396b80aec lrc: 3/0,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0722 expref: 31 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.670130:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xd:0x0].0x0 (ffff90cf39e67200) 00010000:00010000:3.0:1787826385.670133:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826385.670136:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401400, rc 0) 00000100:00100000:0.0:1787826385.672038:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:53666:x1874670563750400:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 4717us (4944us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826385.672055:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3508 00000100:00100000:0.0:1787826385.675291:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826385.675831:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563750656 00000100:00100000:2.0:1787826385.675845:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563750656 00000100:00100000:2.0:1787826385.675926:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3509 00000100:00100000:2.0:1787826385.675937:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1366bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:53666:x1874670563750656:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826385.675965:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826385.675990:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835800/0x22153cd396b80af3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0729 expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.676136:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b80afa lrc: 3/0,1 mode: --/CW res: [0x240000404:0xd:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.676152:0:8247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401400/0x22153cd396b80aec lrc: 2/0,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0722 expref: 32 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.676163:0:8247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b80afa lrc: 4/0,1 mode: --/CW res: [0x240000404:0xd:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.676203:0:8247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401400/0x22153cd396b80aec lrc: 3/0,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0722 expref: 32 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.676218:0:8247:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401400/0x22153cd396b80aec lrc: 4/0,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0722 expref: 32 pid: 32404 timeout: 1431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826385.676235:0:8247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf1ecaed00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8247:1874670585197568:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826385.678544:0:8247:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce05b56600 going to sleep for 11 seconds 00000100:00100000:2.0:1787826385.691792:0:8247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf1ecaed00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8247:1874670585197568:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826385.691833:0:8247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b80afa lrc: 3/0,1 mode: --/CW res: [0x240000404:0xd:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826385.692201:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826385.692675:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563750784 00000100:00100000:2.0:1787826385.692685:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563750784 00010000:00010000:2.0:1787826385.692735:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401400/0x22153cd396b80aec lrc: 4/0,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0722 expref: 33 pid: 32404 timeout: 1431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826385.692782:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1008 00000100:00100000:2.0:1787826385.692792:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1366b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:2403:x1874670563750784:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826385.692811:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826385.692819:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401400/0x22153cd396b80aec lrc: 4/0,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0722 expref: 33 pid: 32404 timeout: 1431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.692833:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401400/0x22153cd396b80aec lrc: 3/0,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0722 expref: 33 pid: 32404 timeout: 1431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.692862:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401400/0x22153cd396b80aec lrc: 0/0,0 mode: --/PR res: [0x240000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0722 expref: 33 pid: 32404 timeout: 1431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.692883:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xd:0x0].0x0 (ffff90cf39e67200) 00010000:00010000:2.0:1787826385.692889:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b80afa lrc: 3/0,1 mode: --/CW res: [0x240000404:0xd:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.692902:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b80afa lrc: 3/0,1 mode: CW/CW res: [0x240000404:0xd:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.692911:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b80afa lrc: 4/0,1 mode: CW/CW res: [0x240000404:0xd:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.692952:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826385.693032:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1366b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+32:2403:x1874670563750784:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 241us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826385.693043:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1008 00010000:00010000:0.0:1787826385.693175:0:8247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b80afa lrc: 3/0,1 mode: CW/CW res: [0x240000404:0xd:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.693183:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b80afa lrc: 3/0,1 mode: CW/CW res: [0x240000404:0xd:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826385.693216:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0xd:0x0]: returning size 16384 00010000:00010000:0.0:1787826385.693441:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835800/0x22153cd396b80af3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0xd:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0729 expref: 33 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.693462:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b80afa lrc: 3/0,0 mode: CW/CW res: [0x240000404:0xd:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0729 expref: 32 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.693527:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xd:0x0].0x0 (ffff90cf39e67200) 00010000:00010000:0.0:1787826385.693531:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787826385.693534:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835000, rc 0) 00000100:00100000:0.0:1787826385.693571:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1366bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+32:53666:x1874670563750656:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 17636us (18295us total) trans 4294967671 rc 0/0 00000100:00100000:0.0:1787826385.693579:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3509 00000100:00100000:1.0:1787826385.699012:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826385.699106:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563750912 00000100:00100000:2.0:1787826385.699119:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563750912 00000100:00100000:2.0:1787826385.699194:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3510 00000100:00100000:2.0:1787826385.699207:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f80b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+32:53666:x1874670563750912:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826385.699240:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826385.699269:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834600/0x22153cd396b80b08 lrc: 2/0,0 mode: --/CR res: [0x240000404:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0730 expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.699450:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834c00/0x22153cd396b80b0f lrc: 3/1,0 mode: --/PR res: [0x240000404:0xd:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.699466:0:9966:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b80afa lrc: 2/0,0 mode: CW/CW res: [0x240000404:0xd:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0729 expref: 33 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.699530:0:9966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834c00/0x22153cd396b80b0f lrc: 4/1,0 mode: --/PR res: [0x240000404:0xd:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.699573:0:9966:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b80afa lrc: 3/0,0 mode: CW/CW res: [0x240000404:0xd:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0729 expref: 33 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.699588:0:9966:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b80afa lrc: 4/0,0 mode: CW/CW res: [0x240000404:0xd:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0729 expref: 33 pid: 8247 timeout: 1431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826385.699604:0:9966:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf1ecaed00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9966:1874670585197696:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826385.699704:0:9966:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce05b56600 going to sleep for 11 seconds 00000100:00100000:1.0:1787826385.702812:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826385.702918:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563751040 00000100:00100000:0.0:1787826385.702930:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563751040 00010000:00010000:0.0:1787826385.702985:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b80afa lrc: 5/0,0 mode: CW/CW res: [0x240000404:0xd:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0729 expref: 34 pid: 8247 timeout: 1431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826385.703039:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1009 00000100:00100000:0.0:1787826385.703051:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf10a51450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:2404:x1874670563751040:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826385.703070:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826385.703078:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b80afa lrc: 5/0,0 mode: CW/CW res: [0x240000404:0xd:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0729 expref: 34 pid: 8247 timeout: 1431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.703093:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b80afa lrc: 4/0,0 mode: CW/CW res: [0x240000404:0xd:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0729 expref: 34 pid: 8247 timeout: 1431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.703124:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xd:0x0].0x0 (ffff90cf39e67200) 00010000:00010000:0.0:1787826385.703130:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834c00/0x22153cd396b80b0f lrc: 3/1,0 mode: --/PR res: [0x240000404:0xd:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.703142:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834c00/0x22153cd396b80b0f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.703151:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834c00/0x22153cd396b80b0f lrc: 4/1,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.703176:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826385.703253:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf10a51450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:2404:x1874670563751040:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 203us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826385.703262:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1009 00010000:00010000:2.0:1787826385.703960:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b80afa lrc: 0/0,0 mode: --/CW res: [0x240000404:0xd:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0729 expref: 33 pid: 8247 timeout: 1431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826385.703983:0:9966:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf1ecaed00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9966:1874670585197696:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826385.704010:0:9966:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834c00/0x22153cd396b80b0f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.704019:0:9966:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834c00/0x22153cd396b80b0f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.704025:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834c00/0x22153cd396b80b0f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826385.704092:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0xd:0x0]: returning size 16384 00000004:00200000:2.0:1787826385.704097:0:9966:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826385.704124:0:9966:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834c00/0x22153cd396b80b0f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.704163:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834600/0x22153cd396b80b08 lrc: 0/0,0 mode: --/CR res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0730 expref: 33 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.704179:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834c00/0x22153cd396b80b0f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0730 expref: 32 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.704188:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xd:0x0].0x0 (ffff90cf39e67200) 00010000:00010000:2.0:1787826385.704191:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826385.704194:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834c00, rc 0) 00000100:00100000:2.0:1787826385.704306:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f80b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+32:53666:x1874670563750912:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 5093us (5300us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826385.704314:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3510 00000100:00100000:1.0:1787826385.729779:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826385.729962:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563751296 00000100:00100000:2.0:1787826385.729975:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563751296 00000100:00100000:2.0:1787826385.730057:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3511 00000100:00100000:2.0:1787826385.730068:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f80b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+32:53666:x1874670563751296:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826385.730096:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826385.730123:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834600/0x22153cd396b80b16 lrc: 2/0,0 mode: --/CR res: [0x240000404:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0737 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.730262:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b80b1d lrc: 3/0,1 mode: --/PW res: [0x240000404:0xd:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.730280:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b80b1d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0xd:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.730294:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b80b1d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0xd:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826385.730309:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0xd:0x0]: returning size 16384 00010000:00010000:2.0:1787826385.730454:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834600/0x22153cd396b80b16 lrc: 0/0,0 mode: --/CR res: [0x240000404:0xd:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0737 expref: 35 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.730525:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b80b1d lrc: 3/0,0 mode: PW/PW res: [0x240000404:0xd:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0737 expref: 34 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.730535:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xd:0x0].0x0 (ffff90cf39e67200) 00010000:00010000:2.0:1787826385.730538:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787826385.730543:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835000, rc 0) 00000100:00100000:2.0:1787826385.730621:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f80b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:53666:x1874670563751296:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 555us (856us total) trans 4294967672 rc 0/0 00000100:00100000:2.0:1787826385.730633:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3511 00000100:00100000:0.0:1787826385.734190:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826385.734298:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563751424 00000100:00100000:3.0:1787826385.734309:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563751424 00000100:00100000:3.0:1787826385.734382:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1894 00000100:00100000:3.0:1787826385.734402:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1366b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2403:x1874670563751424:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:3.0:1787826385.734460:0:30696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d747c98/0x22153cd396b80b2b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.734551:0:30696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c25d1558/0x22153cd396b80a52 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab06f1 expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.734562:0:30696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826385.734567:0:30696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826385.734582:0:30696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d747c98/0x22153cd396b80b2b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.734630:0:30696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c25d1558/0x22153cd396b80a52 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab06f1 expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.734646:0:30696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c25d1558/0x22153cd396b80a52 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab06f1 expref: 7 pid: 8436 timeout: 1431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826385.734663:0:30696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce06306d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:30696:1874670585197824:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826385.734771:0:30696:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a2c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826385.740348:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826385.740552:0:30696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce06306d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:30696:1874670585197824:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826385.740601:0:30696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004d747c98/0x22153cd396b80b2b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826385.740696:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563751552 00000100:00100000:2.0:1787826385.740705:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563751552 00000100:00100000:2.0:1787826385.740771:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1895 00000100:00100000:2.0:1787826385.740782:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1366a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2403:x1874670563751552:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:2.0:1787826385.740845:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c6f0c33/0x22153cd396b80b32 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.740866:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000086914dcf/0x22153cd396b80ad0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab071b expref: 7 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.740876:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826385.740881:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826385.740887:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c6f0c33/0x22153cd396b80b32 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.740929:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000086914dcf/0x22153cd396b80ad0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab071b expref: 7 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.740944:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000086914dcf/0x22153cd396b80ad0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab071b expref: 7 pid: 30398 timeout: 1431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826385.740962:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf1ecaed00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1874670585197952:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826385.741051:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce05b56480 going to sleep for 11 seconds 00000100:00100000:1.0:1787826385.742749:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826385.742902:0:25425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563751680 00000100:00100000:2.0:1787826385.742914:0:25425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563751680 00002000:00100000:2.0:1787826385.742978:0:25425:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000400:0x24:0x0] (0->16383) req@ffff90cf3f8083c0 x1874670563751680/t0(0) o4->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:741/0 lens 16872/0 e 0 to 0 dl 1787826396 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826385.742994:0:25425:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf3f8083c0 with x1874670563751680 ext(0->16383) 00010000:00010000:2.0:1787826385.743004:0:25425:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c25d1558/0x22153cd396b80a52 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab06f1 expref: 8 pid: 8436 timeout: 1431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.743023:0:25425:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c25d1558/0x22153cd396b80a52 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab06f1 expref: 8 pid: 8436 timeout: 1431 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787826385.743033:0:25425:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90cf3f8083c0 00000100:00100000:2.0:1787826385.743064:0:25425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 22 00000100:00100000:2.0:1787826385.743074:0:25425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2404:x1874670563751680:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1787826385.752327:0:25425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563751680:12345-192.168.203.39@tcp:4:dd.0 Request processed in 9236us (9570us total) trans 21474836954 rc 0/0 00000100:00100000:2.0:1787826385.752348:0:25425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 22 00002000:00100000:2.0:1787826385.752366:0:25425:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000400:0x24:0x0] (0->16383) req@ffff90cf3f8083c0 x1874670563751680/t21474836954(0) o4->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:741/0 lens 16872/448 e 0 to 0 dl 1787826396 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826385.752378:0:25425:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf3f8083c0 with x1874670563751680 ext(0->16383) 00010000:00010000:2.0:1787826385.752404:0:25425:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c25d1558/0x22153cd396b80a52 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab06f1 expref: 10 pid: 8436 timeout: 1431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.752421:0:25425:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c25d1558/0x22153cd396b80a52 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab06f1 expref: 10 pid: 8436 timeout: 1431 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787826385.752435:0:25425:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90cf3f8083c0 00000100:00100000:1.0:1787826385.758486:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826385.758608:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf1ecaed00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1874670585197952:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826385.758645:0:8436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005c6f0c33/0x22153cd396b80b32 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826385.758952:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563751808 00000100:00100000:0.0:1787826385.758961:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563751808 00010000:00010000:0.0:1787826385.759012:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000086914dcf/0x22153cd396b80ad0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab071b expref: 8 pid: 30398 timeout: 1431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826385.759059:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1010 00000100:00100000:0.0:1787826385.759069:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f80b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2403:x1874670563751808:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826385.759089:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826385.759117:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000086914dcf/0x22153cd396b80ad0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab071b expref: 8 pid: 30398 timeout: 1431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.759131:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000086914dcf/0x22153cd396b80ad0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab071b expref: 8 pid: 30398 timeout: 1431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.759161:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000086914dcf/0x22153cd396b80ad0 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab071b expref: 8 pid: 30398 timeout: 1431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.759182:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826385.759187:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826385.759193:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005c6f0c33/0x22153cd396b80b32 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.759204:0:10340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c6f0c33/0x22153cd396b80b32 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.759243:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826385.759310:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f80b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2403:x1874670563751808:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 241us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826385.759323:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1010 00010000:00010000:3.0:1787826385.759443:0:8436:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005c6f0c33/0x22153cd396b80b32 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.759463:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c6f0c33/0x22153cd396b80b32 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.759523:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c6f0c33/0x22153cd396b80b32 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.759532:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c6f0c33/0x22153cd396b80b32 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.759540:0:8436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c6f0c33/0x22153cd396b80b32 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.759547:0:8436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834600 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826385.759551:0:8436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c6f0c33/0x22153cd396b80b32 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.759575:0:8436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c6f0c33/0x22153cd396b80b32 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.759594:0:8436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c6f0c33/0x22153cd396b80b32 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.759602:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c6f0c33/0x22153cd396b80b32 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826385.759660:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1366a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+6:2403:x1874670563751552:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 18880us (19328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826385.759669:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1895 00000100:00100000:0.0:1787826385.761134:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826385.761191:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563751936 00000100:00100000:3.0:1787826385.761201:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563751936 00010000:00010000:3.0:1787826385.761238:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c25d1558/0x22153cd396b80a52 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab06f1 expref: 10 pid: 8436 timeout: 1431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826385.761278:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1011 00000100:00100000:3.0:1787826385.761287:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1366ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2402:x1874670563751936:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826385.761303:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787826385.761323:0:10341:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x24:0x0] updating lvb size from disk: 0 -> 16384 00002000:00010000:3.0:1787826385.761326:0:10341:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x24:0x0] updating lvb blocks from disk: 0 -> 32 00010000:00010000:3.0:1787826385.761332:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c25d1558/0x22153cd396b80a52 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab06f1 expref: 10 pid: 8436 timeout: 1431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.761348:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c25d1558/0x22153cd396b80a52 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab06f1 expref: 10 pid: 8436 timeout: 1431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.761377:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c25d1558/0x22153cd396b80a52 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab06f1 expref: 10 pid: 8436 timeout: 1431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.761406:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826385.761412:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826385.761418:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004d747c98/0x22153cd396b80b2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.761430:0:10341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d747c98/0x22153cd396b80b2b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.761673:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826385.761732:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1366ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2402:x1874670563751936:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 444us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826385.761740:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1011 00010000:00010000:1.0:1787826385.761865:0:30696:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004d747c98/0x22153cd396b80b2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.761877:0:30696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d747c98/0x22153cd396b80b2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.761901:0:30696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d747c98/0x22153cd396b80b2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.761910:0:30696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004d747c98/0x22153cd396b80b2b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.761918:0:30696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004d747c98/0x22153cd396b80b2b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.761926:0:30696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401200 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:1.0:1787826385.761931:0:30696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004d747c98/0x22153cd396b80b2b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.761946:0:30696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004d747c98/0x22153cd396b80b2b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.761959:0:30696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004d747c98/0x22153cd396b80b2b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.761968:0:30696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d747c98/0x22153cd396b80b2b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826385.762017:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1366b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2403:x1874670563751424:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 27619us (27842us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826385.762026:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1894 00000100:00100000:1.0:1787826385.773283:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826385.773357:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563752192 00000100:00100000:0.0:1787826385.773370:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563752192 00000100:00100000:0.0:1787826385.773451:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3512 00000100:00100000:0.0:1787826385.773463:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f808f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:53666:x1874670563752192:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:0.0:1787826385.773581:0:32404:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1787826385.773617:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125800/0x22153cd396b80ac9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0714 expref: 34 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.773641:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834c00/0x22153cd396b80b0f lrc: 0/0,0 mode: --/PR res: [0x240000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0730 expref: 33 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.773657:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xd:0x0].0x0 (ffff90cf39e67200) 00010000:00010000:0.0:1787826385.773662:0:32404:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826385.773700:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b80b39 lrc: 3/0,1 mode: --/EX res: [0x240000404:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.773716:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b80b39 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.773728:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b80b39 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787826385.774206:0:32404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].22, 88 off9864 00000004:00080000:0.0:1787826385.774214:0:32404:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1331785742224ns, next at 1201607267971ns, rc = 0 00000040:00080000:0.0:1787826385.774248:0:32404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].20, 88 off9688 00000004:00080000:0.0:1787826385.774252:0:32404:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1331785780225ns, next at 1201610029598ns, rc = 0 00000040:00080000:0.0:1787826385.774271:0:32404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].21, 88 off9776 00000004:00080000:0.0:1787826385.774275:0:32404:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1331785802915ns, next at 1201610029598ns, rc = 0 00000040:00080000:0.0:1787826385.774283:0:32404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].23, 88 off9952 00000004:00080000:0.0:1787826385.774287:0:32404:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1331785815005ns, next at 1201607267971ns, rc = 0 00000001:00080000:2.0:1787826385.777468:0:7449:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967673 is committed 00000004:00080000:2.0:1787826385.777516:0:7449:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 25 committed 00000004:00080000:2.0:1787826385.777529:0:7449:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 22 committed 00000004:00080000:2.0:1787826385.777538:0:7449:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 21 committed 00000004:00080000:2.0:1787826385.777541:0:7449:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 24 committed 00000004:00010000:2.0:1787826385.777645:0:32404:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a81d9b38 reply state 00000000c9bb3f8f transno 4294967673 ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b80b39 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.777675:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b80b39 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.777687:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xd:0x0].0x0 (ffff90cf39e67200) 00010000:00010000:2.0:1787826385.777691:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1787826385.777696:0:32404:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1787826385.777872:0:32404:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1787826385.777893:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f808f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:53666:x1874670563752192:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 4426us (4618us total) trans 4294967673 rc 0/0 00000100:00100000:2.0:1787826385.777904:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3512 00010000:00010000:0.0:1787826385.780043:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125c00/0x22153cd396b80ac2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.780067:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125c00/0x22153cd396b80ac2 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.780077:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125c00/0x22153cd396b80ac2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.780085:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05125c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826385.780092:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125c00/0x22153cd396b80ac2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.780100:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125c00/0x22153cd396b80ac2 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.780125:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xd:0x0].0x0 (ffff90cf39e67200) 00010000:00010000:0.0:1787826385.780130:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826385.780136:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125c00/0x22153cd396b80ac2 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.780142:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125c00/0x22153cd396b80ac2 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826385.780615:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f809e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585198208:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1787826385.780707:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826385.780758:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787826385.780765:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f80a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585198080:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1787826385.780929:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826385.780970:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585198208 00000100:00100000:1.0:1787826385.780978:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585198208 00000100:00100000:1.0:1787826385.781031:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585198080 00000100:00100000:1.0:1787826385.781035:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585198080 00000100:00100000:1.0:1787826385.781057:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1896 00000100:00100000:1.0:1787826385.781068:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f809a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3647:x1874670585198208:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1787826385.781321:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f809a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+7:3647:x1874670585198208:12345-0@lo:2:osp-syn-0-1.0 Request processed in 253us (613us total) trans 21474836955 rc 0/0 00000100:00100000:1.0:1787826385.781330:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1896 00000100:00100000:1.0:1787826385.781351:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1897 00000100:00100000:1.0:1787826385.781357:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f808000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3647:x1874670585198080:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1787826385.781436:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f808000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+7:3647:x1874670585198080:12345-0@lo:2:osp-syn-0-1.0 Request processed in 79us (507us total) trans 21474836956 rc 0/0 00000100:00100000:1.0:1787826385.781443:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1897 00000100:00100000:0.0:1787826385.781546:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 21474836951 gen 2 00000004:00080000:0.0:1787826385.781553:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3aaf30c0, transno 21474836950 00000004:00080000:0.0:1787826385.781567:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3aaf3c00, transno 21474836951 00000100:00100000:0.0:1787826385.781577:0:3647:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff90cf3f80a1c0 x1874670585198080/t21474836956(21474836956) o2->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 440/432 e 0 to 0 dl 1787826401 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1787826385.781589:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3f80a1c0/2, rc 0, transno 21474836956 00000100:00100000:0.0:1787826385.781596:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f80a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585198080:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1787826385.781609:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3f809e00/2, rc 0, transno 21474836955 00000100:00100000:0.0:1787826385.781613:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f809e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585198208:0@lo:2:osp-syn-0-1.0 00010000:00010000:3.0:1787826385.781997:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b80b39 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.782007:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b80b39 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.782014:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b80b39 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.782020:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05661000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826385.782026:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b80b39 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.782038:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b80b39 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.782055:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xd:0x0].0x0 (ffff90cf39e67200) 00010000:00010000:3.0:1787826385.782058:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826385.782062:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b80b39 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.782068:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b80b39 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826385.782094:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce06306d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585198336:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1787826385.782130:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826385.782162:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787826385.782168:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce06307840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585198464:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1787826385.782187:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826385.782211:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585198336 00000100:00100000:3.0:1787826385.782216:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585198336 00000100:00100000:3.0:1787826385.782252:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585198464 00000100:00100000:3.0:1787826385.782255:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585198464 00000100:00100000:0.0:1787826385.782263:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1898 00000100:00100000:0.0:1787826385.782276:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce063070c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+8:3644:x1874670585198336:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1787826385.783425:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce063070c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+9:3644:x1874670585198336:12345-0@lo:2:osp-syn-1-1.0 Request processed in 1140us (1281us total) trans 17179869619 rc 0/0 00000100:00100000:3.0:1787826385.785728:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1899 00000100:00100000:3.0:1787826385.785753:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06305e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+9:3644:x1874670585198464:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1787826385.786147:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06305e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+10:3644:x1874670585198464:12345-0@lo:2:osp-syn-1-1.0 Request processed in 404us (3957us total) trans 17179869620 rc 0/0 00000100:00100000:3.0:1787826385.786158:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1899 00000004:00080000:2.0:1787826385.786310:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce06306d00/2, rc 0, transno 17179869619 00000100:00100000:2.0:1787826385.786319:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce06306d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585198336:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1787826385.786330:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000004:00080000:2.0:1787826385.786341:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce06307840/2, rc 0, transno 17179869620 00000100:00100000:2.0:1787826385.786347:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce06307840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585198464:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1787826385.786456:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1898 00000100:00100000:3.0:1787826385.787006:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563752320 00000100:00100000:3.0:1787826385.787016:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563752320 00000100:00100000:3.0:1787826385.787068:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3513 00000100:00100000:3.0:1787826385.787076:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f808b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:53666:x1874670563752320:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826385.787100:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826385.787126:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b80b40 lrc: 2/0,0 mode: --/CR res: [0x240000404:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab073e expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.787197:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b80b40 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab073e expref: 25 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.787215:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b80b40 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab073e expref: 25 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.787241:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xd:0x0].0x0 (ffff90cf39e67200) 00010000:00010000:3.0:1787826385.787245:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826385.787249:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401800, rc 0) 00000100:00100000:3.0:1787826385.787320:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f808b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:53666:x1874670563752320:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 244us (996us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826385.787327:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3513 00000100:00100000:0.0:1787826385.790463:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826385.790951:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563752448 00000100:00100000:2.0:1787826385.790964:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563752448 00000100:00100000:2.0:1787826385.791040:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3514 00000100:00100000:2.0:1787826385.791052:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf13668780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:53666:x1874670563752448:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826385.791081:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826385.791107:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834400/0x22153cd396b80b47 lrc: 2/0,0 mode: --/CR res: [0x240000404:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0745 expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.791242:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834a00/0x22153cd396b80b4e lrc: 3/1,0 mode: --/PR res: [0x240000404:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.791258:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834a00/0x22153cd396b80b4e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.791273:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834a00/0x22153cd396b80b4e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826385.791304:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0xd:0x0]: returning size 16384 00000004:00200000:2.0:1787826385.791309:0:9966:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826385.791328:0:9966:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834a00/0x22153cd396b80b4e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.791359:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834400/0x22153cd396b80b47 lrc: 0/0,0 mode: --/CR res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0745 expref: 27 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.791380:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834a00/0x22153cd396b80b4e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0745 expref: 26 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.791400:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xd:0x0].0x0 (ffff90cf39e67200) 00010000:00010000:2.0:1787826385.791405:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826385.791409:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834a00, rc 0) 00000100:00100000:2.0:1787826385.791526:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf13668780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:53666:x1874670563752448:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 475us (1078us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826385.791535:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3514 00000100:00100000:0.0:1787826385.794198:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826385.794243:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826385.794371:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563752576 00000100:00100000:1.0:1787826385.794384:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563752576 00000100:00100000:1.0:1787826385.794501:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563752704 00000100:00100000:1.0:1787826385.794504:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563752704 00000100:00100000:1.0:1787826385.794529:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1900 00000100:00100000:1.0:1787826385.794540:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1366a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2404:x1874670563752576:12345-192.168.203.39@tcp:101:lfs.0 00000100:00100000:0.0:1787826385.794659:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1901 00000100:00100000:0.0:1787826385.794669:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8acb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+6:2404:x1874670563752704:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826385.794682:0:28853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826385.794707:0:28853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003299944/0x22153cd396b80b55 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0753 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826385.794739:0:28853:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a9010d2, atime: 0x0, ctime: 0x6a9010d2, blocks: 0x0 00010000:00010000:0.0:1787826385.794765:0:28853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x22:0x0].0x0 since=1331s v=(0 0) 00010000:00010000:0.0:1787826385.794770:0:28853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826385.794791:0:28853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003299944/0x22153cd396b80b55 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0753 expref: 7 pid: 28853 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.794826:0:28853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000003299944/0x22153cd396b80b55 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0753 expref: 7 pid: 28853 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.794842:0:28853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05660600, rc 0) 00000100:00100000:0.0:1787826385.794914:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8acb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2404:x1874670563752704:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 245us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826385.794921:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1901 00010000:00010000:1.0:1787826385.795361:0:30696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826385.795380:0:30696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c5389e4/0x22153cd396b80b5c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab074c expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826385.795408:0:30696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x24:0x0] initial LVB size: 16384, mtime: 0x6a9010d2, atime: 0x0, ctime: 0x6a9010d2, blocks: 0x20 00010000:00010000:1.0:1787826385.795420:0:30696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=1331s v=(0 0) 00010000:00010000:1.0:1787826385.795423:0:30696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826385.795430:0:30696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c5389e4/0x22153cd396b80b5c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab074c expref: 9 pid: 30696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.795441:0:30696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008c5389e4/0x22153cd396b80b5c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab074c expref: 9 pid: 30696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826385.795457:0:30696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05125000, rc 0) 00000100:00100000:1.0:1787826385.795918:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1366a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563752576:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1377us (1733us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826385.795928:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1900 00000100:00100000:0.0:1787826385.890720:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826385.890846:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563752832 00000100:00100000:1.0:1787826385.890860:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563752832 00000100:00100000:1.0:1787826385.890940:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1902 00000100:00100000:1.0:1787826385.890953:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f04b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563752832:12345-192.168.203.39@tcp:23:lfs.0 00000100:00100000:1.0:1787826385.891102:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f04b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563752832:12345-192.168.203.39@tcp:23:lfs.0 Request processed in 151us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826385.891111:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1902 00000100:00100000:2.0:1787826385.903688:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826385.904140:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563752960 00000100:00100000:1.0:1787826385.904154:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563752960 00000100:00100000:1.0:1787826385.904233:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1903 00000100:00100000:1.0:1787826385.904247:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecaed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2402:x1874670563752960:12345-192.168.203.39@tcp:23:lfs.0 00000100:00100000:1.0:1787826385.904412:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecaed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2402:x1874670563752960:12345-192.168.203.39@tcp:23:lfs.0 Request processed in 167us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826385.904421:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1903 00000100:00100000:2.0:1787826385.916293:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826385.916445:0:30178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563753088 00000100:00100000:0.0:1787826385.916499:0:30178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563753088 00000100:00100000:0.0:1787826385.916598:0:30178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 724 00000100:00100000:0.0:1787826385.916609:0:30178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2401:x1874670563753088:12345-192.168.203.39@tcp:3:lfs.0 00010000:00010000:0.0:1787826385.916692:0:30178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e3083a9a/0x22153cd396b80b63 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.916713:0:30178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826385.916719:0:30178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826385.916727:0:30178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3083a9a/0x22153cd396b80b63 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.916742:0:30178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3083a9a/0x22153cd396b80b63 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.916896:0:30178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e3083a9a/0x22153cd396b80b63 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.916913:0:30178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3083a9a/0x22153cd396b80b63 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.916923:0:30178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3083a9a/0x22153cd396b80b63 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.916931:0:30178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05661c00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826385.916936:0:30178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3083a9a/0x22153cd396b80b63 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.916946:0:30178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3083a9a/0x22153cd396b80b63 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.916965:0:30178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3083a9a/0x22153cd396b80b63 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826385.916973:0:30178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3083a9a/0x22153cd396b80b63 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826385.917063:0:30178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2401:x1874670563753088:12345-192.168.203.39@tcp:3:lfs.0 Request processed in 455us (783us total) trans 0 rc 16384/16384 00000100:00100000:0.0:1787826385.917072:0:30178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 724 00000100:00100000:0.0:1787826385.940679:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826385.940785:0:30173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563753216 00000100:00100000:3.0:1787826385.940799:0:30173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563753216 00000100:00100000:3.0:1787826385.940905:0:30173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 725 00000100:00100000:3.0:1787826385.940918:0:30173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2404:x1874670563753216:12345-192.168.203.39@tcp:4:lfs.0 00002000:00010000:3.0:1787826385.940992:0:30173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826385.941004:0:30173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9767cf8/0x22153cd396b80b6a lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.941026:0:30173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x23:0x0].0x0 since=1331s v=(0 0) 00010000:00010000:3.0:1787826385.941032:0:30173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826385.941041:0:30173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9767cf8/0x22153cd396b80b6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826385.941057:0:30173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9767cf8/0x22153cd396b80b6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787826385.959208:0:27651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179869621 is committed 00000001:00080000:1.0:1787826385.959236:0:27651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179869620 is committed 00002000:00010000:2.0:1787826385.967956:0:30173:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x23:0x0] updating lvb size from disk: 0 -> 16384 00002000:00010000:2.0:1787826385.968096:0:30173:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x23:0x0] updating lvb mtime from disk: 0 -> 1787826386 00002000:00010000:2.0:1787826385.968099:0:30173:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x23:0x0] updating lvb ctime from disk: 0 -> 1787826386 00002000:00010000:2.0:1787826385.968102:0:30173:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x23:0x0] updating lvb blocks from disk: 0 -> 32 00010000:00010000:2.0:1787826385.968120:0:30173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9767cf8/0x22153cd396b80b6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.968135:0:30173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9767cf8/0x22153cd396b80b6a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.968143:0:30173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9767cf8/0x22153cd396b80b6a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.968151:0:30173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401e00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826385.968156:0:30173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9767cf8/0x22153cd396b80b6a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.968165:0:30173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9767cf8/0x22153cd396b80b6a lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.968189:0:30173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9767cf8/0x22153cd396b80b6a lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826385.968198:0:30173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9767cf8/0x22153cd396b80b6a lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826385.968366:0:30173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+6:2404:x1874670563753216:12345-192.168.203.39@tcp:4:lfs.0 Request processed in 27442us (27693us total) trans 17179869621 rc 0/0 00000100:00100000:2.0:1787826385.968380:0:30173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 725 00000100:00100000:0.0:1787826386.012942:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826386.013215:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563753472 00000100:00100000:2.0:1787826386.013228:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563753472 00000100:00100000:2.0:1787826386.013310:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3515 00000100:00100000:2.0:1787826386.013323:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aaf30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:53666:x1874670563753472:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:2.0:1787826386.013411:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826386.013454:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834a00/0x22153cd396b80b4e lrc: 0/0,0 mode: --/PR res: [0x240000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0745 expref: 26 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826386.013522:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xd:0x0].0x0 (ffff90cf39e67200) 00010000:00010000:2.0:1787826386.013528:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826386.014795:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834800/0x22153cd396b80b71 lrc: 3/0,1 mode: --/PW res: [0x240000404:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826386.014820:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834800/0x22153cd396b80b71 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826386.014842:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834800/0x22153cd396b80b71 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787826386.014907:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967674 00000004:00010000:2.0:1787826386.014933:0:6518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a7f795a0 reply state 00000000de6451d4 transno 4294967675 ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834800/0x22153cd396b80b71 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826386.014947:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834800/0x22153cd396b80b71 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826386.014954:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xd:0x0].0x0 (ffff90cf39e67200) 00010000:00010000:2.0:1787826386.015188:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826386.015193:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826386.015843:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aaf30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+28:53666:x1874670563753472:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 2507us (2900us total) trans 4294967675 rc 0/0 00000100:00100000:3.0:1787826386.015856:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3515 00000020:00080000:3.0:1787826386.015864:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787826386.024288:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826386.024454:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563753600 00000100:00100000:3.0:1787826386.024467:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563753600 00000100:00100000:0.0:1787826386.024726:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1904 00000100:00100000:0.0:1787826386.024741:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aaf3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+6:53666:x1874670563753600:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826386.024766:0:30398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826386.024794:0:30398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c87ea1db/0x22153cd396b80b78 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab075a expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826386.024830:0:30398:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x23:0x0] initial LVB size: 16384, mtime: 0x6a9010d2, atime: 0x0, ctime: 0x6a9010d2, blocks: 0x20 00010000:00010000:0.0:1787826386.024868:0:30398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x23:0x0].0x0 since=1332s v=(0 0) 00010000:00010000:0.0:1787826386.024874:0:30398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826386.024884:0:30398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c87ea1db/0x22153cd396b80b78 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab075a expref: 7 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.024907:0:30398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c87ea1db/0x22153cd396b80b78 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab075a expref: 7 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.024922:0:30398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05660c00, rc 0) 00000100:00100000:0.0:1787826386.025115:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aaf3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:53666:x1874670563753600:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 377us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826386.025123:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1904 00000100:00100000:1.0:1787826386.031174:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826386.031716:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563753728 00000100:00100000:0.0:1787826386.031727:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563753728 00000100:00100000:0.0:1787826386.031805:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1905 00000100:00100000:0.0:1787826386.031818:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f80ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:53666:x1874670563753728:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826386.031852:0:28853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826386.031880:0:28853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000472bc4f7/0x22153cd396b80b7f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0761 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826386.031921:0:28853:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826386.031951:0:28853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=1332s v=(0 0) 00010000:00010000:0.0:1787826386.031967:0:28853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826386.031979:0:28853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000472bc4f7/0x22153cd396b80b7f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0761 expref: 10 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.032000:0:28853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000472bc4f7/0x22153cd396b80b7f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0761 expref: 10 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.032016:0:28853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05661200, rc 0) 00000100:00100000:0.0:1787826386.032104:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f80ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:53666:x1874670563753728:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 287us (945us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826386.032112:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1905 00000100:00100000:1.0:1787826386.042601:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826386.042641:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826386.042745:0:25422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563753856 00000100:00100000:0.0:1787826386.042758:0:25422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563753856 00002000:00010000:0.0:1787826386.042812:0:25422:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/35 (16384->18446744073709551615) 00002000:00100000:0.0:1787826386.042818:0:25422:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf3f808780 with x1874670563753856 ext(16384->18446744073709551615) 00002000:00010000:0.0:1787826386.042845:0:25422:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90cf3f808780. 00000100:00100000:0.0:1787826386.042880:0:25422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563753984 00000100:00100000:0.0:1787826386.042883:0:25422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563753984 00002000:00010000:0.0:1787826386.042897:0:25422:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/37 (0->18446744073709551615) 00002000:00100000:0.0:1787826386.042900:0:25422:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf3f80bc00 with x1874670563753984 ext(0->18446744073709551615) 00002000:00010000:0.0:1787826386.042907:0:25422:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf3f80bc00. 00000100:00100000:0.0:1787826386.042936:0:25422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 726 00000100:00100000:0.0:1787826386.042948:0:25422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f808780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2404:x1874670563753856:12345-192.168.203.39@tcp:10:lfs.0 00002000:00010000:0.0:1787826386.043178:0:25422:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x23:0x0] updating lvb size from disk: 16384 -> 16384 00002000:00010000:0.0:1787826386.043183:0:25422:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x23:0x0] updating lvb mtime from disk: 1787826386 -> 1787826386 00002000:00010000:0.0:1787826386.043186:0:25422:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x23:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787826386.043188:0:25422:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x23:0x0] updating lvb ctime from disk: 1787826386 -> 1787826386 00002000:00010000:0.0:1787826386.043190:0:25422:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x23:0x0] updating lvb blocks from disk: 32 -> 32 00000100:00100000:0.0:1787826386.043258:0:25422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f808780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2404:x1874670563753856:12345-192.168.203.39@tcp:10:lfs.0 Request processed in 311us (672us total) trans 17179869622 rc 0/0 00000100:00100000:0.0:1787826386.043278:0:25422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 726 00002000:00010000:0.0:1787826386.043282:0:25422:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/35 (16384->18446744073709551615) 00002000:00100000:0.0:1787826386.043284:0:25422:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf3f808780 with x1874670563753856 ext(16384->18446744073709551615) 00002000:00010000:0.0:1787826386.043288:0:25422:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90cf3f808780. 00000100:00100000:0.0:1787826386.043308:0:25422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 727 00000100:00100000:0.0:1787826386.043316:0:25422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f80bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670563753984:12345-192.168.203.39@tcp:10:lfs.0 00002000:00010000:0.0:1787826386.043430:0:25422:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x25:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787826386.043433:0:25422:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x25:0x0] updating lvb mtime from disk: 0 -> 1787826386 00002000:00010000:0.0:1787826386.043435:0:25422:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x25:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787826386.043437:0:25422:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x25:0x0] updating lvb ctime from disk: 0 -> 1787826386 00002000:00010000:0.0:1787826386.043439:0:25422:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x25:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1787826386.043461:0:25422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f80bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2403:x1874670563753984:12345-192.168.203.39@tcp:10:lfs.0 Request processed in 147us (819us total) trans 21474836957 rc 0/0 00000100:00100000:0.0:1787826386.043467:0:25422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 727 00002000:00010000:0.0:1787826386.043522:0:25422:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/37 (0->18446744073709551615) 00002000:00100000:0.0:1787826386.043526:0:25422:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf3f80bc00 with x1874670563753984 ext(0->18446744073709551615) 00002000:00010000:0.0:1787826386.043531:0:25422:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf3f80bc00. 00000100:00100000:1.0:1787826386.047404:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826386.047520:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563754240 00000100:00100000:2.0:1787826386.047535:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563754240 00000100:00100000:2.0:1787826386.047616:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3516 00000100:00100000:2.0:1787826386.047628:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f936d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+28:53666:x1874670563754240:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:2.0:1787826386.047776:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834a00/0x22153cd396b80b86 lrc: 3/0,1 mode: --/PW res: [0x240000404:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826386.047799:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834a00/0x22153cd396b80b86 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826386.047814:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834a00/0x22153cd396b80b86 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826386.048148:0:32404:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004775112f reply state 00000000f9dbb8b8 transno 4294967676 ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834a00/0x22153cd396b80b86 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826386.048164:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834a00/0x22153cd396b80b86 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826386.048172:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xd:0x0].0x0 (ffff90cf39e67200) 00010000:00010000:2.0:1787826386.048175:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826386.048180:0:32404:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826386.048296:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f936d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:53666:x1874670563754240:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 669us (917us total) trans 4294967676 rc 0/0 00000100:00100000:2.0:1787826386.048307:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3516 00000100:00100000:1.0:1787826386.056865:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826386.057115:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563754368 00000100:00100000:3.0:1787826386.057128:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563754368 00000100:00100000:3.0:1787826386.057198:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1906 00000100:00100000:3.0:1787826386.057209:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f9343c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:53666:x1874670563754368:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826386.057232:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826386.057256:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c267dc2/0x22153cd396b80b8d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0768 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826386.057312:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008c5389e4/0x22153cd396b80b5c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab074c expref: 12 pid: 30696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826386.057322:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787826386.057326:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826386.057332:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c267dc2/0x22153cd396b80b8d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0768 expref: 12 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826386.057381:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008c5389e4/0x22153cd396b80b5c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab074c expref: 12 pid: 30696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826386.057406:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008c5389e4/0x22153cd396b80b5c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab074c expref: 12 pid: 30696 timeout: 1432 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826386.057423:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce06304000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1874670585198592:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826386.058146:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a2c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826386.063130:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826386.063749:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563754496 00000100:00100000:3.0:1787826386.063771:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563754496 00010000:00010000:3.0:1787826386.063827:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008c5389e4/0x22153cd396b80b5c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab074c expref: 13 pid: 30696 timeout: 1432 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826386.063887:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1012 00000100:00100000:3.0:1787826386.063899:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f934b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2404:x1874670563754496:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826386.063918:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826386.063948:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008c5389e4/0x22153cd396b80b5c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab074c expref: 13 pid: 30696 timeout: 1432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826386.064152:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008c5389e4/0x22153cd396b80b5c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab074c expref: 13 pid: 30696 timeout: 1432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826386.064189:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826386.064194:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826386.064202:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006c267dc2/0x22153cd396b80b8d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0768 expref: 13 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826386.064213:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c267dc2/0x22153cd396b80b8d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0768 expref: 13 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826386.064261:0:6503:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006c267dc2/0x22153cd396b80b8d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0768 expref: 13 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826386.064431:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03984000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6503:1874670585198720:192.168.203.39@tcp:105: 00000100:00100000:3.0:1787826386.065188:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a2c780 going to sleep for 11 seconds 00010000:00010000:2.0:1787826386.072965:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c5389e4/0x22153cd396b80b5c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab074c expref: 13 pid: 30696 timeout: 1432 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826386.072997:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce06304000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1874670585198592:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826386.073038:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006c267dc2/0x22153cd396b80b8d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0768 expref: 12 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826386.073057:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400600, rc 0) 00000100:00100000:2.0:1787826386.073140:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f9343c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:53666:x1874670563754368:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 15931us (16290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826386.073149:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1906 00000100:00100000:0.0:1787826386.077341:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03984000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6503:1874670585198720:192.168.203.39@tcp:105: 00010000:00010000:0.0:1787826386.077376:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826386.077551:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f934b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2404:x1874670563754496:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 13653us (14434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826386.077651:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1012 00000100:00100000:1.0:1787826386.084294:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826386.084575:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563754624 00000100:00100000:2.0:1787826386.084588:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563754624 00000100:00100000:2.0:1787826386.084660:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1907 00000100:00100000:2.0:1787826386.084672:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f935a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:53666:x1874670563754624:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826386.084695:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826386.084718:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b608887/0x22153cd396b80b94 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab076f expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826386.084758:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000003299944/0x22153cd396b80b55 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0753 expref: 9 pid: 28853 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826386.084769:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787826386.084775:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826386.084782:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b608887/0x22153cd396b80b94 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab076f expref: 9 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826386.084827:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000003299944/0x22153cd396b80b55 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0753 expref: 9 pid: 28853 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826386.084854:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000003299944/0x22153cd396b80b55 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0753 expref: 9 pid: 28853 timeout: 1432 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826386.084872:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fdc780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1874670585198848:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826386.085280:0:8437:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce05b56540 going to sleep for 11 seconds 00000100:00100000:0.0:1787826386.090257:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826386.090370:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563754752 00000100:00100000:3.0:1787826386.090382:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563754752 00010000:00010000:3.0:1787826386.090452:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000003299944/0x22153cd396b80b55 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0753 expref: 10 pid: 28853 timeout: 1432 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826386.090528:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1013 00000100:00100000:3.0:1787826386.090541:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aaf21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670563754752:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826386.090575:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826386.090605:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000003299944/0x22153cd396b80b55 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0753 expref: 10 pid: 28853 timeout: 1432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826386.090622:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000003299944/0x22153cd396b80b55 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0753 expref: 10 pid: 28853 timeout: 1432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826386.090662:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826386.090667:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826386.090676:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004b608887/0x22153cd396b80b94 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab076f expref: 10 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826386.090687:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b608887/0x22153cd396b80b94 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab076f expref: 10 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826386.090735:0:6505:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004b608887/0x22153cd396b80b94 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab076f expref: 10 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826386.090753:0:6505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03984b40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1874670585198976:192.168.203.39@tcp:105: 00000100:00100000:3.0:1787826386.090880:0:6505:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a2c780 going to sleep for 11 seconds 00000100:00100000:0.0:1787826386.094048:0:6505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03984b40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1874670585198976:192.168.203.39@tcp:105: 00010000:00010000:0.0:1787826386.094086:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826386.094217:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aaf21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670563754752:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3677us (3974us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826386.094231:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1013 00010000:00010000:2.0:1787826386.094356:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003299944/0x22153cd396b80b55 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0753 expref: 9 pid: 28853 timeout: 1432 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826386.094380:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fdc780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1874670585198848:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826386.094416:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004b608887/0x22153cd396b80b94 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab076f expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826386.094433:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834e00, rc 0) 00000100:00100000:2.0:1787826386.094462:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f935a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:53666:x1874670563754624:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 9792us (10184us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826386.094511:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1907 00000100:00100000:1.0:1787826386.098369:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826386.098432:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826386.098541:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563754880 00000100:00100000:2.0:1787826386.098553:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563754880 00000100:00100000:2.0:1787826386.098625:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563755008 00000100:00100000:2.0:1787826386.098629:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563755008 00000100:00100000:2.0:1787826386.098663:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1908 00000100:00100000:2.0:1787826386.098674:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f935e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2404:x1874670563754880:12345-192.168.203.39@tcp:2:lfs.0 00002000:00010000:2.0:1787826386.098875:0:30695:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x24:0x0] updating lvb size from disk: 16384 -> 16384 00002000:00010000:2.0:1787826386.098879:0:30695:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x24:0x0] updating lvb mtime from disk: 1787826386 -> 1787826386 00002000:00010000:2.0:1787826386.098881:0:30695:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x24:0x0] updating lvb atime from disk: 0 -> 1787826385 00002000:00010000:2.0:1787826386.098884:0:30695:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x24:0x0] updating lvb ctime from disk: 1787826386 -> 1787826386 00002000:00010000:2.0:1787826386.098886:0:30695:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x24:0x0] updating lvb blocks from disk: 32 -> 32 00000100:00100000:2.0:1787826386.098955:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f935e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563754880:12345-192.168.203.39@tcp:2:lfs.0 Request processed in 282us (603us total) trans 21474836958 rc 0/0 00000100:00100000:2.0:1787826386.098974:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1908 00000100:00100000:2.0:1787826386.098996:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1909 00000100:00100000:2.0:1787826386.099003:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f935680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2403:x1874670563755008:12345-192.168.203.39@tcp:2:lfs.0 00002000:00010000:2.0:1787826386.099091:0:30695:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787826386.099095:0:30695:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x22:0x0] updating lvb mtime from disk: 1787826386 -> 1787826386 00002000:00010000:2.0:1787826386.099097:0:30695:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787826385 00002000:00010000:2.0:1787826386.099099:0:30695:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x22:0x0] updating lvb ctime from disk: 1787826386 -> 1787826386 00002000:00010000:2.0:1787826386.099101:0:30695:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1787826386.099124:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f935680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670563755008:12345-192.168.203.39@tcp:2:lfs.0 Request processed in 121us (692us total) trans 17179869623 rc 0/0 00000100:00100000:2.0:1787826386.099130:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1909 00000100:00100000:1.0:1787826386.103271:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826386.103443:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563755264 00000100:00100000:3.0:1787826386.103457:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563755264 00000100:00100000:3.0:1787826386.103741:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1030 00000100:00100000:3.0:1787826386.103751:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f9361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:53666:x1874670563755264:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:3.0:1787826386.103940:0:6522:0:(mdt_open.c:2504:mdt_close_resync_done()) ### [0x240000404:0xd:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b80b1d lrc: 3/0,0 mode: PW/PW res: [0x240000404:0xd:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0737 expref: 30 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826386.104067:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400400/0x22153cd396b80b9b lrc: 3/0,1 mode: --/EX res: [0x240000404:0xd:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826386.104085:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b80b40 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab073e expref: 30 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826386.104101:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400400/0x22153cd396b80b9b lrc: 4/0,1 mode: --/EX res: [0x240000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826386.104140:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b80b40 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab073e expref: 30 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826386.104156:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b80b40 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab073e expref: 30 pid: 8247 timeout: 1432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826386.104172:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03987480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:6522:1874670585199104:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826386.104331:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a2c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826386.109245:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826386.109393:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563755392 00000100:00100000:3.0:1787826386.109404:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563755392 00010000:00010000:3.0:1787826386.109457:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b80b40 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab073e expref: 31 pid: 8247 timeout: 1432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826386.109539:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1014 00000100:00100000:3.0:1787826386.109550:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f937480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:2404:x1874670563755392:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826386.109583:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826386.109591:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b80b40 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab073e expref: 31 pid: 8247 timeout: 1432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826386.109606:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b80b40 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab073e expref: 31 pid: 8247 timeout: 1432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826386.109636:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xd:0x0].0x0 (ffff90cf39e67200) 00010000:00010000:3.0:1787826386.109643:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400400/0x22153cd396b80b9b lrc: 3/0,1 mode: --/EX res: [0x240000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826386.109654:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400400/0x22153cd396b80b9b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826386.109663:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400400/0x22153cd396b80b9b lrc: 4/0,1 mode: EX/EX res: [0x240000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826386.109686:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826386.109754:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f937480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:2404:x1874670563755392:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 205us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826386.109772:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1014 00010000:00010000:2.0:1787826386.110404:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b80b40 lrc: 0/0,0 mode: --/CR res: [0x240000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab073e expref: 30 pid: 8247 timeout: 1432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826386.110425:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03987480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:6522:1874670585199104:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826386.110449:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400400/0x22153cd396b80b9b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826386.110459:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400400/0x22153cd396b80b9b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826386.110464:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400400/0x22153cd396b80b9b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787826386.111181:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].24, 88 off10040 00000004:00080000:2.0:1787826386.111197:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1332122724734ns, next at 1201607267971ns, rc = 0 00000040:00080000:2.0:1787826386.111227:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].22, 88 off9864 00000004:00080000:2.0:1787826386.111233:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1332122761483ns, next at 1201610029598ns, rc = 0 00000040:00080000:2.0:1787826386.111251:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].23, 88 off9952 00000004:00080000:2.0:1787826386.111255:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1332122783084ns, next at 1201610029598ns, rc = 0 00000040:00080000:2.0:1787826386.111270:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].25, 88 off10128 00000004:00080000:2.0:1787826386.111274:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1332122802108ns, next at 1201607267971ns, rc = 0 00000001:00080000:2.0:1787826386.114064:0:7449:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967677 is committed 00000004:00080000:2.0:1787826386.114081:0:7449:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 27 committed 00000004:00080000:2.0:1787826386.114098:0:7449:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 24 committed 00000004:00080000:2.0:1787826386.114111:0:7449:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 23 committed 00000004:00080000:2.0:1787826386.114114:0:7449:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 26 committed 00000004:00010000:2.0:1787826386.114186:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bb3447f7 reply state 000000009397d881 transno 4294967677 ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400400/0x22153cd396b80b9b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826386.114214:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400400/0x22153cd396b80b9b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826386.114224:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xd:0x0].0x0 (ffff90cf39e67200) 00010000:00010000:2.0:1787826386.114226:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1787826386.114232:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787826386.114243:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xd:0x0].0x0 (ffff90cf39e67200) 00010000:00010000:2.0:1787826386.114245:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787826386.114254:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b80b1d lrc: 0/0,0 mode: --/PW res: [0x240000404:0xd:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0737 expref: 26 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1787826386.114419:0:6522:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1787826386.114433:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f9361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:53666:x1874670563755264:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 10682us (11175us total) trans 4294967677 rc 0/0 00000100:00100000:2.0:1787826386.114444:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1030 00000100:00100000:2.0:1787826386.115377:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f936580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585199232:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1787826386.115463:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826386.115555:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787826386.115561:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f934780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585199360:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1787826386.115596:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826386.115631:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585199232 00000100:00100000:2.0:1787826386.115639:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585199232 00000100:00100000:2.0:1787826386.115684:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585199360 00000100:00100000:2.0:1787826386.115687:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585199360 00000100:00100000:2.0:1787826386.115711:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1910 00000100:00100000:2.0:1787826386.115721:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+8:3646:x1874670585199232:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1787826386.115870:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1911 00000100:00100000:1.0:1787826386.115881:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+8:3646:x1874670585199360:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:1.0:1787826386.116171:0:28853:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x25:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787826386.116175:0:28853:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x25:0x0] updating lvb mtime from disk: 1787826386 -> 1787826386 00002000:00010000:1.0:1787826386.116179:0:28853:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x25:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787826386.116181:0:28853:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x25:0x0] updating lvb ctime from disk: 1787826386 -> 1787826386 00002000:00010000:1.0:1787826386.116183:0:28853:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x25:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1787826386.116236:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+9:3646:x1874670585199360:12345-0@lo:2:osp-syn-0-1.0 Request processed in 357us (638us total) trans 21474836959 rc 0/0 00000100:00100000:1.0:1787826386.116244:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1911 00000004:00080000:1.0:1787826386.116298:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3f934780/2, rc 0, transno 21474836959 00000100:00100000:1.0:1787826386.116305:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f934780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585199360:0@lo:2:osp-syn-0-1.0 00002000:00010000:2.0:1787826386.116426:0:8435:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x24:0x0] updating lvb size from disk: 16384 -> 16384 00002000:00010000:2.0:1787826386.116429:0:8435:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x24:0x0] updating lvb mtime from disk: 1787826386 -> 1787826386 00002000:00010000:2.0:1787826386.116431:0:8435:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x24:0x0] updating lvb atime from disk: 1787826385 -> 1787826385 00002000:00010000:2.0:1787826386.116433:0:8435:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x24:0x0] updating lvb ctime from disk: 1787826386 -> 1787826386 00002000:00010000:2.0:1787826386.116435:0:8435:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x24:0x0] updating lvb blocks from disk: 32 -> 32 00000100:00100000:2.0:1787826386.116507:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+9:3646:x1874670585199232:12345-0@lo:2:osp-syn-0-1.0 Request processed in 787us (1043us total) trans 21474836960 rc 0/0 00000100:00100000:2.0:1787826386.116518:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1910 00010000:00010000:3.0:1787826386.116693:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400400/0x22153cd396b80b9b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826386.116704:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400400/0x22153cd396b80b9b lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826386.116713:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400400/0x22153cd396b80b9b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826386.116720:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826386.116726:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400400/0x22153cd396b80b9b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826386.116734:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400400/0x22153cd396b80b9b lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826386.116754:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xd:0x0].0x0 (ffff90cf39e67200) 00010000:00010000:3.0:1787826386.116757:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826386.116763:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400400/0x22153cd396b80b9b lrc: 2/0,0 mode: --/TXN res: [0x240000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826386.116770:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400400/0x22153cd396b80b9b lrc: 0/0,0 mode: --/TXN res: [0x240000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826386.116874:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03987c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585199488:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1787826386.116918:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826386.116949:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787826386.116955:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce039861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585199616:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1787826386.117107:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826386.117145:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585199488 00000100:00100000:3.0:1787826386.117151:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585199488 00000100:00100000:3.0:1787826386.117188:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585199616 00000100:00100000:3.0:1787826386.117191:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585199616 00000100:00100000:3.0:1787826386.117211:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1912 00000100:00100000:3.0:1787826386.117218:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf2f795450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3644:x1874670585199488:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1787826386.117326:0:14864:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787826386.117330:0:14864:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x22:0x0] updating lvb mtime from disk: 1787826386 -> 1787826386 00002000:00010000:3.0:1787826386.117332:0:14864:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x22:0x0] updating lvb atime from disk: 1787826385 -> 1787826385 00002000:00010000:3.0:1787826386.117334:0:14864:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x22:0x0] updating lvb ctime from disk: 1787826386 -> 1787826386 00002000:00010000:3.0:1787826386.117337:0:14864:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1787826386.117372:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf2f795450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+7:3644:x1874670585199488:12345-0@lo:2:osp-syn-1-1.0 Request processed in 155us (453us total) trans 17179869624 rc 0/0 00000100:00100000:3.0:1787826386.117380:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1912 00000100:00100000:3.0:1787826386.117598:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1913 00000100:00100000:3.0:1787826386.117604:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03986940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3644:x1874670585199616:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1787826386.117660:0:14864:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x23:0x0] updating lvb size from disk: 16384 -> 16384 00002000:00010000:3.0:1787826386.117663:0:14864:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x23:0x0] updating lvb mtime from disk: 1787826386 -> 1787826386 00002000:00010000:3.0:1787826386.117666:0:14864:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x23:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787826386.117668:0:14864:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x23:0x0] updating lvb ctime from disk: 1787826386 -> 1787826386 00002000:00010000:3.0:1787826386.117670:0:14864:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x23:0x0] updating lvb blocks from disk: 32 -> 32 00000100:00100000:3.0:1787826386.117698:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03986940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+7:3644:x1874670585199616:12345-0@lo:2:osp-syn-1-1.0 Request processed in 94us (590us total) trans 17179869625 rc 0/0 00000100:00100000:3.0:1787826386.117704:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1913 00000100:00100000:3.0:1787826386.117745:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179869620 gen 2 00000004:00080000:3.0:1787826386.117752:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce06305680, transno 17179869616 00000004:00080000:3.0:1787826386.117761:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce06307480, transno 17179869617 00000004:00080000:3.0:1787826386.117764:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce06306d00, transno 17179869619 00000004:00080000:3.0:1787826386.117767:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce06307840, transno 17179869620 00000100:00100000:3.0:1787826386.117775:0:3644:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff90ce039861c0 x1874670585199616/t17179869625(17179869625) o2->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 440/432 e 0 to 0 dl 1787826402 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1787826386.117787:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce039861c0/2, rc 0, transno 17179869625 00000100:00100000:3.0:1787826386.117794:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce039861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585199616:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1787826386.117807:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce03987c00/2, rc 0, transno 17179869624 00000100:00100000:3.0:1787826386.117810:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03987c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585199488:0@lo:2:osp-syn-1-1.0 00000004:00080000:1.0:1787826386.118449:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3f936580/2, rc 0, transno 21474836960 00000100:00100000:1.0:1787826386.118460:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f936580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585199232:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1787826386.118735:0:9964:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 0 changes, 2 in progress, 0 in flight, 4 done 00000100:00100000:3.0:1787826386.121520:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826386.121681:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563755520 00000100:00100000:2.0:1787826386.121694:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563755520 00000100:00100000:2.0:1787826386.121758:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3517 00000100:00100000:2.0:1787826386.121770:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03984f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:53666:x1874670563755520:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826386.121801:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826386.121828:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834400/0x22153cd396b80ba2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0776 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826386.121909:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834400/0x22153cd396b80ba2 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0776 expref: 27 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826386.121926:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834400/0x22153cd396b80ba2 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0776 expref: 27 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826386.121949:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xd:0x0].0x0 (ffff90cf39e67200) 00010000:00010000:2.0:1787826386.121953:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826386.121966:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834400, rc 0) 00000100:00100000:2.0:1787826386.122030:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03984f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:53666:x1874670563755520:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 262us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826386.122038:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3517 00010000:00010000:0.0:1787826386.123202:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834800/0x22153cd396b80b71 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.123219:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834800/0x22153cd396b80b71 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.123227:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834800/0x22153cd396b80b71 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.123233:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826386.123238:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834800/0x22153cd396b80b71 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.123246:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834800/0x22153cd396b80b71 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.123264:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xd:0x0].0x0 (ffff90cf39e67200) 00010000:00010000:0.0:1787826386.123267:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826386.123271:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834800/0x22153cd396b80b71 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.123279:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834800/0x22153cd396b80b71 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.123297:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834a00/0x22153cd396b80b86 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.123303:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834a00/0x22153cd396b80b86 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.123309:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834a00/0x22153cd396b80b86 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.123313:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826386.123316:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834a00/0x22153cd396b80b86 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.123321:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834a00/0x22153cd396b80b86 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.123328:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xd:0x0].0x0 (ffff90cf39e67200) 00010000:00010000:0.0:1787826386.123330:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826386.123333:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834a00/0x22153cd396b80b86 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.123339:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834a00/0x22153cd396b80b86 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826386.126257:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826386.126707:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563755776 00000100:00100000:3.0:1787826386.126720:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563755776 00000100:00100000:3.0:1787826386.126794:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1031 00000100:00100000:3.0:1787826386.126806:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f937840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:53666:x1874670563755776:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:3.0:1787826386.127344:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f937840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:53666:x1874670563755776:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 537us (1097us total) trans 4294967678 rc 0/0 00000100:00100000:3.0:1787826386.127352:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1031 00000100:00100000:2.0:1787826386.165550:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826386.165752:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563756032 00000100:00100000:0.0:1787826386.166248:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563756032 00000100:00100000:0.0:1787826386.166318:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3518 00000100:00100000:0.0:1787826386.166330:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fde580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:53668:x1874670563756032:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826386.166363:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826386.166404:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661c00/0x22153cd396b80ba9 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab077d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.166549:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661400/0x22153cd396b80bb0 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.167746:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661400/0x22153cd396b80bb0 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.167771:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661400/0x22153cd396b80bb0 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.167808:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661800/0x22153cd396b80bb7 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.167820:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661800/0x22153cd396b80bb7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.168025:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661800/0x22153cd396b80bb7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.168148:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661400/0x22153cd396b80bb0 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.168157:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661400/0x22153cd396b80bb0 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.168163:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661400/0x22153cd396b80bb0 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.168170:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661400/0x22153cd396b80bb0 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.168179:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05661400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826386.168184:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661400/0x22153cd396b80bb0 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.168192:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661400/0x22153cd396b80bb0 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.168207:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff90cf371d2d00) 00010000:00010000:0.0:1787826386.168210:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826386.168216:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661400/0x22153cd396b80bb0 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.168222:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661400/0x22153cd396b80bb0 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.168241:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661800/0x22153cd396b80bb7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.168247:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661800/0x22153cd396b80bb7 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.168252:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661800/0x22153cd396b80bb7 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.168257:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05661800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826386.168260:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661800/0x22153cd396b80bb7 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.168265:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661800/0x22153cd396b80bb7 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.168277:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x98a5b8df (ffff90cf371d2300) 00010000:00010000:0.0:1787826386.168280:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826386.168283:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661800/0x22153cd396b80bb7 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.168289:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661800/0x22153cd396b80bb7 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.168346:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661c00/0x22153cd396b80ba9 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab077d expref: 26 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.168359:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff90cf371d2d00) 00010000:00010000:0.0:1787826386.168361:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787826386.168365:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661c00/0x22153cd396b80ba9 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab077d expref: 26 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.169935:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05661c00, rc 0) 00000100:00100000:0.0:1787826386.170061:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fde580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:53668:x1874670563756032:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 3726us (4519us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826386.170073:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3518 00000100:00100000:3.0:1787826386.174605:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826386.174682:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563756288 00000100:00100000:0.0:1787826386.174696:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563756288 00000100:00100000:0.0:1787826386.174787:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3519 00000100:00100000:0.0:1787826386.174799:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03987840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+29:53668:x1874670563756288:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826386.175298:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826386.175333:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661000/0x22153cd396b80bbe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0784 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826386.175670:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x17:0x0]: returning size 4096 00010000:00010000:0.0:1787826386.175967:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661000/0x22153cd396b80bbe lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0784 expref: 31 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.175985:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ce01f45300) 00010000:00010000:0.0:1787826386.175988:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787826386.175994:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661000/0x22153cd396b80bbe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0784 expref: 31 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.176013:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05661000, rc 0) 00000100:00100000:0.0:1787826386.176092:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03987840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:53668:x1874670563756288:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1295us (1502us total) trans 8589934695 rc 301/301 00000100:00100000:0.0:1787826386.176102:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3519 00000100:00100000:3.0:1787826386.178424:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826386.178969:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563756416 00000100:00100000:0.0:1787826386.178982:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563756416 00000100:00100000:0.0:1787826386.179053:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3520 00000100:00100000:0.0:1787826386.179064:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce039852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:53668:x1874670563756416:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:0.0:1787826386.179159:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b80bcc lrc: 3/1,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.179181:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b80bcc lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.179196:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b80bcc lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.179209:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661a00/0x22153cd396b80bd3 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.179217:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661a00/0x22153cd396b80bd3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.179224:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661a00/0x22153cd396b80bd3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.179313:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80bda lrc: 3/1,0 mode: --/PR res: [0x240000404:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.179322:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80bda lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.179329:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80bda lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826386.179381:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0xd:0x0]: returning size 16384 00000004:00200000:0.0:1787826386.179397:0:32404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826386.179412:0:32404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80bda lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.179430:0:32404:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b80bcc lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.179438:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b80bcc lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.179446:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b80bcc lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.179453:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b80bcc lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.179465:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05660a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826386.179506:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b80bcc lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.179516:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b80bcc lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.179530:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff90cf371d2800) 00010000:00010000:0.0:1787826386.179533:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826386.179539:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b80bcc lrc: 3/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.179546:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b80bcc lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.179570:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661a00/0x22153cd396b80bd3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.179577:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661a00/0x22153cd396b80bd3 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.179584:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661a00/0x22153cd396b80bd3 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.179589:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05661a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826386.179592:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661a00/0x22153cd396b80bd3 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.179599:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661a00/0x22153cd396b80bd3 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.179611:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x98a5b8df (ffff90cf371d2200) 00010000:00010000:0.0:1787826386.179613:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826386.179616:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661a00/0x22153cd396b80bd3 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.179622:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661a00/0x22153cd396b80bd3 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.179636:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80bda lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.179642:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80bda lrc: 2/0,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.179649:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80bda lrc: 3/0,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.179654:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05660400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826386.179657:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80bda lrc: 3/0,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.179663:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80bda lrc: 4/0,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.179671:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xd:0x0].0x0 (ffff90cf39e67200) 00010000:00010000:0.0:1787826386.179674:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826386.179677:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80bda lrc: 2/0,0 mode: --/PR res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.179683:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80bda lrc: 0/0,0 mode: --/PR res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826386.179802:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce039852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:53668:x1874670563756416:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 739us (1391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826386.179810:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3520 00000100:00100000:3.0:1787826386.185008:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826386.185319:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563756672 00000100:00100000:2.0:1787826386.185331:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563756672 00000100:00100000:2.0:1787826386.185403:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1032 00000100:00100000:2.0:1787826386.185414:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf18582c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:53668:x1874670563756672:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:2.0:1787826386.185790:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf18582c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:53668:x1874670563756672:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 375us (795us total) trans 8589934696 rc 0/0 00000100:00100000:2.0:1787826386.185798:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1032 00000100:00100000:2.0:1787826386.205676:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826386.205862:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563756928 00000100:00100000:0.0:1787826386.205873:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563756928 00000100:00100000:0.0:1787826386.205947:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3521 00000100:00100000:0.0:1787826386.205959:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fde1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:53670:x1874670563756928:12345-192.168.203.39@tcp:101:multiop.0 00010000:00010000:0.0:1787826386.205987:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826386.206016:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80be1 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab078b expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.206179:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661a00/0x22153cd396b80be8 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.206193:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661a00/0x22153cd396b80be8 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.206203:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661a00/0x22153cd396b80be8 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.206212:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b80bef lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.206217:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b80bef lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.206221:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b80bef lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.206286:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b80bf6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.206295:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b80bf6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.206302:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b80bf6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826386.206314:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0xd:0x0]: returning size 16384 00010000:00010000:0.0:1787826386.206428:0:9966:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661a00/0x22153cd396b80be8 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.206436:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661a00/0x22153cd396b80be8 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.206443:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661a00/0x22153cd396b80be8 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.206450:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661a00/0x22153cd396b80be8 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.206457:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05661a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826386.206462:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661a00/0x22153cd396b80be8 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.209809:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661a00/0x22153cd396b80be8 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.209920:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff90cf371d2200) 00010000:00010000:0.0:1787826386.209924:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826386.209934:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661a00/0x22153cd396b80be8 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.209943:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661a00/0x22153cd396b80be8 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.209969:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b80bef lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.209977:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b80bef lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.209984:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b80bef lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.209990:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05660a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826386.209995:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b80bef lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.210002:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b80bef lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.210011:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x98a5b8df (ffff90cf371d2800) 00010000:00010000:0.0:1787826386.210013:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826386.210016:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b80bef lrc: 2/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.210022:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b80bef lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826386.212019:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80be1 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab078b expref: 28 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826386.212065:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b80bf6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab078b expref: 27 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826386.212075:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xd:0x0].0x0 (ffff90cf39e67200) 00010000:00010000:2.0:1787826386.212078:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826386.212081:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05661000, rc 0) 00000100:00100000:2.0:1787826386.212180:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fde1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:53670:x1874670563756928:12345-192.168.203.39@tcp:101:multiop.0 Request processed in 6222us (6518us total) trans 4294967679 rc 0/0 00000100:00100000:2.0:1787826386.212191:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3521 00000100:00100000:3.0:1787826386.215492:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826386.217120:0:30175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563757056 00000100:00100000:1.0:1787826386.217138:0:30175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563757056 00002000:00100000:1.0:1787826386.217214:0:30175:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x280000400:0x24:0x0] (0->4095) req@ffff90ce039843c0 x1874670563757056/t0(0) o3->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:742/0 lens 488/0 e 0 to 0 dl 1787826397 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826386.217234:0:30175:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce039843c0 with x1874670563757056 ext(0->4095) 00002000:00010000:1.0:1787826386.217242:0:30175:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90ce039843c0 00000100:00100000:1.0:1787826386.217332:0:30175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 728 00000100:00100000:1.0:1787826386.217344:0:30175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce039843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2401:x1874670563757056:12345-192.168.203.39@tcp:3:lfs.0 00000100:00100000:1.0:1787826386.217754:0:30175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce039843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2401:x1874670563757056:12345-192.168.203.39@tcp:3:lfs.0 Request processed in 411us (2290us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787826386.217820:0:30175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 728 00002000:00100000:1.0:1787826386.217828:0:30175:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x280000400:0x24:0x0] (0->4095) req@ffff90ce039843c0 x1874670563757056/t0(0) o3->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:742/0 lens 488/4536 e 0 to 0 dl 1787826397 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826386.217909:0:30175:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce039843c0 with x1874670563757056 ext(0->4095) 00002000:00010000:1.0:1787826386.217913:0:30175:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90ce039843c0 00000100:00100000:3.0:1787826386.221320:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826386.222044:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563757312 00000100:00100000:0.0:1787826386.222057:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563757312 00000100:00100000:0.0:1787826386.222178:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3522 00000100:00100000:0.0:1787826386.222191:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03985680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:53670:x1874670563757312:12345-192.168.203.39@tcp:101:multiop.0 00010000:00010000:0.0:1787826386.222222:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826386.222226:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:0.0:1787826386.222260:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834400/0x22153cd396b80ba2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0776 expref: 27 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.222288:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b80bf6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab078b expref: 26 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.222301:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xd:0x0].0x0 (ffff90cf39e67200) 00010000:00010000:0.0:1787826386.222307:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826386.222325:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661c00/0x22153cd396b80c04 lrc: 2/0,0 mode: --/EX res: [0x240000404:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0792 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.222396:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661800/0x22153cd396b80c0b lrc: 3/0,1 mode: --/EX res: [0x240000404:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.222412:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661800/0x22153cd396b80c0b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0xd:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.222423:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661800/0x22153cd396b80c0b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0xd:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787826386.223034:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].26, 88 off10216 00000004:00080000:0.0:1787826386.223045:0:6519:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1332234572880ns, next at 1201607267971ns, rc = 0 00000040:00080000:0.0:1787826386.223075:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].24, 88 off10040 00000004:00080000:0.0:1787826386.223079:0:6519:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1332234607542ns, next at 1201610029598ns, rc = 0 00000040:00080000:0.0:1787826386.223142:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].25, 88 off10128 00000004:00080000:0.0:1787826386.223147:0:6519:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1332234675412ns, next at 1201610029598ns, rc = 0 00000040:00080000:0.0:1787826386.223500:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].27, 88 off10304 00000004:00080000:0.0:1787826386.223507:0:6519:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1332235035105ns, next at 1201607267971ns, rc = 0 00000001:00080000:3.0:1787826386.225540:0:7449:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967680 is committed 00000004:00080000:3.0:1787826386.225692:0:7449:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 29 committed 00000004:00080000:3.0:1787826386.225755:0:7449:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 26 committed 00000100:00100000:2.0:1787826386.225939:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fdc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585199872:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1787826386.226039:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826386.226088:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787826386.226095:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fdcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585199744:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1787826386.226117:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826386.226977:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585199872 00000100:00100000:2.0:1787826386.226990:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585199872 00000100:00100000:2.0:1787826386.227094:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585199744 00000100:00100000:2.0:1787826386.227100:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585199744 00000100:00100000:0.0:1787826386.227283:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1914 00000100:00100000:0.0:1787826386.227296:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06304b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+8:3647:x1874670585199872:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1787826386.227527:0:28853:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x23:0x0] updating lvb size from disk: 16384 -> 16384 00002000:00010000:0.0:1787826386.227532:0:28853:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x23:0x0] updating lvb mtime from disk: 1787826386 -> 1787826386 00002000:00010000:0.0:1787826386.227535:0:28853:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x23:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787826386.227537:0:28853:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x23:0x0] updating lvb ctime from disk: 1787826386 -> 1787826386 00002000:00010000:0.0:1787826386.227539:0:28853:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x23:0x0] updating lvb blocks from disk: 32 -> 32 00000100:00100000:0.0:1787826386.227637:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06304b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+9:3647:x1874670585199872:12345-0@lo:2:osp-syn-1-1.0 Request processed in 343us (1597us total) trans 17179869626 rc 0/0 00000100:00100000:0.0:1787826386.227645:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1914 00000100:00100000:0.0:1787826386.227665:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1915 00000100:00100000:0.0:1787826386.227672:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06305680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+8:3647:x1874670585199744:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1787826386.227728:0:28853:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787826386.227731:0:28853:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x22:0x0] updating lvb mtime from disk: 1787826386 -> 1787826386 00002000:00010000:0.0:1787826386.227733:0:28853:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x22:0x0] updating lvb atime from disk: 1787826385 -> 1787826385 00002000:00010000:0.0:1787826386.227735:0:28853:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x22:0x0] updating lvb ctime from disk: 1787826386 -> 1787826386 00002000:00010000:0.0:1787826386.227737:0:28853:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1787826386.227763:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06305680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+9:3647:x1874670585199744:12345-0@lo:2:osp-syn-1-1.0 Request processed in 91us (1644us total) trans 17179869627 rc 0/0 00000100:00100000:0.0:1787826386.227770:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1915 00000004:00080000:0.0:1787826386.227820:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce01fdcf00/2, rc 0, transno 17179869627 00000100:00100000:0.0:1787826386.227827:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fdcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585199744:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1787826386.227951:0:7449:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 25 committed 00000004:00080000:3.0:1787826386.227956:0:7449:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 28 committed 00000004:00080000:0.0:1787826386.228151:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce01fdc780/2, rc 0, transno 17179869626 00000100:00100000:0.0:1787826386.228157:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fdc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585199872:0@lo:2:osp-syn-1-1.0 00010000:00010000:0.0:1787826386.228233:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661800/0x22153cd396b80c0b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0xd:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0792 expref: 25 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.228249:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xd:0x0].0x0 (ffff90cf39e67200) 00010000:00010000:0.0:1787826386.228253:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1787826386.228273:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661c00/0x22153cd396b80c04 lrc: 0/0,0 mode: --/EX res: [0x240000404:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0792 expref: 25 pid: 6519 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.228296:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661800/0x22153cd396b80c0b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0xd:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0792 expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.228331:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xd:0x0].0x0 (ffff90cf39e67200) 00010000:00010000:0.0:1787826386.228334:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1787826386.228337:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05661800, rc 0) 00000100:00100000:0.0:1787826386.228458:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03985680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:53670:x1874670563757312:12345-192.168.203.39@tcp:101:multiop.0 Request processed in 6269us (7154us total) trans 4294967680 rc 0/0 00000100:00100000:0.0:1787826386.228466:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3522 00000100:00100000:1.0:1787826386.228748:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f9352c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585200000:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1787826386.228800:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826386.228913:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787826386.228921:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f9361c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585200128:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1787826386.228945:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826386.228994:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585200000 00000100:00100000:1.0:1787826386.229001:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585200000 00000100:00100000:1.0:1787826386.229038:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585200128 00000100:00100000:1.0:1787826386.229040:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585200128 00000100:00100000:1.0:1787826386.229060:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1916 00000100:00100000:1.0:1787826386.229067:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f937840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+10:3644:x1874670585200000:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:1.0:1787826386.229190:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x24:0x0] updating lvb size from disk: 16384 -> 16384 00002000:00010000:1.0:1787826386.229193:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x24:0x0] updating lvb mtime from disk: 1787826386 -> 1787826386 00002000:00010000:1.0:1787826386.229197:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x24:0x0] updating lvb atime from disk: 1787826385 -> 1787826385 00002000:00010000:1.0:1787826386.229199:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x24:0x0] updating lvb ctime from disk: 1787826386 -> 1787826386 00002000:00010000:1.0:1787826386.229202:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x24:0x0] updating lvb blocks from disk: 32 -> 32 00000100:00100000:1.0:1787826386.229234:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f937840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+11:3644:x1874670585200000:12345-0@lo:2:osp-syn-0-1.0 Request processed in 168us (434us total) trans 21474836961 rc 0/0 00000100:00100000:1.0:1787826386.229241:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1916 00000100:00100000:1.0:1787826386.229257:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1917 00000100:00100000:1.0:1787826386.229262:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f9343c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+10:3644:x1874670585200128:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:1.0:1787826386.229310:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x25:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787826386.229313:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x25:0x0] updating lvb mtime from disk: 1787826386 -> 1787826386 00002000:00010000:1.0:1787826386.229315:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x25:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787826386.229317:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x25:0x0] updating lvb ctime from disk: 1787826386 -> 1787826386 00002000:00010000:1.0:1787826386.229320:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x25:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1787826386.229343:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f9343c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+11:3644:x1874670585200128:12345-0@lo:2:osp-syn-0-1.0 Request processed in 81us (397us total) trans 21474836962 rc 0/0 00000100:00100000:1.0:1787826386.229350:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1917 00000004:00080000:1.0:1787826386.229402:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3f9361c0/2, rc 0, transno 21474836962 00000100:00100000:1.0:1787826386.229409:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f9361c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585200128:0@lo:2:osp-syn-0-1.0 00000004:00080000:1.0:1787826386.229418:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3f9352c0/2, rc 0, transno 21474836961 00000100:00100000:1.0:1787826386.229421:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f9352c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585200000:0@lo:2:osp-syn-0-1.0 00010000:00010000:1.0:1787826386.246228:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826386.249977:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826386.250151:0:25423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563757440 00000100:00100000:2.0:1787826386.250163:0:25423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563757440 00002000:00100000:2.0:1787826386.250228:0:25423:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000400:0x24:0x0] (0->4095) req@ffff90ce03987480 x1874670563757440/t0(0) o3->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:742/0 lens 488/0 e 0 to 0 dl 1787826397 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826386.250241:0:25423:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce03987480 with x1874670563757440 ext(0->4095) 00002000:00010000:2.0:1787826386.250248:0:25423:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90ce03987480 00000100:00100000:2.0:1787826386.250320:0:25423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 729 00000100:00100000:2.0:1787826386.250333:0:25423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03987480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563757440:12345-192.168.203.39@tcp:3:lfs.0 00000100:00100000:2.0:1787826386.250616:0:25423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03987480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563757440:12345-192.168.203.39@tcp:3:lfs.0 Request processed in 284us (653us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787826386.250625:0:25423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 729 00002000:00100000:2.0:1787826386.250633:0:25423:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000400:0x24:0x0] (0->4095) req@ffff90ce03987480 x1874670563757440/t0(0) o3->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:742/0 lens 488/4536 e 0 to 0 dl 1787826397 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826386.250642:0:25423:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce03987480 with x1874670563757440 ext(0->4095) 00002000:00010000:2.0:1787826386.250645:0:25423:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90ce03987480 00000100:00100000:2.0:1787826386.258780:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826386.258984:0:25426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563757568 00000100:00100000:1.0:1787826386.258997:0:25426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563757568 00002000:00100000:1.0:1787826386.259065:0:25426:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000400:0x24:0x0] (4096->8191) req@ffff90ce06307480 x1874670563757568/t0(0) o3->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:742/0 lens 488/0 e 0 to 0 dl 1787826397 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826386.259077:0:25426:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce06307480 with x1874670563757568 ext(4096->8191) 00002000:00010000:1.0:1787826386.259085:0:25426:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90ce06307480 00000100:00100000:1.0:1787826386.259122:0:25426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 730 00000100:00100000:1.0:1787826386.259133:0:25426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06307480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563757568:12345-192.168.203.39@tcp:3:lfs.0 00000100:00100000:1.0:1787826386.259557:0:25426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06307480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563757568:12345-192.168.203.39@tcp:3:lfs.0 Request processed in 423us (791us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787826386.259567:0:25426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 730 00002000:00100000:1.0:1787826386.259576:0:25426:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000400:0x24:0x0] (4096->8191) req@ffff90ce06307480 x1874670563757568/t0(0) o3->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:742/0 lens 488/4536 e 0 to 0 dl 1787826397 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826386.259584:0:25426:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce06307480 with x1874670563757568 ext(4096->8191) 00002000:00010000:1.0:1787826386.259588:0:25426:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90ce06307480 00000100:00100000:1.0:1787826386.268014:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826386.268162:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563757696 00000100:00100000:3.0:1787826386.268176:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563757696 00002000:00100000:3.0:1787826386.268245:0:8442:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x24:0x0] (8192->12287) req@ffff90cf3f935a40 x1874670563757696/t0(0) o3->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:742/0 lens 488/0 e 0 to 0 dl 1787826397 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826386.268257:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf3f935a40 with x1874670563757696 ext(8192->12287) 00002000:00010000:3.0:1787826386.268327:0:8442:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf3f935a40 00000100:00100000:3.0:1787826386.268411:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 731 00000100:00100000:3.0:1787826386.268424:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f935a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2401:x1874670563757696:12345-192.168.203.39@tcp:3:lfs.0 00000100:00100000:3.0:1787826386.268708:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f935a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2401:x1874670563757696:12345-192.168.203.39@tcp:3:lfs.0 Request processed in 287us (1279us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787826386.268717:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 731 00002000:00100000:3.0:1787826386.268724:0:8442:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x24:0x0] (8192->12287) req@ffff90cf3f935a40 x1874670563757696/t0(0) o3->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:742/0 lens 488/4536 e 0 to 0 dl 1787826397 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826386.268733:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf3f935a40 with x1874670563757696 ext(8192->12287) 00002000:00010000:3.0:1787826386.268736:0:8442:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf3f935a40 00000100:00100000:1.0:1787826386.281026:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826386.281152:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563757824 00000100:00100000:3.0:1787826386.281165:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563757824 00002000:00100000:3.0:1787826386.281232:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x24:0x0] (12288->16383) req@ffff90cf3f935e00 x1874670563757824/t0(0) o3->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:742/0 lens 488/0 e 0 to 0 dl 1787826397 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826386.281245:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf3f935e00 with x1874670563757824 ext(12288->16383) 00002000:00010000:3.0:1787826386.281253:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf3f935e00 00000100:00100000:3.0:1787826386.281352:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 732 00000100:00100000:3.0:1787826386.281365:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f935e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563757824:12345-192.168.203.39@tcp:3:lfs.0 00000100:00100000:3.0:1787826386.281668:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f935e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563757824:12345-192.168.203.39@tcp:3:lfs.0 Request processed in 304us (657us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787826386.281684:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 732 00002000:00100000:3.0:1787826386.281692:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x24:0x0] (12288->16383) req@ffff90cf3f935e00 x1874670563757824/t0(0) o3->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:742/0 lens 488/4536 e 0 to 0 dl 1787826397 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826386.281700:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf3f935e00 with x1874670563757824 ext(12288->16383) 00002000:00010000:3.0:1787826386.281703:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf3f935e00 00000100:00100000:2.0:1787826386.292073:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826386.299585:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563758080 00000100:00100000:3.0:1787826386.299607:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563758080 00000100:00100000:3.0:1787826386.299719:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1033 00000100:00100000:3.0:1787826386.299732:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06306d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:53670:x1874670563758080:12345-192.168.203.39@tcp:35:multiop.0 00000100:00100000:3.0:1787826386.300340:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06306d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:53670:x1874670563758080:12345-192.168.203.39@tcp:35:multiop.0 Request processed in 608us (8278us total) trans 4294967681 rc 0/0 00000100:00100000:3.0:1787826386.300351:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1033 00000100:00100000:1.0:1787826386.347926:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826386.348042:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563758336 00000100:00100000:0.0:1787826386.348054:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563758336 00000100:00100000:0.0:1787826386.348136:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3523 00000100:00100000:0.0:1787826386.348149:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f935680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:53672:x1874670563758336:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826386.348178:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826386.348211:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661c00/0x22153cd396b80c12 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0799 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.348360:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b80c19 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.348378:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b80c19 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.348402:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b80c19 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.348416:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b80c20 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.348424:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b80c20 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.348430:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b80c20 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.348578:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b80c19 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.348585:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b80c19 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.348593:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b80c19 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.348600:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05661000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826386.348604:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b80c19 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.348614:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b80c19 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.348627:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff90cf371d2800) 00010000:00010000:0.0:1787826386.348631:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826386.348638:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b80c19 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.348645:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b80c19 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.348662:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b80c20 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.349049:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b80c20 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.349058:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b80c20 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.349064:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05660a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826386.349067:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b80c20 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.349074:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b80c20 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.349082:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x98a5b8df (ffff90cf371d2d00) 00010000:00010000:0.0:1787826386.349085:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826386.349088:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b80c20 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.349094:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b80c20 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.349817:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661c00/0x22153cd396b80c12 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0799 expref: 26 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.349851:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff90cf371d2800) 00010000:00010000:0.0:1787826386.349854:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787826386.349859:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661c00/0x22153cd396b80c12 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0799 expref: 26 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.349877:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05661c00, rc 0) 00000100:00100000:1.0:1787826386.350539:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f935680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:53672:x1874670563758336:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 2388us (2622us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826386.350551:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3523 00000100:00100000:1.0:1787826386.363122:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826386.363608:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563758592 00000100:00100000:3.0:1787826386.363622:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563758592 00000100:00100000:3.0:1787826386.364399:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3524 00000100:00100000:3.0:1787826386.364420:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a1a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:53672:x1874670563758592:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826386.364456:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826386.364529:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b80c27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab07a0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826386.365191:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x17:0x0]: returning size 4096 00010000:00010000:3.0:1787826386.365330:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b80c27 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab07a0 expref: 33 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826386.365349:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ce01f45300) 00010000:00010000:3.0:1787826386.365353:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787826386.365358:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b80c27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab07a0 expref: 33 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826386.365376:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400400, rc 0) 00000100:00100000:3.0:1787826386.365590:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a1a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+32:53672:x1874670563758592:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1177us (2484us total) trans 8589934697 rc 301/301 00000100:00100000:3.0:1787826386.365599:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3524 00000100:00100000:2.0:1787826386.371319:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826386.371438:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563758720 00000100:00100000:0.0:1787826386.371451:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563758720 00000100:00100000:0.0:1787826386.371546:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3525 00000100:00100000:0.0:1787826386.371556:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06307840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:53672:x1874670563758720:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:0.0:1787826386.371672:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661c00/0x22153cd396b80c35 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.371694:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661c00/0x22153cd396b80c35 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.371709:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661c00/0x22153cd396b80c35 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.371725:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b80c3c lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.371733:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b80c3c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.371739:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b80c3c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.371838:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b80c43 lrc: 3/1,0 mode: --/PR res: [0x240000404:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.371849:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b80c43 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.371855:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b80c43 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826386.371908:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0xd:0x0]: returning size 16384 00000004:00200000:0.0:1787826386.371913:0:9966:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826386.371929:0:9966:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b80c43 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.371946:0:9966:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661c00/0x22153cd396b80c35 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.371954:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661c00/0x22153cd396b80c35 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.371965:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661c00/0x22153cd396b80c35 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.371973:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661c00/0x22153cd396b80c35 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.371979:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05661c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826386.371983:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661c00/0x22153cd396b80c35 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.371991:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661c00/0x22153cd396b80c35 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.372005:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff90cf371d2800) 00010000:00010000:0.0:1787826386.372097:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826386.372104:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661c00/0x22153cd396b80c35 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.372111:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661c00/0x22153cd396b80c35 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.372134:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b80c3c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.372140:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b80c3c lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.372149:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b80c3c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.372157:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05660a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826386.372160:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b80c3c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.372166:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b80c3c lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.372173:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x98a5b8df (ffff90cf371d2d00) 00010000:00010000:0.0:1787826386.372177:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826386.372180:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b80c3c lrc: 2/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.372185:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b80c3c lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x98a5b8df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.372196:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b80c43 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.372209:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b80c43 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.372215:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b80c43 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.372219:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05661000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826386.372221:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b80c43 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.372226:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b80c43 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.372232:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xd:0x0].0x0 (ffff90cf39e67200) 00010000:00010000:0.0:1787826386.372234:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826386.372236:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b80c43 lrc: 2/0,0 mode: --/PR res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826386.372241:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b80c43 lrc: 0/0,0 mode: --/PR res: [0x240000404:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826386.372420:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06307840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:53672:x1874670563758720:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 863us (1118us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826386.372428:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3525 00000100:00100000:1.0:1787826386.378451:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826386.378770:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563758976 00000100:00100000:2.0:1787826386.378784:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563758976 00000100:00100000:2.0:1787826386.378855:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1034 00000100:00100000:2.0:1787826386.378866:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a19680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+32:53672:x1874670563758976:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:2.0:1787826386.379261:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a19680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:53672:x1874670563758976:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 394us (822us total) trans 8589934698 rc 0/0 00000100:00100000:2.0:1787826386.379270:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1034 00000100:00100000:1.0:1787826387.204035:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03a18780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585200640:0@lo:400:kworker.0 00000100:00100000:1.0:1787826387.204125:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826387.204171:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03a18f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874670585201152:0@lo:400:kworker.0 00000100:00100000:1.0:1787826387.204197:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826387.204212:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03a192c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585201664:0@lo:400:kworker.0 00000100:00100000:1.0:1787826387.204231:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826387.204257:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1787826387.204262:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03a1b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e3c550b8-2c3c-46c3-ad36-671c284167ea:3645:1874670585200512:0@lo:400:kworker.0 00000100:00100000:1.0:1787826387.204288:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826387.204314:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03a1a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585201024:0@lo:400:kworker.0 00000100:00100000:1.0:1787826387.204340:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826387.204356:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03a19e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874670585201536:0@lo:400:kworker.0 00000100:00100000:1.0:1787826387.204397:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826387.204416:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab14f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874670585202048:0@lo:400:kworker.0 00000100:00100000:1.0:1787826387.204436:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826387.204497:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585200640 00000100:00100000:1.0:1787826387.204506:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585200640 00000100:00100000:1.0:1787826387.204632:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585201664 00000100:00100000:1.0:1787826387.204636:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585201664 00000100:00100000:1.0:1787826387.204660:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1376 00000100:00100000:1.0:1787826387.204670:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab17840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3645:x1874670585200640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826387.204735:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab17840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3645:x1874670585200640:12345-0@lo:400:kworker.0 Request processed in 65us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826387.204743:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1376 00000100:00100000:1.0:1787826387.204764:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1377 00000100:00100000:1.0:1787826387.204769:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874670585201664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826387.204799:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874670585201664:12345-0@lo:400:kworker.0 Request processed in 30us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826387.204805:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1377 00000100:00100000:1.0:1787826387.204827:0:34488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585200512 00000100:00100000:1.0:1787826387.204831:0:34488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585200512 00000100:00100000:1.0:1787826387.204864:0:34488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787826387.204870:0:34488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf0819b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3c550b8-2c3c-46c3-ad36-671c284167ea+24:3645:x1874670585200512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826387.204900:0:34488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf0819b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3c550b8-2c3c-46c3-ad36-671c284167ea+24:3645:x1874670585200512:12345-0@lo:400:kworker.0 Request processed in 31us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826387.204906:0:34488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787826387.204935:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585201152 00000100:00100000:1.0:1787826387.204939:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585201152 00000100:00100000:1.0:1787826387.204976:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585201536 00000100:00100000:1.0:1787826387.204979:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585201536 00000100:00100000:1.0:1787826387.204994:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585202048 00000100:00100000:1.0:1787826387.204996:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585202048 00000100:00100000:1.0:1787826387.205013:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1537 00000100:00100000:1.0:1787826387.205019:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab15680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874670585201152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826387.205049:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab15680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874670585201152:12345-0@lo:400:kworker.0 Request processed in 31us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826387.205056:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1537 00000100:00100000:1.0:1787826387.205066:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1538 00000100:00100000:1.0:1787826387.205072:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab15a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874670585201536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826387.205094:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab15a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874670585201536:12345-0@lo:400:kworker.0 Request processed in 23us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826387.205101:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1538 00000100:00100000:1.0:1787826387.205109:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1539 00000100:00100000:1.0:1787826387.205114:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab16d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874670585202048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826387.205134:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab16d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874670585202048:12345-0@lo:400:kworker.0 Request processed in 20us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826387.205139:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1539 00000100:00080000:1.0:1787826387.205162:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787826387.205167:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787826387.205201:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03a1b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e3c550b8-2c3c-46c3-ad36-671c284167ea:3645:1874670585200512:0@lo:400:kworker.0 00000100:00100000:1.0:1787826387.205218:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03a19e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874670585201536:0@lo:400:kworker.0 00000100:00100000:1.0:1787826387.205229:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab14f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874670585202048:0@lo:400:kworker.0 00000100:00100000:1.0:1787826387.205239:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03a18780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585200640:0@lo:400:kworker.0 00000100:00100000:1.0:1787826387.205253:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03a18f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874670585201152:0@lo:400:kworker.0 00000100:00100000:1.0:1787826387.205264:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967659 gen 2 00000004:00080000:1.0:1787826387.205271:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967659 committed transno 4294967659 00000100:00100000:1.0:1787826387.205333:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03a192c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585201664:0@lo:400:kworker.0 00000100:00100000:1.0:1787826387.205422:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03984b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585200384:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826387.205458:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826387.205510:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03a19a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585200896:0@lo:400:kworker.0 00000100:00100000:1.0:1787826387.205536:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826387.205662:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585200384 00000100:00100000:3.0:1787826387.205668:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585200384 00000100:00100000:3.0:1787826387.205707:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1378 00000100:00100000:3.0:1787826387.205717:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab14f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3647:x1874670585200384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787826387.205751:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445896192 avail 1299656704 00000100:00100000:3.0:1787826387.205799:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab14f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3647:x1874670585200384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826387.205807:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1378 00000100:00100000:3.0:1787826387.205836:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585201024 00000100:00100000:3.0:1787826387.205841:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585201024 00000100:00100000:0.0:1787826387.205858:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03a1bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585200256:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787826387.205880:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585200896 00000100:00100000:3.0:1787826387.205885:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585200896 00000100:00100000:0.0:1787826387.205900:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826387.205915:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 907 00000100:00100000:3.0:1787826387.205923:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab152c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+9:3645:x1874670585201024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826387.205931:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03a1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874670585200768:0@lo:400:kworker.0 00000100:00100000:3.0:1787826387.205968:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab152c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+9:3645:x1874670585201024:12345-0@lo:400:kworker.0 Request processed in 45us (1626us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826387.205976:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826387.205998:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 907 00000100:00100000:0.0:1787826387.206003:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03a1a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874670585201280:0@lo:400:kworker.0 00000100:00100000:3.0:1787826387.206015:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 908 00000100:00100000:3.0:1787826387.206023:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab16940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+11:3647:x1874670585200896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826387.206035:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826387.206061:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03a18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585201792:0@lo:400:kworker.0 00000100:00100000:3.0:1787826387.206066:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab16940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+11:3647:x1874670585200896:12345-0@lo:400:kworker.0 Request processed in 42us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826387.206073:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 908 00000100:00100000:0.0:1787826387.206096:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826387.206100:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585200256 00000100:00100000:3.0:1787826387.206104:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585200256 00000100:00100000:3.0:1787826387.206125:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1379 00000100:00100000:3.0:1787826387.206133:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aaf2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874670585200256:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826387.206144:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585200768 00000100:00100000:0.0:1787826387.206150:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585200768 00000004:00000024:3.0:1787826387.206154:0:7796:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446195200 avail 1299955712 00000100:00100000:0.0:1787826387.206189:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585201280 00000100:00100000:0.0:1787826387.206193:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585201280 00000100:00100000:3.0:1787826387.206197:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aaf2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874670585200256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 64us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826387.206206:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1379 00000100:00080000:3.0:1787826387.206225:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787826387.206230:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1540 00000100:00080000:3.0:1787826387.206232:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787826387.206236:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826387.206240:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aaf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874670585200768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826387.206249:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585201792 00000100:00100000:3.0:1787826387.206254:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585201792 00000100:00100000:0.0:1787826387.206279:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aaf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874670585200768:12345-0@lo:400:kworker.0 Request processed in 41us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826387.206288:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1540 00000100:00100000:3.0:1787826387.206293:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 909 00000100:00100000:3.0:1787826387.206301:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aaf3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874670585201792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826387.206313:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1541 00000100:00100000:0.0:1787826387.206322:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aaf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874670585201280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826387.206340:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aaf3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874670585201792:12345-0@lo:400:kworker.0 Request processed in 39us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826387.206347:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 909 00000100:00100000:0.0:1787826387.206364:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aaf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874670585201280:12345-0@lo:400:kworker.0 Request processed in 43us (329us total) trans 0 rc 0/0 00000100:00080000:3.0:1787826387.206365:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826387.206374:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1541 00000100:00100000:3.0:1787826387.206410:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03a1bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585200256:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787826387.206424:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03a1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874670585200768:0@lo:400:kworker.0 00000100:00100000:3.0:1787826387.206438:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03a1a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874670585201280:0@lo:400:kworker.0 00000100:00100000:3.0:1787826387.206449:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03a18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585201792:0@lo:400:kworker.0 00000100:00100000:0.0:1787826387.206502:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03a1a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585201024:0@lo:400:kworker.0 00000100:00100000:1.0:1787826387.208632:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03a1b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1874670585201408:0@lo:400:kworker.0 00000100:00100000:1.0:1787826387.208730:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826387.208777:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab14b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585201920:0@lo:400:kworker.0 00000100:00100000:1.0:1787826387.208807:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826387.208880:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03984b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585200384:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826387.208901:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03a19a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585200896:0@lo:400:kworker.0 00000100:00100000:2.0:1787826387.209497:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585201408 00000100:00100000:2.0:1787826387.209507:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585201408 00000100:00080000:2.0:1787826387.209545:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787826387.210765:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585201920 00000100:00100000:3.0:1787826387.210779:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585201920 00000100:00100000:3.0:1787826387.210873:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 910 00000100:00100000:3.0:1787826387.210887:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3647:x1874670585201920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826387.211008:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3647:x1874670585201920:12345-0@lo:400:kworker.0 Request processed in 125us (2199us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826387.211016:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 910 00000100:00100000:3.0:1787826387.211078:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869615 gen 2 00000004:00080000:3.0:1787826387.211086:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3aa870c0, transno 17179869609 00000004:00080000:3.0:1787826387.211097:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3aa86580, transno 17179869610 00000004:00080000:3.0:1787826387.211100:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce01fdc3c0, transno 17179869611 00000004:00080000:3.0:1787826387.211103:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce01fdf840, transno 17179869612 00000004:00080000:3.0:1787826387.211107:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3f82f840, transno 17179869614 00000004:00080000:3.0:1787826387.211109:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3f82ed00, transno 17179869615 00000100:00100000:3.0:1787826387.211117:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab14b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585201920:0@lo:400:kworker.0 00000004:00080000:3.0:1787826387.211283:0:34502:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 2 changes, 0 in progress, 0 in flight, 6 done 00000100:00100000:3.0:1787826387.211398:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1542 00000100:00100000:3.0:1787826387.211409:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab14780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874670585201408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826387.211458:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab14780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874670585201408:12345-0@lo:400:kworker.0 Request processed in 52us (2728us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826387.211465:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1542 00000100:00100000:3.0:1787826387.211532:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03a1b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1874670585201408:0@lo:400:kworker.0 00000100:00080000:2.0:1787826387.211659:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787826387.267682:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826387.603611:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826387.603667:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563759232 00000100:00100000:3.0:1787826387.603676:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563759232 00000100:00100000:3.0:1787826387.603733:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1918 00000100:00100000:3.0:1787826387.603743:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03984000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563759232:12345-192.168.203.39@tcp:16:kworker.0 00000100:00080000:3.0:1787826387.603804:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826387.609591:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826387.609728:0:30178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563759104 00000100:00100000:1.0:1787826387.609737:0:30178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563759104 00002000:00100000:1.0:1787826387.609784:0:30178:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_016: refresh rw locks for [0x280000400:0x24:0x0] (0->16383) req@ffff90ce06304780 x1874670563759104/t0(0) o4->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:743/0 lens 16872/0 e 0 to 0 dl 1787826398 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826387.609795:0:30178:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce06304780 with x1874670563759104 ext(0->16383) 00002000:00010000:1.0:1787826387.609801:0:30178:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90ce06304780 00000100:00100000:1.0:1787826387.609834:0:30178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 733 00000100:00100000:1.0:1787826387.609847:0:30178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06304780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2403:x1874670563759104:12345-192.168.203.39@tcp:4:lfs.0 00000100:00100000:1.0:1787826387.615735:0:30178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06304780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2403:x1874670563759104:12345-192.168.203.39@tcp:4:lfs.0 Request processed in 5876us (6139us total) trans 21474836963 rc 0/0 00000100:00100000:1.0:1787826387.615751:0:30178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 733 00002000:00100000:1.0:1787826387.615766:0:30178:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_016: refresh rw locks for [0x280000400:0x24:0x0] (0->16383) req@ffff90ce06304780 x1874670563759104/t21474836963(0) o4->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:743/0 lens 16872/448 e 0 to 0 dl 1787826398 ref 1 fl Complete:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826387.615776:0:30178:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce06304780 with x1874670563759104 ext(0->16383) 00002000:00010000:1.0:1787826387.615783:0:30178:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90ce06304780 00000001:00080000:1.0:1787826387.617394:0:26205:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836962 is committed 00000001:00080000:1.0:1787826387.617413:0:26205:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836958 is committed 00000100:00100000:3.0:1787826387.617624:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03984000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670563759232:12345-192.168.203.39@tcp:16:kworker.0 Request processed in 13877us (14016us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826387.617635:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1918 00000004:00080000:1.0:1787826387.715658:0:34501:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1333727184690ns, next at 1334727181995ns, rc = 0 00000100:00100000:1.0:1787826387.715681:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787826387.715700:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585202176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826387.715766:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826387.715963:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585202304:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826387.716071:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1787826387.716341:0:34503:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1333727868517ns, next at 1334727867157ns, rc = 0 00000100:00100000:3.0:1787826387.716356:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fdc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585202432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787826387.716400:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826387.718440:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585202304 00000100:00100000:0.0:1787826387.718453:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585202304 00000100:00100000:0.0:1787826387.718531:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585202432 00000100:00100000:0.0:1787826387.718535:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585202432 00000100:00100000:0.0:1787826387.718557:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 758 00000100:00100000:0.0:1787826387.718567:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03984b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+9:3646:x1874670585202304:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787826387.718601:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 134798144 pending 0 free 3920248832 avail 3688726528 00000100:00100000:0.0:1787826387.718677:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03984b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+9:3646:x1874670585202304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 111us (2604us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826387.718685:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 758 00000100:00100000:0.0:1787826387.718702:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 759 00000100:00100000:0.0:1787826387.718708:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874670585202432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787826387.718719:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 134798144 pending 0 free 3920248832 avail 3688726528 00000100:00100000:0.0:1787826387.719198:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874670585202432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 488us (2795us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826387.719205:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 759 00000100:00100000:0.0:1787826387.719436:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787826387.719454:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3fb96d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585202560:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826387.719534:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826387.719603:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fdc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585202432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787826387.719840:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585202560 00000100:00100000:0.0:1787826387.719846:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585202560 00000100:00100000:0.0:1787826387.719876:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 760 00000100:00100000:0.0:1787826387.719884:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb943c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874670585202560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787826387.719899:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 152656704 pending 40960 free 3919187968 avail 3687624704 00000100:00100000:0.0:1787826387.719943:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb943c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874670585202560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826387.719950:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 760 00000100:00100000:0.0:1787826387.719990:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 21474836962 gen 2 00000004:00080000:0.0:1787826387.719996:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3f809e00, transno 21474836955 00000004:00080000:0.0:1787826387.720006:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3f80a1c0, transno 21474836956 00000004:00080000:0.0:1787826387.720009:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3f934780, transno 21474836959 00000004:00080000:0.0:1787826387.720011:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3f936580, transno 21474836960 00000004:00080000:0.0:1787826387.720013:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3f9352c0, transno 21474836961 00000004:00080000:0.0:1787826387.720016:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3f9361c0, transno 21474836962 00000100:00100000:0.0:1787826387.720024:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3fb96d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585202560:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826387.720420:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585202304:0@lo:13:osp-pre-1-1.0 00000004:00080000:0.0:1787826387.720633:0:8538:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0001: 0 changes, 0 in progress, 0 in flight, 6 done 00000100:00100000:1.0:1787826387.721657:0:25628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585202176 00000100:00100000:1.0:1787826387.721666:0:25628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585202176 00000100:00100000:1.0:1787826387.721747:0:25628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 761 00000100:00100000:1.0:1787826387.721756:0:25628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3755d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874670585202176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787826387.721775:0:25628:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 152656704 pending 40960 free 3919187968 avail 3687624704 00000100:00100000:1.0:1787826387.721844:0:25628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3755d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874670585202176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (6078us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826387.721852:0:25628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 761 00000100:00100000:2.0:1787826387.722148:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585202176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826388.118876:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826388.118910:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826388.118945:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826388.118975:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826388.119007:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563759616 00000100:00100000:1.0:1787826388.119016:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563759616 00000100:00100000:1.0:1787826388.119076:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563759488 00000100:00100000:1.0:1787826388.119079:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563759488 00000100:00100000:1.0:1787826388.119103:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1543 00000100:00100000:1.0:1787826388.119112:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab16580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:2402:x1874670563759616:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1787826388.119252:0:34487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563759360 00000100:00100000:0.0:1787826388.119257:0:34487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563759360 00000100:00100000:0.0:1787826388.119288:0:34487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 90 00000100:00100000:0.0:1787826388.119295:0:34487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf08198050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:307626ff-a376-4faf-93e0-9f55b723d964+10:2402:x1874670563759360:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1787826388.119355:0:34487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf08198050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:307626ff-a376-4faf-93e0-9f55b723d964+10:2402:x1874670563759360:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 60us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826388.119362:0:34487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 90 00000100:00100000:3.0:1787826388.119447:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1544 00000100:00100000:3.0:1787826388.119458:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab15e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:2402:x1874670563759488:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1787826388.119514:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab15e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:2402:x1874670563759488:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 59us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826388.119519:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1544 00000100:00080000:0.0:1787826388.119650:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787826388.119654:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787826388.119664:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563759744 00000100:00100000:0.0:1787826388.119668:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563759744 00000100:00100000:0.0:1787826388.119708:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 911 00000100:00100000:0.0:1787826388.119715:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab17c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2402:x1874670563759744:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1787826388.119744:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab17c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2402:x1874670563759744:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 29us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826388.119750:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 911 00000100:00080000:3.0:1787826388.119846:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826388.119926:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab16580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:2402:x1874670563759616:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 815us (1015us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826388.119933:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1543 00010000:00010000:1.0:1787826388.291797:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787826388.744668:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 20 committed 00000004:00080000:0.0:1787826388.744699:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 21 committed 00000100:00100000:3.0:1787826388.745022:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fdfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585202688:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787826388.745091:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826388.745144:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fdc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585202816:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787826388.745167:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826388.745202:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585202688 00000100:00100000:3.0:1787826388.745209:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585202688 00000100:00100000:3.0:1787826388.745249:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585202816 00000100:00100000:3.0:1787826388.745252:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585202816 00000100:00100000:3.0:1787826388.745272:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1919 00000100:00100000:3.0:1787826388.745295:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3645:x1874670585202688:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787826388.745320:0:30694:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:258 count 1 00002000:00010000:3.0:1787826388.745363:0:30694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x102:0x0] initial LVB size: 1048576, mtime: 0x6a9010c8, atime: 0x6a9010c7, ctime: 0x6a9010c8, blocks: 0x0 00010000:00010000:3.0:1787826388.745382:0:30694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021c90a82/0x22153cd396b80c4a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826388.745400:0:30694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x102:0x0].0x0 since=1334s v=(0 0) 00010000:00010000:3.0:1787826388.745405:0:30694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x102:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826388.745411:0:30694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021c90a82/0x22153cd396b80c4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826388.745424:0:30694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021c90a82/0x22153cd396b80c4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826388.745434:0:30694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021c90a82/0x22153cd396b80c4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826388.745446:0:30694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000021c90a82/0x22153cd396b80c4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826388.745464:0:30694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787826388.747886:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1920 00000100:00100000:1.0:1787826388.747915:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3646:x1874670585202816:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787826388.747957:0:8545:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:259 count 1 00002000:00010000:1.0:1787826388.748004:0:8545:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x103:0x0] initial LVB size: 2110464, mtime: 0x6a9010c9, atime: 0x6a9010c7, ctime: 0x6a9010c9, blocks: 0x30 00010000:00010000:1.0:1787826388.748014:0:8545:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e42b1469/0x22153cd396b80c51 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.748035:0:8545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x103:0x0].0x0 since=1334s v=(0 0) 00010000:00010000:1.0:1787826388.748041:0:8545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x103:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826388.748049:0:8545:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e42b1469/0x22153cd396b80c51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.748066:0:8545:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e42b1469/0x22153cd396b80c51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.748085:0:8545:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e42b1469/0x22153cd396b80c51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.748094:0:8545:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e42b1469/0x22153cd396b80c51 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.748124:0:8545:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1787826388.748617:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3646:x1874670585202816:12345-0@lo:6:osp-syn-1-0.0 Request processed in 603us (3335us total) trans 17179869628 rc 0/0 00000100:00100000:1.0:1787826388.748628:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1920 00010000:00010000:1.0:1787826388.748677:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787826388.748687:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000021c90a82/0x22153cd396b80c4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.748699:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400400 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:1.0:1787826388.748704:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000021c90a82/0x22153cd396b80c4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.748717:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000021c90a82/0x22153cd396b80c4a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.748740:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000021c90a82/0x22153cd396b80c4a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.748749:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021c90a82/0x22153cd396b80c4a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.748776:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826388.748780:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e42b1469/0x22153cd396b80c51 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.748788:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05124a00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:1.0:1787826388.748791:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e42b1469/0x22153cd396b80c51 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.748800:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e42b1469/0x22153cd396b80c51 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.748811:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e42b1469/0x22153cd396b80c51 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.748819:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e42b1469/0x22153cd396b80c51 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.748832:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826388.748833:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826388.748835:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826388.748859:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826388.749271:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:3645:x1874670585202688:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3971us (4173us total) trans 17179869629 rc 0/0 00000100:00100000:3.0:1787826388.749285:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1919 00000004:00080000:3.0:1787826388.749346:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce01fdfc00/2, rc 0, transno 17179869629 00000100:00100000:3.0:1787826388.749353:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fdfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585202688:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1787826388.750009:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce01fdc3c0/2, rc 0, transno 17179869628 00000100:00100000:1.0:1787826388.750021:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fdc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585202816:0@lo:6:osp-syn-1-0.0 00000001:00080000:0.0:1787826388.754901:0:34481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934698 is committed 00000020:00080000:0.0:1787826388.754929:0:34481:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90cf117b0a80 refcount 2 committed 0 result 0 batchid 4294969326 00000020:00080000:0.0:1787826388.754935:0:34481:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cf07f6c100 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90cf117b0240 00000020:00080000:0.0:1787826388.754939:0:34481:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000405:0x2:0x0].1 00000020:00080000:0.0:1787826388.754942:0:34481:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cf07f6cf00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90cf39e6f000 00000020:00080000:0.0:1787826388.754946:0:34481:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000bd0:0x2:0x0].1 00000004:00080000:0.0:1787826388.754965:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 20 committed 00000004:00080000:0.0:1787826388.754970:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 19 committed 00000020:00080000:0.0:1787826388.755015:0:34512:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969326 committed batchid 55 00000020:00080000:0.0:1787826388.755099:0:34512:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 55 00010000:00010000:0.0:1787826388.755123:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400e00/0x22153cd396b808f4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.755133:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400e00/0x22153cd396b808f4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.755140:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400e00/0x22153cd396b808f4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.755146:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400e00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826388.755150:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400e00/0x22153cd396b808f4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.755157:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400e00/0x22153cd396b808f4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.755173:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0xe1e61496 (ffff90cf39656800) 00010000:00010000:0.0:1787826388.755176:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826388.755180:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400e00/0x22153cd396b808f4 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.755186:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400e00/0x22153cd396b808f4 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826388.755674:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585202944:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787826388.755722:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585203072:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787826388.755770:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787826388.756333:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660800/0x22153cd396b80925 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7b0e8b47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.756350:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660800/0x22153cd396b80925 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7b0e8b47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.756357:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660800/0x22153cd396b80925 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7b0e8b47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.756362:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05660800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826388.756376:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660800/0x22153cd396b80925 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7b0e8b47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.756382:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660800/0x22153cd396b80925 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7b0e8b47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.756395:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7b0e8b47 (ffff90cf371d2900) 00010000:00010000:0.0:1787826388.756398:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826388.756402:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660800/0x22153cd396b80925 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7b0e8b47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.756409:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05660800/0x22153cd396b80925 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7b0e8b47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.756551:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b8092c lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.756559:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b8092c lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.756565:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b8092c lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.756570:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826388.756573:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b8092c lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.756579:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b8092c lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.756588:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x0 (ffff90cf06894100) 00010000:00010000:0.0:1787826388.756590:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826388.756594:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b8092c lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.756600:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b8092c lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.756610:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b80933 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.756615:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b80933 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.756620:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b80933 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.756624:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826388.756627:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b80933 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.756631:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b80933 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.756638:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x1:0x0].0x0 (ffff90cf06894900) 00010000:00010000:0.0:1787826388.756640:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826388.756643:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b80933 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.756648:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b80933 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826388.756703:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585202944 00000100:00100000:0.0:1787826388.756711:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585202944 00000100:00100000:0.0:1787826388.756771:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1921 00000100:00100000:0.0:1787826388.756780:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3647:x1874670585202944:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787826388.756812:0:14864:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:258 count 1 00002000:00010000:0.0:1787826388.756844:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x102:0x0] initial LVB size: 2097152, mtime: 0x6a9010c9, atime: 0x6a9010c7, ctime: 0x6a9010c9, blocks: 0x10 00010000:00010000:0.0:1787826388.756851:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6b1b26e/0x22153cd396b80c58 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.756865:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x102:0x0].0x0 since=1334s v=(0 0) 00010000:00010000:0.0:1787826388.756871:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x102:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826388.756877:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6b1b26e/0x22153cd396b80c58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.756889:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6b1b26e/0x22153cd396b80c58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.756897:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6b1b26e/0x22153cd396b80c58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.756904:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c6b1b26e/0x22153cd396b80c58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826388.756927:0:14864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787826388.761637:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787826388.761774:0:7460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826388.761787:0:7460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c6b1b26e/0x22153cd396b80c58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.761804:0:7460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05660200 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:1.0:1787826388.761810:0:7460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6b1b26e/0x22153cd396b80c58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.761823:0:7460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6b1b26e/0x22153cd396b80c58 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.761848:0:7460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c6b1b26e/0x22153cd396b80c58 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.761857:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6b1b26e/0x22153cd396b80c58 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.761889:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826388.761891:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826388.761893:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826388.761926:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585203072 00000100:00100000:1.0:1787826388.761939:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585203072 00000100:00100000:1.0:1787826388.761998:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1922 00000100:00100000:1.0:1787826388.762009:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab143c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:3644:x1874670585203072:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787826388.762053:0:30398:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:259 count 1 00002000:00010000:1.0:1787826388.762095:0:30398:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x103:0x0] initial LVB size: 2110464, mtime: 0x6a9010c9, atime: 0x6a9010c7, ctime: 0x6a9010c9, blocks: 0x20 00010000:00010000:1.0:1787826388.762103:0:30398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f453621b/0x22153cd396b80c5f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.762119:0:30398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x103:0x0].0x0 since=1334s v=(0 0) 00010000:00010000:1.0:1787826388.762124:0:30398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x103:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826388.762133:0:30398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f453621b/0x22153cd396b80c5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.762147:0:30398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f453621b/0x22153cd396b80c5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.762157:0:30398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f453621b/0x22153cd396b80c5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.762165:0:30398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f453621b/0x22153cd396b80c5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.762185:0:30398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787826388.762415:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab143c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3644:x1874670585203072:12345-0@lo:6:osp-syn-0-0.0 Request processed in 406us (789us total) trans 21474836965 rc 0/0 00000100:00100000:1.0:1787826388.762425:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1922 00010000:00010000:1.0:1787826388.762454:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826388.762460:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f453621b/0x22153cd396b80c5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.762505:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05124c00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:1.0:1787826388.762510:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f453621b/0x22153cd396b80c5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.762526:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f453621b/0x22153cd396b80c5f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.762539:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f453621b/0x22153cd396b80c5f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.762547:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f453621b/0x22153cd396b80c5f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826388.762566:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826388.762568:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826388.762569:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787826388.762640:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3ab14000/2, rc 0, transno 21474836965 00000100:00100000:1.0:1787826388.762648:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585203072:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787826388.764539:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3647:x1874670585202944:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7751us (8773us total) trans 21474836964 rc 0/0 00000100:00100000:0.0:1787826388.764553:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1921 00000004:00080000:3.0:1787826388.764662:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3ab161c0/2, rc 0, transno 21474836964 00000100:00100000:3.0:1787826388.764669:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585202944:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1787826389.321919:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826390.340900:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826391.367097:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787826391.815556:0:27651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179869629 is committed 00000001:00080000:1.0:1787826391.815579:0:27651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179869627 is committed 00000001:00080000:1.0:1787826391.815599:0:27651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179869623 is committed 00000001:00080000:2.0:1787826391.821856:0:7449:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967681 is committed 00000100:00100000:3.0:1787826392.327238:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f874000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585203456:0@lo:400:kworker.0 00000100:00100000:3.0:1787826392.327306:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826392.327367:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03974780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874670585203968:0@lo:400:kworker.0 00000100:00100000:3.0:1787826392.327393:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826392.327409:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03975a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585204480:0@lo:400:kworker.0 00000100:00100000:3.0:1787826392.327431:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826392.327455:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1787826392.327461:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f8761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e3c550b8-2c3c-46c3-ad36-671c284167ea:3647:1874670585203328:0@lo:400:kworker.0 00000100:00100000:3.0:1787826392.327513:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826392.327534:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f875a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585203840:0@lo:400:kworker.0 00000100:00100000:3.0:1787826392.327558:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826392.327573:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce039752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1874670585204352:0@lo:400:kworker.0 00000100:00100000:3.0:1787826392.327593:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826392.327612:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a9ae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874670585204864:0@lo:400:kworker.0 00000100:00100000:3.0:1787826392.327633:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826392.327661:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585203456 00000100:00100000:3.0:1787826392.327668:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585203456 00000100:00100000:3.0:1787826392.327707:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585204480 00000100:00100000:3.0:1787826392.327711:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585204480 00000100:00100000:3.0:1787826392.327727:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1380 00000100:00100000:3.0:1787826392.327735:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3647:x1874670585203456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826392.327789:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3647:x1874670585203456:12345-0@lo:400:kworker.0 Request processed in 54us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826392.327796:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1380 00000100:00100000:3.0:1787826392.327817:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1381 00000100:00100000:3.0:1787826392.327824:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874670585204480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826392.327851:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874670585204480:12345-0@lo:400:kworker.0 Request processed in 28us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826392.327857:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1381 00000100:00100000:3.0:1787826392.327877:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585203968 00000100:00100000:3.0:1787826392.327881:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585203968 00000100:00100000:3.0:1787826392.327911:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585204352 00000100:00100000:3.0:1787826392.327913:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585204352 00000100:00100000:3.0:1787826392.327927:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585204864 00000100:00100000:3.0:1787826392.327928:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585204864 00000100:00100000:3.0:1787826392.327941:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1545 00000100:00100000:3.0:1787826392.327946:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9ada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874670585203968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826392.327977:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9ada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874670585203968:12345-0@lo:400:kworker.0 Request processed in 31us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826392.327983:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1545 00000100:00100000:3.0:1787826392.327994:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1546 00000100:00100000:3.0:1787826392.328000:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8afc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874670585204352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826392.328025:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8afc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874670585204352:12345-0@lo:400:kworker.0 Request processed in 26us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826392.328031:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1546 00000100:00100000:3.0:1787826392.328043:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1547 00000100:00100000:3.0:1787826392.328050:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8af840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874670585204864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826392.328075:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8af840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874670585204864:12345-0@lo:400:kworker.0 Request processed in 26us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826392.328079:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1547 00000100:00080000:3.0:1787826392.328096:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787826392.328099:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787826392.328128:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce039752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1874670585204352:0@lo:400:kworker.0 00000100:00100000:3.0:1787826392.328138:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a9ae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874670585204864:0@lo:400:kworker.0 00000100:00100000:3.0:1787826392.328147:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f874000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585203456:0@lo:400:kworker.0 00000100:00100000:3.0:1787826392.328155:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03974780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874670585203968:0@lo:400:kworker.0 00000100:00100000:3.0:1787826392.328162:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03975a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585204480:0@lo:400:kworker.0 00000100:00100000:1.0:1787826392.328270:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f8743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585203200:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826392.328300:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826392.328328:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f8752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585203712:0@lo:400:kworker.0 00000100:00100000:1.0:1787826392.328360:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826392.328381:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce039761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1874670585204224:0@lo:400:kworker.0 00000100:00100000:1.0:1787826392.328405:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826392.328420:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf07964780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585204736:0@lo:400:kworker.0 00000100:00100000:1.0:1787826392.328440:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826392.328459:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787826392.328465:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f876580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874670585203584:0@lo:400:kworker.0 00000100:00100000:1.0:1787826392.328514:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826392.328531:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce039743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1874670585204096:0@lo:400:kworker.0 00000100:00100000:1.0:1787826392.328551:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826392.328567:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf079643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585204608:0@lo:400:kworker.0 00000100:00100000:1.0:1787826392.328587:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826392.328619:0:34488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585203328 00000100:00100000:1.0:1787826392.328622:0:34488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585203328 00000100:00100000:1.0:1787826392.328654:0:34488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787826392.328661:0:34488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf0819bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3c550b8-2c3c-46c3-ad36-671c284167ea+24:3647:x1874670585203328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826392.328699:0:34488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf0819bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3c550b8-2c3c-46c3-ad36-671c284167ea+24:3647:x1874670585203328:12345-0@lo:400:kworker.0 Request processed in 39us (1185us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826392.328705:0:34488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787826392.328733:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585204224 00000100:00100000:1.0:1787826392.328736:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585204224 00000100:00100000:1.0:1787826392.328758:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585203584 00000100:00100000:1.0:1787826392.328761:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585203584 00000100:00100000:1.0:1787826392.328772:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585204096 00000100:00100000:1.0:1787826392.328774:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585204096 00000100:00100000:1.0:1787826392.328788:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1548 00000100:00100000:1.0:1787826392.328794:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03986580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874670585204224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826392.328829:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03986580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874670585204224:12345-0@lo:400:kworker.0 Request processed in 35us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826392.328838:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1548 00000100:00100000:1.0:1787826392.328849:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1549 00000100:00100000:1.0:1787826392.328854:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aaf1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874670585203584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826392.328881:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aaf1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874670585203584:12345-0@lo:400:kworker.0 Request processed in 27us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826392.328887:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1549 00000100:00100000:1.0:1787826392.328899:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1550 00000100:00100000:1.0:1787826392.328905:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aaf03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874670585204096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826392.328928:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aaf03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874670585204096:12345-0@lo:400:kworker.0 Request processed in 25us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826392.328934:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1550 00000100:00100000:1.0:1787826392.328949:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585203840 00000100:00100000:1.0:1787826392.328952:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585203840 00000100:00100000:1.0:1787826392.328974:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585203712 00000100:00100000:1.0:1787826392.328977:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585203712 00000100:00100000:1.0:1787826392.328991:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585204736 00000100:00100000:1.0:1787826392.328993:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585204736 00000100:00100000:1.0:1787826392.329010:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585204608 00000100:00100000:1.0:1787826392.329012:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585204608 00000100:00100000:1.0:1787826392.329032:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 912 00000100:00100000:1.0:1787826392.329038:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3647:x1874670585203840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826392.329069:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3647:x1874670585203840:12345-0@lo:400:kworker.0 Request processed in 31us (1510us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826392.329075:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 912 00000100:00100000:1.0:1787826392.329087:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 913 00000100:00100000:1.0:1787826392.329092:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03986d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3645:x1874670585203712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826392.329120:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03986d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3645:x1874670585203712:12345-0@lo:400:kworker.0 Request processed in 28us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826392.329126:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 913 00000100:00100000:1.0:1787826392.329136:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 914 00000100:00100000:1.0:1787826392.329142:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03984780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3645:x1874670585204736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826392.329168:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03984780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3645:x1874670585204736:12345-0@lo:400:kworker.0 Request processed in 26us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826392.329173:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 914 00000100:00100000:1.0:1787826392.329183:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 915 00000100:00100000:1.0:1787826392.329189:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aaf0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3645:x1874670585204608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826392.329214:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aaf0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3645:x1874670585204608:12345-0@lo:400:kworker.0 Request processed in 26us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826392.329219:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 915 00000100:00080000:1.0:1787826392.329260:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787826392.329264:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787826392.329266:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787826392.329268:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787826392.329293:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f876580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874670585203584:0@lo:400:kworker.0 00000100:00100000:1.0:1787826392.329303:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce039743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1874670585204096:0@lo:400:kworker.0 00000100:00100000:1.0:1787826392.329312:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf079643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585204608:0@lo:400:kworker.0 00000100:00100000:1.0:1787826392.329320:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f8752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585203712:0@lo:400:kworker.0 00000100:00100000:1.0:1787826392.329328:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce039761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1874670585204224:0@lo:400:kworker.0 00000100:00100000:1.0:1787826392.329336:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869629 gen 2 00000004:00080000:1.0:1787826392.329353:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce01fdc3c0, transno 17179869628 00000004:00080000:1.0:1787826392.329362:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce01fdfc00, transno 17179869629 00000100:00100000:1.0:1787826392.329366:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf07964780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585204736:0@lo:400:kworker.0 00000100:00100000:1.0:1787826392.329403:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f8761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e3c550b8-2c3c-46c3-ad36-671c284167ea:3647:1874670585203328:0@lo:400:kworker.0 00000100:00100000:1.0:1787826392.329411:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179869627 gen 2 00000004:00080000:1.0:1787826392.329414:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce03987c00, transno 17179869624 00000004:00080000:1.0:1787826392.329420:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce039861c0, transno 17179869625 00000004:00080000:1.0:1787826392.329423:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce01fdc780, transno 17179869626 00000004:00080000:1.0:1787826392.329426:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce01fdcf00, transno 17179869627 00000100:00100000:1.0:1787826392.329429:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f875a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585203840:0@lo:400:kworker.0 00000100:00100000:0.0:1787826392.329539:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585203200 00000100:00100000:0.0:1787826392.329544:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585203200 00000100:00100000:0.0:1787826392.329580:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1382 00000100:00100000:0.0:1787826392.329587:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3645:x1874670585203200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787826392.329613:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445896192 avail 1299656704 00000100:00100000:0.0:1787826392.329654:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3645:x1874670585203200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (1352us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826392.329661:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1382 00000100:00100000:0.0:1787826392.329807:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f8743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585203200:0@lo:41:osp-pre-0-1.0 00000004:00080000:2.0:1787826392.330056:0:9964:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 0 changes, 0 in progress, 0 in flight, 4 done 00000100:00100000:0.0:1787826392.330110:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787826392.330121:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce06305e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585204992:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787826392.330155:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826392.330266:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585204992 00000100:00100000:1.0:1787826392.330271:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585204992 00000100:00100000:1.0:1787826392.330305:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1383 00000100:00100000:1.0:1787826392.330313:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb96d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874670585204992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787826392.330331:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446195200 avail 1299955712 00000100:00100000:1.0:1787826392.330382:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb96d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874670585204992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826392.330388:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1383 00000100:00100000:0.0:1787826392.330451:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce06305e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585204992:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787826392.390864:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826392.835661:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787826392.835695:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3fb97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585205120:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826392.836150:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826392.836392:0:12021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585205120 00000100:00100000:2.0:1787826392.836400:0:12021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585205120 00000100:00100000:2.0:1787826392.836449:0:12021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 762 00000100:00100000:2.0:1787826392.836458:0:12021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb94780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874670585205120:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787826392.836509:0:12021:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 152656704 pending 40960 free 3919212544 avail 3687690240 00000100:00100000:2.0:1787826392.836555:0:12021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb94780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874670585205120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826392.836562:0:12021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 762 00000100:00100000:2.0:1787826392.836590:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce06305e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585205248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787826392.837066:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a8ae940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585205376:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826392.837101:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826392.837139:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585205376 00000100:00100000:3.0:1787826392.837143:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585205376 00000100:00100000:3.0:1787826392.837172:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 763 00000100:00100000:3.0:1787826392.837179:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8ada40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874670585205376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787826392.837196:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 134798144 pending 0 free 3920273408 avail 3688751104 00000100:00100000:3.0:1787826392.837229:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8ada40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874670585205376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826392.837236:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 763 00000100:00100000:3.0:1787826392.837289:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a8ae940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585205376:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826392.837377:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826392.837416:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3fb97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585205120:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826392.838178:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3fb952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585205504:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787826392.838213:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826392.838425:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585205248 00000100:00100000:0.0:1787826392.838431:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585205248 00000100:00100000:0.0:1787826392.838459:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585205504 00000100:00100000:0.0:1787826392.838462:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585205504 00000100:00100000:0.0:1787826392.838503:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 764 00000100:00100000:0.0:1787826392.838511:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce063070c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874670585205248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787826392.838529:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 134798144 pending 0 free 3920273408 avail 3688751104 00000100:00100000:0.0:1787826392.838569:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce063070c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874670585205248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (1192us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826392.838576:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 764 00000100:00100000:2.0:1787826392.839150:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce06305e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585205248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787826392.839215:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 765 00000100:00100000:0.0:1787826392.839226:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06304f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1874670585205504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787826392.839242:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 152656704 pending 40960 free 3919212544 avail 3687690240 00000100:00100000:0.0:1787826392.839283:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06304f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1874670585205504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (1069us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826392.843074:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3fb952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585205504:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1787826392.843960:0:26205:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836965 is committed 00000001:00080000:3.0:1787826392.843975:0:26205:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836963 is committed 00000100:00100000:0.0:1787826392.849217:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 765 00000100:00100000:0.0:1787826393.246547:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826393.246588:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826393.246617:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826393.246639:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826393.246959:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826393.246992:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563760000 00000100:00100000:0.0:1787826393.247000:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563760000 00000100:00100000:0.0:1787826393.247056:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563760128 00000100:00100000:0.0:1787826393.247059:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563760128 00000100:00100000:0.0:1787826393.247093:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1551 00000100:00100000:0.0:1787826393.247103:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:2402:x1874670563760000:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1787826393.247172:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:2402:x1874670563760000:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 70us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826393.247179:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1551 00000100:00100000:0.0:1787826393.247196:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1552 00000100:00100000:0.0:1787826393.247203:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:2402:x1874670563760128:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1787826393.247228:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:2402:x1874670563760128:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 25us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826393.247234:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1552 00000100:00100000:0.0:1787826393.247251:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563760384 00000100:00100000:0.0:1787826393.247254:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563760384 00000100:00100000:0.0:1787826393.247278:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563760256 00000100:00100000:0.0:1787826393.247280:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563760256 00000100:00100000:0.0:1787826393.247299:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 916 00000100:00100000:0.0:1787826393.247305:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2402:x1874670563760384:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1787826393.247329:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2402:x1874670563760384:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 25us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826393.247344:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 916 00000100:00100000:0.0:1787826393.247355:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 917 00000100:00100000:0.0:1787826393.247362:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2402:x1874670563760256:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1787826393.247385:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2402:x1874670563760256:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 24us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826393.247391:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 917 00000100:00080000:0.0:1787826393.247410:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787826393.247414:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787826393.247416:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787826393.247418:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787826393.248665:0:34487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563759872 00000100:00100000:2.0:1787826393.248674:0:34487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563759872 00000100:00100000:2.0:1787826393.248717:0:34487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 92 00000100:00100000:2.0:1787826393.248725:0:34487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf0819b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:307626ff-a376-4faf-93e0-9f55b723d964+10:2402:x1874670563759872:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1787826393.248769:0:34487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf0819b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:307626ff-a376-4faf-93e0-9f55b723d964+10:2402:x1874670563759872:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 45us (2232us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826393.248775:0:34487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 92 00010000:00010000:0.0:1787826393.423421:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787826393.665416:0:35898:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 50d: mirror rsync keep holes ========== 06:26:32 (1787826392) 00000100:00100000:0.0:1787826393.757087:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826393.757569:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563760640 00000100:00100000:3.0:1787826393.757584:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563760640 00000100:00100000:3.0:1787826393.757915:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3526 00000100:00100000:3.0:1787826393.757930:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:54252:x1874670563760640:12345-192.168.203.39@tcp:36:mkdir.0 00000100:00100000:3.0:1787826393.758111:0:8247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a8ae940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8247:1874670585205632:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787826393.758184:0:8247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826393.758230:0:8247:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf078fed80 going to sleep for 11 seconds 00000100:00100000:1.0:1787826393.759232:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585205632 00000100:00100000:1.0:1787826393.759243:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585205632 00000100:00100000:1.0:1787826393.759309:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1384 00000100:00100000:1.0:1787826393.759318:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8acb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:8247:x1874670585205632:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787826393.759445:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8acb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:8247:x1874670585205632:12345-0@lo:1000:mdt00_003.0 Request processed in 127us (1260us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826393.759454:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1384 00000100:00100000:1.0:1787826393.759528:0:8247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a8ae940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8247:1874670585205632:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787826393.759619:0:8247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aaf12c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8247:1874670585205760:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787826393.760434:0:8247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826393.760555:0:8247:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a2d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826393.764430:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585205760 00000100:00100000:0.0:1787826393.764451:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585205760 00000100:00100000:2.0:1787826393.764651:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1385 00000100:00100000:2.0:1787826393.764664:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aaf2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:8247:x1874670585205760:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787826393.765051:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aaf2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:8247:x1874670585205760:12345-0@lo:1000:mdt00_003.0 Request processed in 388us (4615us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787826393.765060:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1385 00000100:00100000:0.0:1787826393.765149:0:8247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aaf12c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8247:1874670585205760:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1787826393.765249:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff90ce05660a00/0x22153cd396b80c66 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.765261:0:8247:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff90ce05660a00/0x22153cd396b80c66 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.765273:0:8247:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff90ce05660a00/0x22153cd396b80c66 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826393.765298:0:8247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fdfc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8247:1874670585205888:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1787826393.765356:0:8247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826393.765389:0:8247:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf185500c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826393.765573:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585205888 00000100:00100000:2.0:1787826393.765580:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585205888 00000100:00100000:0.0:1787826393.765700:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1386 00000100:00100000:0.0:1787826393.765711:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f937c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:8247:x1874670585205888:12345-0@lo:101:mdt00_003.0 00010000:00010000:0.0:1787826393.765726:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826393.765755:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661c00/0x22153cd396b80c6d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x22153cd396b80c66 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.765903:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8094f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab069d expref: 20 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.765915:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661c00/0x22153cd396b80c6d lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x22153cd396b80c66 expref: 8 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.765948:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8094f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab069d expref: 20 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.765964:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8094f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab069d expref: 20 pid: 9966 timeout: 1439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826393.765979:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f9370c0 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:6523:1874670585206016:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826393.766053:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf18550000 going to sleep for 11 seconds 00000100:00100000:0.0:1787826393.777309:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f9370c0 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:6523:1874670585206016:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826393.777374:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661c00/0x22153cd396b80c6d lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x22153cd396b80c66 expref: 8 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.777391:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ce01f45300) 00010000:00010000:0.0:1787826393.777395:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826393.777400:0:6523:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661c00/0x22153cd396b80c6d lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x22153cd396b80c66 expref: 8 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.777412:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05661c00, rc 0) 00000100:00100000:0.0:1787826393.782953:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826393.783254:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563760768 00000100:00100000:2.0:1787826393.783266:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563760768 00010000:00010000:2.0:1787826393.783327:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8094f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab069d expref: 21 pid: 9966 timeout: 1439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826393.783403:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1015 00000100:00100000:2.0:1787826393.783416:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f9370c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:2404:x1874670563760768:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826393.783436:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826393.783445:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8094f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab069d expref: 21 pid: 9966 timeout: 1439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826393.783463:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8094f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab069d expref: 21 pid: 9966 timeout: 1439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826393.783519:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8094f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab069d expref: 21 pid: 9966 timeout: 1439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826393.783542:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ce01f45300) 00010000:00010000:2.0:1787826393.783552:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661c00/0x22153cd396b80c6d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x22153cd396b80c66 expref: 8 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826393.783565:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661c00/0x22153cd396b80c6d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x22153cd396b80c66 expref: 8 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826393.783577:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661c00/0x22153cd396b80c6d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x22153cd396b80c66 expref: 8 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826393.783642:0:6504:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661c00/0x22153cd396b80c6d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x22153cd396b80c66 expref: 8 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826393.783660:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce06305e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6504:1874670585206144:0@lo:105: 00000100:00100000:2.0:1787826393.783724:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826393.783994:0:6504:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a2cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826393.784088:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585206144 00000100:00100000:1.0:1787826393.784094:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585206144 00000100:00100000:1.0:1787826393.784144:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787826393.784152:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce063052c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6504:x1874670585206144:12345-0@lo:105: 00010000:00010000:1.0:1787826393.784165:0:6502:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff90ce05660a00/0x22153cd396b80c66 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x22153cd396b80c6d expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.784177:0:6502:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff90ce05660a00/0x22153cd396b80c66 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x22153cd396b80c6d expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.784187:0:6502:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff90ce05660a00/0x22153cd396b80c66 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x22153cd396b80c6d expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.784196:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff90ce05660a00/0x22153cd396b80c66 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x22153cd396b80c6d expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.784204:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff90ce05660a00/0x22153cd396b80c66 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x22153cd396b80c6d expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.784214:0:6502:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff90ce05660a00/0x22153cd396b80c66 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x22153cd396b80c6d expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.784230:0:6502:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff90ce05660a00) 00000100:00100000:1.0:1787826393.784283:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce063052c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6504:x1874670585206144:12345-0@lo:105: Request processed in 131us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826393.784295:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787826393.784354:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce06305e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6504:1874670585206144:0@lo:105: 00010000:00010000:1.0:1787826393.784376:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826393.784430:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f9370c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:2404:x1874670563760768:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 1016us (1491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826393.784438:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1015 00000100:00100000:1.0:1787826393.784901:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f937c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:8247:x1874670585205888:12345-0@lo:101:mdt00_003.0 Request processed in 19188us (19542us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826393.784911:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1386 00000100:00100000:0.0:1787826393.785033:0:8247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fdfc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8247:1874670585205888:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1787826393.785057:0:8247:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff90ce05660a00/0x22153cd396b80c66 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x22153cd396b80c6d expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787826393.785083:0:8247:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1787826393.785134:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff90ce05661400/0x22153cd396b80c74 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x33cac8cf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.785142:0:8247:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff90ce05661400/0x22153cd396b80c74 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x33cac8cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.785152:0:8247:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff90ce05661400/0x22153cd396b80c74 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x33cac8cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826393.785176:0:8247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f934f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8247:1874670585206272:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1787826393.785214:0:8247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826393.785246:0:8247:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf185500c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826393.786092:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585206272 00000100:00100000:1.0:1787826393.786103:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585206272 00000100:00100000:1.0:1787826393.786161:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1387 00000100:00100000:1.0:1787826393.786170:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f934000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:8247:x1874670585206272:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1787826393.786193:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826393.786217:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05124200/0x22153cd396b80c7b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x33cac8cf bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x22153cd396b80c74 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.786248:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05124200/0x22153cd396b80c7b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x33cac8cf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x22153cd396b80c74 expref: 9 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.786263:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05124200/0x22153cd396b80c7b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x33cac8cf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x22153cd396b80c74 expref: 9 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.786272:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x33cac8cf (ffff90cf3ab61a00) 00010000:00010000:1.0:1787826393.786276:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826393.786279:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05124200, rc 0) 00000100:00100000:1.0:1787826393.787787:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f934000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:8247:x1874670585206272:12345-0@lo:101:mdt00_003.0 Request processed in 1606us (2560us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826393.787801:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1387 00000100:00100000:0.0:1787826393.795628:0:8247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f934f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8247:1874670585206272:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1787826393.795677:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff90ce05661400/0x22153cd396b80c74 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x33cac8cf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x22153cd396b80c7b expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.795697:0:8247:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff90ce05661400/0x22153cd396b80c74 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x33cac8cf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x22153cd396b80c7b expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787826393.795731:0:8247:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:1.0:1787826393.796397:0:8247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aaf12c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8247:1874670585206400:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787826393.796507:0:8247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826393.796543:0:8247:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a13f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826393.799640:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585206400 00000100:00100000:0.0:1787826393.799661:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585206400 00000100:00100000:0.0:1787826393.799756:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1388 00000100:00100000:0.0:1787826393.799777:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf07964780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:8247:x1874670585206400:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787826393.799935:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf07964780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:8247:x1874670585206400:12345-0@lo:1000:mdt00_003.0 Request processed in 156us (3423us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826393.799944:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1388 00000100:00100000:1.0:1787826393.800235:0:8247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aaf12c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8247:1874670585206400:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787826393.800344:0:8247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf079643c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8247:1874670585206528:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787826393.800392:0:8247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826393.800431:0:8247:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf038a40c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826393.801424:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585206528 00000100:00100000:0.0:1787826393.801437:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585206528 00000100:00100000:0.0:1787826393.801538:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1389 00000100:00100000:0.0:1787826393.801549:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aaf12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:8247:x1874670585206528:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787826393.802317:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aaf12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:8247:x1874670585206528:12345-0@lo:1000:mdt00_003.0 Request processed in 767us (1921us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787826393.802328:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1389 00000100:00100000:1.0:1787826393.802526:0:8247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf079643c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8247:1874670585206528:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787826393.802692:0:8247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf079643c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8247:1874670585206656:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787826393.802738:0:8247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826393.802947:0:8247:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf038a40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826393.803019:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585206656 00000100:00100000:2.0:1787826393.803025:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585206656 00000100:00100000:2.0:1787826393.803075:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1390 00000100:00100000:2.0:1787826393.803083:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a18b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:8247:x1874670585206656:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787826393.803169:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a18b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:8247:x1874670585206656:12345-0@lo:1000:mdt00_003.0 Request processed in 86us (431us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787826393.803177:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1390 00000100:00100000:0.0:1787826393.803339:0:8247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf079643c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8247:1874670585206656:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787826393.803408:0:8247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f934f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8247:1874670585206784:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787826393.803439:0:8247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826393.803465:0:8247:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf18550000 going to sleep for 11 seconds 00000100:00100000:2.0:1787826393.803608:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585206784 00000100:00100000:2.0:1787826393.803613:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585206784 00000100:00100000:2.0:1787826393.803651:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1391 00000100:00100000:2.0:1787826393.803659:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f936940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:8247:x1874670585206784:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787826393.803717:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f936940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:8247:x1874670585206784:12345-0@lo:1000:mdt00_003.0 Request processed in 59us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826393.803724:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1391 00000100:00100000:0.0:1787826393.804012:0:8247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f934f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8247:1874670585206784:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787826393.804067:0:8247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f934f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8247:1874670585206912:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787826393.804093:0:8247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826393.804118:0:8247:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf18550000 going to sleep for 11 seconds 00000100:00100000:1.0:1787826393.804430:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585206912 00000100:00100000:1.0:1787826393.804436:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585206912 00000100:00100000:1.0:1787826393.804495:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1392 00000100:00100000:1.0:1787826393.804503:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f934780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:8247:x1874670585206912:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787826393.804588:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f934780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:8247:x1874670585206912:12345-0@lo:1000:mdt00_003.0 Request processed in 86us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826393.804609:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1392 00000100:00100000:0.0:1787826393.805130:0:8247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f934f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8247:1874670585206912:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787826393.805202:0:8247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f934f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8247:1874670585207040:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787826393.805237:0:8247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826393.805264:0:8247:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf18550000 going to sleep for 11 seconds 00000100:00100000:2.0:1787826393.805750:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585207040 00000100:00100000:2.0:1787826393.805871:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585207040 00000100:00100000:2.0:1787826393.805925:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1393 00000100:00100000:2.0:1787826393.805933:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f936580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:8247:x1874670585207040:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787826393.806036:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f936580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:8247:x1874670585207040:12345-0@lo:1000:mdt00_003.0 Request processed in 104us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826393.806043:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1393 00000100:00100000:0.0:1787826393.806277:0:8247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f934f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8247:1874670585207040:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787826393.807970:0:8247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f934f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8247:1874670585207168:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787826393.808041:0:8247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826393.808079:0:8247:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf18550000 going to sleep for 11 seconds 00000100:00100000:2.0:1787826393.808731:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585207168 00000100:00100000:2.0:1787826393.808753:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585207168 00000100:00100000:2.0:1787826393.808825:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1394 00000100:00100000:2.0:1787826393.808835:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f9352c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:8247:x1874670585207168:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787826393.808975:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f9352c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:8247:x1874670585207168:12345-0@lo:1000:mdt00_003.0 Request processed in 141us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826393.808985:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1394 00000100:00100000:1.0:1787826393.809171:0:8247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f934f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8247:1874670585207168:0@lo:1000:mdt00_003.0 00000040:00080000:1.0:1787826393.809909:0:8247:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].19, 992 off52656 00000040:00080000:1.0:1787826393.809983:0:8247:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x2:0x0].16, 1144 off53792 00000004:00080000:1.0:1787826393.809991:0:8247:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff90cf038a4780 with version 34 00000004:00080000:2.0:1787826393.810382:0:7464:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff90cf076a8cc0 version 34 rpc_version 34 00000020:00100000:2.0:1787826393.810424:0:7464:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787826393.810435:0:7464:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff90ce06305a40 x1874670585207424/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2424/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826393.810462:0:7464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce06305a40 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7464:1874670585207424:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787826393.810581:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826393.810622:0:7464:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a2c240 going to sleep for 11 seconds 00000100:00100000:0.0:1787826393.812834:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585207424 00000100:00100000:0.0:1787826393.812856:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585207424 00000100:00100000:0.0:1787826393.812935:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1395 00000100:00100000:0.0:1787826393.812947:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06305e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:7464:x1874670585207424:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787826393.814091:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06305e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:7464:x1874670585207424:12345-0@lo:1000:osp_up0-1.0 Request processed in 1139us (3504us total) trans 8589934699 rc 0/0 00000100:00100000:0.0:1787826393.814104:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1395 00000100:00100000:2.0:1787826393.814676:0:7464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce06305a40 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7464:1874670585207424:0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1787826393.819059:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660800/0x22153cd396b80c82 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.819094:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660800/0x22153cd396b80c82 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.819108:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660800/0x22153cd396b80c82 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826393.819133:0:8247:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008a09de1d reply state 00000000bb5694e0 transno 4294967682 ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660800/0x22153cd396b80c82 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.819146:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660800/0x22153cd396b80c82 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.819156:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x0 (ffff90ce01f45c00) 00010000:00010000:0.0:1787826393.819159:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826393.819164:0:8247:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787826393.819172:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0x10:0x0]: returning size 4096 00000004:00080000:0.0:1787826393.819185:0:8247:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1787826393.819203:0:8247:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff90ce05660a00/0x22153cd396b80c66 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x22153cd396b80c6d expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.819213:0:8247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff90ce05660a00/0x22153cd396b80c66 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x22153cd396b80c6d expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.819221:0:8247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff90ce05660a00/0x22153cd396b80c66 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x22153cd396b80c6d expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.819308:0:8247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1787826393.819315:0:8247:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1787826393.819321:0:8247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff90ce05661400/0x22153cd396b80c74 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x33cac8cf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x22153cd396b80c7b expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.819344:0:8247:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff90ce05661400/0x22153cd396b80c74 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x33cac8cf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x22153cd396b80c7b expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826393.819529:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:54252:x1874670563760640:12345-192.168.203.39@tcp:36:mkdir.0 Request processed in 61596us (62450us total) trans 4294967682 rc 0/0 00000100:00100000:0.0:1787826393.819541:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3526 00000001:00080000:1.0:1787826393.824621:0:34481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934699 is committed 00000020:00080000:1.0:1787826393.824639:0:34481:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969326 batchid updated 00010000:00010000:2.0:1787826393.826118:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826393.826141:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff90ce05660a00/0x22153cd396b80c66 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x22153cd396b80c6d expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826393.826157:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05660a00 already unused, calling callback (ffffffffc18ffee0) 00010000:00010000:2.0:1787826393.826168:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff90ce05660a00/0x22153cd396b80c66 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x22153cd396b80c6d expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826393.826179:0:6507:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff90ce05660a00/0x22153cd396b80c66 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x22153cd396b80c6d expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826393.826251:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff90ce05660a00/0x22153cd396b80c66 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x22153cd396b80c6d expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826393.826258:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787826393.826317:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff90ce05660a00/0x22153cd396b80c66 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x22153cd396b80c6d expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826393.826327:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff90ce05660a00/0x22153cd396b80c66 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x22153cd396b80c6d expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826393.826353:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826393.826355:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826393.826357:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826393.826374:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787826393.826402:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03987c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585207552:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787826393.826522:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826393.826585:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585207552 00000100:00100000:2.0:1787826393.826594:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585207552 00000020:00080000:0.0:1787826393.826793:0:34512:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969326 00000100:00100000:0.0:1787826393.826900:0:34512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f9361c0 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:34512:1874670585207680:0@lo:1000:dist_txn-0.0 00000100:00100000:0.0:1787826393.826968:0:34512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826393.826995:0:34512:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf18550000 going to sleep for 11 seconds 00000100:00100000:2.0:1787826393.828001:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1787826393.828013:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf10a53c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+9:3645:x1874670585207552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787826393.828033:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826393.828065:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05661c00/0x22153cd396b80c6d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x22153cd396b80c66 expref: 9 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826393.828085:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ce01f45300) 00010000:00010000:2.0:1787826393.828091:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826393.828161:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf10a53c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+8:3645:x1874670585207552:12345-0@lo:103:ldlm_bl.0 Request processed in 150us (1639us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826393.828170:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1787826393.828272:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03987c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585207552:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787826393.828318:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585207680 00000100:00100000:2.0:1787826393.828324:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585207680 00000100:00100000:2.0:1787826393.828366:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1396 00000100:00100000:2.0:1787826393.828373:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f934f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:34512:x1874670585207680:12345-0@lo:1000:dist_txn-0.0 00000100:00100000:2.0:1787826393.828464:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f934f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:34512:x1874670585207680:12345-0@lo:1000:dist_txn-0.0 Request processed in 91us (1495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826393.828492:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1396 00000100:00100000:2.0:1787826393.828530:0:34512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f9361c0 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:34512:1874670585207680:0@lo:1000:dist_txn-0.0 00000004:00080000:2.0:1787826393.828573:0:34512:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff90cf18550b40 with version 8 00000020:00080000:2.0:1787826393.828589:0:34512:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 4294969326 cancel update log [0x240000405:0x2:0x0].1: rc = 0 00000020:00080000:2.0:1787826393.832115:0:34512:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 4294969326 cancel update log [0x200000bd0:0x2:0x0].1: rc = 0 00000020:00080000:2.0:1787826393.832132:0:34512:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969326 00000004:00080000:2.0:1787826393.832147:0:34498:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff90cf39def9c0 version 8 rpc_version 8 00000020:00100000:2.0:1787826393.832196:0:34498:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787826393.832212:0:34498:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff90ce03987c00 x1874670585207936/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826393.832242:0:34498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03987c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:34498:1874670585207936:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826393.832359:0:34498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826393.832413:0:34498:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a2c900 going to sleep for 11 seconds 00000100:00100000:3.0:1787826393.833287:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585207936 00000100:00100000:3.0:1787826393.833309:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585207936 00000100:00100000:3.0:1787826393.833398:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1397 00000100:00100000:3.0:1787826393.833409:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce039861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:34498:x1874670585207936:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826393.834102:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce039861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:34498:x1874670585207936:12345-0@lo:1000:osp_up1-0.0 Request processed in 690us (1738us total) trans 4294967683 rc 0/0 00000100:00100000:3.0:1787826393.834118:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1397 00000100:00100000:0.0:1787826393.834258:0:34498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03987c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:34498:1874670585207936:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787826393.859157:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826393.861142:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563760896 00000100:00100000:2.0:1787826393.861169:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563760896 00000100:00100000:3.0:1787826393.861432:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3527 00000100:00100000:3.0:1787826393.861450:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8ae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:54253:x1874670563760896:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826393.861511:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826393.861541:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b80c89 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab07a7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826393.861653:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400a00/0x22153cd396b80c90 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826393.861674:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400a00/0x22153cd396b80c90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826393.861691:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400a00/0x22153cd396b80c90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826393.862980:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787826393.862990:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826393.863024:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400a00/0x22153cd396b80c90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826393.863067:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b80c89 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab07a7 expref: 22 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826393.863093:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400a00/0x22153cd396b80c90 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab07a7 expref: 21 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826393.863103:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ce01f45300) 00010000:00010000:3.0:1787826393.863107:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787826393.863112:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400a00, rc 0) 00000100:00100000:3.0:1787826393.863216:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8ae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:54253:x1874670563760896:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1770us (4075us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826393.863226:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3527 00000100:00100000:0.0:1787826393.870226:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826393.870518:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563761024 00000100:00100000:1.0:1787826393.870532:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563761024 00000100:00100000:1.0:1787826393.870609:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3528 00000100:00100000:1.0:1787826393.870631:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f9361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:54253:x1874670563761024:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826393.870661:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826393.870689:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125000/0x22153cd396b80c97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab07ae expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.871105:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05124800/0x22153cd396b80c9e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.871125:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05124800/0x22153cd396b80c9e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.871141:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05124800/0x22153cd396b80c9e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.871155:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05124600/0x22153cd396b80ca5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x33cac8cf bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.871168:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05124200/0x22153cd396b80c7b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x33cac8cf bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x22153cd396b80c74 expref: 7 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.871178:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05124600/0x22153cd396b80ca5 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x33cac8cf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.871226:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05124200/0x22153cd396b80c7b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x33cac8cf bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x22153cd396b80c74 expref: 7 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826393.871438:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03a1b840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1874670585208064:0@lo:104: 00000100:00100000:1.0:1787826393.871927:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826393.871995:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a186c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826393.872017:0:6502:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787826393.872034:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585208064 00000100:00100000:2.0:1787826393.872040:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585208064 00000100:00100000:2.0:1787826393.872110:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787826393.872120:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8cb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6518:x1874670585208064:12345-0@lo:104: 00010000:00010000:2.0:1787826393.872146:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff90ce05661400/0x22153cd396b80c74 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x33cac8cf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x22153cd396b80c7b expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826393.872233:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787826393.872240:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8cb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6518:x1874670585208064:12345-0@lo:104: Request processed in 122us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826393.872248:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00010000:0.0:1787826393.872329:0:7460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826393.872347:0:7460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff90ce05661400/0x22153cd396b80c74 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x33cac8cf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x22153cd396b80c7b expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.872357:0:7460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05661400 already unused, calling callback (ffffffffc18ffee0) 00010000:00010000:0.0:1787826393.872365:0:7460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff90ce05661400/0x22153cd396b80c74 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x33cac8cf bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x22153cd396b80c7b expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826393.872375:0:7460:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff90ce05661400/0x22153cd396b80c74 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x33cac8cf bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x22153cd396b80c7b expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.872415:0:7460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff90ce05661400/0x22153cd396b80c74 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x33cac8cf bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x22153cd396b80c7b expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.872428:0:7460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787826393.872507:0:7460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff90ce05661400/0x22153cd396b80c74 lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x33cac8cf bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x22153cd396b80c7b expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.872517:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff90ce05661400/0x22153cd396b80c74 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x33cac8cf bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x22153cd396b80c7b expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.872541:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826393.872544:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826393.872545:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826393.872556:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787826393.872572:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f934b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585208192:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787826393.873129:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826393.873193:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585208192 00000100:00100000:0.0:1787826393.873201:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585208192 00010000:00010000:0.0:1787826393.873238:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05124200/0x22153cd396b80c7b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x33cac8cf bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x22153cd396b80c74 expref: 8 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826393.873271:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1016 00000100:00100000:0.0:1787826393.873279:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f937480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+8:3644:x1874670585208192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787826393.873292:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787826393.873727:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03a1b840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1874670585208064:0@lo:104: 00010000:00010000:1.0:1787826393.874182:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05124600/0x22153cd396b80ca5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x33cac8cf bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.880298:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05124200/0x22153cd396b80c7b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x33cac8cf bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x22153cd396b80c74 expref: 8 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.880329:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x33cac8cf (ffff90cf3ab61a00) 00010000:00010000:0.0:1787826393.880345:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05124600/0x22153cd396b80ca5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x33cac8cf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.880363:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05124600/0x22153cd396b80ca5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x33cac8cf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.880373:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05124600/0x22153cd396b80ca5 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x33cac8cf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.880412:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826393.881157:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f937480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+7:3644:x1874670585208192:12345-0@lo:103:ldlm_bl.0 Request processed in 7872us (8525us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826393.881172:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1016 00010000:00010000:1.0:1787826393.881492:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05124600/0x22153cd396b80ca5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x33cac8cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.881512:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05124600/0x22153cd396b80ca5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x33cac8cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826393.881943:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03a1b840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6518:1874670585208320:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787826393.882010:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826393.882047:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a180c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826393.882258:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f934b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585208192:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787826393.882365:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585208320 00000100:00100000:0.0:1787826393.882373:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585208320 00000100:00100000:0.0:1787826393.882430:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1398 00000100:00100000:0.0:1787826393.882440:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a19a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6518:x1874670585208320:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787826393.882579:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a19a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6518:x1874670585208320:12345-0@lo:1000:mdt00_000.0 Request processed in 140us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826393.882588:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1398 00000100:00100000:1.0:1787826393.883185:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03a1b840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6518:1874670585208320:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1787826393.883258:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05124000/0x22153cd396b80cac lrc: 3/1,0 mode: --/PR res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.883277:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05124000/0x22153cd396b80cac lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.883289:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05124000/0x22153cd396b80cac lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826393.883329:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05124000/0x22153cd396b80cac lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.883355:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05124800/0x22153cd396b80c9e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.883367:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05124800/0x22153cd396b80c9e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.883374:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05124800/0x22153cd396b80c9e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.883381:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05124800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826393.883386:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05124800/0x22153cd396b80c9e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.883394:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05124800/0x22153cd396b80c9e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.883409:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ce01f45300) 00010000:00010000:1.0:1787826393.883413:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826393.883418:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05124800/0x22153cd396b80c9e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.883425:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05124800/0x22153cd396b80c9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.883440:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05124600/0x22153cd396b80ca5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x33cac8cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.883446:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05124600/0x22153cd396b80ca5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x33cac8cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.883451:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05124600/0x22153cd396b80ca5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x33cac8cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.883468:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05124600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826393.883512:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05124600/0x22153cd396b80ca5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x33cac8cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.883520:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05124600/0x22153cd396b80ca5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x33cac8cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.883528:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x33cac8cf (ffff90cf3ab61a00) 00010000:00010000:1.0:1787826393.883531:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826393.883534:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05124600/0x22153cd396b80ca5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x33cac8cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.883541:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05124600/0x22153cd396b80ca5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x33cac8cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.883594:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05125000/0x22153cd396b80c97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab07ae expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.883613:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce05124000/0x22153cd396b80cac lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab07ae expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.883621:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x0 (ffff90cf3ab61700) 00010000:00010000:1.0:1787826393.883633:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787826393.883636:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05124000, rc 0) 00000100:00100000:1.0:1787826393.883705:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f9361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:54253:x1874670563761024:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 13085us (13496us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826393.883715:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3528 00000100:00100000:1.0:1787826393.890603:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826393.890735:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563761152 00000100:00100000:0.0:1787826393.890821:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563761152 00000100:00100000:0.0:1787826393.890896:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3529 00000100:00100000:0.0:1787826393.890908:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a1b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:54253:x1874670563761152:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826393.890942:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826393.890972:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661400/0x22153cd396b80cb3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab07b5 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.891052:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661c00/0x22153cd396b80cba lrc: 3/1,0 mode: --/PR res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.891077:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661c00/0x22153cd396b80cba lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.891091:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661c00/0x22153cd396b80cba lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826393.891152:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0x10:0x0]: returning size 4096 00000004:00200000:0.0:1787826393.891157:0:16564:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1787826393.891204:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661400/0x22153cd396b80cb3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab07b5 expref: 28 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.891223:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661c00/0x22153cd396b80cba lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab07b5 expref: 27 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.891232:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x0 (ffff90ce01f45c00) 00010000:00010000:0.0:1787826393.891235:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:0.0:1787826393.891239:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05661c00, rc 0) 00000100:00100000:0.0:1787826393.891313:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a1b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:54253:x1874670563761152:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 407us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826393.891322:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3529 00000100:00100000:0.0:1787826393.895846:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826393.896191:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563761280 00000100:00100000:1.0:1787826393.896205:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563761280 00000100:00100000:1.0:1787826393.896291:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3530 00000100:00100000:1.0:1787826393.896304:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f9370c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:54253:x1874670563761280:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826393.896344:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826393.896374:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125c00/0x22153cd396b80cc1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab07bc expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.896465:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125800/0x22153cd396b80cc8 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.896522:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125800/0x22153cd396b80cc8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.896538:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125800/0x22153cd396b80cc8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.896556:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124e00/0x22153cd396b80ccf lrc: 3/1,0 mode: --/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.896564:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124e00/0x22153cd396b80ccf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.896572:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124e00/0x22153cd396b80ccf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.896697:0:8247:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125800/0x22153cd396b80cc8 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.896706:0:8247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125800/0x22153cd396b80cc8 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.896713:0:8247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125800/0x22153cd396b80cc8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.896726:0:8247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125800/0x22153cd396b80cc8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.896733:0:8247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05125800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826393.896860:0:8247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125800/0x22153cd396b80cc8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.896871:0:8247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125800/0x22153cd396b80cc8 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.896885:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x0 (ffff90ce01f45c00) 00010000:00010000:1.0:1787826393.896889:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826393.896894:0:8247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125800/0x22153cd396b80cc8 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.896901:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125800/0x22153cd396b80cc8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.896918:0:8247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124e00/0x22153cd396b80ccf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.896924:0:8247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124e00/0x22153cd396b80ccf lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.896930:0:8247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124e00/0x22153cd396b80ccf lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.896934:0:8247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05124e00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826393.896938:0:8247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124e00/0x22153cd396b80ccf lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.896947:0:8247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124e00/0x22153cd396b80ccf lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.896954:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x37186b36 (ffff90cf3ab61500) 00010000:00010000:1.0:1787826393.896957:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826393.896959:0:8247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124e00/0x22153cd396b80ccf lrc: 2/0,0 mode: --/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.896964:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124e00/0x22153cd396b80ccf lrc: 0/0,0 mode: --/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.897006:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125c00/0x22153cd396b80cc1 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab07bc expref: 28 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.897018:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x0 (ffff90ce01f45c00) 00010000:00010000:1.0:1787826393.897020:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826393.897023:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125c00/0x22153cd396b80cc1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab07bc expref: 28 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.897033:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05125c00, rc 0) 00000100:00100000:1.0:1787826393.897125:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f9370c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:54253:x1874670563761280:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 823us (1294us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826393.897133:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3530 00000100:00100000:1.0:1787826393.906970:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826393.911440:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563761408 00000100:00100000:2.0:1787826393.911459:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563761408 00000100:00100000:2.0:1787826393.912022:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3531 00000100:00100000:2.0:1787826393.912037:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a1a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:54253:x1874670563761408:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826393.912066:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826393.912101:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835c00/0x22153cd396b80cd6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab07c3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826393.912211:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b80cdd lrc: 3/1,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826393.912231:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b80cdd lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826393.912245:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b80cdd lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826393.912262:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834400/0x22153cd396b80ce4 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826393.912268:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834400/0x22153cd396b80ce4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826393.912274:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834400/0x22153cd396b80ce4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826393.912364:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b80cdd lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826393.912372:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b80cdd lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826393.912379:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b80cdd lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826393.912385:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b80cdd lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826393.912391:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826393.912396:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b80cdd lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826393.912405:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b80cdd lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826393.912419:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x0 (ffff90ce01f45c00) 00010000:00010000:2.0:1787826393.912422:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826393.912428:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b80cdd lrc: 3/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826393.912434:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b80cdd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826393.912448:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834400/0x22153cd396b80ce4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826393.912454:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834400/0x22153cd396b80ce4 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826393.912460:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834400/0x22153cd396b80ce4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826393.912465:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826393.912506:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834400/0x22153cd396b80ce4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826393.912522:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834400/0x22153cd396b80ce4 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826393.912531:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x37186b36 (ffff90cf1859ac00) 00010000:00010000:2.0:1787826393.912533:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826393.912537:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834400/0x22153cd396b80ce4 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826393.912543:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834400/0x22153cd396b80ce4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826393.912585:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835c00/0x22153cd396b80cd6 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab07c3 expref: 28 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826393.912598:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x0 (ffff90ce01f45c00) 00010000:00010000:2.0:1787826393.912601:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826393.912606:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835c00/0x22153cd396b80cd6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab07c3 expref: 28 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826393.912617:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835c00, rc 0) 00000100:00100000:2.0:1787826393.912725:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a1a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:54253:x1874670563761408:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 691us (5769us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826393.912735:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3531 00000100:00100000:3.0:1787826393.920852:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826393.921713:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563761536 00000100:00100000:0.0:1787826393.921730:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563761536 00000100:00100000:0.0:1787826393.921971:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3532 00000100:00100000:0.0:1787826393.921984:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:54253:x1874670563761536:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826393.922012:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826393.922046:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661400/0x22153cd396b80ceb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab07ca expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.922142:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660200/0x22153cd396b80cf2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.922160:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660200/0x22153cd396b80cf2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.922175:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660200/0x22153cd396b80cf2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826393.922235:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0x10:0x0]: returning size 4096 00000004:00200000:0.0:1787826393.922239:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826393.922264:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660200/0x22153cd396b80cf2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.922357:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661400/0x22153cd396b80ceb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab07ca expref: 29 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.922384:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660200/0x22153cd396b80cf2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab07ca expref: 28 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.922394:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x0 (ffff90ce01f45c00) 00010000:00010000:0.0:1787826393.922398:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787826393.922403:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05660200, rc 0) 00000100:00100000:0.0:1787826393.922527:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+28:54253:x1874670563761536:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 546us (1693us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826393.922537:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3532 00000100:00100000:1.0:1787826393.927964:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826393.928067:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563761664 00000100:00100000:0.0:1787826393.928081:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563761664 00000100:00100000:0.0:1787826393.928157:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3533 00000100:00100000:0.0:1787826393.928169:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+28:54253:x1874670563761664:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826393.928197:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826393.928224:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b80cf9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab07d1 expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.928323:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80d00 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.928351:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80d00 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.928367:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80d00 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.928386:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660600/0x22153cd396b80d07 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.928394:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660600/0x22153cd396b80d07 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.928401:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660600/0x22153cd396b80d07 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.928458:0:32404:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80d00 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.928466:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80d00 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.930010:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80d00 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.930026:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80d00 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.930035:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05660400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826393.930041:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80d00 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.930052:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80d00 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.930073:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x0 (ffff90ce01f45c00) 00010000:00010000:0.0:1787826393.930077:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826393.930084:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80d00 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.930092:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80d00 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.930109:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660600/0x22153cd396b80d07 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.930116:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660600/0x22153cd396b80d07 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.930122:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660600/0x22153cd396b80d07 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.930128:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05660600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826393.930130:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660600/0x22153cd396b80d07 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.930140:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660600/0x22153cd396b80d07 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.930148:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x37186b36 (ffff90ce01f45b00) 00010000:00010000:0.0:1787826393.930150:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826393.930153:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660600/0x22153cd396b80d07 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.930159:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660600/0x22153cd396b80d07 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.930225:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b80cf9 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab07d1 expref: 29 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.930237:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x0 (ffff90ce01f45c00) 00010000:00010000:0.0:1787826393.930239:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826393.930243:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b80cf9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab07d1 expref: 29 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.930252:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05661000, rc 0) 00000100:00100000:0.0:1787826393.930359:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+28:54253:x1874670563761664:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 2191us (2411us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826393.930369:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3533 00000100:00100000:0.0:1787826393.936448:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826393.936935:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563761920 00000100:00100000:1.0:1787826393.936948:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563761920 00000100:00100000:1.0:1787826393.937035:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3534 00000100:00100000:1.0:1787826393.937048:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f934b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+28:54253:x1874670563761920:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826393.937078:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826393.937082:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787826393.937119:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660200/0x22153cd396b80cf2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab07ca expref: 28 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.937141:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x0 (ffff90ce01f45c00) 00010000:00010000:1.0:1787826393.937148:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826393.937167:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125c00/0x22153cd396b80d0e lrc: 2/0,0 mode: --/CW res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab07d8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.937299:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124e00/0x22153cd396b80d15 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.937315:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124e00/0x22153cd396b80d15 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.937327:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124e00/0x22153cd396b80d15 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.937356:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125800/0x22153cd396b80d1c lrc: 3/0,1 mode: --/PW res: [0x240000404:0x10:0x0].0x37186b36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.937364:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125800/0x22153cd396b80d1c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826393.937370:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125800/0x22153cd396b80d1c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826393.937903:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03a1a580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6520:1874670585208448:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787826393.937979:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826393.938388:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a180c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826393.953081:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585208448 00000100:00100000:2.0:1787826393.953102:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585208448 00000100:00100000:2.0:1787826393.953183:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1399 00000100:00100000:2.0:1787826393.953193:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:6520:x1874670585208448:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787826393.953691:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:6520:x1874670585208448:12345-0@lo:1000:mdt00_002.0 Request processed in 497us (15709us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826393.953701:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1399 00000100:00100000:2.0:1787826393.953770:0:6520:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 8589934699 gen 2 00000004:00080000:2.0:1787826393.953777:0:6520:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934699 committed transno 8589934699 00000100:00100000:2.0:1787826393.953808:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03a1a580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6520:1874670585208448:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1787826393.954697:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834400/0x22153cd396b80d23 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826393.954721:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834400/0x22153cd396b80d23 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826393.954734:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834400/0x22153cd396b80d23 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826393.954748:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0x11:0x0]: returning size 0 00010000:00010000:2.0:1787826393.954780:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124e00/0x22153cd396b80d15 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826393.954788:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124e00/0x22153cd396b80d15 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826393.954795:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124e00/0x22153cd396b80d15 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826393.954802:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124e00/0x22153cd396b80d15 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826393.954808:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05124e00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826393.954813:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124e00/0x22153cd396b80d15 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826393.954821:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124e00/0x22153cd396b80d15 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826393.954835:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x0 (ffff90ce01f45c00) 00010000:00010000:2.0:1787826393.954838:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826393.954842:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124e00/0x22153cd396b80d15 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826393.954850:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124e00/0x22153cd396b80d15 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826393.954865:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000076cde028 reply state 00000000098b6dab transno 4294967684 ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125800/0x22153cd396b80d1c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826393.954876:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125800/0x22153cd396b80d1c lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826393.954883:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x37186b36 (ffff90cf3ab61500) 00010000:00010000:2.0:1787826393.954885:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826393.954888:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787826393.954927:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125c00/0x22153cd396b80d0e lrc: 0/0,0 mode: --/CW res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab07d8 expref: 30 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826393.954941:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834400/0x22153cd396b80d23 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab07d8 expref: 29 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826393.954949:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff90cf1859ac00) 00010000:00010000:2.0:1787826393.954951:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826393.954953:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834400, rc 0) 00000100:00100000:2.0:1787826393.955020:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f934b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:54253:x1874670563761920:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 17975us (18587us total) trans 4294967684 rc 0/0 00000100:00100000:2.0:1787826393.955585:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3534 00000100:00100000:2.0:1787826393.959373:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826393.960384:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563762176 00000100:00100000:2.0:1787826393.960402:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563762176 00000100:00100000:2.0:1787826393.960729:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3535 00000100:00100000:2.0:1787826393.960746:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06305a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:54253:x1874670563762176:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826393.960853:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826393.960882:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835400/0x22153cd396b80d31 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab07df expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826393.961103:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834c00/0x22153cd396b80d38 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826393.961125:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834400/0x22153cd396b80d23 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab07d8 expref: 31 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826393.961142:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834c00/0x22153cd396b80d38 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826393.961197:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834400/0x22153cd396b80d23 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab07d8 expref: 31 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826393.961359:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834400/0x22153cd396b80d23 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab07d8 expref: 31 pid: 6520 timeout: 1439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826393.961379:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce063052c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6519:1874670585208576:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826393.961840:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a2cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826393.965547:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce063052c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6519:1874670585208576:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826393.965594:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834c00/0x22153cd396b80d38 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826393.977904:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826393.977954:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563762304 00000100:00100000:0.0:1787826393.977969:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563762304 00010000:00010000:0.0:1787826393.978024:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834400/0x22153cd396b80d23 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab07d8 expref: 32 pid: 6520 timeout: 1439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826393.978079:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1017 00000100:00100000:0.0:1787826393.978091:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce063052c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+32:2403:x1874670563762304:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826393.978110:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826393.978118:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834400/0x22153cd396b80d23 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab07d8 expref: 32 pid: 6520 timeout: 1439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.978132:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834400/0x22153cd396b80d23 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab07d8 expref: 32 pid: 6520 timeout: 1439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.978161:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834400/0x22153cd396b80d23 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab07d8 expref: 32 pid: 6520 timeout: 1439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.978180:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff90cf1859ac00) 00010000:00010000:0.0:1787826393.978187:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834c00/0x22153cd396b80d38 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.978197:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834c00/0x22153cd396b80d38 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826393.978206:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834c00/0x22153cd396b80d38 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826393.980902:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834c00/0x22153cd396b80d38 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826393.980926:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834c00/0x22153cd396b80d38 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826393.980958:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0x11:0x0]: returning size 0 00010000:00010000:0.0:1787826393.981151:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:2.0:1787826393.981385:0:6519:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x26:0x0], index 0: 0 00000004:00080000:2.0:1787826393.981396:0:6519:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x24:0x0], index 1: 0 00010000:00010000:2.0:1787826393.981896:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834c00/0x22153cd396b80d38 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826393.981909:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834c00/0x22153cd396b80d38 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826393.981917:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834c00/0x22153cd396b80d38 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826393.981924:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826393.981930:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834c00/0x22153cd396b80d38 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826393.981939:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834c00/0x22153cd396b80d38 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826393.981959:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff90cf1859ac00) 00010000:00010000:2.0:1787826393.981962:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826393.981968:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834c00/0x22153cd396b80d38 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826393.981974:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834c00/0x22153cd396b80d38 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826393.984846:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835400/0x22153cd396b80d31 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab07df expref: 32 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826393.984876:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x0 (ffff90ce01f45c00) 00010000:00010000:2.0:1787826393.984881:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787826393.984888:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835400/0x22153cd396b80d31 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab07df expref: 32 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826393.984909:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835400, rc 0) 00000100:00100000:0.0:1787826393.985120:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce063052c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:2403:x1874670563762304:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 7026us (7227us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826393.985135:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1017 00000100:00100000:2.0:1787826393.985351:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06305a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:54253:x1874670563762176:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 24609us (25993us total) trans 4294967685 rc 301/301 00000100:00100000:2.0:1787826393.985364:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3535 00000100:00100000:0.0:1787826394.001376:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826394.001616:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563762560 00000100:00100000:0.0:1787826394.001629:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563762560 00000100:00100000:0.0:1787826394.001851:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1035 00000100:00100000:0.0:1787826394.001867:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf079643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:54253:x1874670563762560:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:0.0:1787826394.002360:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf079643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:54253:x1874670563762560:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 496us (993us total) trans 4294967686 rc 0/0 00000100:00100000:0.0:1787826394.002372:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1035 00000100:00100000:2.0:1787826394.007205:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826394.007805:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563762816 00000100:00100000:0.0:1787826394.007820:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563762816 00000100:00100000:0.0:1787826394.007888:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1036 00000100:00100000:0.0:1787826394.007900:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aaf0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:54253:x1874670563762816:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:0.0:1787826394.008181:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aaf0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+32:54253:x1874670563762816:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 281us (988us total) trans 4294967687 rc 0/0 00000100:00100000:0.0:1787826394.008190:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1036 00000100:00100000:2.0:1787826394.023585:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826394.023769:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563763072 00000100:00100000:0.0:1787826394.023784:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563763072 00000100:00100000:0.0:1787826394.023865:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3536 00000100:00100000:0.0:1787826394.023877:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aaf0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+32:54254:x1874670563763072:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:0.0:1787826394.023909:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826394.023938:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b80d46 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab07e6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.024154:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660600/0x22153cd396b80d4d lrc: 3/1,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.024172:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660600/0x22153cd396b80d4d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.024192:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660600/0x22153cd396b80d4d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.024203:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80d54 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.024211:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80d54 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.024217:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80d54 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.024291:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661400/0x22153cd396b80d5b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.024299:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661400/0x22153cd396b80d5b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.024306:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661400/0x22153cd396b80d5b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826394.024316:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0x11:0x0]: returning size 0 00010000:00010000:0.0:1787826394.024596:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660600/0x22153cd396b80d4d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.024605:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660600/0x22153cd396b80d4d lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.024612:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660600/0x22153cd396b80d4d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.024618:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05660600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826394.024742:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660600/0x22153cd396b80d4d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.024753:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660600/0x22153cd396b80d4d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.024769:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x0 (ffff90ce01f45c00) 00010000:00010000:0.0:1787826394.024772:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826394.024777:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660600/0x22153cd396b80d4d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.024784:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660600/0x22153cd396b80d4d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.024799:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80d54 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.024806:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80d54 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.024811:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80d54 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.024816:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05660400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826394.024818:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80d54 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.024824:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80d54 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.024831:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x37186b36 (ffff90cf3ab61500) 00010000:00010000:0.0:1787826394.024833:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826394.024836:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80d54 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.024842:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80d54 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.024890:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661000/0x22153cd396b80d46 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab07e6 expref: 35 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.024905:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661400/0x22153cd396b80d5b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab07e6 expref: 34 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.024912:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff90ce01f45b00) 00010000:00010000:0.0:1787826394.024915:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826394.024917:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05661400, rc 0) 00000100:00100000:0.0:1787826394.025000:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aaf0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:54254:x1874670563763072:12345-192.168.203.39@tcp:101:dd.0 Request processed in 1124us (1429us total) trans 4294967688 rc 0/0 00000100:00100000:0.0:1787826394.025010:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3536 00000100:00100000:1.0:1787826394.028415:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826394.028541:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563763200 00000100:00100000:0.0:1787826394.028553:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563763200 00000100:00100000:0.0:1787826394.028641:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3537 00000100:00100000:0.0:1787826394.028652:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a1bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:54254:x1874670563763200:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:0.0:1787826394.028683:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826394.028712:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661e00/0x22153cd396b80d69 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab07ed expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.028758:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660200/0x22153cd396b80d70 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.028780:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660200/0x22153cd396b80d70 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.028793:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660200/0x22153cd396b80d70 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.028940:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661e00/0x22153cd396b80d69 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x11:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab07ed expref: 36 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.028962:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660200/0x22153cd396b80d70 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab07ed expref: 35 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.028972:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff90ce01f45b00) 00010000:00010000:0.0:1787826394.028975:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787826394.028979:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05660200, rc 0) 00000100:00100000:0.0:1787826394.029062:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a1bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:54254:x1874670563763200:12345-192.168.203.39@tcp:101:dd.0 Request processed in 412us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826394.029070:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3537 00000100:00100000:2.0:1787826394.033936:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826394.042196:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563763456 00000100:00100000:1.0:1787826394.042217:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563763456 00000100:00100000:1.0:1787826394.042312:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3538 00000100:00100000:1.0:1787826394.042324:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aaf21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:54254:x1874670563763456:12345-192.168.203.39@tcp:36:dd.0 00010000:00010000:1.0:1787826394.042432:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826394.042468:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661400/0x22153cd396b80d5b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab07e6 expref: 35 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.042522:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff90ce01f45b00) 00010000:00010000:1.0:1787826394.042528:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826394.042975:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125600/0x22153cd396b80d77 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.042996:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125600/0x22153cd396b80d77 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.043008:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125600/0x22153cd396b80d77 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787826394.043063:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967689 00000004:00010000:1.0:1787826394.043089:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000932d8ba6 reply state 00000000d259b71d transno 4294967690 ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125600/0x22153cd396b80d77 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.043102:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125600/0x22153cd396b80d77 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.043108:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff90ce01f45b00) 00010000:00010000:1.0:1787826394.043112:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826394.043115:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826394.043312:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aaf21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:54254:x1874670563763456:12345-192.168.203.39@tcp:36:dd.0 Request processed in 988us (9388us total) trans 4294967690 rc 0/0 00000100:00100000:1.0:1787826394.043320:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3538 00000020:00080000:1.0:1787826394.043326:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787826394.051384:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826394.051529:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563763584 00000100:00100000:0.0:1787826394.051543:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563763584 00000100:00100000:0.0:1787826394.051615:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3539 00000100:00100000:0.0:1787826394.051626:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:54254:x1874670563763584:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:0.0:1787826394.051658:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826394.051684:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661e00/0x22153cd396b80d7e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab07f4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826394.052275:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661e00/0x22153cd396b80d7e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab07f4 expref: 38 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826394.052295:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661e00/0x22153cd396b80d7e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab07f4 expref: 38 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826394.052320:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff90ce01f45b00) 00010000:00010000:2.0:1787826394.052324:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826394.052341:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05661e00, rc 0) 00000100:00100000:2.0:1787826394.052427:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:54254:x1874670563763584:12345-192.168.203.39@tcp:101:dd.0 Request processed in 802us (1058us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826394.052436:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3539 00000100:00100000:0.0:1787826394.055618:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826394.055881:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563763840 00000100:00100000:1.0:1787826394.055894:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563763840 00000100:00100000:1.0:1787826394.055974:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3540 00000100:00100000:2.0:1787826394.056118:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:54254:x1874670563763840:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:2.0:1787826394.056146:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826394.056152:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787826394.056189:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661e00/0x22153cd396b80d7e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab07f4 expref: 38 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826394.056214:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff90ce01f45b00) 00010000:00010000:2.0:1787826394.056220:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826394.056238:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835800/0x22153cd396b80d85 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab07fb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826394.056306:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835200/0x22153cd396b80d8c lrc: 3/0,1 mode: --/EX res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826394.056323:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835200/0x22153cd396b80d8c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x11:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826394.056344:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835200/0x22153cd396b80d8c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x11:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787826394.056692:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].28, 88 off10392 00000004:00080000:2.0:1787826394.056704:0:6518:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1340068232145ns, next at 1201607267971ns, rc = 0 00000040:00080000:2.0:1787826394.056745:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].26, 88 off10216 00000004:00080000:2.0:1787826394.056751:0:6518:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1340068279617ns, next at 1201610029598ns, rc = 0 00000001:00080000:2.0:1787826394.061460:0:7449:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967691 is committed 00000004:00080000:2.0:1787826394.061510:0:7449:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 27 committed 00000004:00080000:2.0:1787826394.061522:0:7449:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 30 committed 00000001:00080000:2.0:1787826394.061562:0:7449:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967683 is committed 00000020:00080000:2.0:1787826394.061572:0:7449:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff90cf038a40c0 refcount 2 committed 0 result 0 batchid 22 00000020:00080000:2.0:1787826394.061580:0:7449:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cf2f56e800 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff90cf038a4780 00000020:00080000:2.0:1787826394.061584:0:7449:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000401:0x2:0x0].16 00000020:00080000:2.0:1787826394.061587:0:7449:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cf2f56e700 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90cf26c05e00 00000020:00080000:2.0:1787826394.061590:0:7449:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].19 00000020:00080000:1.0:1787826394.061666:0:7472:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 22 committed batchid 21 00010000:00010000:2.0:1787826394.061702:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835200/0x22153cd396b80d8c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x11:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab07fb expref: 31 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826394.061719:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff90ce01f45b00) 00010000:00010000:2.0:1787826394.061723:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1787826394.061748:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835800/0x22153cd396b80d85 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab07fb expref: 31 pid: 6518 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787826394.061767:0:7472:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 21 00010000:00010000:2.0:1787826394.061775:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835200/0x22153cd396b80d8c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x11:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab07fb expref: 30 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826394.061814:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff90ce01f45b00) 00010000:00010000:2.0:1787826394.061817:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1787826394.061819:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835200, rc 0) 00000100:00100000:1.0:1787826394.061871:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03a192c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585208704:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1787826394.061911:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:54254:x1874670563763840:12345-192.168.203.39@tcp:101:dd.0 Request processed in 5923us (6308us total) trans 4294967691 rc 0/0 00000100:00100000:2.0:1787826394.061922:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3540 00000100:00100000:1.0:1787826394.061944:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826394.062015:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585208704 00010000:00010000:0.0:1787826394.062160:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660800/0x22153cd396b80c82 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.062171:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660800/0x22153cd396b80c82 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.062179:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660800/0x22153cd396b80c82 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.062186:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05660800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826394.062191:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660800/0x22153cd396b80c82 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.062200:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660800/0x22153cd396b80c82 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.062212:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x0 (ffff90ce01f45c00) 00010000:00010000:0.0:1787826394.062215:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826394.062219:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660800/0x22153cd396b80c82 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.062226:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660800/0x22153cd396b80c82 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.062243:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125800/0x22153cd396b80d1c lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.062249:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125800/0x22153cd396b80d1c lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826394.062253:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585208704 00010000:00010000:0.0:1787826394.062255:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125800/0x22153cd396b80d1c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.062267:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05125800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826394.062270:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125800/0x22153cd396b80d1c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.062276:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125800/0x22153cd396b80d1c lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.062286:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x37186b36 (ffff90cf3ab61500) 00010000:00010000:0.0:1787826394.062288:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826394.062291:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125800/0x22153cd396b80d1c lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.062298:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125800/0x22153cd396b80d1c lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.062317:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125600/0x22153cd396b80d77 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.062325:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125600/0x22153cd396b80d77 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826394.062325:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1923 00010000:00010000:0.0:1787826394.062346:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125600/0x22153cd396b80d77 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826394.062354:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a18f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874670585208704:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:0.0:1787826394.062355:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05125600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826394.062360:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125600/0x22153cd396b80d77 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.062367:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125600/0x22153cd396b80d77 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.062379:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff90ce01f45b00) 00010000:00010000:0.0:1787826394.062382:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826394.062385:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125600/0x22153cd396b80d77 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.062392:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125600/0x22153cd396b80d77 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826394.062443:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787826394.062452:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fdfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585208832:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1787826394.062525:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826394.062559:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585208832 00000100:00100000:0.0:1787826394.062563:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585208832 00000100:00100000:0.0:1787826394.062596:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1924 00000100:00100000:0.0:1787826394.062603:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3646:x1874670585208832:12345-0@lo:2:osp-syn-0-1.0 00000100:00080000:3.0:1787826394.064454:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787826394.064465:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826394.064856:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826394.065168:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563763968 00000100:00100000:3.0:1787826394.065178:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563763968 00000100:00100000:3.0:1787826394.065268:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1925 00000100:00100000:3.0:1787826394.065278:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa86580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:54254:x1874670563763968:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:3.0:1787826394.065298:0:30695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826394.065323:0:30695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc2068bb/0x22153cd396b80d93 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0802 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826394.065381:0:30695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826394.065406:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=1340s v=(0 0) 00010000:00010000:3.0:1787826394.065411:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826394.065422:0:30695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc2068bb/0x22153cd396b80d93 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0802 expref: 8 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826394.065443:0:30695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dc2068bb/0x22153cd396b80d93 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0802 expref: 8 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826394.065458:0:30695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400800, rc 0) 00000100:00100000:3.0:1787826394.065556:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa86580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:54254:x1874670563763968:12345-192.168.203.39@tcp:101:dd.0 Request processed in 280us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826394.065564:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1925 00002000:00010000:0.0:1787826394.065735:0:30398:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x26:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787826394.065750:0:30398:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x26:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1787826394.065753:0:30398:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x26:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787826394.065761:0:30398:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x26:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1787826394.065764:0:30398:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x26:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1787826394.065816:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+6:3646:x1874670585208832:12345-0@lo:2:osp-syn-0-1.0 Request processed in 3213us (3290us total) trans 21474836966 rc 0/0 00000100:00100000:0.0:1787826394.065825:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1924 00000004:00080000:2.0:1787826394.066933:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce01fdfc00/2, rc 0, transno 21474836966 00000100:00100000:2.0:1787826394.066947:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fdfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585208832:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1787826394.071536:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000004:00080000:0.0:1787826394.071664:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce03a192c0/2, rc 0, transno 17179869630 00000100:00100000:0.0:1787826394.071674:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03a192c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585208704:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1787826394.071692:0:30173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563764096 00000100:00100000:3.0:1787826394.071701:0:30173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563764096 00000100:00100000:1.0:1787826394.071717:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a18f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3646:x1874670585208704:12345-0@lo:2:osp-syn-1-1.0 Request processed in 9195us (9600us total) trans 17179869630 rc 0/0 00000100:00100000:1.0:1787826394.071733:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1923 00002000:00010000:3.0:1787826394.071748:0:30173:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/38 (1045504->18446744073709551615) 00002000:00100000:3.0:1787826394.071755:0:30173:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf3aa87c00 with x1874670563764096 ext(1045504->18446744073709551615) 00002000:00010000:3.0:1787826394.071768:0:30173:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf3aa87c00. 00000100:00100000:3.0:1787826394.071803:0:30173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 734 00000100:00100000:3.0:1787826394.071813:0:30173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa87c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2403:x1874670563764096:12345-192.168.203.39@tcp:10:dd.0 00002000:00010000:3.0:1787826394.072064:0:30173:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x26:0x0] updating lvb size from disk: 0 -> 1045504 00002000:00010000:3.0:1787826394.072069:0:30173:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x26:0x0] updating lvb mtime from disk: 0 -> 1787826394 00002000:00010000:3.0:1787826394.072072:0:30173:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x26:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787826394.072074:0:30173:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x26:0x0] updating lvb ctime from disk: 0 -> 1787826394 00002000:00010000:3.0:1787826394.072076:0:30173:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x26:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1787826394.072135:0:30173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa87c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670563764096:12345-192.168.203.39@tcp:10:dd.0 Request processed in 322us (676us total) trans 21474836967 rc 0/0 00000100:00100000:3.0:1787826394.072142:0:30173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 734 00002000:00010000:3.0:1787826394.072145:0:30173:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/38 (1045504->18446744073709551615) 00002000:00100000:3.0:1787826394.072149:0:30173:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf3aa87c00 with x1874670563764096 ext(1045504->18446744073709551615) 00002000:00010000:3.0:1787826394.072153:0:30173:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf3aa87c00. 00000100:00100000:3.0:1787826394.090956:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826394.093695:0:30176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563764224 00000100:00100000:2.0:1787826394.093714:0:30176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563764224 00002000:00100000:3.0:1787826394.095968:0:30176:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x280000400:0x26:0x0] (1044480->1048575) req@ffff90cf3f875a40 x1874670563764224/t0(0) o3->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:750/0 lens 488/0 e 0 to 0 dl 1787826405 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826394.095993:0:30176:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf3f875a40 with x1874670563764224 ext(1044480->1048575) 00002000:00010000:3.0:1787826394.096003:0:30176:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf3f875a40 00000100:00100000:3.0:1787826394.096065:0:30176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 735 00000100:00100000:3.0:1787826394.096076:0:30176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f875a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2402:x1874670563764224:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:3.0:1787826394.096350:0:30176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f875a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2402:x1874670563764224:12345-192.168.203.39@tcp:3:dd.0 Request processed in 275us (5409us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787826394.096359:0:30176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 735 00002000:00100000:3.0:1787826394.096366:0:30176:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x280000400:0x26:0x0] (1044480->1048575) req@ffff90cf3f875a40 x1874670563764224/t0(0) o3->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:750/0 lens 488/4536 e 0 to 0 dl 1787826405 ref 1 fl Complete:/600/0 rc 4096/4096 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787826394.096375:0:30176:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf3f875a40 with x1874670563764224 ext(1044480->1048575) 00002000:00010000:3.0:1787826394.096379:0:30176:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf3f875a40 00000100:00100000:2.0:1787826394.106852:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826394.108463:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563764480 00000100:00100000:1.0:1787826394.108548:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563764480 00000100:00100000:1.0:1787826394.108650:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3541 00000100:00100000:1.0:1787826394.108664:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:54254:x1874670563764480:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:1.0:1787826394.108697:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826394.108702:0:9966:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787826394.108739:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835200/0x22153cd396b80d8c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x11:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab07fb expref: 27 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.108770:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff90ce01f45b00) 00010000:00010000:1.0:1787826394.108776:0:9966:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826394.108798:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125200/0x22153cd396b80d9a lrc: 2/0,0 mode: --/EX res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0809 expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.108860:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124a00/0x22153cd396b80da1 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.108876:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124a00/0x22153cd396b80da1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x11:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.108887:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124a00/0x22153cd396b80da1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x11:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787826394.109178:0:9966:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x27:0x0], index 0: 0 00000040:00080000:1.0:1787826394.109288:0:9966:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].29, 88 off10480 00000004:00080000:1.0:1787826394.109297:0:9966:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1340120824909ns, next at 1201607267971ns, rc = 0 00000040:00080000:1.0:1787826394.109324:0:9966:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].30, 88 off10568 00000004:00080000:1.0:1787826394.109340:0:9966:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1340120867539ns, next at 1201607267971ns, rc = 0 00000040:00080000:1.0:1787826394.109363:0:9966:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].27, 88 off10304 00000004:00080000:1.0:1787826394.109368:0:9966:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1340120896228ns, next at 1201610029598ns, rc = 0 00000001:00080000:0.0:1787826394.113409:0:7449:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967692 is committed 00000004:00080000:0.0:1787826394.113427:0:7449:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 28 committed 00000004:00080000:0.0:1787826394.113449:0:7449:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 32 committed 00000004:00080000:0.0:1787826394.113464:0:7449:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 31 committed 00000020:00080000:0.0:1787826394.113517:0:7449:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 22 batchid updated 00000100:00100000:3.0:1787826394.113679:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787826394.113706:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f8761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585208960:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1787826394.113799:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826394.113875:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585208960 00000100:00100000:3.0:1787826394.113884:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585208960 00000100:00100000:3.0:1787826394.113944:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1926 00000100:00100000:3.0:1787826394.113955:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1874670585208960:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1787826394.114452:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+7:3645:x1874670585208960:12345-0@lo:2:osp-syn-1-1.0 Request processed in 497us (651us total) trans 17179869631 rc 0/0 00000100:00100000:3.0:1787826394.114462:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1926 00000004:00080000:3.0:1787826394.114558:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3f8761c0/2, rc 0, transno 17179869631 00000100:00100000:3.0:1787826394.114565:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f8761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585208960:0@lo:2:osp-syn-1-1.0 00000020:00080000:2.0:1787826394.115117:0:7472:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 22 00000004:00080000:2.0:1787826394.115194:0:7472:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff90cf10a2c480 with version 35 00000020:00080000:2.0:1787826394.115215:0:7472:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 22 cancel update log [0x200000401:0x2:0x0].16: rc = 0 00000004:00080000:3.0:1787826394.115298:0:7464:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff90cf076a8cc0 version 35 rpc_version 35 00000020:00080000:2.0:1787826394.115299:0:7472:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 22 cancel update log [0x240000400:0x2:0x0].19: rc = 0 00000020:00080000:2.0:1787826394.115317:0:7472:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 22 00000020:00100000:3.0:1787826394.115342:0:7464:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787826394.115354:0:7464:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff90cf3f876580 x1874670585209216/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787826394.115383:0:7464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f876580 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7464:1874670585209216:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787826394.115460:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826394.115740:0:7464:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf078fed80 going to sleep for 11 seconds 00000100:00100000:3.0:1787826394.115763:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03a18780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585209344:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1787826394.115798:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03a19e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585209472:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1787826394.115800:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826394.115840:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787826394.116941:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124a00/0x22153cd396b80da1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x11:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0809 expref: 28 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.116961:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff90ce01f45b00) 00010000:00010000:0.0:1787826394.116964:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1787826394.116986:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125200/0x22153cd396b80d9a lrc: 0/0,0 mode: --/EX res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0809 expref: 28 pid: 9966 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.117009:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124a00/0x22153cd396b80da1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x11:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0809 expref: 27 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.117060:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff90ce01f45b00) 00010000:00010000:0.0:1787826394.117063:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1787826394.117066:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05124a00, rc 0) 00000100:00100000:0.0:1787826394.117155:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:54254:x1874670563764480:12345-192.168.203.39@tcp:101:dd.0 Request processed in 8493us (10430us total) trans 4294967692 rc 0/0 00000100:00100000:0.0:1787826394.117165:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3541 00000100:00100000:2.0:1787826394.118667:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585209216 00000100:00100000:2.0:1787826394.118685:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585209216 00000100:00100000:2.0:1787826394.118773:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1400 00000100:00100000:2.0:1787826394.118785:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:7464:x1874670585209216:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787826394.119345:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:7464:x1874670585209216:12345-0@lo:1000:osp_up0-1.0 Request processed in 561us (3883us total) trans 8589934700 rc 0/0 00000100:00100000:2.0:1787826394.119355:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1400 00000100:00100000:3.0:1787826394.119451:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585209344 00000100:00100000:3.0:1787826394.119458:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585209344 00000100:00100000:3.0:1787826394.119674:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585209472 00000100:00100000:3.0:1787826394.119679:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585209472 00000100:00100000:0.0:1787826394.119704:0:7464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f876580 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7464:1874670585209216:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787826394.119716:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1927 00000100:00100000:3.0:1787826394.119727:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9ae580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+7:3645:x1874670585209344:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1787826394.120729:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1928 00000100:00100000:2.0:1787826394.120748:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a1b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+8:3646:x1874670585209472:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1787826394.121077:0:28853:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x26:0x0] updating lvb size from disk: 1045504 -> 1045504 00002000:00010000:3.0:1787826394.121082:0:28853:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x26:0x0] updating lvb mtime from disk: 1787826394 -> 1787826394 00002000:00010000:3.0:1787826394.121085:0:28853:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x26:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787826394.121087:0:28853:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x26:0x0] updating lvb ctime from disk: 1787826394 -> 1787826394 00002000:00010000:3.0:1787826394.121089:0:28853:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x26:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1787826394.121175:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9ae580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+8:3645:x1874670585209344:12345-0@lo:2:osp-syn-0-1.0 Request processed in 1451us (5375us total) trans 21474836968 rc 0/0 00000100:00100000:3.0:1787826394.121185:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1927 00000004:00080000:0.0:1787826394.121845:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce03a18780/2, rc 0, transno 21474836968 00000100:00100000:0.0:1787826394.121856:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03a18780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585209344:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1787826394.123448:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a1b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+8:3646:x1874670585209472:12345-0@lo:2:osp-syn-0-1.0 Request processed in 2701us (7600us total) trans 21474836969 rc 0/0 00000100:00100000:2.0:1787826394.123462:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1928 00000004:00080000:1.0:1787826394.124174:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce03a19e00/2, rc 0, transno 21474836969 00000100:00100000:1.0:1787826394.124185:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03a19e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585209472:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1787826394.129775:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826394.130053:0:14865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563764608 00000100:00100000:1.0:1787826394.130065:0:14865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563764608 00002000:00100000:1.0:1787826394.130137:0:14865:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x26:0x0] (1044480->1048575) req@ffff90cf3aa84f00 x1874670563764608/t0(0) o4->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:750/0 lens 4584/0 e 0 to 0 dl 1787826405 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826394.130151:0:14865:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf3aa84f00 with x1874670563764608 ext(1044480->1048575) 00002000:00010000:1.0:1787826394.130158:0:14865:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf3aa84f00 00000100:00100000:1.0:1787826394.130193:0:14865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 736 00000100:00100000:1.0:1787826394.130203:0:14865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa84f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563764608:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:1.0:1787826394.131205:0:14865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa84f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2404:x1874670563764608:12345-192.168.203.39@tcp:4:dd.0 Request processed in 995us (1436us total) trans 21474836970 rc 0/0 00000100:00100000:1.0:1787826394.131217:0:14865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 736 00002000:00100000:1.0:1787826394.131228:0:14865:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x26:0x0] (1044480->1048575) req@ffff90cf3aa84f00 x1874670563764608/t21474836970(0) o4->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:750/0 lens 4584/448 e 0 to 0 dl 1787826405 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787826394.131237:0:14865:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf3aa84f00 with x1874670563764608 ext(1044480->1048575) 00002000:00010000:1.0:1787826394.131242:0:14865:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf3aa84f00 00000100:00100000:3.0:1787826394.137745:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826394.138660:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563764736 00000100:00100000:0.0:1787826394.138675:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563764736 00000100:00100000:0.0:1787826394.138945:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1929 00000100:00100000:0.0:1787826394.138959:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce039761c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:54254:x1874670563764736:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:0.0:1787826394.138986:0:30695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826394.139014:0:30695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ab9f4ae/0x22153cd396b80da8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0810 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826394.139045:0:30695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826394.139074:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=1340s v=(0 0) 00010000:00010000:0.0:1787826394.139080:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826394.139091:0:30695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ab9f4ae/0x22153cd396b80da8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->1052671) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0810 expref: 12 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.139115:0:30695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002ab9f4ae/0x22153cd396b80da8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->1052671) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0810 expref: 12 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.139131:0:30695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05660800, rc 0) 00000100:00100000:0.0:1787826394.139211:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce039761c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:54254:x1874670563764736:12345-192.168.203.39@tcp:101:dd.0 Request processed in 256us (1482us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826394.139220:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1929 00000100:00100000:2.0:1787826394.147384:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826394.147964:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563764992 00000100:00100000:0.0:1787826394.147978:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563764992 00000100:00100000:0.0:1787826394.148061:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1037 00000100:00100000:0.0:1787826394.148073:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:54254:x1874670563764992:12345-192.168.203.39@tcp:35:dd.0 00000100:00100000:0.0:1787826394.148956:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+28:54254:x1874670563764992:12345-192.168.203.39@tcp:35:dd.0 Request processed in 878us (1581us total) trans 4294967693 rc 0/0 00000100:00100000:0.0:1787826394.148970:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1037 00000100:00100000:2.0:1787826394.177299:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826394.178015:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563765248 00000100:00100000:1.0:1787826394.178031:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563765248 00000100:00100000:1.0:1787826394.178115:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3542 00000100:00100000:1.0:1787826394.178127:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa85a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+28:54256:x1874670563765248:12345-192.168.203.39@tcp:101:fallocate.0 00010000:00010000:1.0:1787826394.178158:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826394.178185:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124c00/0x22153cd396b80daf lrc: 2/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0817 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.178297:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124400/0x22153cd396b80db6 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.178315:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124400/0x22153cd396b80db6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.178340:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124400/0x22153cd396b80db6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.178358:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125e00/0x22153cd396b80dbd lrc: 3/1,0 mode: --/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.178365:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125e00/0x22153cd396b80dbd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.178373:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125e00/0x22153cd396b80dbd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.178580:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125a00/0x22153cd396b80dc4 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.178590:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125a00/0x22153cd396b80dc4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.178598:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125a00/0x22153cd396b80dc4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826394.178609:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0x11:0x0]: returning size 1065984 00010000:00010000:1.0:1787826394.179060:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124400/0x22153cd396b80db6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.179071:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124400/0x22153cd396b80db6 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.179078:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124400/0x22153cd396b80db6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.179085:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05124400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826394.179090:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124400/0x22153cd396b80db6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.179098:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124400/0x22153cd396b80db6 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.179113:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x0 (ffff90ce01f45c00) 00010000:00010000:1.0:1787826394.179117:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826394.179122:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124400/0x22153cd396b80db6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.179129:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124400/0x22153cd396b80db6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.179146:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125e00/0x22153cd396b80dbd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.179152:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125e00/0x22153cd396b80dbd lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.179157:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125e00/0x22153cd396b80dbd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.179163:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05125e00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826394.179166:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125e00/0x22153cd396b80dbd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.179173:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125e00/0x22153cd396b80dbd lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.179180:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x37186b36 (ffff90cf3ab61a00) 00010000:00010000:1.0:1787826394.179183:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826394.179186:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125e00/0x22153cd396b80dbd lrc: 2/0,0 mode: --/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.179193:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125e00/0x22153cd396b80dbd lrc: 0/0,0 mode: --/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.179382:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124c00/0x22153cd396b80daf lrc: 0/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0817 expref: 31 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.179402:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125a00/0x22153cd396b80dc4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0817 expref: 30 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.179411:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff90ce01f45b00) 00010000:00010000:1.0:1787826394.179414:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826394.179416:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05125a00, rc 0) 00000100:00100000:1.0:1787826394.179981:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa85a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:54256:x1874670563765248:12345-192.168.203.39@tcp:101:fallocate.0 Request processed in 1851us (2692us total) trans 4294967694 rc 0/0 00000100:00100000:1.0:1787826394.179994:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3542 00000100:00100000:3.0:1787826394.184686:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826394.184741:0:30175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563765376 00000100:00100000:1.0:1787826394.184754:0:30175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563765376 00000100:00100000:1.0:1787826394.184853:0:30175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 737 00000100:00100000:1.0:1787826394.184866:0:30175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce039743c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2402:x1874670563765376:12345-192.168.203.39@tcp:22:fallocate.0 00002000:00010000:1.0:1787826394.185178:0:30175:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x26:0x0] updating lvb size from disk: 1045504 -> 1048576 00002000:00010000:1.0:1787826394.185182:0:30175:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x26:0x0] updating lvb mtime from disk: 1787826394 -> 1787826394 00002000:00010000:1.0:1787826394.185184:0:30175:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x26:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787826394.185186:0:30175:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x26:0x0] updating lvb ctime from disk: 1787826394 -> 1787826394 00002000:00010000:1.0:1787826394.185187:0:30175:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x26:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1787826394.185432:0:30175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce039743c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2402:x1874670563765376:12345-192.168.203.39@tcp:22:fallocate.0 Request processed in 567us (760us total) trans 21474836971 rc 0/0 00000100:00100000:1.0:1787826394.185442:0:30175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 737 00000100:00100000:2.0:1787826394.195882:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826394.195997:0:25423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563765504 00000100:00100000:0.0:1787826394.196011:0:25423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563765504 00002000:00100000:0.0:1787826394.196081:0:25423:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000400:0x27:0x0] (1048576->1065983) req@ffff90cf3aa861c0 x1874670563765504/t0(0) o4->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:750/0 lens 488/0 e 0 to 0 dl 1787826405 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826394.196095:0:25423:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf3aa861c0 with x1874670563765504 ext(1048576->1065983) 00002000:00010000:0.0:1787826394.196102:0:25423:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf3aa861c0 00000100:00100000:0.0:1787826394.196191:0:25423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 738 00000100:00100000:0.0:1787826394.196204:0:25423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2401:x1874670563765504:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1787826394.208999:0:25423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2401:x1874670563765504:12345-192.168.203.39@tcp:4:dd.0 Request processed in 12780us (13116us total) trans 21474836972 rc 0/0 00000100:00100000:0.0:1787826394.209018:0:25423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 738 00002000:00100000:0.0:1787826394.209037:0:25423:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000400:0x27:0x0] (1048576->1065983) req@ffff90cf3aa861c0 x1874670563765504/t21474836972(0) o4->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:750/0 lens 488/448 e 0 to 0 dl 1787826405 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826394.209050:0:25423:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf3aa861c0 with x1874670563765504 ext(1048576->1065983) 00002000:00010000:0.0:1787826394.209057:0:25423:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf3aa861c0 00000100:00100000:2.0:1787826394.218374:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826394.219093:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563765632 00000100:00100000:0.0:1787826394.219110:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563765632 00000100:00100000:0.0:1787826394.219202:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3543 00000100:00100000:0.0:1787826394.219214:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:54256:x1874670563765632:12345-192.168.203.39@tcp:44:fallocate.0 00000100:00100000:0.0:1787826394.220253:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:54256:x1874670563765632:12345-192.168.203.39@tcp:44:fallocate.0 Request processed in 1031us (1885us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826394.220266:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3543 00000100:00100000:3.0:1787826394.225467:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826394.226039:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563765760 00000100:00100000:1.0:1787826394.226053:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563765760 00000100:00100000:1.0:1787826394.226130:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1930 00000100:00100000:1.0:1787826394.226140:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03975a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2403:x1874670563765760:12345-192.168.203.39@tcp:16:fallocate.0 00000100:00100000:2.0:1787826394.227601:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826394.227768:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563765888 00000100:00100000:3.0:1787826394.227779:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563765888 00000100:00100000:3.0:1787826394.227844:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1931 00000100:00100000:3.0:1787826394.227855:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2403:x1874670563765888:12345-192.168.203.39@tcp:16:fallocate.0 00000001:00080000:1.0:1787826394.230382:0:26205:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836972 is committed 00000001:00080000:1.0:1787826394.230418:0:26205:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836969 is committed 00000100:00100000:2.0:1787826394.239920:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03975a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670563765760:12345-192.168.203.39@tcp:16:fallocate.0 Request processed in 13764us (14449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826394.239937:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1930 00000100:00100000:3.0:1787826394.243188:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670563765888:12345-192.168.203.39@tcp:16:fallocate.0 Request processed in 15317us (15583us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826394.243205:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1931 00000100:00100000:2.0:1787826394.250847:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826394.254788:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563766144 00000100:00100000:3.0:1787826394.254813:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563766144 00000100:00100000:0.0:1787826394.264763:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1038 00000100:00100000:0.0:1787826394.264784:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf18581850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:54256:x1874670563766144:12345-192.168.203.39@tcp:35:fallocate.0 00000100:00100000:0.0:1787826394.265198:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf18581850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:54256:x1874670563766144:12345-192.168.203.39@tcp:35:fallocate.0 Request processed in 419us (14365us total) trans 4294967695 rc 0/0 00000100:00100000:0.0:1787826394.265209:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1038 00000100:00100000:2.0:1787826394.328975:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826394.337913:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563766400 00000100:00100000:0.0:1787826394.337936:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563766400 00000100:00100000:2.0:1787826394.352672:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3544 00000100:00100000:2.0:1787826394.352693:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:54258:x1874670563766400:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826394.352729:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826394.352762:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835c00/0x22153cd396b80dd2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab081e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826394.352918:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0x10:0x0]: returning size 4096 00010000:00010000:2.0:1787826394.353051:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835c00/0x22153cd396b80dd2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab081e expref: 33 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826394.353069:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cf39e67e00) 00010000:00010000:2.0:1787826394.353073:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787826394.353079:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835c00/0x22153cd396b80dd2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab081e expref: 33 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826394.353116:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835c00, rc 0) 00000100:00100000:2.0:1787826394.353206:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+32:54258:x1874670563766400:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 519us (24245us total) trans 4294967696 rc 301/301 00000100:00100000:2.0:1787826394.353215:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3544 00000100:00100000:1.0:1787826394.361468:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826394.361617:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563766528 00000100:00100000:0.0:1787826394.361629:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563766528 00000100:00100000:0.0:1787826394.361704:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3545 00000100:00100000:0.0:1787826394.361714:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a19680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+32:54258:x1874670563766528:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:0.0:1787826394.361817:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80de0 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.361838:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80de0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.361851:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80de0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.361868:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660600/0x22153cd396b80de7 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.361877:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660600/0x22153cd396b80de7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.361884:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660600/0x22153cd396b80de7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.361972:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661a00/0x22153cd396b80dee lrc: 3/1,0 mode: --/PR res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.361981:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661a00/0x22153cd396b80dee lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.361994:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661a00/0x22153cd396b80dee lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826394.362039:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0x11:0x0]: returning size 1065984 00000004:00200000:0.0:1787826394.362044:0:9966:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826394.362057:0:9966:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661a00/0x22153cd396b80dee lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.362072:0:9966:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80de0 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.362080:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80de0 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.362087:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80de0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.362094:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80de0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.362100:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05660400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826394.362105:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80de0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.362124:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80de0 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.362137:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x0 (ffff90ce01f45c00) 00010000:00010000:0.0:1787826394.362140:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826394.362145:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80de0 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.362157:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80de0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.362173:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660600/0x22153cd396b80de7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.362179:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660600/0x22153cd396b80de7 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.362186:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660600/0x22153cd396b80de7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.362191:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05660600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826394.362194:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660600/0x22153cd396b80de7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.362199:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660600/0x22153cd396b80de7 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.362205:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x37186b36 (ffff90cf3abcb900) 00010000:00010000:0.0:1787826394.362208:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826394.362210:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660600/0x22153cd396b80de7 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.362216:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660600/0x22153cd396b80de7 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.362231:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661a00/0x22153cd396b80dee lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.362237:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661a00/0x22153cd396b80dee lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.362244:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661a00/0x22153cd396b80dee lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.362249:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05661a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826394.362252:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661a00/0x22153cd396b80dee lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.362257:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661a00/0x22153cd396b80dee lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.362264:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff90ce01f45b00) 00010000:00010000:0.0:1787826394.362266:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826394.362268:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661a00/0x22153cd396b80dee lrc: 2/0,0 mode: --/PR res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.362274:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661a00/0x22153cd396b80dee lrc: 0/0,0 mode: --/PR res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826394.362366:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a19680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+32:54258:x1874670563766528:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 651us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826394.362374:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3545 00000100:00100000:1.0:1787826394.367390:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826394.368968:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563766784 00000100:00100000:0.0:1787826394.368986:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563766784 00000100:00100000:0.0:1787826394.369069:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1039 00000100:00100000:0.0:1787826394.369079:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a1a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+32:54258:x1874670563766784:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:0.0:1787826394.369385:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a1a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:54258:x1874670563766784:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 307us (2011us total) trans 4294967697 rc 0/0 00000100:00100000:0.0:1787826394.369395:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1039 00000100:00100000:2.0:1787826394.423803:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826394.423979:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563767040 00000100:00100000:1.0:1787826394.423992:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563767040 00000100:00100000:1.0:1787826394.424067:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3546 00000100:00100000:1.0:1787826394.424079:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c87840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:54260:x1874670563767040:12345-192.168.203.39@tcp:101:lseek_test.0 00010000:00010000:1.0:1787826394.424111:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826394.424139:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125200/0x22153cd396b80df5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0825 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.424322:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125600/0x22153cd396b80dfc lrc: 3/1,0 mode: --/PR res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.424352:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125600/0x22153cd396b80dfc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.424366:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125600/0x22153cd396b80dfc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826394.424380:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0x11:0x0]: returning size 1065984 00010000:00010000:1.0:1787826394.424570:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125200/0x22153cd396b80df5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0825 expref: 36 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.424594:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125600/0x22153cd396b80dfc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0825 expref: 35 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.424605:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff90ce01f45b00) 00010000:00010000:1.0:1787826394.424608:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826394.424612:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05125600, rc 0) 00000100:00100000:1.0:1787826394.424694:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c87840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:54260:x1874670563767040:12345-192.168.203.39@tcp:101:lseek_test.0 Request processed in 618us (906us total) trans 4294967698 rc 0/0 00000100:00100000:1.0:1787826394.424704:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3546 00000100:00100000:1.0:1787826394.432449:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826394.432539:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826394.432575:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826394.435179:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563767296 00000100:00100000:3.0:1787826394.435201:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563767296 00000100:00100000:3.0:1787826394.435287:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563767424 00000100:00100000:3.0:1787826394.435291:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563767424 00000100:00100000:3.0:1787826394.435321:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1932 00000100:00100000:3.0:1787826394.435346:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05120b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2401:x1874670563767296:12345-192.168.203.39@tcp:23:lseek_test.0 00010000:00010000:2.0:1787826394.436376:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826394.436402:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1933 00000100:00100000:2.0:1787826394.436419:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05122940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2401:x1874670563767424:12345-192.168.203.39@tcp:23:lseek_test.0 00000100:00100000:0.0:1787826394.436549:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563767168 00000100:00100000:0.0:1787826394.436557:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563767168 00000100:00100000:0.0:1787826394.436615:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 346 00000100:00100000:0.0:1787826394.436624:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a1ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:2404:x1874670563767168:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826394.436636:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826394.436666:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125600/0x22153cd396b80dfc lrc: 0/0,0 mode: --/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0825 expref: 35 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.436690:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff90ce01f45b00) 00010000:00010000:0.0:1787826394.436696:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826394.438072:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05120b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2401:x1874670563767296:12345-192.168.203.39@tcp:23:lseek_test.0 Request processed in 2717us (5520us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826394.438088:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1932 00000100:00100000:2.0:1787826394.439189:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05122940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2401:x1874670563767424:12345-192.168.203.39@tcp:23:lseek_test.0 Request processed in 2767us (6601us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826394.439203:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1933 00000100:00100000:1.0:1787826394.441109:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a1ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:2404:x1874670563767168:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4469us (8657us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826394.441126:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 346 00000100:00100000:3.0:1787826394.451113:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826394.451172:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563767680 00000100:00100000:0.0:1787826394.451185:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563767680 00000100:00100000:0.0:1787826394.451264:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1040 00000100:00100000:0.0:1787826394.451278:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03974780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:54260:x1874670563767680:12345-192.168.203.39@tcp:35:lseek_test.0 00000100:00100000:0.0:1787826394.451646:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03974780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:54260:x1874670563767680:12345-192.168.203.39@tcp:35:lseek_test.0 Request processed in 369us (548us total) trans 4294967699 rc 0/0 00000100:00100000:0.0:1787826394.451656:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1040 00000100:00100000:2.0:1787826394.495148:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826394.495276:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563767936 00000100:00100000:0.0:1787826394.495289:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563767936 00000100:00100000:0.0:1787826394.495379:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3547 00000100:00100000:0.0:1787826394.495390:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:54261:x1874670563767936:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826394.495422:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826394.495452:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660600/0x22153cd396b80e0a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab082c expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.495644:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80e11 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.495663:0:32404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125a00/0x22153cd396b80dc4 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0817 expref: 36 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.495674:0:32404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80e11 lrc: 4/0,1 mode: --/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.495713:0:32404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125a00/0x22153cd396b80dc4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0817 expref: 36 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.495727:0:32404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125a00/0x22153cd396b80dc4 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0817 expref: 36 pid: 16564 timeout: 1440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826394.495743:0:32404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce044d2580 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001_UUID:32404:1874670585209600:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826394.495837:0:32404:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf18550000 going to sleep for 11 seconds 00000100:00100000:1.0:1787826394.505852:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826394.505966:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563768064 00000100:00100000:2.0:1787826394.505977:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563768064 00010000:00010000:2.0:1787826394.506031:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125a00/0x22153cd396b80dc4 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0817 expref: 37 pid: 16564 timeout: 1440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826394.506080:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1018 00000100:00100000:2.0:1787826394.506090:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce051203c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:2404:x1874670563768064:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826394.506110:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826394.506119:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125a00/0x22153cd396b80dc4 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0817 expref: 37 pid: 16564 timeout: 1440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826394.506136:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125a00/0x22153cd396b80dc4 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0817 expref: 37 pid: 16564 timeout: 1440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826394.506166:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff90ce01f45b00) 00010000:00010000:2.0:1787826394.506172:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80e11 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826394.506183:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80e11 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826394.506192:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80e11 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826394.506215:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826394.506286:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce051203c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:2404:x1874670563768064:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 197us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826394.506295:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1018 00010000:00010000:0.0:1787826394.508129:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125a00/0x22153cd396b80dc4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0817 expref: 36 pid: 16564 timeout: 1440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826394.508159:0:32404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce044d2580 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001_UUID:32404:1874670585209600:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826394.508203:0:32404:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80e11 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.508214:0:32404:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80e11 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.508220:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80e11 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826394.508245:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0x11:0x0]: returning size 1065984 00010000:00010000:0.0:1787826394.508540:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660600/0x22153cd396b80e0a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab082c expref: 37 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.508558:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80e11 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab082c expref: 36 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.508568:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff90ce01f45b00) 00010000:00010000:0.0:1787826394.508571:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787826394.508575:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05660400, rc 0) 00000100:00100000:0.0:1787826394.508660:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:54261:x1874670563767936:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 13270us (13525us total) trans 4294967700 rc 0/0 00000100:00100000:0.0:1787826394.508670:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3547 00000100:00100000:1.0:1787826394.512731:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826394.512871:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563768192 00000100:00100000:0.0:1787826394.512884:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563768192 00000100:00100000:0.0:1787826394.512971:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3548 00000100:00100000:0.0:1787826394.512984:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05121a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:54261:x1874670563768192:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826394.513019:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826394.513046:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b80e1f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0833 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.513187:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661a00/0x22153cd396b80e26 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.513206:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80e11 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab082c expref: 37 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.513216:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661a00/0x22153cd396b80e26 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x11:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.513265:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80e11 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab082c expref: 37 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.513281:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80e11 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab082c expref: 37 pid: 32404 timeout: 1440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826394.513298:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce044d2580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6520:1874670585209728:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826394.513423:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf18550cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826394.518646:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826394.518755:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563768320 00000100:00100000:1.0:1787826394.518767:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563768320 00010000:00010000:1.0:1787826394.518823:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80e11 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab082c expref: 38 pid: 32404 timeout: 1440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826394.518876:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1019 00000100:00100000:1.0:1787826394.518887:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c85a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:2403:x1874670563768320:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826394.518907:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826394.518915:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80e11 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab082c expref: 38 pid: 32404 timeout: 1440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.518938:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80e11 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab082c expref: 38 pid: 32404 timeout: 1440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.518968:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff90ce01f45b00) 00010000:00010000:1.0:1787826394.518973:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661a00/0x22153cd396b80e26 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x11:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.518985:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661a00/0x22153cd396b80e26 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.518992:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661a00/0x22153cd396b80e26 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.519016:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826394.519086:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c85a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:2403:x1874670563768320:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 202us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826394.519095:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1019 00010000:00010000:0.0:1787826394.519504:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80e11 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab082c expref: 37 pid: 32404 timeout: 1440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826394.519525:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce044d2580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6520:1874670585209728:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826394.519558:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661a00/0x22153cd396b80e26 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.519569:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661a00/0x22153cd396b80e26 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.519576:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661a00/0x22153cd396b80e26 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826394.519641:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0x11:0x0]: returning size 1065984 00000004:00200000:0.0:1787826394.519647:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826394.519672:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661a00/0x22153cd396b80e26 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.519709:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b80e1f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0833 expref: 37 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.519731:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661a00/0x22153cd396b80e26 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0833 expref: 36 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.519738:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff90ce01f45b00) 00010000:00010000:0.0:1787826394.519741:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826394.519744:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05661a00, rc 0) 00000100:00100000:0.0:1787826394.519794:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05121a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:54261:x1874670563768192:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 6812us (7078us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826394.519802:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3548 00000100:00100000:2.0:1787826394.530743:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826394.531517:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563768576 00000100:00100000:1.0:1787826394.531532:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563768576 00000100:00100000:1.0:1787826394.531624:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3549 00000100:00100000:1.0:1787826394.531636:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:54261:x1874670563768576:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826394.531665:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826394.531694:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124800/0x22153cd396b80e2d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab083a expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.531847:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125c00/0x22153cd396b80e34 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.531865:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125c00/0x22153cd396b80e34 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x11:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.531880:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125c00/0x22153cd396b80e34 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x11:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826394.531896:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0x11:0x0]: returning size 1065984 00010000:00010000:1.0:1787826394.532248:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124800/0x22153cd396b80e2d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x11:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab083a expref: 39 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.532272:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125c00/0x22153cd396b80e34 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x11:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab083a expref: 38 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.532281:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff90ce01f45b00) 00010000:00010000:1.0:1787826394.532284:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787826394.532288:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05125c00, rc 0) 00000100:00100000:1.0:1787826394.532387:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:54261:x1874670563768576:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 753us (1657us total) trans 4294967701 rc 0/0 00000100:00100000:1.0:1787826394.532395:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3549 00000100:00100000:2.0:1787826394.539352:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826394.539407:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826394.539515:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563768704 00000100:00100000:0.0:1787826394.539539:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563768704 00000100:00100000:0.0:1787826394.539610:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1934 00000100:00100000:0.0:1787826394.539622:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2402:x1874670563768704:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:0.0:1787826394.539680:0:30695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9012eb8/0x22153cd396b80e42 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.539706:0:30695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dc2068bb/0x22153cd396b80d93 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0802 expref: 9 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.539715:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826394.539720:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826394.539725:0:30695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9012eb8/0x22153cd396b80e42 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.539774:0:30695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dc2068bb/0x22153cd396b80d93 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0802 expref: 9 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.539790:0:30695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dc2068bb/0x22153cd396b80d93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0802 expref: 9 pid: 30695 timeout: 1440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826394.539808:0:30695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce044d2580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:30695:1874670585209856:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826394.539916:0:30695:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf18550cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826394.540046:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563768832 00000100:00100000:2.0:1787826394.540054:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563768832 00000100:00100000:2.0:1787826394.540096:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1935 00000100:00100000:2.0:1787826394.540105:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2402:x1874670563768832:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:2.0:1787826394.540128:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b80e49 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826394.540143:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002ab9f4ae/0x22153cd396b80da8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1052671) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0810 expref: 10 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826394.540151:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826394.540155:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826394.540160:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b80e49 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826394.540184:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002ab9f4ae/0x22153cd396b80da8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1052671) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0810 expref: 10 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826394.540193:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002ab9f4ae/0x22153cd396b80da8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1052671) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0810 expref: 10 pid: 30695 timeout: 1440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826394.540210:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf41c85e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1874670585209984:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826394.540255:0:8437:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf038a4840 going to sleep for 11 seconds 00000100:00100000:0.0:1787826394.549841:0:30695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce044d2580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:30695:1874670585209856:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826394.549887:0:30695:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d9012eb8/0x22153cd396b80e42 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826394.550286:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826394.550349:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826394.550515:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563768960 00000100:00100000:0.0:1787826394.550524:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563768960 00010000:00010000:0.0:1787826394.550766:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dc2068bb/0x22153cd396b80d93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0802 expref: 11 pid: 30695 timeout: 1440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826394.550809:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563769088 00000100:00100000:0.0:1787826394.550812:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563769088 00010000:00010000:0.0:1787826394.550828:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002ab9f4ae/0x22153cd396b80da8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1052671) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0810 expref: 12 pid: 30695 timeout: 1440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826394.550852:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1020 00000100:00100000:0.0:1787826394.550862:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563768960:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826394.550884:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826394.550912:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dc2068bb/0x22153cd396b80d93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0802 expref: 12 pid: 30695 timeout: 1440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.550933:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dc2068bb/0x22153cd396b80d93 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0802 expref: 12 pid: 30695 timeout: 1440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.550961:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc2068bb/0x22153cd396b80d93 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0802 expref: 12 pid: 30695 timeout: 1440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.550982:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826394.550987:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826394.550993:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9012eb8/0x22153cd396b80e42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.551004:0:10341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9012eb8/0x22153cd396b80e42 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826394.551140:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1021 00000100:00100000:3.0:1787826394.551150:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf10a52050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2404:x1874670563769088:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826394.551160:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787826394.551171:0:10340:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x27:0x0] updating lvb size from disk: 0 -> 1065984 00002000:00010000:3.0:1787826394.551175:0:10340:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x27:0x0] updating lvb mtime from disk: 0 -> 1787826394 00002000:00010000:3.0:1787826394.551177:0:10340:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x27:0x0] updating lvb ctime from disk: 0 -> 1787826394 00002000:00010000:3.0:1787826394.551179:0:10340:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x27:0x0] updating lvb blocks from disk: 0 -> 40 00010000:00010000:3.0:1787826394.551184:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002ab9f4ae/0x22153cd396b80da8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1052671) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0810 expref: 11 pid: 30695 timeout: 1440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826394.551195:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002ab9f4ae/0x22153cd396b80da8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1052671) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0810 expref: 11 pid: 30695 timeout: 1440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826394.551209:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826394.551213:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826394.551217:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b80e49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826394.551225:0:10340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b80e49 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826394.551244:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826394.551312:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf10a52050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2404:x1874670563769088:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 163us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826394.551320:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1021 00010000:00010000:0.0:1787826394.551858:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826394.552879:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ab9f4ae/0x22153cd396b80da8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1052671) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0810 expref: 10 pid: 30695 timeout: 1440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826394.552905:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf41c85e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1874670585209984:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826394.552939:0:8437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b80e49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.552957:0:8437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b80e49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.552963:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b80e49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.552997:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b80e49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.553006:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b80e49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.553015:0:8437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b80e49 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.553095:0:8437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834a00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:1.0:1787826394.553101:0:8437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b80e49 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.553113:0:8437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b80e49 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.553136:0:8437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b80e49 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.553151:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b80e49 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826394.553512:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563768960:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 2647us (3224us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826394.553524:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1020 00000100:00100000:1.0:1787826394.554346:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2402:x1874670563768832:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 14221us (14917us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826394.554358:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1935 00010000:00010000:2.0:1787826394.554564:0:30695:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d9012eb8/0x22153cd396b80e42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826394.554579:0:30695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9012eb8/0x22153cd396b80e42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826394.554611:0:30695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9012eb8/0x22153cd396b80e42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826394.554620:0:30695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9012eb8/0x22153cd396b80e42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826394.554765:0:30695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9012eb8/0x22153cd396b80e42 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826394.554773:0:30695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05660a00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826394.554777:0:30695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9012eb8/0x22153cd396b80e42 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826394.554788:0:30695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9012eb8/0x22153cd396b80e42 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826394.554811:0:30695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9012eb8/0x22153cd396b80e42 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826394.554820:0:30695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9012eb8/0x22153cd396b80e42 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826394.554898:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2402:x1874670563768704:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 15277us (15570us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826394.554906:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1934 00000100:00100000:2.0:1787826394.567919:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826394.568099:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563769344 00000100:00100000:0.0:1787826394.568113:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563769344 00000100:00100000:0.0:1787826394.568192:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3550 00000100:00100000:0.0:1787826394.568204:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:54261:x1874670563769344:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:0.0:1787826394.568281:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1787826394.568319:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124a00/0x22153cd396b80da1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x11:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0809 expref: 38 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.568367:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661a00/0x22153cd396b80e26 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0833 expref: 37 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.568382:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff90ce01f45b00) 00010000:00010000:0.0:1787826394.568388:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826394.568429:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80e50 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.568446:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80e50 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.568458:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80e50 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787826394.569411:0:6519:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x25:0x0], index 1: 0 00000040:00080000:0.0:1787826394.570001:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].31, 88 off10656 00000004:00080000:0.0:1787826394.570013:0:6519:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1340581541056ns, next at 1201607267971ns, rc = 0 00000040:00080000:0.0:1787826394.570202:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].32, 88 off10744 00000004:00080000:0.0:1787826394.570208:0:6519:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1340581736449ns, next at 1201607267971ns, rc = 0 00000040:00080000:0.0:1787826394.570439:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].28, 88 off10392 00000004:00080000:0.0:1787826394.570445:0:6519:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1340581973027ns, next at 1201610029598ns, rc = 0 00000040:00080000:0.0:1787826394.570585:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].29, 88 off10480 00000004:00080000:0.0:1787826394.570591:0:6519:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1340582119680ns, next at 1201610029598ns, rc = 0 00000001:00080000:2.0:1787826394.574322:0:7449:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967702 is committed 00000004:00080000:2.0:1787826394.574353:0:7449:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 30 committed 00000100:00100000:1.0:1787826394.574785:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787826394.574814:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce039752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585210112:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1787826394.574911:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826394.574984:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585210112 00000100:00100000:1.0:1787826394.574993:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585210112 00000100:00100000:1.0:1787826394.575191:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1936 00000100:00100000:1.0:1787826394.575202:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05123840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+7:3646:x1874670585210112:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1787826394.575454:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05123840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+8:3646:x1874670585210112:12345-0@lo:2:osp-syn-1-1.0 Request processed in 253us (542us total) trans 17179869632 rc 0/0 00000100:00100000:1.0:1787826394.575462:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1936 00000004:00080000:1.0:1787826394.576020:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce039752c0/2, rc 0, transno 17179869632 00000100:00100000:1.0:1787826394.576103:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce039752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585210112:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1787826394.576461:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787826394.576494:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf1366ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585210240:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1787826394.576673:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826394.576926:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585210240 00000100:00100000:3.0:1787826394.576935:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585210240 00000100:00100000:3.0:1787826394.577005:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1937 00000100:00100000:3.0:1787826394.577015:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+8:3645:x1874670585210240:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1787826394.580233:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+9:3645:x1874670585210240:12345-0@lo:2:osp-syn-1-1.0 Request processed in 3206us (3546us total) trans 17179869633 rc 0/0 00000100:00100000:1.0:1787826394.580250:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1937 00000004:00080000:0.0:1787826394.580455:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf1366ad00/2, rc 0, transno 17179869633 00000100:00100000:0.0:1787826394.580464:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf1366ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585210240:0@lo:2:osp-syn-1-1.0 00000004:00080000:2.0:1787826394.582947:0:7449:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 29 committed 00000004:00080000:2.0:1787826394.585232:0:7449:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 34 committed 00000004:00080000:2.0:1787826394.585295:0:7449:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 33 committed 00000100:00100000:1.0:1787826394.585822:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787826394.585851:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce05122580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585210496:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1787826394.586012:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826394.586186:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787826394.586202:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce05123480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585210368:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1787826394.586872:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585210496 00000100:00100000:1.0:1787826394.586883:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585210496 00000100:00100000:1.0:1787826394.586961:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1938 00000100:00100000:1.0:1787826394.586973:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05121e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3647:x1874670585210496:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1787826394.587236:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05121e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+6:3647:x1874670585210496:12345-0@lo:2:osp-syn-0-1.0 Request processed in 264us (1222us total) trans 21474836973 rc 0/0 00000100:00100000:1.0:1787826394.587245:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1938 00000100:00100000:1.0:1787826394.587294:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 21474836969 gen 2 00000004:00080000:1.0:1787826394.587299:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce01fdfc00, transno 21474836966 00000004:00080000:1.0:1787826394.587308:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce03a18780, transno 21474836968 00000004:00080000:1.0:1787826394.587311:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce03a19e00, transno 21474836969 00000100:00100000:1.0:1787826394.587318:0:3647:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff90ce05122580 x1874670585210496/t21474836973(21474836973) o2->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 440/432 e 0 to 0 dl 1787826410 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1787826394.587342:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce05122580/2, rc 0, transno 21474836973 00000100:00100000:1.0:1787826394.587349:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce05122580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585210496:0@lo:2:osp-syn-0-1.0 00000004:00080000:1.0:1787826394.587467:0:8538:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0001: 0 changes, 2 in progress, 1 in flight, 3 done 00000004:00010000:0.0:1787826394.588354:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ea615ebe reply state 000000003f9ea5e3 transno 4294967702 ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80e50 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.588383:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80e50 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.588395:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff90ce01f45b00) 00010000:00010000:0.0:1787826394.588398:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1787826394.588403:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1787826394.588559:0:6519:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1787826394.588581:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+28:54261:x1874670563769344:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 20375us (20675us total) trans 4294967702 rc 0/0 00000100:00100000:0.0:1787826394.588590:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3550 00010000:00010000:0.0:1787826394.588893:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80e50 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.588903:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80e50 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.588910:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80e50 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.588917:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05660400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826394.588922:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80e50 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.588931:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80e50 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.588944:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff90ce01f45b00) 00010000:00010000:0.0:1787826394.588947:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826394.588950:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80e50 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.588956:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80e50 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826394.591392:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826394.593548:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826394.593973:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563769472 00000100:00100000:2.0:1787826394.593987:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563769472 00000100:00100000:2.0:1787826394.594069:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3551 00000100:00100000:2.0:1787826394.594081:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf13669e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:54261:x1874670563769472:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826394.594112:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826394.594141:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b80e57 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0841 expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826394.594214:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b80e57 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0841 expref: 28 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826394.594236:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b80e57 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0841 expref: 28 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826394.594257:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff90ce01f45b00) 00010000:00010000:2.0:1787826394.594261:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826394.594265:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835000, rc 0) 00000100:00100000:2.0:1787826394.594357:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf13669e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+28:54261:x1874670563769472:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 277us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826394.594364:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3551 00000100:00100000:0.0:1787826394.597392:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585210368 00000100:00100000:0.0:1787826394.597414:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585210368 00000100:00100000:0.0:1787826394.598713:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1939 00000100:00100000:0.0:1787826394.598728:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1366b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+6:3644:x1874670585210368:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1787826394.599386:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1366b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+7:3644:x1874670585210368:12345-0@lo:2:osp-syn-0-1.0 Request processed in 659us (8002us total) trans 21474836974 rc 0/0 00000100:00100000:0.0:1787826394.599396:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1939 00000004:00080000:3.0:1787826394.599540:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce05123480/2, rc 0, transno 21474836974 00000100:00100000:3.0:1787826394.599558:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce05123480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585210368:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1787826394.601099:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826394.601349:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563769600 00000100:00100000:0.0:1787826394.601362:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563769600 00000100:00100000:0.0:1787826394.601428:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3552 00000100:00100000:0.0:1787826394.601439:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+28:54261:x1874670563769600:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826394.601464:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826394.601739:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661a00/0x22153cd396b80e5e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0848 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.601983:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660600/0x22153cd396b80e65 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.602001:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660600/0x22153cd396b80e65 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.602015:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660600/0x22153cd396b80e65 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826394.602228:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0x11:0x0]: returning size 1065984 00000004:00200000:0.0:1787826394.602234:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826394.602256:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660600/0x22153cd396b80e65 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.602290:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661a00/0x22153cd396b80e5e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0848 expref: 30 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.602312:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660600/0x22153cd396b80e65 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0848 expref: 29 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.602321:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff90ce01f45b00) 00010000:00010000:0.0:1787826394.602324:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826394.602340:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05660600, rc 0) 00000100:00100000:0.0:1787826394.602522:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+29:54261:x1874670563769600:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1034us (1383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826394.602531:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3552 00000100:00100000:2.0:1787826394.607913:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826394.607958:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826394.608047:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563769856 00000100:00100000:1.0:1787826394.608059:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563769856 00000100:00100000:1.0:1787826394.608122:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563769728 00000100:00100000:1.0:1787826394.608125:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563769728 00000100:00100000:1.0:1787826394.608377:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1940 00000100:00100000:1.0:1787826394.608390:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2403:x1874670563769856:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826394.608415:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826394.608441:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f3bdd7b/0x22153cd396b80e6c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0856 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826394.608493:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x27:0x0] initial LVB size: 1065984, mtime: 0x6a9010da, atime: 0x0, ctime: 0x6a9010da, blocks: 0x28 00010000:00010000:1.0:1787826394.608534:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=1340s v=(0 0) 00010000:00010000:1.0:1787826394.608540:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826394.608562:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f3bdd7b/0x22153cd396b80e6c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0856 expref: 9 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.608583:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000f3bdd7b/0x22153cd396b80e6c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0856 expref: 9 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.608600:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05124800, rc 0) 00000100:00100000:1.0:1787826394.608684:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670563769856:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 297us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826394.608692:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1940 00000100:00100000:1.0:1787826394.608712:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1941 00000100:00100000:1.0:1787826394.608719:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2403:x1874670563769728:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826394.608727:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826394.608737:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086914dcf/0x22153cd396b80e73 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab084f expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826394.608750:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x26:0x0] initial LVB size: 1048576, mtime: 0x6a9010da, atime: 0x0, ctime: 0x6a9010da, blocks: 0x0 00010000:00010000:1.0:1787826394.608760:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=1340s v=(0 0) 00010000:00010000:1.0:1787826394.608763:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826394.608769:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086914dcf/0x22153cd396b80e73 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab084f expref: 9 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.608780:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000086914dcf/0x22153cd396b80e73 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab084f expref: 9 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.608795:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05124e00, rc 0) 00000100:00100000:1.0:1787826394.608818:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670563769728:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 99us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826394.608824:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1941 00000100:00100000:2.0:1787826394.685811:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826394.685869:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826394.685974:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563769984 00000100:00100000:0.0:1787826394.685987:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563769984 00000100:00100000:0.0:1787826394.686058:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563770112 00000100:00100000:0.0:1787826394.686062:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563770112 00000100:00100000:0.0:1787826394.686145:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1942 00000100:00100000:0.0:1787826394.686158:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf2f797c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670563769984:12345-192.168.203.39@tcp:23:lfs.0 00000100:00100000:0.0:1787826394.686301:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf2f797c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670563769984:12345-192.168.203.39@tcp:23:lfs.0 Request processed in 145us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826394.686310:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1942 00000100:00100000:0.0:1787826394.686578:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1943 00000100:00100000:0.0:1787826394.686588:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563770112:12345-192.168.203.39@tcp:23:lfs.0 00000100:00100000:0.0:1787826394.686649:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563770112:12345-192.168.203.39@tcp:23:lfs.0 Request processed in 62us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826394.686656:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1943 00000100:00100000:0.0:1787826394.691672:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826394.691984:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563770240 00000100:00100000:3.0:1787826394.691998:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563770240 00000100:00100000:3.0:1787826394.692073:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1944 00000100:00100000:3.0:1787826394.692086:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563770240:12345-192.168.203.39@tcp:23:lfs.0 00000100:00100000:3.0:1787826394.692242:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563770240:12345-192.168.203.39@tcp:23:lfs.0 Request processed in 157us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826394.692250:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1944 00000100:00100000:3.0:1787826394.697956:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826394.698457:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563770368 00000100:00100000:0.0:1787826394.698982:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563770368 00000100:00100000:0.0:1787826394.699115:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1945 00000100:00100000:0.0:1787826394.699128:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1366a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:54261:x1874670563770368:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826394.699160:0:30695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826394.699188:0:30695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005cb54982/0x22153cd396b80e7a lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab085d expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826394.699223:0:30695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826394.699253:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x24:0x0].0x0 since=1340s v=(0 0) 00010000:00010000:0.0:1787826394.699259:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826394.699272:0:30695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005cb54982/0x22153cd396b80e7a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab085d expref: 8 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.699293:0:30695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005cb54982/0x22153cd396b80e7a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab085d expref: 8 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.699310:0:30695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05661a00, rc 0) 00000100:00100000:0.0:1787826394.699414:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1366a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:54261:x1874670563770368:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 287us (1472us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826394.699423:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1945 00000100:00100000:1.0:1787826394.705764:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826394.705874:0:25426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563770496 00000100:00100000:0.0:1787826394.705887:0:25426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563770496 00000100:00100000:0.0:1787826394.706871:0:25426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 739 00000100:00100000:0.0:1787826394.706893:0:25426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05123c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2403:x1874670563770496:12345-192.168.203.39@tcp:22:lfs.0 00002000:00010000:0.0:1787826394.707608:0:25426:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x24:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787826394.707615:0:25426:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x24:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1787826394.707618:0:25426:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x24:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787826394.707620:0:25426:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x24:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1787826394.707623:0:25426:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x24:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1787826394.707738:0:25426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05123c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670563770496:12345-192.168.203.39@tcp:22:lfs.0 Request processed in 851us (2054us total) trans 17179869634 rc 0/0 00000100:00100000:0.0:1787826394.707750:0:25426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 739 00000100:00100000:1.0:1787826394.716811:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826394.717370:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563770624 00000100:00100000:0.0:1787826394.717384:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563770624 00000100:00100000:0.0:1787826394.717605:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 740 00000100:00100000:0.0:1787826394.717620:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce051221c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2402:x1874670563770624:12345-192.168.203.39@tcp:3:lfs.0 00010000:00010000:0.0:1787826394.717668:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c55e1152/0x22153cd396b80e81 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.717701:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826394.717707:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826394.717715:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c55e1152/0x22153cd396b80e81 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [1048576->1069055] (req 1048576->1069055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.717732:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c55e1152/0x22153cd396b80e81 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [1048576->1069055] (req 1048576->1069055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.736142:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c55e1152/0x22153cd396b80e81 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [1048576->1069055] (req 1048576->1069055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.736237:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c55e1152/0x22153cd396b80e81 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [1048576->1069055] (req 1048576->1069055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.736249:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c55e1152/0x22153cd396b80e81 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [1048576->1069055] (req 1048576->1069055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.736257:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05660400 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826394.736263:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c55e1152/0x22153cd396b80e81 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [1048576->1069055] (req 1048576->1069055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.736275:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c55e1152/0x22153cd396b80e81 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [1048576->1069055] (req 1048576->1069055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.736300:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c55e1152/0x22153cd396b80e81 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [1048576->1069055] (req 1048576->1069055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.736395:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c55e1152/0x22153cd396b80e81 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [1048576->1069055] (req 1048576->1069055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826394.736962:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce051221c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2402:x1874670563770624:12345-192.168.203.39@tcp:3:lfs.0 Request processed in 19336us (20158us total) trans 0 rc 17408/17408 00000100:00100000:0.0:1787826394.737035:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 740 00000100:00100000:1.0:1787826394.743291:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826394.744050:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563770752 00000100:00100000:3.0:1787826394.744069:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563770752 00000100:00100000:3.0:1787826394.744242:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 741 00000100:00100000:3.0:1787826394.744256:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05121680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2401:x1874670563770752:12345-192.168.203.39@tcp:4:lfs.0 00010000:00010000:3.0:1787826394.744309:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a816990/0x22153cd396b80e88 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826394.744349:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005cb54982/0x22153cd396b80e7a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab085d expref: 9 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826394.744359:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826394.744364:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x24:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826394.744369:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a816990/0x22153cd396b80e88 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x24:0x0].0x0 rrc: 3 type: EXT [1048576->1069055] (req 1048576->1069055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826394.744415:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005cb54982/0x22153cd396b80e7a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab085d expref: 9 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826394.744432:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005cb54982/0x22153cd396b80e7a lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab085d expref: 9 pid: 30695 timeout: 1440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826394.744456:0:8441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf1366b840 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:8441:1874670585210624:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826394.744616:0:8441:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10b3bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826394.748888:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826394.749154:0:8441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf1366b840 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:8441:1874670585210624:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826394.749202:0:8441:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003a816990/0x22153cd396b80e88 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x24:0x0].0x0 rrc: 3 type: EXT [1048576->1069055] (req 1048576->1069055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826394.749358:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563770880 00000100:00100000:1.0:1787826394.749367:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563770880 00010000:00010000:1.0:1787826394.749417:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005cb54982/0x22153cd396b80e7a lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab085d expref: 10 pid: 30695 timeout: 1440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826394.749464:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1022 00000100:00100000:1.0:1787826394.749541:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563770880:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826394.749560:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826394.749593:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005cb54982/0x22153cd396b80e7a lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab085d expref: 10 pid: 30695 timeout: 1440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.749608:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005cb54982/0x22153cd396b80e7a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab085d expref: 10 pid: 30695 timeout: 1440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.749641:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005cb54982/0x22153cd396b80e7a lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab085d expref: 10 pid: 30695 timeout: 1440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.749671:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x24:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826394.749677:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x24:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826394.750054:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003a816990/0x22153cd396b80e88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24:0x0].0x0 rrc: 3 type: EXT [1048576->1069055] (req 1048576->1069055) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.750068:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a816990/0x22153cd396b80e88 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x24:0x0].0x0 rrc: 3 type: EXT [1048576->1069055] (req 1048576->1069055) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.750117:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826394.750197:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563770880:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 721us (1321us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826394.750206:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1022 00010000:00010000:2.0:1787826394.750310:0:8441:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003a816990/0x22153cd396b80e88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24:0x0].0x0 rrc: 2 type: EXT [1048576->1069055] (req 1048576->1069055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826394.750322:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a816990/0x22153cd396b80e88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24:0x0].0x0 rrc: 2 type: EXT [1048576->1069055] (req 1048576->1069055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787826394.764011:0:27651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179869635 is committed 00000001:00080000:0.0:1787826394.764044:0:27651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179869633 is committed 00002000:00010000:2.0:1787826394.764254:0:8441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x24:0x0] updating lvb size from disk: 0 -> 1069056 00002000:00010000:2.0:1787826394.764260:0:8441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x24:0x0] updating lvb mtime from disk: 0 -> 1787826395 00002000:00010000:2.0:1787826394.764263:0:8441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x24:0x0] updating lvb ctime from disk: 0 -> 1787826395 00002000:00010000:2.0:1787826394.764266:0:8441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x24:0x0] updating lvb blocks from disk: 0 -> 40 00010000:00010000:2.0:1787826394.764284:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a816990/0x22153cd396b80e88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24:0x0].0x0 rrc: 2 type: EXT [1048576->1069055] (req 1048576->1069055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826394.764300:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a816990/0x22153cd396b80e88 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x24:0x0].0x0 rrc: 2 type: EXT [1048576->1069055] (req 1048576->1069055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826394.764310:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a816990/0x22153cd396b80e88 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x24:0x0].0x0 rrc: 2 type: EXT [1048576->1069055] (req 1048576->1069055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826394.764319:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401400 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826394.764337:0:8441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a816990/0x22153cd396b80e88 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x24:0x0].0x0 rrc: 2 type: EXT [1048576->1069055] (req 1048576->1069055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826394.764348:0:8441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a816990/0x22153cd396b80e88 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x24:0x0].0x0 rrc: 2 type: EXT [1048576->1069055] (req 1048576->1069055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826394.764373:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a816990/0x22153cd396b80e88 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x24:0x0].0x0 rrc: 2 type: EXT [1048576->1069055] (req 1048576->1069055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826394.764382:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a816990/0x22153cd396b80e88 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x24:0x0].0x0 rrc: 2 type: EXT [1048576->1069055] (req 1048576->1069055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826394.766234:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05121680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2401:x1874670563770752:12345-192.168.203.39@tcp:4:lfs.0 Request processed in 20360us (21339us total) trans 17179869635 rc 0/0 00000100:00100000:2.0:1787826394.766261:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 741 00000100:00100000:2.0:1787826394.790266:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826394.791249:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563771136 00000100:00100000:1.0:1787826394.791265:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563771136 00000100:00100000:1.0:1787826394.791404:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3553 00000100:00100000:1.0:1787826394.791416:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+29:54261:x1874670563771136:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:1.0:1787826394.791553:0:8247:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826394.791591:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660600/0x22153cd396b80e65 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0848 expref: 29 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.791617:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff90ce01f45b00) 00010000:00010000:1.0:1787826394.791624:0:8247:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826394.791849:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124600/0x22153cd396b80e8f lrc: 3/0,1 mode: --/PW res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.791866:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124600/0x22153cd396b80e8f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.791879:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124600/0x22153cd396b80e8f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787826394.791935:0:8247:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967703 00000004:00010000:1.0:1787826394.791971:0:8247:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000056e33588 reply state 00000000a9c790ed transno 4294967704 ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124600/0x22153cd396b80e8f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.791985:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124600/0x22153cd396b80e8f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.791991:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff90ce01f45b00) 00010000:00010000:1.0:1787826394.791994:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826394.791996:0:8247:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826394.792122:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:54261:x1874670563771136:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 706us (1870us total) trans 4294967704 rc 0/0 00000100:00100000:1.0:1787826394.792131:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3553 00000020:00080000:1.0:1787826394.792137:0:8247:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787826394.794953:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826394.795385:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563771264 00000100:00100000:3.0:1787826394.795398:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563771264 00000100:00100000:3.0:1787826394.795528:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1946 00000100:00100000:3.0:1787826394.795541:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:54261:x1874670563771264:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826394.795565:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826394.795591:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9767cf8/0x22153cd396b80e96 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0864 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826394.795627:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x24:0x0] initial LVB size: 1069056, mtime: 0x6a9010db, atime: 0x0, ctime: 0x6a9010db, blocks: 0x28 00010000:00010000:3.0:1787826394.795658:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x24:0x0].0x0 since=1340s v=(0 0) 00010000:00010000:3.0:1787826394.795663:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826394.795675:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9767cf8/0x22153cd396b80e96 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0864 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826394.795693:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e9767cf8/0x22153cd396b80e96 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0864 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826394.795708:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401e00, rc 0) 00000100:00100000:3.0:1787826394.795962:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:54261:x1874670563771264:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 422us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826394.795970:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1946 00000100:00100000:0.0:1787826394.802345:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826394.803228:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563771392 00000100:00100000:3.0:1787826394.803244:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563771392 00000100:00100000:3.0:1787826394.803409:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1947 00000100:00100000:3.0:1787826394.803423:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:54261:x1874670563771392:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826394.803446:0:28853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826394.803488:0:28853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d747c98/0x22153cd396b80e9d lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab086b expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826394.803534:0:28853:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787826394.803562:0:28853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x25:0x0].0x0 since=1340s v=(0 0) 00010000:00010000:3.0:1787826394.803567:0:28853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826394.803579:0:28853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d747c98/0x22153cd396b80e9d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab086b expref: 9 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826394.803598:0:28853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004d747c98/0x22153cd396b80e9d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab086b expref: 9 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826394.803614:0:28853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401200, rc 0) 00000100:00100000:3.0:1787826394.803702:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:54261:x1874670563771392:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 281us (1386us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826394.803710:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1947 00000100:00100000:3.0:1787826394.813662:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826394.813759:0:30178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563771520 00000100:00100000:1.0:1787826394.813773:0:30178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563771520 00002000:00010000:1.0:1787826394.813832:0:30178:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/36 (1065984->18446744073709551615) 00002000:00100000:1.0:1787826394.813837:0:30178:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf1366b840 with x1874670563771520 ext(1065984->18446744073709551615) 00002000:00010000:1.0:1787826394.813852:0:30178:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90cf1366b840. 00000100:00100000:1.0:1787826394.813898:0:30178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 742 00000100:00100000:1.0:1787826394.813909:0:30178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1366b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670563771520:12345-192.168.203.39@tcp:10:lfs.0 00002000:00010000:2.0:1787826394.820252:0:30178:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x24:0x0] updating lvb size from disk: 1069056 -> 1065984 00002000:00010000:2.0:1787826394.820270:0:30178:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x24:0x0] updating lvb mtime from disk: 1787826395 -> 1787826395 00002000:00010000:2.0:1787826394.820275:0:30178:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x24:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787826394.820277:0:30178:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x24:0x0] updating lvb ctime from disk: 1787826395 -> 1787826395 00002000:00010000:2.0:1787826394.820280:0:30178:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x24:0x0] updating lvb blocks from disk: 40 -> 40 00000100:00100000:2.0:1787826394.820521:0:30178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1366b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670563771520:12345-192.168.203.39@tcp:10:lfs.0 Request processed in 6603us (6864us total) trans 17179869636 rc 0/0 00000100:00100000:2.0:1787826394.820535:0:30178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 742 00002000:00010000:2.0:1787826394.820543:0:30178:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/36 (1065984->18446744073709551615) 00002000:00100000:2.0:1787826394.820548:0:30178:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf1366b840 with x1874670563771520 ext(1065984->18446744073709551615) 00002000:00010000:2.0:1787826394.820560:0:30178:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90cf1366b840. 00000100:00100000:0.0:1787826394.825598:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826394.825943:0:30173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563771648 00000100:00100000:2.0:1787826394.825967:0:30173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563771648 00002000:00010000:2.0:1787826394.826035:0:30173:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/37 (0->18446744073709551615) 00002000:00100000:2.0:1787826394.826041:0:30173:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce044d03c0 with x1874670563771648 ext(0->18446744073709551615) 00002000:00010000:2.0:1787826394.826058:0:30173:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90ce044d03c0. 00000100:00100000:2.0:1787826394.826113:0:30173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 743 00000100:00100000:2.0:1787826394.826124:0:30173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670563771648:12345-192.168.203.39@tcp:10:lfs.0 00002000:00010000:2.0:1787826394.826349:0:30173:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x25:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787826394.826354:0:30173:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x25:0x0] updating lvb mtime from disk: 0 -> 1787826395 00002000:00010000:2.0:1787826394.826357:0:30173:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x25:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787826394.826359:0:30173:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x25:0x0] updating lvb ctime from disk: 0 -> 1787826395 00002000:00010000:2.0:1787826394.826361:0:30173:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x25:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1787826394.826429:0:30173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2403:x1874670563771648:12345-192.168.203.39@tcp:10:lfs.0 Request processed in 305us (845us total) trans 17179869637 rc 0/0 00000100:00100000:2.0:1787826394.826439:0:30173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 743 00002000:00010000:2.0:1787826394.826443:0:30173:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/37 (0->18446744073709551615) 00002000:00100000:2.0:1787826394.826446:0:30173:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce044d03c0 with x1874670563771648 ext(0->18446744073709551615) 00002000:00010000:2.0:1787826394.826451:0:30173:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90ce044d03c0. 00000100:00100000:3.0:1787826394.834043:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826394.834230:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563771904 00000100:00100000:0.0:1787826394.834245:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563771904 00000100:00100000:0.0:1787826394.834341:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3554 00000100:00100000:0.0:1787826394.834354:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1366a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:54261:x1874670563771904:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:0.0:1787826394.834564:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661e00/0x22153cd396b80ea4 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.834588:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661e00/0x22153cd396b80ea4 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.834602:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661e00/0x22153cd396b80ea4 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826394.834756:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009e74e0f5 reply state 000000003146722d transno 4294967705 ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661e00/0x22153cd396b80ea4 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.834772:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661e00/0x22153cd396b80ea4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.834781:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff90ce01f45b00) 00010000:00010000:0.0:1787826394.834784:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826394.834788:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787826394.834916:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1366a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:54261:x1874670563771904:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 564us (889us total) trans 4294967705 rc 0/0 00000100:00100000:0.0:1787826394.834924:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3554 00000100:00100000:0.0:1787826394.840830:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826394.840969:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563772032 00000100:00100000:1.0:1787826394.840982:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563772032 00000100:00100000:1.0:1787826394.841068:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1948 00000100:00100000:1.0:1787826394.841081:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:54261:x1874670563772032:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826394.841117:0:30694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826394.841142:0:30694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a3adc48c/0x22153cd396b80eab lrc: 2/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0872 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.841186:0:30694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000086914dcf/0x22153cd396b80e73 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab084f expref: 10 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.841196:0:30694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826394.841201:0:30694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826394.841208:0:30694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3adc48c/0x22153cd396b80eab lrc: 4/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0872 expref: 10 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.841253:0:30694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000086914dcf/0x22153cd396b80e73 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab084f expref: 10 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.841270:0:30694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000086914dcf/0x22153cd396b80e73 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab084f expref: 10 pid: 8437 timeout: 1440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826394.841287:0:30694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce051230c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:30694:1874670585210752:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826394.841412:0:30694:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a180c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826394.850307:0:30694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce051230c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:30694:1874670585210752:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826394.850375:0:30694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a3adc48c/0x22153cd396b80eab lrc: 3/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0872 expref: 10 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826394.850403:0:30694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05125800, rc 0) 00000100:00100000:2.0:1787826394.851436:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:54261:x1874670563772032:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 10348us (10612us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826394.851451:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1948 00000100:00100000:2.0:1787826394.852560:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826394.853417:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563772160 00000100:00100000:0.0:1787826394.853432:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563772160 00010000:00010000:0.0:1787826394.853825:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000086914dcf/0x22153cd396b80e73 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab084f expref: 10 pid: 8437 timeout: 1440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826394.853933:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1023 00000100:00100000:0.0:1787826394.853946:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563772160:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826394.853966:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826394.853993:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000086914dcf/0x22153cd396b80e73 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab084f expref: 10 pid: 8437 timeout: 1440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.854011:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000086914dcf/0x22153cd396b80e73 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab084f expref: 10 pid: 8437 timeout: 1440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.854048:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086914dcf/0x22153cd396b80e73 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab084f expref: 10 pid: 8437 timeout: 1440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.854071:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826394.854076:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826394.854086:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a3adc48c/0x22153cd396b80eab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0872 expref: 9 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.854099:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3adc48c/0x22153cd396b80eab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0872 expref: 9 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.854156:0:6503:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a3adc48c/0x22153cd396b80eab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0872 expref: 9 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826394.854176:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce044d3840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6503:1874670585210880:192.168.203.39@tcp:105: 00000100:00100000:0.0:1787826394.854296:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf18550840 going to sleep for 11 seconds 00000100:00100000:2.0:1787826394.858227:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce044d3840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6503:1874670585210880:192.168.203.39@tcp:105: 00010000:00010000:2.0:1787826394.858266:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826394.858355:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563772160:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4412us (5801us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826394.858369:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1023 00000100:00100000:3.0:1787826394.860454:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826394.860598:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563772288 00000100:00100000:0.0:1787826394.860610:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563772288 00000100:00100000:0.0:1787826394.860680:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1949 00000100:00100000:0.0:1787826394.860691:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1366b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:54261:x1874670563772288:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826394.860773:0:30398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826394.860802:0:30398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ab9f4ae/0x22153cd396b80eb2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0879 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.860845:0:30398:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000f3bdd7b/0x22153cd396b80e6c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0856 expref: 10 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.860856:0:30398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826394.860861:0:30398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826394.860867:0:30398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ab9f4ae/0x22153cd396b80eb2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0879 expref: 10 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.860980:0:30398:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000f3bdd7b/0x22153cd396b80e6c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0856 expref: 10 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.860997:0:30398:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000f3bdd7b/0x22153cd396b80e6c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0856 expref: 10 pid: 8437 timeout: 1440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826394.861022:0:30398:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce044d12c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:30398:1874670585211008:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826394.861162:0:30398:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf18550840 going to sleep for 11 seconds 00000100:00100000:3.0:1787826394.874268:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826394.876120:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563772416 00000100:00100000:1.0:1787826394.876143:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563772416 00010000:00010000:1.0:1787826394.876228:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000f3bdd7b/0x22153cd396b80e6c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0856 expref: 11 pid: 8437 timeout: 1440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826394.876292:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1024 00000100:00100000:1.0:1787826394.876305:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f05680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2403:x1874670563772416:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826394.876336:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826394.876364:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000f3bdd7b/0x22153cd396b80e6c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0856 expref: 11 pid: 8437 timeout: 1440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.876382:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000f3bdd7b/0x22153cd396b80e6c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0856 expref: 11 pid: 8437 timeout: 1440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.876418:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826394.876423:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826394.876434:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002ab9f4ae/0x22153cd396b80eb2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0879 expref: 11 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.876447:0:10341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ab9f4ae/0x22153cd396b80eb2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0879 expref: 11 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.876585:0:10341:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002ab9f4ae/0x22153cd396b80eb2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0879 expref: 11 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826394.876604:0:10341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce05120780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10341:1874670585211136:192.168.203.39@tcp:105: 00000100:00100000:1.0:1787826394.877007:0:10341:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a180c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826394.886197:0:10341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce05120780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10341:1874670585211136:192.168.203.39@tcp:105: 00010000:00010000:1.0:1787826394.886235:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826394.886311:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f05680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2403:x1874670563772416:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 10007us (12059us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826394.886339:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1024 00010000:00010000:0.0:1787826394.889697:0:30398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f3bdd7b/0x22153cd396b80e6c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0856 expref: 10 pid: 8437 timeout: 1440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826394.889734:0:30398:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce044d12c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:30398:1874670585211008:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826394.889781:0:30398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002ab9f4ae/0x22153cd396b80eb2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0879 expref: 9 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.889803:0:30398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05660800, rc 0) 00000100:00100000:0.0:1787826394.890186:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1366b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:54261:x1874670563772288:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 29494us (29740us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826394.890197:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1949 00000100:00100000:2.0:1787826394.901033:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826394.901145:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826394.901834:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563772544 00000100:00100000:1.0:1787826394.901848:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563772544 00000100:00100000:1.0:1787826394.902108:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563772672 00000100:00100000:1.0:1787826394.902113:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563772672 00000100:00100000:1.0:1787826394.902153:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1950 00000100:00100000:1.0:1787826394.902164:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563772544:12345-192.168.203.39@tcp:2:lfs.0 00002000:00010000:1.0:1787826394.902384:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x26:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1787826394.902388:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x26:0x0] updating lvb mtime from disk: 1787826394 -> 1787826394 00002000:00010000:1.0:1787826394.902391:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x26:0x0] updating lvb atime from disk: 0 -> 1787826394 00002000:00010000:1.0:1787826394.902393:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x26:0x0] updating lvb ctime from disk: 1787826394 -> 1787826395 00002000:00010000:1.0:1787826394.902396:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x26:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1787826394.902856:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1951 00000100:00100000:2.0:1787826394.902869:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2404:x1874670563772672:12345-192.168.203.39@tcp:2:lfs.0 00002000:00010000:2.0:1787826394.902956:0:8437:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x27:0x0] updating lvb size from disk: 1065984 -> 1065984 00002000:00010000:2.0:1787826394.902960:0:8437:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x27:0x0] updating lvb mtime from disk: 1787826394 -> 1787826394 00002000:00010000:2.0:1787826394.902962:0:8437:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x27:0x0] updating lvb atime from disk: 0 -> 1787826394 00002000:00010000:2.0:1787826394.902964:0:8437:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x27:0x0] updating lvb ctime from disk: 1787826394 -> 1787826395 00002000:00010000:2.0:1787826394.902966:0:8437:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x27:0x0] updating lvb blocks from disk: 40 -> 40 00000100:00100000:2.0:1787826394.902993:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563772672:12345-192.168.203.39@tcp:2:lfs.0 Request processed in 128us (1847us total) trans 21474836976 rc 0/0 00000100:00100000:2.0:1787826394.903002:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1951 00000100:00100000:1.0:1787826394.903169:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2404:x1874670563772544:12345-192.168.203.39@tcp:2:lfs.0 Request processed in 337us (1482us total) trans 21474836975 rc 0/0 00000100:00100000:1.0:1787826394.903177:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1950 00000100:00100000:2.0:1787826394.907863:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826394.908120:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563772928 00000100:00100000:0.0:1787826394.908134:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563772928 00000100:00100000:0.0:1787826394.908297:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1041 00000100:00100000:0.0:1787826394.908309:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:54261:x1874670563772928:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:0.0:1787826394.908416:0:14257:0:(mdt_open.c:2504:mdt_close_resync_done()) ### [0x240000404:0x11:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125c00/0x22153cd396b80e34 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x11:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab083a expref: 33 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.908522:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b80eb9 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.908540:0:14257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b80e57 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0841 expref: 33 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.908561:0:14257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b80eb9 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.908606:0:14257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b80e57 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0841 expref: 33 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.908699:0:14257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b80e57 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0841 expref: 33 pid: 32404 timeout: 1440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826394.908719:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce044d12c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:14257:1874670585211264:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826394.908851:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf18550840 going to sleep for 11 seconds 00000100:00100000:0.0:1787826394.913433:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce044d12c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:14257:1874670585211264:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826394.913517:0:14257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b80eb9 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826394.916237:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826394.916707:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563773056 00000100:00100000:3.0:1787826394.916721:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563773056 00010000:00010000:3.0:1787826394.916786:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b80e57 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0841 expref: 34 pid: 32404 timeout: 1440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826394.917048:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1025 00000100:00100000:3.0:1787826394.917066:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:2404:x1874670563773056:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826394.917086:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826394.917094:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b80e57 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0841 expref: 34 pid: 32404 timeout: 1440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826394.917109:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b80e57 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0841 expref: 34 pid: 32404 timeout: 1440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826394.917138:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b80e57 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0841 expref: 34 pid: 32404 timeout: 1440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826394.917158:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff90ce01f45b00) 00010000:00010000:3.0:1787826394.917165:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b80eb9 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826394.917182:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b80eb9 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826394.917191:0:10340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b80eb9 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826394.917232:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826394.918006:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:2404:x1874670563773056:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 938us (1776us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826394.918018:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1025 00010000:00010000:0.0:1787826394.918131:0:14257:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b80eb9 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.918143:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b80eb9 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787826394.918514:0:14257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].33, 88 off10832 00000004:00080000:0.0:1787826394.918523:0:14257:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1340930051054ns, next at 1201607267971ns, rc = 0 00000040:00080000:0.0:1787826394.918561:0:14257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].34, 88 off10920 00000004:00080000:0.0:1787826394.918567:0:14257:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1340930094876ns, next at 1201607267971ns, rc = 0 00000040:00080000:0.0:1787826394.918587:0:14257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].30, 88 off10568 00000004:00080000:0.0:1787826394.918591:0:14257:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1340930119696ns, next at 1201610029598ns, rc = 0 00000040:00080000:0.0:1787826394.918610:0:14257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].31, 88 off10656 00000004:00080000:0.0:1787826394.918614:0:14257:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1340930142635ns, next at 1201610029598ns, rc = 0 00000001:00080000:0.0:1787826394.925241:0:7449:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967706 is committed 00000004:00080000:0.0:1787826394.925261:0:7449:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 32 committed 00000004:00080000:0.0:1787826394.925280:0:7449:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 31 committed 00000004:00080000:0.0:1787826394.925283:0:7449:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 36 committed 00000004:00080000:0.0:1787826394.925292:0:7449:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 35 committed 00000004:00010000:0.0:1787826394.925374:0:14257:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f46759f4 reply state 00000000723d3e59 transno 4294967706 ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b80eb9 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.925404:0:14257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b80eb9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.925415:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff90ce01f45b00) 00010000:00010000:0.0:1787826394.925419:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1787826394.925424:0:14257:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787826394.925435:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff90ce01f45b00) 00010000:00010000:0.0:1787826394.925437:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787826394.925448:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125c00/0x22153cd396b80e34 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x11:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab083a expref: 29 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1787826394.925645:0:14257:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1787826394.925662:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+29:54261:x1874670563772928:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 17354us (17814us total) trans 4294967706 rc 0/0 00000100:00100000:0.0:1787826394.925674:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1041 00010000:00010000:0.0:1787826394.925717:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b80eb9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.925727:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b80eb9 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14257 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.925739:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b80eb9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.925746:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05660a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826394.925752:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b80eb9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.925762:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b80eb9 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14257 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.925774:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff90ce01f45b00) 00010000:00010000:0.0:1787826394.925777:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826394.925781:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b80eb9 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.925788:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b80eb9 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826394.926416:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787826394.926439:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce04f061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585211520:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1787826394.926535:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826394.926592:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585211520 00000100:00100000:3.0:1787826394.926601:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585211520 00000100:00100000:3.0:1787826394.926665:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1952 00000100:00100000:3.0:1787826394.926674:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f05a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+7:3645:x1874670585211520:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1787826394.926874:0:8545:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x27:0x0] updating lvb size from disk: 1065984 -> 1065984 00002000:00010000:3.0:1787826394.926878:0:8545:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x27:0x0] updating lvb mtime from disk: 1787826394 -> 1787826394 00002000:00010000:3.0:1787826394.926881:0:8545:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x27:0x0] updating lvb atime from disk: 1787826394 -> 1787826394 00002000:00010000:3.0:1787826394.926883:0:8545:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x27:0x0] updating lvb ctime from disk: 1787826395 -> 1787826395 00002000:00010000:3.0:1787826394.926885:0:8545:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x27:0x0] updating lvb blocks from disk: 40 -> 40 00000100:00100000:3.0:1787826394.927196:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f05a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+8:3645:x1874670585211520:12345-0@lo:2:osp-syn-0-1.0 Request processed in 522us (661us total) trans 21474836977 rc 0/0 00000100:00100000:3.0:1787826394.927205:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1952 00000004:00080000:3.0:1787826394.927263:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce04f061c0/2, rc 0, transno 21474836977 00000100:00100000:3.0:1787826394.927271:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce04f061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585211520:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1787826394.927352:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce04f06940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585211648:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1787826394.927384:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826394.927417:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585211648 00000100:00100000:3.0:1787826394.927422:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585211648 00000100:00100000:3.0:1787826394.927462:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1953 00000100:00100000:3.0:1787826394.927502:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f04b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3645:x1874670585211648:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1787826394.927740:0:14864:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x24:0x0] updating lvb size from disk: 1065984 -> 1065984 00002000:00010000:3.0:1787826394.927744:0:14864:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x24:0x0] updating lvb mtime from disk: 1787826395 -> 1787826395 00002000:00010000:3.0:1787826394.927747:0:14864:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x24:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787826394.927749:0:14864:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x24:0x0] updating lvb ctime from disk: 1787826395 -> 1787826395 00002000:00010000:3.0:1787826394.927752:0:14864:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x24:0x0] updating lvb blocks from disk: 40 -> 40 00000100:00100000:3.0:1787826394.927878:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f04b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3645:x1874670585211648:12345-0@lo:2:osp-syn-1-1.0 Request processed in 408us (493us total) trans 17179869638 rc 0/0 00000100:00100000:3.0:1787826394.927887:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1953 00000100:00100000:3.0:1787826394.928000:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179869633 gen 2 00000004:00080000:3.0:1787826394.928007:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce03a192c0, transno 17179869630 00000004:00080000:3.0:1787826394.928017:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3f8761c0, transno 17179869631 00000004:00080000:3.0:1787826394.928021:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce039752c0, transno 17179869632 00000004:00080000:3.0:1787826394.928024:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf1366ad00, transno 17179869633 00000100:00100000:3.0:1787826394.928032:0:3645:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff90ce04f06940 x1874670585211648/t17179869638(17179869638) o2->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 440/432 e 0 to 0 dl 1787826410 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1787826394.928044:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce04f06940/2, rc 0, transno 17179869638 00000100:00100000:3.0:1787826394.928049:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce04f06940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585211648:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1787826394.928194:0:9964:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 0 changes, 2 in progress, 1 in flight, 4 done 00000100:00100000:0.0:1787826394.930075:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce04f052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585211392:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1787826394.930172:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826394.930231:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787826394.930239:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce04f07840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585211776:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1787826394.930265:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826394.930310:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585211392 00000100:00100000:0.0:1787826394.930320:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585211392 00000100:00100000:0.0:1787826394.930386:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585211776 00000100:00100000:0.0:1787826394.930390:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585211776 00000100:00100000:0.0:1787826394.930426:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1954 00000100:00100000:0.0:1787826394.930435:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+8:3647:x1874670585211392:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:0.0:1787826394.930842:0:30398:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x26:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1787826394.930848:0:30398:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x26:0x0] updating lvb mtime from disk: 1787826394 -> 1787826394 00002000:00010000:0.0:1787826394.930852:0:30398:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x26:0x0] updating lvb atime from disk: 1787826394 -> 1787826394 00002000:00010000:0.0:1787826394.930854:0:30398:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x26:0x0] updating lvb ctime from disk: 1787826395 -> 1787826395 00002000:00010000:0.0:1787826394.930857:0:30398:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x26:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1787826394.931037:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+9:3647:x1874670585211392:12345-0@lo:2:osp-syn-0-1.0 Request processed in 601us (863us total) trans 21474836978 rc 0/0 00000100:00100000:0.0:1787826394.931047:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1954 00000100:00100000:0.0:1787826394.931070:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1955 00000100:00100000:0.0:1787826394.931078:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+6:3647:x1874670585211776:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1787826394.931156:0:30398:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x25:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787826394.931160:0:30398:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x25:0x0] updating lvb mtime from disk: 1787826395 -> 1787826395 00002000:00010000:0.0:1787826394.931163:0:30398:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x25:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787826394.931165:0:30398:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x25:0x0] updating lvb ctime from disk: 1787826395 -> 1787826395 00002000:00010000:0.0:1787826394.931167:0:30398:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x25:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1787826394.931194:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+7:3647:x1874670585211776:12345-0@lo:2:osp-syn-1-1.0 Request processed in 117us (928us total) trans 17179869639 rc 0/0 00000100:00100000:0.0:1787826394.931200:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1955 00000004:00080000:0.0:1787826394.931253:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce04f07840/2, rc 0, transno 17179869639 00000100:00100000:0.0:1787826394.931260:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce04f07840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585211776:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1787826394.931273:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce04f052c0/2, rc 0, transno 21474836978 00000100:00100000:0.0:1787826394.931277:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce04f052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585211392:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1787826394.933252:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826394.933336:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563773184 00000100:00100000:3.0:1787826394.933348:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563773184 00000100:00100000:3.0:1787826394.933425:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3555 00000100:00100000:3.0:1787826394.933436:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+29:54261:x1874670563773184:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826394.933466:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826394.933534:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400200/0x22153cd396b80ec0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0880 expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826394.933612:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400200/0x22153cd396b80ec0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0880 expref: 30 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826394.933641:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400200/0x22153cd396b80ec0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0880 expref: 30 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826394.933665:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff90ce01f45b00) 00010000:00010000:3.0:1787826394.933669:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826394.933673:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400200, rc 0) 00000100:00100000:3.0:1787826394.933733:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:54261:x1874670563773184:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 299us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826394.933741:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3555 00000100:00100000:2.0:1787826394.939357:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826394.939468:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563773440 00000100:00100000:0.0:1787826394.939530:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563773440 00000100:00100000:0.0:1787826394.939604:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1042 00000100:00100000:0.0:1787826394.939616:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:54261:x1874670563773440:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:0.0:1787826394.940418:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:54261:x1874670563773440:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 800us (1073us total) trans 4294967707 rc 0/0 00000100:00100000:0.0:1787826394.940430:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1042 00010000:00010000:1.0:1787826394.940703:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124600/0x22153cd396b80e8f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.940716:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124600/0x22153cd396b80e8f lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.940725:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124600/0x22153cd396b80e8f lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.940732:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05124600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826394.940737:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124600/0x22153cd396b80e8f lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.940750:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124600/0x22153cd396b80e8f lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.940779:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff90ce01f45b00) 00010000:00010000:1.0:1787826394.940783:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826394.940789:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124600/0x22153cd396b80e8f lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.940805:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05124600/0x22153cd396b80e8f lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.940825:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661e00/0x22153cd396b80ea4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.940831:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661e00/0x22153cd396b80ea4 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.940837:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661e00/0x22153cd396b80ea4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.940842:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05661e00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826394.940846:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661e00/0x22153cd396b80ea4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.940852:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661e00/0x22153cd396b80ea4 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.940861:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff90ce01f45b00) 00010000:00010000:1.0:1787826394.940864:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826394.940866:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661e00/0x22153cd396b80ea4 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826394.940876:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661e00/0x22153cd396b80ea4 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826394.973041:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826394.973273:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563773696 00000100:00100000:0.0:1787826394.973349:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563773696 00000100:00100000:0.0:1787826394.973429:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3556 00000100:00100000:0.0:1787826394.973441:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+28:54263:x1874670563773696:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826394.973505:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826394.973533:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b80ec7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0887 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.973657:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80ece lrc: 3/1,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.973674:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80ece lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.973687:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80ece lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.973705:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661400/0x22153cd396b80ed5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.973713:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661400/0x22153cd396b80ed5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.973738:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661400/0x22153cd396b80ed5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.973883:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660600/0x22153cd396b80edc lrc: 3/1,0 mode: --/PR res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.973893:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660600/0x22153cd396b80edc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.973900:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660600/0x22153cd396b80edc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826394.973912:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0x11:0x0]: returning size 1065984 00010000:00010000:0.0:1787826394.974183:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80ece lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.974192:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80ece lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.974200:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80ece lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.974207:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80ece lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.974214:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05660400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826394.974219:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80ece lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.974227:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80ece lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.974241:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x0 (ffff90ce01f45c00) 00010000:00010000:0.0:1787826394.974244:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826394.974250:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80ece lrc: 3/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.974257:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660400/0x22153cd396b80ece lrc: 0/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.974273:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661400/0x22153cd396b80ed5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.974278:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661400/0x22153cd396b80ed5 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.974285:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661400/0x22153cd396b80ed5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.974290:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05661400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826394.974293:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661400/0x22153cd396b80ed5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.974299:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661400/0x22153cd396b80ed5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.974305:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x37186b36 (ffff90cf3abcb600) 00010000:00010000:0.0:1787826394.974308:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826394.974310:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661400/0x22153cd396b80ed5 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.974316:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05661400/0x22153cd396b80ed5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.974375:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660a00/0x22153cd396b80ec7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0887 expref: 31 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.974396:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660600/0x22153cd396b80edc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0887 expref: 30 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826394.974404:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff90ce01f45b00) 00010000:00010000:0.0:1787826394.974406:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826394.974409:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05660600, rc 0) 00000100:00100000:0.0:1787826394.974549:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:54263:x1874670563773696:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1110us (1523us total) trans 4294967708 rc 0/0 00000100:00100000:0.0:1787826394.974557:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3556 00000100:00100000:2.0:1787826395.030970:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826395.031036:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826395.031223:0:30176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563773824 00000100:00100000:3.0:1787826395.031237:0:30176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563773824 00000100:00100000:3.0:1787826395.031362:0:30176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563773952 00000100:00100000:3.0:1787826395.031367:0:30176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563773952 00000100:00080000:0.0:1787826395.031374:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826395.031402:0:30176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 744 00000100:00100000:3.0:1787826395.031414:0:30176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563773824:12345-192.168.203.39@tcp:3:lfs.0 00000100:00100000:0.0:1787826395.031418:0:14865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 745 00000100:00100000:0.0:1787826395.031434:0:14865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563773952:12345-192.168.203.39@tcp:3:lfs.0 00010000:00010000:3.0:1787826395.031503:0:30176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008343e43a/0x22153cd396b80eea lrc: 3/1,0 mode: --/PR res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826395.031505:0:14865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d9012eb8/0x22153cd396b80ef1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826395.031545:0:30176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a3adc48c/0x22153cd396b80eab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0872 expref: 12 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826395.031546:0:14865:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002ab9f4ae/0x22153cd396b80eb2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0879 expref: 12 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826395.031570:0:14865:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x27:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787826395.031570:0:30176:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x26:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787826395.031582:0:14865:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826395.031582:0:30176:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826395.031595:0:30176:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008343e43a/0x22153cd396b80eea lrc: 4/1,0 mode: --/PR res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826395.031596:0:14865:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9012eb8/0x22153cd396b80ef1 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [1048576->1069055] (req 1048576->1069055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826395.031655:0:30176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a3adc48c/0x22153cd396b80eab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0872 expref: 12 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826395.031656:0:14865:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002ab9f4ae/0x22153cd396b80eb2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0879 expref: 12 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826395.031691:0:14865:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002ab9f4ae/0x22153cd396b80eb2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0879 expref: 12 pid: 30398 timeout: 1441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826395.031691:0:30176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a3adc48c/0x22153cd396b80eab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0872 expref: 12 pid: 30694 timeout: 1441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826395.031740:0:14865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce044d1e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0000_UUID:14865:1874670585212032:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826395.031786:0:30176:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf1366ad00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0000_UUID:30176:1874670585211904:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826395.034870:0:30176:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10b3bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826395.037350:0:14865:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a2d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826395.045380:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826395.045526:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563774080 00000100:00100000:3.0:1787826395.045537:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563774080 00010000:00010000:3.0:1787826395.045603:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002ab9f4ae/0x22153cd396b80eb2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0879 expref: 13 pid: 30398 timeout: 1441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826395.045649:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1026 00000100:00100000:3.0:1787826395.045662:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05120780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2403:x1874670563774080:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826395.045683:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787826395.045700:0:14865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce044d1e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0000_UUID:14865:1874670585212032:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826395.045713:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002ab9f4ae/0x22153cd396b80eb2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0879 expref: 13 pid: 30398 timeout: 1441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826395.045729:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002ab9f4ae/0x22153cd396b80eb2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0879 expref: 13 pid: 30398 timeout: 1441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826395.045826:0:30176:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf1366ad00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0000_UUID:30176:1874670585211904:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826395.045846:0:30176:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008343e43a/0x22153cd396b80eea lrc: 3/1,0 mode: --/PR res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826395.045961:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ab9f4ae/0x22153cd396b80eb2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0879 expref: 13 pid: 30398 timeout: 1441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826395.050455:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826395.050819:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563774208 00000100:00100000:2.0:1787826395.050831:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563774208 00010000:00010000:2.0:1787826395.050879:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a3adc48c/0x22153cd396b80eab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0872 expref: 13 pid: 30694 timeout: 1441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826395.050932:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1027 00000100:00100000:2.0:1787826395.050943:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05120f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2403:x1874670563774208:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826395.050961:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826395.050987:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a3adc48c/0x22153cd396b80eab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0872 expref: 13 pid: 30694 timeout: 1441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826395.051004:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a3adc48c/0x22153cd396b80eab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0872 expref: 13 pid: 30694 timeout: 1441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826395.051032:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3adc48c/0x22153cd396b80eab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0872 expref: 13 pid: 30694 timeout: 1441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826395.051053:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826395.051059:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826395.051066:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008343e43a/0x22153cd396b80eea lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 30176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826395.051078:0:10341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008343e43a/0x22153cd396b80eea lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 30176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826395.051111:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826395.051187:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05120f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563774208:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 244us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826395.051194:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1027 00010000:00010000:2.0:1787826395.051225:0:30176:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008343e43a/0x22153cd396b80eea lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826395.051234:0:30176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008343e43a/0x22153cd396b80eea lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826395.052077:0:14865:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d9012eb8/0x22153cd396b80ef1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [1048576->1069055] (req 1048576->1069055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826395.055698:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826395.055710:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826395.056231:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9012eb8/0x22153cd396b80ef1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [1048576->1069055] (req 1048576->1069055) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826395.056252:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9012eb8/0x22153cd396b80ef1 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [1048576->1069055] (req 1048576->1069055) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826395.057577:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826395.057670:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05120780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563774080:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 12001us (12294us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826395.057684:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1026 00010000:00010000:0.0:1787826395.057932:0:14865:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d9012eb8/0x22153cd396b80ef1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [1048576->1069055] (req 1048576->1069055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826395.057950:0:14865:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9012eb8/0x22153cd396b80ef1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [1048576->1069055] (req 1048576->1069055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826395.063908:0:14865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d9012eb8/0x22153cd396b80ef1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [1048576->1069055] (req 1048576->1069055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826395.063934:0:14865:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9012eb8/0x22153cd396b80ef1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [1048576->1069055] (req 1048576->1069055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826395.063945:0:14865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9012eb8/0x22153cd396b80ef1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [1048576->1069055] (req 1048576->1069055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826395.063954:0:14865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce05660a00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826395.063960:0:14865:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9012eb8/0x22153cd396b80ef1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [1048576->1069055] (req 1048576->1069055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826395.063970:0:14865:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9012eb8/0x22153cd396b80ef1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [1048576->1069055] (req 1048576->1069055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826395.063994:0:14865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9012eb8/0x22153cd396b80ef1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [1048576->1069055] (req 1048576->1069055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826395.064003:0:14865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9012eb8/0x22153cd396b80ef1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [1048576->1069055] (req 1048576->1069055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826395.064204:0:14865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2404:x1874670563773952:12345-192.168.203.39@tcp:3:lfs.0 Request processed in 32683us (33075us total) trans 0 rc 17408/17408 00000100:00100000:2.0:1787826395.064217:0:14865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 745 00010000:00010000:2.0:1787826395.075886:0:30176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008343e43a/0x22153cd396b80eea lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826395.075914:0:30176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008343e43a/0x22153cd396b80eea lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826395.075924:0:30176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008343e43a/0x22153cd396b80eea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826395.075932:0:30176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401000 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826395.075939:0:30176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008343e43a/0x22153cd396b80eea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826395.075950:0:30176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008343e43a/0x22153cd396b80eea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826395.075975:0:30176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008343e43a/0x22153cd396b80eea lrc: 2/0,0 mode: --/PR res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826395.075983:0:30176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008343e43a/0x22153cd396b80eea lrc: 0/0,0 mode: --/PR res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826395.076153:0:30176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563773824:12345-192.168.203.39@tcp:3:lfs.0 Request processed in 44732us (45191us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1787826395.076165:0:30176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 744 00000100:00100000:3.0:1787826395.121347:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826395.121431:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563774336 00000100:00100000:0.0:1787826395.121445:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563774336 00000100:00100000:0.0:1787826395.121614:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1956 00000100:00100000:3.0:1787826395.121661:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826395.121710:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1366ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563774336:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826395.121744:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826395.121782:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f453621b/0x22153cd396b80ef8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab088e expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826395.121817:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x26:0x0] initial LVB size: 1048576, mtime: 0x6a9010da, atime: 0x6a9010da, ctime: 0x6a9010db, blocks: 0x0 00010000:00010000:1.0:1787826395.121844:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=1341s v=(0 0) 00010000:00010000:1.0:1787826395.121849:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826395.121864:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f453621b/0x22153cd396b80ef8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab088e expref: 10 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826395.121887:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f453621b/0x22153cd396b80ef8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab088e expref: 10 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826395.121913:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05124c00, rc 0) 00000100:00100000:1.0:1787826395.122408:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1366ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563774336:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 778us (1082us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826395.122419:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1956 00000100:00100000:2.0:1787826395.122428:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563774464 00000100:00100000:2.0:1787826395.122435:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563774464 00000100:00100000:1.0:1787826395.122544:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1957 00000100:00100000:1.0:1787826395.122552:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563774464:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826395.122563:0:30695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826395.122576:0:30695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c21779c/0x22153cd396b80eff lrc: 2/0,0 mode: --/PR res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0895 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826395.122594:0:30695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x27:0x0] initial LVB size: 1065984, mtime: 0x6a9010da, atime: 0x6a9010da, ctime: 0x6a9010db, blocks: 0x28 00010000:00010000:1.0:1787826395.122606:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=1341s v=(0 0) 00010000:00010000:1.0:1787826395.122610:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826395.122618:0:30695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c21779c/0x22153cd396b80eff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0895 expref: 11 pid: 30695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826395.122631:0:30695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009c21779c/0x22153cd396b80eff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0895 expref: 11 pid: 30695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826395.122642:0:30695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05125e00, rc 0) 00000100:00100000:1.0:1787826395.122667:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2404:x1874670563774464:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 116us (1009us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826395.122675:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1957 00000100:00100000:0.0:1787826395.140663:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826395.145028:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563774720 00000100:00100000:2.0:1787826395.145047:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563774720 00000100:00100000:2.0:1787826395.145167:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1043 00000100:00100000:2.0:1787826395.145179:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf18581450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:54263:x1874670563774720:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:2.0:1787826395.146903:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf18581450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:54263:x1874670563774720:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 1709us (6253us total) trans 4294967709 rc 0/0 00000100:00100000:2.0:1787826395.146918:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1043 00000100:00080000:0.0:1787826395.148571:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787826395.179203:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826395.179353:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563774976 00000100:00100000:1.0:1787826395.179366:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563774976 00000100:00100000:1.0:1787826395.179522:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3557 00000100:00100000:1.0:1787826395.179542:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:54266:x1874670563774976:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826395.179580:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826395.179615:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125800/0x22153cd396b80f06 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab089c expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826395.179767:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125600/0x22153cd396b80f0d lrc: 3/1,0 mode: --/CR res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826395.179785:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125600/0x22153cd396b80f0d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x11:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826395.179801:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125600/0x22153cd396b80f0d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x11:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826395.179819:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0x11:0x0]: returning size 1065984 00010000:00010000:1.0:1787826395.179958:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125800/0x22153cd396b80f06 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab089c expref: 34 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826395.179981:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125600/0x22153cd396b80f0d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x11:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab089c expref: 33 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826395.180004:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff90ce01f45b00) 00010000:00010000:1.0:1787826395.180007:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787826395.180011:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce05125600, rc 0) 00000100:00100000:1.0:1787826395.180163:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:54266:x1874670563774976:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 621us (973us total) trans 4294967710 rc 0/0 00000100:00100000:1.0:1787826395.180171:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3557 00000100:00100000:1.0:1787826395.238984:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826395.239544:0:20692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563775104 00000100:00100000:3.0:1787826395.239557:0:20692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563775104 00000100:00100000:3.0:1787826395.239664:0:20692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 746 00000100:00100000:3.0:1787826395.239677:0:20692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce051212c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2404:x1874670563775104:12345-192.168.203.39@tcp:3:lfs.0 00010000:00010000:3.0:1787826395.239721:0:20692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b33b8f4a/0x22153cd396b80f1b lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826395.239745:0:20692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e9767cf8/0x22153cd396b80e96 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0864 expref: 11 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826395.239755:0:20692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000400:0x24:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787826395.239760:0:20692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x24:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826395.239766:0:20692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b33b8f4a/0x22153cd396b80f1b lrc: 4/1,0 mode: --/PR res: [0x2c0000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->1069055] (req 0->1069055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787826395.239856:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787826395.239937:0:20692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e9767cf8/0x22153cd396b80e96 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0864 expref: 11 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826395.239955:0:20692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e9767cf8/0x22153cd396b80e96 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0864 expref: 11 pid: 8435 timeout: 1441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826395.239977:0:20692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf1ecaed00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:20692:1874670585212160:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826395.240086:0:20692:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10b3bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787826395.243052:0:20692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf1ecaed00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:20692:1874670585212160:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826395.243090:0:20692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b33b8f4a/0x22153cd396b80f1b lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->1069055] (req 0->1069055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826395.244124:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826395.244620:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563775232 00000100:00100000:2.0:1787826395.244631:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563775232 00010000:00010000:2.0:1787826395.244684:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e9767cf8/0x22153cd396b80e96 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0864 expref: 12 pid: 8435 timeout: 1441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826395.244738:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1028 00000100:00100000:2.0:1787826395.244751:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf185dc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563775232:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826395.244770:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826395.244800:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e9767cf8/0x22153cd396b80e96 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0864 expref: 12 pid: 8435 timeout: 1441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826395.244816:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e9767cf8/0x22153cd396b80e96 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0864 expref: 12 pid: 8435 timeout: 1441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826395.244994:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9767cf8/0x22153cd396b80e96 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0864 expref: 12 pid: 8435 timeout: 1441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826395.245015:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x24:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826395.245020:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x24:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826395.245027:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b33b8f4a/0x22153cd396b80f1b lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->1069055] (req 0->1069055) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826395.245040:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b33b8f4a/0x22153cd396b80f1b lrc: 4/1,0 mode: PR/PR res: [0x2c0000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->1069055] (req 0->1069055) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826395.245216:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826395.245340:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf185dc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2403:x1874670563775232:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 590us (1223us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826395.245350:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1028 00010000:00010000:3.0:1787826395.245784:0:20692:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b33b8f4a/0x22153cd396b80f1b lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->1069055] (req 0->1069055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826395.245797:0:20692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b33b8f4a/0x22153cd396b80f1b lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->1069055] (req 0->1069055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826395.260306:0:20692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b33b8f4a/0x22153cd396b80f1b lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->1069055] (req 0->1069055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826395.260339:0:20692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b33b8f4a/0x22153cd396b80f1b lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->1069055] (req 0->1069055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826395.260351:0:20692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b33b8f4a/0x22153cd396b80f1b lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->1069055] (req 0->1069055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826395.260356:0:20692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401600 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826395.260360:0:20692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b33b8f4a/0x22153cd396b80f1b lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->1069055] (req 0->1069055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826395.260367:0:20692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b33b8f4a/0x22153cd396b80f1b lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->1069055] (req 0->1069055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826395.260388:0:20692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b33b8f4a/0x22153cd396b80f1b lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->1069055] (req 0->1069055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826395.260394:0:20692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b33b8f4a/0x22153cd396b80f1b lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->1069055] (req 0->1069055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826395.260587:0:20692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce051212c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563775104:12345-192.168.203.39@tcp:3:lfs.0 Request processed in 20906us (21612us total) trans 0 rc 1065984/1065984 00000100:00100000:3.0:1787826395.260599:0:20692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 746 00000100:00100000:1.0:1787826395.298122:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826395.298239:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563775360 00000100:00100000:3.0:1787826395.298251:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563775360 00000100:00100000:3.0:1787826395.298443:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1958 00000100:00100000:3.0:1787826395.298455:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563775360:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826395.298536:0:28853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826395.298564:0:28853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b33b8f4a/0x22153cd396b80f22 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab08a3 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826395.298598:0:28853:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x24:0x0] initial LVB size: 1065984, mtime: 0x6a9010db, atime: 0x0, ctime: 0x6a9010db, blocks: 0x28 00010000:00010000:3.0:1787826395.298626:0:28853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x24:0x0].0x0 since=1341s v=(0 0) 00010000:00010000:3.0:1787826395.298632:0:28853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826395.298650:0:28853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b33b8f4a/0x22153cd396b80f22 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08a3 expref: 11 pid: 28853 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826395.298673:0:28853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b33b8f4a/0x22153cd396b80f22 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08a3 expref: 11 pid: 28853 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826395.298690:0:28853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401600, rc 0) 00000100:00100000:2.0:1787826395.300370:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2404:x1874670563775360:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1905us (2250us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826395.300385:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1958 00000100:00100000:0.0:1787826395.326751:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826395.326953:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563775488 00000100:00100000:2.0:1787826395.326967:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563775488 00000100:00100000:1.0:1787826395.327055:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826395.327061:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 347 00000100:00100000:2.0:1787826395.327075:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:42221:x1874670563775488:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826395.327095:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1787826395.327151:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c267dc2/0x22153cd396b80b8d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0768 expref: 11 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826395.327196:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c21779c/0x22153cd396b80eff lrc: 0/0,0 mode: --/PR res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0895 expref: 10 pid: 30695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826395.327231:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f453621b/0x22153cd396b80ef8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab088e expref: 9 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826395.327258:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000472bc4f7/0x22153cd396b80b7f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0761 expref: 8 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826395.327273:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826395.327349:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:42221:x1874670563775488:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 277us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826395.327358:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 347 00000100:00100000:2.0:1787826395.327375:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563775616 00000100:00100000:2.0:1787826395.327379:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563775616 00000100:00100000:0.0:1787826395.328628:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 348 00000100:00100000:0.0:1787826395.328650:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05120f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:49796:x1874670563775616:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826395.328671:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1787826395.328712:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b33b8f4a/0x22153cd396b80f22 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08a3 expref: 11 pid: 28853 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826395.328765:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d747c98/0x22153cd396b80e9d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab086b expref: 10 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826395.328793:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b608887/0x22153cd396b80b94 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab076f expref: 9 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826395.328818:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c87ea1db/0x22153cd396b80b78 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab075a expref: 8 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826395.328831:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826395.328951:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05120f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:49796:x1874670563775616:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 311us (1896us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826395.328960:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 348 00000100:00100000:1.0:1787826395.368586:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826395.368712:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563775872 00000100:00100000:0.0:1787826395.368725:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563775872 00000100:00100000:0.0:1787826395.368800:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3558 00000100:00100000:0.0:1787826395.368812:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05120780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:54273:x1874670563775872:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826395.368844:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826395.368871:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf0165fe00/0x22153cd396b80f29 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab08aa expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826395.369024:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf0165f600/0x22153cd396b80f30 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826395.369044:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660600/0x22153cd396b80edc lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0887 expref: 34 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826395.369055:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf0165f600/0x22153cd396b80f30 lrc: 4/0,1 mode: --/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826395.369100:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660600/0x22153cd396b80edc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0887 expref: 34 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826395.369117:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660600/0x22153cd396b80edc lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0887 expref: 34 pid: 6520 timeout: 1441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826395.369133:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce044d3c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6519:1874670585212288:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826395.369258:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a2d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826395.375170:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826395.375291:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563776000 00000100:00100000:2.0:1787826395.375304:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563776000 00010000:00010000:2.0:1787826395.375370:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660600/0x22153cd396b80edc lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0887 expref: 35 pid: 6520 timeout: 1441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826395.375433:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1029 00000100:00100000:2.0:1787826395.375445:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce051230c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:2403:x1874670563776000:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826395.375465:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826395.375531:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660600/0x22153cd396b80edc lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0887 expref: 35 pid: 6520 timeout: 1441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826395.375547:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660600/0x22153cd396b80edc lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0887 expref: 35 pid: 6520 timeout: 1441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826395.375578:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff90ce01f45b00) 00010000:00010000:2.0:1787826395.375585:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff90cf0165f600/0x22153cd396b80f30 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826395.375598:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf0165f600/0x22153cd396b80f30 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826395.375607:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf0165f600/0x22153cd396b80f30 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826395.375631:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826395.375699:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce051230c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:2403:x1874670563776000:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 256us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826395.375708:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1029 00010000:00010000:0.0:1787826395.376561:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660600/0x22153cd396b80edc lrc: 0/0,0 mode: --/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0887 expref: 34 pid: 6520 timeout: 1441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826395.376585:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce044d3c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6519:1874670585212288:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826395.376618:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff90cf0165f600/0x22153cd396b80f30 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826395.376628:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff90cf0165f600/0x22153cd396b80f30 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826395.376633:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf0165f600/0x22153cd396b80f30 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826395.376655:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0x11:0x0]: returning size 1065984 00010000:00010000:0.0:1787826395.376829:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf0165fe00/0x22153cd396b80f29 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08aa expref: 35 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826395.376848:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf0165f600/0x22153cd396b80f30 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08aa expref: 34 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826395.376857:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff90ce01f45b00) 00010000:00010000:0.0:1787826395.376860:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787826395.376863:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165f600, rc 0) 00000100:00100000:0.0:1787826395.376923:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05120780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:54273:x1874670563775872:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 8113us (8352us total) trans 4294967711 rc 0/0 00000100:00100000:0.0:1787826395.376932:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3558 00000100:00100000:1.0:1787826395.380171:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826395.384533:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563776128 00000100:00100000:0.0:1787826395.384557:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563776128 00000100:00100000:0.0:1787826395.384659:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3559 00000100:00100000:0.0:1787826395.384671:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05120b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:54273:x1874670563776128:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826395.384703:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826395.384731:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf0165e200/0x22153cd396b80f3e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab08b1 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826395.384861:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf0165ec00/0x22153cd396b80f45 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826395.384880:0:16564:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf0165f600/0x22153cd396b80f30 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08aa expref: 35 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826395.384892:0:16564:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf0165ec00/0x22153cd396b80f45 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x11:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826395.384939:0:16564:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff90cf0165f600/0x22153cd396b80f30 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08aa expref: 35 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826395.384955:0:16564:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf0165f600/0x22153cd396b80f30 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08aa expref: 35 pid: 6519 timeout: 1441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826395.384973:0:16564:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce044d3c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:16564:1874670585212416:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826395.385087:0:16564:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a2d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826395.390510:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826395.390651:0:16564:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce044d3c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:16564:1874670585212416:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826395.390691:0:16564:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff90cf0165ec00/0x22153cd396b80f45 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x11:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826395.390914:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563776256 00000100:00100000:1.0:1787826395.390925:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563776256 00010000:00010000:1.0:1787826395.390982:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf0165f600/0x22153cd396b80f30 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08aa expref: 36 pid: 6519 timeout: 1441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826395.391029:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1030 00000100:00100000:1.0:1787826395.391041:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:2404:x1874670563776256:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826395.391061:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826395.391070:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff90cf0165f600/0x22153cd396b80f30 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08aa expref: 36 pid: 6519 timeout: 1441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826395.391085:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff90cf0165f600/0x22153cd396b80f30 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08aa expref: 36 pid: 6519 timeout: 1441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826395.391113:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf0165f600/0x22153cd396b80f30 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08aa expref: 36 pid: 6519 timeout: 1441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826395.391131:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff90ce01f45b00) 00010000:00010000:1.0:1787826395.391137:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff90cf0165ec00/0x22153cd396b80f45 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x11:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826395.391148:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf0165ec00/0x22153cd396b80f45 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826395.391158:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf0165ec00/0x22153cd396b80f45 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826395.391191:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826395.391360:0:16564:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff90cf0165ec00/0x22153cd396b80f45 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826395.391373:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf0165ec00/0x22153cd396b80f45 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826395.391442:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0x11:0x0]: returning size 1065984 00000004:00200000:2.0:1787826395.391448:0:16564:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826395.391566:0:16564:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff90cf0165ec00/0x22153cd396b80f45 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826395.391605:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf0165e200/0x22153cd396b80f3e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08b1 expref: 36 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826395.391622:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf0165ec00/0x22153cd396b80f45 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08b1 expref: 35 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826395.391631:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff90ce01f45b00) 00010000:00010000:2.0:1787826395.391634:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826395.391636:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165ec00, rc 0) 00000100:00100000:1.0:1787826395.391718:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:2404:x1874670563776256:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 677us (1254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826395.391728:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1030 00000100:00100000:2.0:1787826395.392237:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05120b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:54273:x1874670563776128:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 7565us (12079us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826395.392247:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3559 00000100:00100000:2.0:1787826395.398691:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826395.401350:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826395.402047:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563776384 00000100:00100000:2.0:1787826395.402062:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563776384 00000100:00100000:2.0:1787826395.402131:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563776512 00000100:00100000:2.0:1787826395.402134:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563776512 00000100:00100000:2.0:1787826395.402165:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1959 00000100:00100000:2.0:1787826395.402178:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2401:x1874670563776384:12345-192.168.203.39@tcp:1:lfs.0 00002000:00010000:2.0:1787826395.402258:0:30696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x26:0x0] initial LVB size: 1048576, mtime: 0x6a9010da, atime: 0x6a9010da, ctime: 0x6a9010db, blocks: 0x0 00010000:00010000:2.0:1787826395.402271:0:30696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000673b7b2e/0x22153cd396b80f4c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826395.402291:0:30696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=1341s v=(0 0) 00010000:00010000:2.0:1787826395.402297:0:30696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826395.402305:0:30696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000673b7b2e/0x22153cd396b80f4c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826395.402336:0:30696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000673b7b2e/0x22153cd396b80f4c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826395.402357:0:30696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000673b7b2e/0x22153cd396b80f4c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826395.402366:0:30696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000673b7b2e/0x22153cd396b80f4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826395.402376:0:30696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000673b7b2e/0x22153cd396b80f4c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826395.402383:0:30696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835400 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826395.402388:0:30696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000673b7b2e/0x22153cd396b80f4c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826395.402398:0:30696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000673b7b2e/0x22153cd396b80f4c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826395.402423:0:30696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000673b7b2e/0x22153cd396b80f4c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826395.402432:0:30696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000673b7b2e/0x22153cd396b80f4c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826395.402617:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1960 00000100:00100000:1.0:1787826395.402630:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecaed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2402:x1874670563776512:12345-192.168.203.39@tcp:1:lfs.0 00002000:00010000:1.0:1787826395.402661:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x27:0x0] initial LVB size: 1065984, mtime: 0x6a9010da, atime: 0x6a9010da, ctime: 0x6a9010db, blocks: 0x28 00010000:00010000:1.0:1787826395.402667:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004bbb43ea/0x22153cd396b80f53 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826395.402677:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=1341s v=(0 0) 00010000:00010000:1.0:1787826395.402680:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826395.402685:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004bbb43ea/0x22153cd396b80f53 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826395.402695:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004bbb43ea/0x22153cd396b80f53 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826395.402706:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004bbb43ea/0x22153cd396b80f53 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826395.402714:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004bbb43ea/0x22153cd396b80f53 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826395.402722:0:8436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004bbb43ea/0x22153cd396b80f53 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826395.402730:0:8436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0a067200 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:1.0:1787826395.402734:0:8436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004bbb43ea/0x22153cd396b80f53 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826395.402743:0:8436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004bbb43ea/0x22153cd396b80f53 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826395.402753:0:8436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004bbb43ea/0x22153cd396b80f53 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826395.402761:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004bbb43ea/0x22153cd396b80f53 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826395.402851:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecaed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2402:x1874670563776512:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 225us (1527us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826395.402860:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1960 00000100:00100000:2.0:1787826395.403234:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2401:x1874670563776384:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 1058us (4556us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826395.403243:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1959 00000100:00100000:3.0:1787826395.406769:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826395.406888:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563776768 00000100:00100000:2.0:1787826395.406901:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563776768 00000100:00100000:2.0:1787826395.406964:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3560 00000100:00100000:2.0:1787826395.406974:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f80b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:54273:x1874670563776768:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:2.0:1787826395.407055:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826395.407093:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05660200/0x22153cd396b80d70 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x11:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab07ed expref: 34 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826395.407116:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff90ce01f45b00) 00010000:00010000:2.0:1787826395.407122:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826395.407151:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834200/0x22153cd396b80f5a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826395.407166:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf0165ec00/0x22153cd396b80f45 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08b1 expref: 33 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826395.407176:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400200/0x22153cd396b80ec0 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0880 expref: 33 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826395.407185:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125600/0x22153cd396b80f0d lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x11:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab089c expref: 33 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826395.407195:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834200/0x22153cd396b80f5a lrc: 6/0,1 mode: --/EX res: [0x240000404:0x11:0x0].0x0 bits 0x2a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826395.407238:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125600/0x22153cd396b80f0d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x11:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab089c expref: 33 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826395.407254:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125600/0x22153cd396b80f0d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x11:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab089c expref: 33 pid: 8247 timeout: 1441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826395.407272:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f8c3c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6518:1874670585212544:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826395.407989:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400200/0x22153cd396b80ec0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0880 expref: 33 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826395.408002:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400200/0x22153cd396b80ec0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0880 expref: 33 pid: 9966 timeout: 1441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826395.408012:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f8c2d00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6518:1874670585212672:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826395.408049:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff90cf0165ec00/0x22153cd396b80f45 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08b1 expref: 33 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826395.408058:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf0165ec00/0x22153cd396b80f45 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08b1 expref: 33 pid: 16564 timeout: 1441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826395.408074:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f8c2580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6518:1874670585212800:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826395.408099:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce02742540 going to sleep for 11 seconds 00000100:00100000:1.0:1787826395.417794:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826395.417915:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563777024 00000100:00100000:0.0:1787826395.417926:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563777024 00000100:00100000:0.0:1787826395.417989:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1044 00000100:00100000:0.0:1787826395.418000:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05122940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:49796:x1874670563777024:12345-192.168.203.39@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787826395.418312:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05122940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:49796:x1874670563777024:12345-192.168.203.39@tcp:35:ldlm_bl.0 Request processed in 313us (533us total) trans 4294967712 rc 0/0 00000100:00100000:0.0:1787826395.418330:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1044 00000100:00100000:2.0:1787826395.418468:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f8c3c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6518:1874670585212544:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826395.418522:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f8c2d00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6518:1874670585212672:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826395.418531:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f8c2580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6518:1874670585212800:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826395.418566:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834200/0x22153cd396b80f5a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x11:0x0].0x0 bits 0x2a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826395.420814:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826395.420846:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826395.421217:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563777152 00000100:00100000:2.0:1787826395.421230:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563777152 00010000:00010000:2.0:1787826395.421282:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400200/0x22153cd396b80ec0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0880 expref: 35 pid: 9966 timeout: 1441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826395.421337:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563777280 00000100:00100000:2.0:1787826395.421341:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563777280 00010000:00010000:2.0:1787826395.421362:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf0165ec00/0x22153cd396b80f45 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08b1 expref: 36 pid: 16564 timeout: 1441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826395.421384:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1031 00000100:00100000:2.0:1787826395.421394:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05123840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:2403:x1874670563777152:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826395.421413:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787826395.421418:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1032 00010000:00010000:2.0:1787826395.421420:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400200/0x22153cd396b80ec0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0880 expref: 36 pid: 9966 timeout: 1441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826395.421428:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05121e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:2403:x1874670563777280:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826395.421433:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400200/0x22153cd396b80ec0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0880 expref: 36 pid: 9966 timeout: 1441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826395.421435:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826395.421440:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff90cf0165ec00/0x22153cd396b80f45 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08b1 expref: 36 pid: 16564 timeout: 1441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826395.421461:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400200/0x22153cd396b80ec0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0880 expref: 36 pid: 9966 timeout: 1441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826395.422055:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff90cf0165ec00/0x22153cd396b80f45 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08b1 expref: 35 pid: 16564 timeout: 1441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826395.422073:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf0165ec00/0x22153cd396b80f45 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08b1 expref: 35 pid: 16564 timeout: 1441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826395.422087:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff90ce01f45b00) 00010000:00010000:0.0:1787826395.422093:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834200/0x22153cd396b80f5a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x11:0x0].0x0 bits 0x2a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826395.422103:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834200/0x22153cd396b80f5a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x11:0x0].0x0 bits 0x2a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826395.422109:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834200/0x22153cd396b80f5a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x11:0x0].0x0 bits 0x2a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826395.422116:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826395.422779:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05121e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:2403:x1874670563777280:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 1345us (1924us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826395.422792:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1032 00000100:00100000:1.0:1787826395.423036:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00010000:00010000:2.0:1787826395.423264:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff90ce01f45b00) 00010000:00010000:2.0:1787826395.423273:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834200/0x22153cd396b80f5a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x11:0x0].0x0 bits 0x2a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826395.423284:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834200/0x22153cd396b80f5a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x11:0x0].0x0 bits 0x2a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826395.423290:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834200/0x22153cd396b80f5a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x11:0x0].0x0 bits 0x2a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826395.423297:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826395.423349:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05123840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:2403:x1874670563777152:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 1955us (2548us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826395.423358:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1031 00000100:00100000:2.0:1787826395.423393:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563777408 00000100:00100000:2.0:1787826395.423401:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563777408 00010000:00010000:2.0:1787826395.423435:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125600/0x22153cd396b80f0d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x11:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab089c expref: 33 pid: 8247 timeout: 1441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826395.424235:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1033 00000100:00100000:0.0:1787826395.424249:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf185de450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:2404:x1874670563777408:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826395.424268:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826395.424277:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125600/0x22153cd396b80f0d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x11:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab089c expref: 33 pid: 8247 timeout: 1441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826395.424290:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125600/0x22153cd396b80f0d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x11:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab089c expref: 33 pid: 8247 timeout: 1441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826395.424315:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce05125600/0x22153cd396b80f0d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x11:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab089c expref: 33 pid: 8247 timeout: 1441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826395.424341:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff90ce01f45b00) 00010000:00010000:0.0:1787826395.424346:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834200/0x22153cd396b80f5a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x11:0x0].0x0 bits 0x2a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826395.424357:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834200/0x22153cd396b80f5a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x11:0x0].0x0 bits 0x2a/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826395.424365:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834200/0x22153cd396b80f5a lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x11:0x0].0x0 bits 0x2a/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826395.424657:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826395.424965:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834200/0x22153cd396b80f5a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x11:0x0].0x0 bits 0x2a/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826395.424976:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834200/0x22153cd396b80f5a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x11:0x0].0x0 bits 0x2a/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826395.425219:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf185de450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+32:2404:x1874670563777408:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 466us (1677us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826395.425230:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1033 00000004:00010000:1.0:1787826395.426228:0:6518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000a6b9ce0 reply state 0000000085ff1e3f transno 4294967713 ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834200/0x22153cd396b80f5a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x11:0x0].0x0 bits 0x2a/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826395.426255:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834200/0x22153cd396b80f5a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x2a/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826395.426265:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff90ce01f45b00) 00010000:00010000:1.0:1787826395.426269:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2a 00000100:00100000:1.0:1787826395.426273:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826395.426377:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f80b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:54273:x1874670563776768:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 19394us (19612us total) trans 4294967713 rc 0/0 00000100:00100000:1.0:1787826395.427250:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3560 00000100:00100000:1.0:1787826395.441818:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826395.441876:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563777664 00000100:00100000:2.0:1787826395.441890:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563777664 00000100:00100000:2.0:1787826395.441972:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1045 00000100:00100000:2.0:1787826395.441984:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce051203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:54273:x1874670563777664:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:2.0:1787826395.443060:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce051203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:54273:x1874670563777664:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 1069us (1250us total) trans 4294967714 rc 0/0 00000100:00100000:2.0:1787826395.443072:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1045 00010000:00010000:0.0:1787826395.460010:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826395.478270:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826395.478430:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563777920 00000100:00100000:1.0:1787826395.478443:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563777920 00000100:00100000:1.0:1787826395.478569:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3561 00000100:00100000:1.0:1787826395.478582:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:54274:x1874670563777920:12345-192.168.203.39@tcp:101:lseek_test.0 00010000:00010000:1.0:1787826395.478613:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826395.478981:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce0a066800/0x22153cd396b80f61 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab08b8 expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826395.479077:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce0a067c00/0x22153cd396b80f68 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826395.479096:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce0a067c00/0x22153cd396b80f68 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826395.479108:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce0a067c00/0x22153cd396b80f68 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826395.479123:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce0a066600/0x22153cd396b80f6f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826395.479130:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce0a066600/0x22153cd396b80f6f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826395.479135:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce0a066600/0x22153cd396b80f6f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826395.479292:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce0a067a00/0x22153cd396b80f76 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826395.479302:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90ce0a067a00/0x22153cd396b80f76 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826395.479309:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90ce0a067a00/0x22153cd396b80f76 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826395.479331:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0x11:0x0]: returning size 1065984 00010000:00010000:1.0:1787826395.481990:0:8247:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce0a067c00/0x22153cd396b80f68 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826395.482012:0:8247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce0a067c00/0x22153cd396b80f68 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826395.482020:0:8247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce0a067c00/0x22153cd396b80f68 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826395.482028:0:8247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90ce0a067c00/0x22153cd396b80f68 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826395.482035:0:8247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0a067c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826395.482042:0:8247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce0a067c00/0x22153cd396b80f68 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826395.482050:0:8247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce0a067c00/0x22153cd396b80f68 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826395.482070:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x0 (ffff90ce01f45c00) 00010000:00010000:1.0:1787826395.482074:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826395.482079:0:8247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90ce0a067c00/0x22153cd396b80f68 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826395.482087:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce0a067c00/0x22153cd396b80f68 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826395.482105:0:8247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce0a066600/0x22153cd396b80f6f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826395.482110:0:8247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90ce0a066600/0x22153cd396b80f6f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826395.482116:0:8247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90ce0a066600/0x22153cd396b80f6f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826395.482120:0:8247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0a066600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826395.482123:0:8247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce0a066600/0x22153cd396b80f6f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826395.482128:0:8247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90ce0a066600/0x22153cd396b80f6f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826395.482135:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x37186b36 (ffff90cf04f8bf00) 00010000:00010000:1.0:1787826395.482138:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826395.482141:0:8247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90ce0a066600/0x22153cd396b80f6f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826395.482148:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce0a066600/0x22153cd396b80f6f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x10:0x0].0x37186b36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826395.482229:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90ce0a066800/0x22153cd396b80f61 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08b8 expref: 37 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826395.482247:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90ce0a067a00/0x22153cd396b80f76 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08b8 expref: 36 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826395.482254:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff90ce01f45b00) 00010000:00010000:1.0:1787826395.482257:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826395.482260:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0a067a00, rc 0) 00000100:00100000:1.0:1787826395.482390:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:54274:x1874670563777920:12345-192.168.203.39@tcp:101:lseek_test.0 Request processed in 3803us (4127us total) trans 4294967715 rc 0/0 00000100:00100000:1.0:1787826395.482401:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3561 00000100:00100000:0.0:1787826395.496600:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826395.496942:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563778048 00000100:00100000:3.0:1787826395.496956:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563778048 00000100:00100000:3.0:1787826395.497023:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1961 00000100:00100000:3.0:1787826395.497036:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:54274:x1874670563778048:12345-192.168.203.39@tcp:101:lseek_test.0 00010000:00010000:3.0:1787826395.497060:0:8545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826395.497087:0:8545:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4014864/0x22153cd396b80f84 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab08bf expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826395.497121:0:8545:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x24:0x0] initial LVB size: 1065984, mtime: 0x6a9010db, atime: 0x0, ctime: 0x6a9010db, blocks: 0x28 00010000:00010000:3.0:1787826395.497150:0:8545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x24:0x0].0x0 since=1341s v=(0 0) 00010000:00010000:3.0:1787826395.497155:0:8545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826395.497167:0:8545:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4014864/0x22153cd396b80f84 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08bf expref: 8 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826395.497187:0:8545:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f4014864/0x22153cd396b80f84 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08bf expref: 8 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826395.497202:0:8545:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400e00, rc 0) 00000100:00100000:3.0:1787826395.497409:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:54274:x1874670563778048:12345-192.168.203.39@tcp:101:lseek_test.0 Request processed in 374us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826395.497418:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1961 00000100:00100000:3.0:1787826395.502347:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826395.502961:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563778176 00000100:00100000:2.0:1787826395.502975:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563778176 00000100:00100000:2.0:1787826395.503095:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1962 00000100:00100000:2.0:1787826395.503108:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f80a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:54274:x1874670563778176:12345-192.168.203.39@tcp:101:lseek_test.0 00010000:00010000:2.0:1787826395.503129:0:14864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826395.503156:0:14864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000673b7b2e/0x22153cd396b80f8b lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab08c6 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787826395.503190:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x25:0x0] initial LVB size: 0, mtime: 0x6a9010db, atime: 0x0, ctime: 0x6a9010db, blocks: 0x0 00010000:00010000:2.0:1787826395.503218:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x25:0x0].0x0 since=1341s v=(0 0) 00010000:00010000:2.0:1787826395.503224:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826395.503245:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000673b7b2e/0x22153cd396b80f8b lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08c6 expref: 9 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826395.503265:0:14864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000673b7b2e/0x22153cd396b80f8b lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08c6 expref: 9 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826395.503282:0:14864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835400, rc 0) 00000100:00100000:2.0:1787826395.503374:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f80a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:54274:x1874670563778176:12345-192.168.203.39@tcp:101:lseek_test.0 Request processed in 262us (1047us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826395.503383:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1962 00000100:00100000:0.0:1787826395.506849:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826395.507026:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563778304 00000100:00100000:2.0:1787826395.507039:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563778304 00000100:00100000:2.0:1787826395.507116:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1963 00000100:00100000:2.0:1787826395.507129:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670563778304:12345-192.168.203.39@tcp:23:lseek_test.0 00000100:00100000:2.0:1787826395.507293:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670563778304:12345-192.168.203.39@tcp:23:lseek_test.0 Request processed in 167us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826395.507301:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1963 00000100:00100000:0.0:1787826395.511203:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826395.511358:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563778560 00000100:00100000:3.0:1787826395.511372:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563778560 00000100:00100000:3.0:1787826395.511439:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1046 00000100:00100000:3.0:1787826395.511451:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:54274:x1874670563778560:12345-192.168.203.39@tcp:35:lseek_test.0 00000100:00100000:3.0:1787826395.512086:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:54274:x1874670563778560:12345-192.168.203.39@tcp:35:lseek_test.0 Request processed in 633us (909us total) trans 4294967716 rc 0/0 00000100:00100000:3.0:1787826395.512095:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1046 00010000:00010000:2.0:1787826396.483895:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826397.444212:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce05120f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e3c550b8-2c3c-46c3-ad36-671c284167ea:3647:1874670585212928:0@lo:400:kworker.0 00000100:00100000:3.0:1787826397.444212:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce051230c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585213056:0@lo:400:kworker.0 00000100:00100000:2.0:1787826397.444323:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f809e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585213312:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826397.444764:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826397.445733:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce044d0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585213440:0@lo:400:kworker.0 00000100:00100000:0.0:1787826397.445788:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826397.445824:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1874670585213952:0@lo:400:kworker.0 00000100:00100000:0.0:1787826397.445871:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826397.446767:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f82e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585214464:0@lo:400:kworker.0 00000100:00100000:0.0:1787826397.446812:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826397.447520:0:34488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585212928 00000100:00100000:1.0:1787826397.447533:0:34488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585212928 00000100:00100000:0.0:1787826397.447589:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787826397.447604:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab16940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874670585213824:0@lo:400:kworker.0 00000100:00100000:1.0:1787826397.447611:0:34488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787826397.447626:0:34488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf08199450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3c550b8-2c3c-46c3-ad36-671c284167ea+24:3647:x1874670585212928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826397.447666:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826397.447701:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f82f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585214336:0@lo:400:kworker.0 00000100:00100000:1.0:1787826397.447709:0:34488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf08199450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3c550b8-2c3c-46c3-ad36-671c284167ea+24:3647:x1874670585212928:12345-0@lo:400:kworker.0 Request processed in 85us (2945us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826397.447719:0:34488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787826397.447738:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826397.447780:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce05120f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e3c550b8-2c3c-46c3-ad36-671c284167ea:3647:1874670585212928:0@lo:400:kworker.0 00000100:00100000:0.0:1787826397.447824:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585213440 00000100:00100000:0.0:1787826397.447828:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585213440 00000100:00100000:0.0:1787826397.448654:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585214464 00000100:00100000:0.0:1787826397.448662:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585214464 00000100:00100000:1.0:1787826397.451380:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585214336 00000100:00100000:1.0:1787826397.451401:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585214336 00000100:00100000:2.0:1787826397.451442:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826397.451511:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 918 00000100:00100000:1.0:1787826397.451527:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+9:3647:x1874670585213440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826397.451613:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 919 00000100:00100000:1.0:1787826397.451623:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+9:3647:x1874670585213440:12345-0@lo:400:kworker.0 Request processed in 100us (5833us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826397.451630:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03984000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3647:x1874670585214464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826397.451637:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 918 00000100:00100000:1.0:1787826397.451677:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920 00000100:00100000:2.0:1787826397.451683:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03984000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3647:x1874670585214464:12345-0@lo:400:kworker.0 Request processed in 58us (4867us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826397.451690:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03984780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3647:x1874670585214336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826397.451697:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 919 00000100:00100000:2.0:1787826397.451731:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585213312 00000100:00100000:1.0:1787826397.451733:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03984780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3647:x1874670585214336:12345-0@lo:400:kworker.0 Request processed in 46us (3995us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826397.451736:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585213312 00000100:00100000:1.0:1787826397.451744:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920 00000100:00100000:2.0:1787826397.451795:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1401 00000100:00100000:2.0:1787826397.451803:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:3646:x1874670585213312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787826397.451841:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445888000 avail 1299648512 00000100:00100000:2.0:1787826397.451899:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:3646:x1874670585213312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826397.451906:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1401 00000100:00100000:2.0:1787826397.451961:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce05121e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874670585213184:0@lo:400:kworker.0 00000100:00100000:2.0:1787826397.452003:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826397.452026:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874670585213696:0@lo:400:kworker.0 00000100:00100000:2.0:1787826397.452052:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826397.452073:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585214208:0@lo:400:kworker.0 00000100:00100000:2.0:1787826397.452112:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826397.452131:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f8c2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585214720:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787826397.452154:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826397.452174:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787826397.452181:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce044d3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585213568:0@lo:400:kworker.0 00000100:00100000:2.0:1787826397.452210:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826397.452231:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab17c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874670585214080:0@lo:400:kworker.0 00000100:00100000:2.0:1787826397.452255:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826397.452276:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f82ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874670585214592:0@lo:400:kworker.0 00000100:00100000:2.0:1787826397.452300:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826397.452345:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585213952 00000100:00100000:2.0:1787826397.452350:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585213952 00000100:00100000:2.0:1787826397.452383:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585213824 00000100:00100000:2.0:1787826397.452387:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585213824 00000100:00100000:2.0:1787826397.452404:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585213184 00000100:00100000:2.0:1787826397.452407:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585213184 00000100:00100000:2.0:1787826397.452420:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585213696 00000100:00100000:2.0:1787826397.452423:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585213696 00000100:00100000:2.0:1787826397.452438:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585214080 00000100:00100000:2.0:1787826397.452441:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585214080 00000100:00100000:2.0:1787826397.452453:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585214592 00000100:00100000:2.0:1787826397.452456:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585214592 00000100:00100000:2.0:1787826397.452502:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1553 00000100:00100000:2.0:1787826397.452514:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03986940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874670585213952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826397.452559:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03986940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874670585213952:12345-0@lo:400:kworker.0 Request processed in 48us (6687us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826397.452565:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1553 00000100:00100000:2.0:1787826397.452581:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1554 00000100:00100000:2.0:1787826397.452588:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03986d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874670585213824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826397.452621:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03986d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874670585213824:12345-0@lo:400:kworker.0 Request processed in 34us (4956us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826397.452628:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1554 00000100:00100000:2.0:1787826397.452639:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1555 00000100:00100000:2.0:1787826397.452646:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874670585213184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826397.452679:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874670585213184:12345-0@lo:400:kworker.0 Request processed in 33us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826397.452685:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1555 00000100:00100000:2.0:1787826397.452698:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1556 00000100:00100000:2.0:1787826397.452705:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874670585213696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826397.452732:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874670585213696:12345-0@lo:400:kworker.0 Request processed in 28us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826397.452739:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1556 00000100:00100000:2.0:1787826397.452752:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1557 00000100:00100000:2.0:1787826397.452758:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce038903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874670585214080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826397.452787:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce038903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874670585214080:12345-0@lo:400:kworker.0 Request processed in 30us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826397.452793:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1557 00000100:00100000:2.0:1787826397.452806:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1558 00000100:00100000:2.0:1787826397.452814:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03891a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874670585214592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826397.452842:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03891a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874670585214592:12345-0@lo:400:kworker.0 Request processed in 30us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826397.452848:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1558 00000100:00100000:2.0:1787826397.452874:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585214208 00000100:00100000:2.0:1787826397.452880:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585214208 00000100:00100000:2.0:1787826397.452905:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585214720 00000100:00100000:2.0:1787826397.452908:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585214720 00000100:00100000:2.0:1787826397.452921:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1402 00000100:00100000:2.0:1787826397.452928:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1874670585214208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826397.452965:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1874670585214208:12345-0@lo:400:kworker.0 Request processed in 38us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826397.452972:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1402 00000100:00100000:2.0:1787826397.452983:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1403 00000100:00100000:2.0:1787826397.452989:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f05680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874670585214720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787826397.453016:0:7796:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446191104 avail 1299951616 00000100:00100000:2.0:1787826397.453050:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f05680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874670585214720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 61us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826397.453056:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1403 00000100:00100000:2.0:1787826397.453079:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585213568 00000100:00100000:2.0:1787826397.453082:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585213568 00000100:00100000:2.0:1787826397.453112:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 921 00000100:00100000:2.0:1787826397.453118:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03892580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+7:3645:x1874670585213568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826397.453149:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03892580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+7:3645:x1874670585213568:12345-0@lo:400:kworker.0 Request processed in 31us (939us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826397.453154:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 921 00000100:00100000:2.0:1787826397.453206:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce044d3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585213568:0@lo:400:kworker.0 00000100:00100000:2.0:1787826397.453219:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab17c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874670585214080:0@lo:400:kworker.0 00000100:00100000:2.0:1787826397.453229:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f82ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874670585214592:0@lo:400:kworker.0 00000100:00100000:2.0:1787826397.453242:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce05121e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874670585213184:0@lo:400:kworker.0 00000100:00100000:2.0:1787826397.453254:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874670585213696:0@lo:400:kworker.0 00000100:00100000:2.0:1787826397.453262:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967683 gen 2 00000004:00080000:2.0:1787826397.453269:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967683 committed transno 4294967683 00000100:00100000:2.0:1787826397.453298:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585214208:0@lo:400:kworker.0 00000100:00100000:2.0:1787826397.453325:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f8c2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585214720:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1787826397.453438:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787826397.453443:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787826397.453446:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787826397.453449:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826397.453556:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab16940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874670585213824:0@lo:400:kworker.0 00000100:00100000:0.0:1787826397.453573:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836965 gen 2 00000004:00080000:0.0:1787826397.453578:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3ab161c0, transno 21474836964 00000004:00080000:0.0:1787826397.453590:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3ab14000, transno 21474836965 00000100:00100000:0.0:1787826397.453595:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f82f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585214336:0@lo:400:kworker.0 00000100:00100000:0.0:1787826397.453612:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce044d0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585213440:0@lo:400:kworker.0 00000100:00100000:0.0:1787826397.453624:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1874670585213952:0@lo:400:kworker.0 00000100:00100000:0.0:1787826397.453638:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f82e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585214464:0@lo:400:kworker.0 00000100:00100000:1.0:1787826397.455155:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f809e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585213312:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826397.461599:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826397.461782:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585213056 00000100:00100000:2.0:1787826397.461795:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585213056 00000100:00100000:2.0:1787826397.461868:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1404 00000100:00100000:2.0:1787826397.461880:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f80a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:3644:x1874670585213056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826397.461965:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f80a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:3644:x1874670585213056:12345-0@lo:400:kworker.0 Request processed in 88us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826397.461973:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1404 00000100:00100000:3.0:1787826397.462218:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce051230c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585213056:0@lo:400:kworker.0 00010000:00010000:0.0:1787826397.507850:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826397.956717:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f8752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585214976:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826397.956825:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826397.956886:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787826397.956893:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f8761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585214848:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787826397.956919:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826397.957417:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787826397.957430:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce05123840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585215104:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826397.957466:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826397.957525:0:12021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585214848 00000100:00100000:1.0:1787826397.957534:0:12021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585214848 00000100:00100000:1.0:1787826397.957584:0:12021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585215104 00000100:00100000:1.0:1787826397.957587:0:12021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585215104 00000100:00100000:1.0:1787826397.957602:0:12021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 766 00000100:00100000:1.0:1787826397.957612:0:12021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03974780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874670585214848:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787826397.957729:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585214976 00000100:00100000:0.0:1787826397.957734:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585214976 00000100:00100000:0.0:1787826397.957758:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 767 00000100:00100000:0.0:1787826397.957763:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce051230c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3645:x1874670585215104:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787826397.957803:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143190848 pending 0 free 3920252928 avail 3688730624 00000100:00100000:0.0:1787826397.958013:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce051230c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3645:x1874670585215104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 248us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826397.958021:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 767 00000100:00100000:0.0:1787826397.958041:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 768 00000100:00100000:0.0:1787826397.958047:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9ae580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+9:3647:x1874670585214976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787826397.958063:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 169417536 pending 0 free 3919192064 avail 3687669760 00000100:00100000:0.0:1787826397.958095:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9ae580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+9:3647:x1874670585214976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 48us (1271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826397.958100:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 768 00000100:00100000:3.0:1787826397.958265:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00002000:00000024:1.0:1787826397.958612:0:12021:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 169417536 pending 0 free 3919192064 avail 3687669760 00000100:00100000:1.0:1787826397.958652:0:12021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03974780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874670585214848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1040us (1731us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826397.958659:0:12021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 766 00000100:00100000:1.0:1787826397.958731:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce05123840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585215104:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826397.958994:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f8761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585214848:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787826397.959014:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f8752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585214976:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787826397.959119:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f809a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585215232:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787826397.959161:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826397.959777:0:12021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585215232 00000100:00100000:1.0:1787826397.959788:0:12021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585215232 00000100:00100000:1.0:1787826397.960325:0:12021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 769 00000100:00100000:1.0:1787826397.960337:0:12021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f808000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874670585215232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787826397.960362:0:12021:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143190848 pending 0 free 3920252928 avail 3688730624 00000100:00100000:1.0:1787826397.960601:0:12021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f808000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874670585215232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 266us (1438us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826397.960610:0:12021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 769 00000100:00100000:3.0:1787826397.960781:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f809a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585215232:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826398.354387:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826398.354439:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826398.354520:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826398.354547:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826398.354577:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826398.354610:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563778944 00000100:00100000:1.0:1787826398.354622:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563778944 00000100:00100000:1.0:1787826398.354689:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563778816 00000100:00100000:1.0:1787826398.354692:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563778816 00000100:00100000:1.0:1787826398.354731:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1559 00000100:00100000:1.0:1787826398.354744:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05123840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:2403:x1874670563778944:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1787826398.354848:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05123840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:2403:x1874670563778944:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 107us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826398.354857:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1559 00000100:00100000:1.0:1787826398.354887:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1560 00000100:00100000:1.0:1787826398.354895:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05120f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:2403:x1874670563778816:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1787826398.354922:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05120f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:2403:x1874670563778816:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 29us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826398.354929:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1560 00000100:00100000:1.0:1787826398.354948:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563779200 00000100:00100000:1.0:1787826398.354951:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563779200 00000100:00100000:1.0:1787826398.354980:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563779072 00000100:00100000:1.0:1787826398.354983:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563779072 00000100:00100000:1.0:1787826398.355003:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 922 00000100:00100000:1.0:1787826398.355008:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05121e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670563779200:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1787826398.355039:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05121e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670563779200:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 30us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826398.355045:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 922 00000100:00100000:1.0:1787826398.355055:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 923 00000100:00100000:1.0:1787826398.355060:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2403:x1874670563779072:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1787826398.355086:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2403:x1874670563779072:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 26us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826398.355371:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 923 00000100:00080000:1.0:1787826398.355403:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787826398.355408:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787826398.355411:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787826398.355413:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787826398.359435:0:34487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563778688 00000100:00100000:2.0:1787826398.359458:0:34487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563778688 00000100:00100000:2.0:1787826398.359565:0:34487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 94 00000100:00100000:2.0:1787826398.359582:0:34487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf39ddd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:307626ff-a376-4faf-93e0-9f55b723d964+10:2403:x1874670563778688:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1787826398.359696:0:34487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf39ddd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:307626ff-a376-4faf-93e0-9f55b723d964+10:2403:x1874670563778688:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 117us (5321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826398.359704:0:34487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 94 00010000:00010000:2.0:1787826398.532177:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826399.555976:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787826400.009164:0:34481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934700 is committed 00000001:00080000:1.0:1787826400.015508:0:26205:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836978 is committed 00000001:00080000:1.0:1787826400.015526:0:26205:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836976 is committed 00010000:00010000:2.0:1787826400.579795:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787826401.030725:0:27651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179869639 is committed 00000001:00080000:2.0:1787826401.030742:0:27651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179869637 is committed 00000001:00080000:0.0:1787826401.030830:0:7449:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967716 is committed 00010000:00010000:2.0:1787826401.030902:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834200/0x22153cd396b80f5a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x2a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826401.030914:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834200/0x22153cd396b80f5a lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x2a/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826401.030921:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834200/0x22153cd396b80f5a lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x2a/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826401.030927:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826401.030931:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834200/0x22153cd396b80f5a lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x2a/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826401.030940:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834200/0x22153cd396b80f5a lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x2a/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826401.030959:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff90ce01f45b00) 00010000:00010000:2.0:1787826401.030962:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2a 00010000:00010000:2.0:1787826401.030967:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834200/0x22153cd396b80f5a lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x2a/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826401.030974:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834200/0x22153cd396b80f5a lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x2a/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826401.604719:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826402.564387:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787826402.564410:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f80ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585215360:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787826402.564512:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826402.564600:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585215360 00000100:00100000:2.0:1787826402.564610:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585215360 00000100:00100000:3.0:1787826402.564626:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f809e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585215488:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787826402.564668:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1405 00000100:00100000:3.0:1787826402.564670:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826402.564680:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f809a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3647:x1874670585215360:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787826402.564712:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445888000 avail 1299648512 00000100:00100000:3.0:1787826402.564722:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585215488 00000100:00100000:3.0:1787826402.564727:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585215488 00000100:00100000:3.0:1787826402.564756:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1406 00000100:00100000:3.0:1787826402.564765:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f809680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874670585215488:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787826402.564772:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f809a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3647:x1874670585215360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826402.564781:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1405 00000004:00000024:3.0:1787826402.564787:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446191104 avail 1299951616 00000100:00100000:3.0:1787826402.564827:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f809680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874670585215488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 63us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826402.564834:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1406 00000100:00100000:2.0:1787826402.564895:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f809e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585215488:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787826402.564907:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf41c870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585215872:0@lo:400:kworker.0 00000100:00100000:2.0:1787826402.564916:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 8589934700 gen 2 00000004:00080000:2.0:1787826402.564921:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934700 committed transno 8589934700 00000100:00100000:3.0:1787826402.564935:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826402.564941:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f80ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585215360:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787826402.564963:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585215872 00000100:00100000:2.0:1787826402.564966:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585215872 00000100:00100000:2.0:1787826402.565001:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 924 00000100:00100000:2.0:1787826402.565008:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874670585215872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826402.565010:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787826402.565015:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf41c84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585216000:0@lo:400:kworker.0 00000100:00100000:2.0:1787826402.565039:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874670585215872:12345-0@lo:400:kworker.0 Request processed in 33us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826402.565045:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826402.565046:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 924 00000100:00100000:2.0:1787826402.565056:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585216000 00000100:00100000:2.0:1787826402.565059:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585216000 00000100:00100000:3.0:1787826402.565067:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 21474836978 gen 2 00000004:00080000:3.0:1787826402.565071:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce05122580, transno 21474836973 00000004:00080000:3.0:1787826402.565078:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce05123480, transno 21474836974 00000100:00100000:2.0:1787826402.565079:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 925 00000004:00080000:3.0:1787826402.565081:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce04f061c0, transno 21474836977 00000100:00100000:2.0:1787826402.565083:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874670585216000:12345-0@lo:400:kworker.0 00000004:00080000:3.0:1787826402.565084:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce04f052c0, transno 21474836978 00000100:00100000:3.0:1787826402.565088:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf41c870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585215872:0@lo:400:kworker.0 00000100:00100000:2.0:1787826402.565113:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874670585216000:12345-0@lo:400:kworker.0 Request processed in 29us (67us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826402.565118:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 925 00000100:00080000:2.0:1787826402.565132:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787826402.565137:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826402.565166:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179869639 gen 2 00000004:00080000:2.0:1787826402.565170:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce04f06940, transno 17179869638 00000004:00080000:2.0:1787826402.565179:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce04f07840, transno 17179869639 00000100:00100000:2.0:1787826402.565184:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf41c84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585216000:0@lo:400:kworker.0 00000004:00080000:3.0:1787826402.565215:0:8538:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0001: 0 changes, 0 in progress, 0 in flight, 4 done 00000100:00100000:1.0:1787826402.565773:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fdfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e3c550b8-2c3c-46c3-ad36-671c284167ea:3644:1874670585215616:0@lo:400:kworker.0 00000100:00100000:1.0:1787826402.565808:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826402.565834:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf41c85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874670585216128:0@lo:400:kworker.0 00000100:00100000:1.0:1787826402.565858:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826402.565876:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf136d7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585216640:0@lo:400:kworker.0 00000100:00100000:1.0:1787826402.565900:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826402.565923:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787826402.565932:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf41c852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874670585215744:0@lo:400:kworker.0 00000100:00100000:1.0:1787826402.565962:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826402.565980:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf41c85e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874670585216256:0@lo:400:kworker.0 00000100:00100000:1.0:1787826402.566004:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826402.566020:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf136d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585216768:0@lo:400:kworker.0 00000100:00100000:1.0:1787826402.566051:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826402.566081:0:34488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585215616 00000100:00100000:1.0:1787826402.566086:0:34488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585215616 00000100:00100000:1.0:1787826402.566116:0:34488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787826402.566123:0:34488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf39ddc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3c550b8-2c3c-46c3-ad36-671c284167ea+24:3644:x1874670585215616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826402.566171:0:34488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf39ddc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3c550b8-2c3c-46c3-ad36-671c284167ea+24:3644:x1874670585215616:12345-0@lo:400:kworker.0 Request processed in 49us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826402.566178:0:34488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787826402.566207:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585216640 00000100:00100000:1.0:1787826402.566210:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585216640 00000100:00100000:1.0:1787826402.566240:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585216768 00000100:00100000:1.0:1787826402.566243:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585216768 00000100:00100000:1.0:1787826402.566264:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 926 00000100:00100000:1.0:1787826402.566281:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874670585216640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826402.566316:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874670585216640:12345-0@lo:400:kworker.0 Request processed in 46us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826402.566332:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 926 00000100:00100000:1.0:1787826402.566344:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 927 00000100:00100000:1.0:1787826402.566350:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136d6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874670585216768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826402.566377:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136d6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874670585216768:12345-0@lo:400:kworker.0 Request processed in 28us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826402.566382:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 927 00000100:00100000:1.0:1787826402.566400:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585216128 00000100:00100000:1.0:1787826402.566403:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585216128 00000100:00100000:1.0:1787826402.566430:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585215744 00000100:00100000:1.0:1787826402.566433:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585215744 00000100:00100000:1.0:1787826402.566454:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585216256 00000100:00100000:1.0:1787826402.566457:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585216256 00000100:00100000:1.0:1787826402.566509:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1561 00000100:00100000:1.0:1787826402.566515:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874670585216128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826402.566557:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874670585216128:12345-0@lo:400:kworker.0 Request processed in 43us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826402.566562:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1561 00000100:00100000:1.0:1787826402.566571:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1562 00000100:00100000:1.0:1787826402.566576:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136d4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874670585215744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826402.566601:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136d4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874670585215744:12345-0@lo:400:kworker.0 Request processed in 24us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826402.566606:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1562 00000100:00100000:1.0:1787826402.566616:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1563 00000100:00100000:1.0:1787826402.566622:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136d4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874670585216256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826402.566654:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136d4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874670585216256:12345-0@lo:400:kworker.0 Request processed in 33us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826402.566661:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1563 00000100:00100000:1.0:1787826402.566715:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf41c852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874670585215744:0@lo:400:kworker.0 00000100:00100000:1.0:1787826402.566726:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf41c85e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874670585216256:0@lo:400:kworker.0 00000100:00100000:1.0:1787826402.566741:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf136d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585216768:0@lo:400:kworker.0 00000100:00100000:1.0:1787826402.566749:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fdfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e3c550b8-2c3c-46c3-ad36-671c284167ea:3644:1874670585215616:0@lo:400:kworker.0 00000100:00100000:1.0:1787826402.566761:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf41c85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874670585216128:0@lo:400:kworker.0 00000100:00100000:1.0:1787826402.566769:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf136d7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585216640:0@lo:400:kworker.0 00000100:00080000:2.0:1787826402.566958:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787826402.566963:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787826402.566966:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787826402.566970:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826402.566984:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf41c870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1874670585216512:0@lo:400:kworker.0 00000100:00100000:3.0:1787826402.567016:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf41c84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874670585216384:0@lo:400:kworker.0 00000100:00100000:2.0:1787826402.567025:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826402.567056:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826402.567077:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf136d5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874670585216896:0@lo:400:kworker.0 00000100:00100000:3.0:1787826402.567097:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826402.567130:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585216512 00000100:00100000:2.0:1787826402.567135:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585216512 00000100:00100000:2.0:1787826402.567180:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585216384 00000100:00100000:2.0:1787826402.567183:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585216384 00000100:00100000:2.0:1787826402.567199:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585216896 00000100:00100000:2.0:1787826402.567201:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585216896 00000100:00100000:2.0:1787826402.567233:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1564 00000100:00100000:2.0:1787826402.567240:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03891680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874670585216512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826402.567288:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03891680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874670585216512:12345-0@lo:400:kworker.0 Request processed in 49us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826402.567294:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1564 00000100:00100000:2.0:1787826402.567317:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1565 00000100:00100000:2.0:1787826402.567324:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874670585216384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826402.567352:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874670585216384:12345-0@lo:400:kworker.0 Request processed in 29us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826402.567357:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1565 00000100:00100000:2.0:1787826402.567366:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1566 00000100:00100000:2.0:1787826402.567371:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874670585216896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826402.567392:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874670585216896:12345-0@lo:400:kworker.0 Request processed in 21us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826402.567398:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1566 00000100:00100000:2.0:1787826402.567430:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf41c870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1874670585216512:0@lo:400:kworker.0 00000100:00080000:3.0:1787826402.567505:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787826402.567511:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787826402.568059:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf41c84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874670585216384:0@lo:400:kworker.0 00000100:00100000:2.0:1787826402.568072:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf136d5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874670585216896:0@lo:400:kworker.0 00010000:00010000:2.0:1787826402.627649:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787826402.772127:0:36094:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 60a: mirror extend sets correct size on sparse file ========================================================== 06:26:41 (1787826401) 00000100:00100000:1.0:1787826403.075940:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787826403.075964:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0300f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585217024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826403.076030:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826403.076083:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585217024 00000100:00100000:1.0:1787826403.076090:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585217024 00000100:00100000:1.0:1787826403.076137:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 770 00000100:00100000:1.0:1787826403.076147:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136d7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874670585217024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787826403.076175:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143190848 pending 0 free 3920252928 avail 3688730624 00000100:00100000:1.0:1787826403.076217:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136d7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874670585217024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826403.076224:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 770 00000100:00100000:1.0:1787826403.076280:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0300f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585217024:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787826403.076752:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03893840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585217152:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787826403.076786:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826403.076861:0:12021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585217152 00000100:00100000:2.0:1787826403.076866:0:12021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585217152 00000100:00100000:2.0:1787826403.076901:0:12021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 771 00000100:00100000:2.0:1787826403.076908:0:12021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce039752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874670585217152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787826403.076926:0:12021:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 169417536 pending 0 free 3919192064 avail 3687669760 00000100:00100000:2.0:1787826403.076960:0:12021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce039752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874670585217152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826403.076967:0:12021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 771 00000100:00100000:0.0:1787826403.077039:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03893840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585217152:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787826403.077166:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787826403.077175:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0300f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585217280:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826403.077200:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826403.077262:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585217280 00000100:00100000:2.0:1787826403.077277:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585217280 00000100:00100000:2.0:1787826403.077307:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 772 00000100:00100000:2.0:1787826403.077314:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce039761c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874670585217280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787826403.077325:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143190848 pending 0 free 3920252928 avail 3688730624 00000100:00100000:2.0:1787826403.077363:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce039761c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874670585217280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826403.077369:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 772 00000100:00100000:3.0:1787826403.077433:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0300f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585217280:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826403.077716:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787826403.077727:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf136d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585217408:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826403.077754:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826403.077825:0:12021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585217408 00000100:00100000:3.0:1787826403.077829:0:12021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585217408 00000100:00100000:3.0:1787826403.077862:0:12021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 773 00000100:00100000:3.0:1787826403.077869:0:12021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03975a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874670585217408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787826403.077881:0:12021:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 169417536 pending 0 free 3919192064 avail 3687669760 00000100:00100000:3.0:1787826403.077915:0:12021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03975a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874670585217408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 48us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826403.077921:0:12021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 773 00000100:00100000:0.0:1787826403.078037:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf136d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585217408:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826403.198696:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826403.199008:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563779456 00000100:00100000:2.0:1787826403.199018:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563779456 00000100:00100000:2.0:1787826403.199110:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3562 00000100:00100000:2.0:1787826403.199120:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:54844:x1874670563779456:12345-192.168.203.39@tcp:36:mkdir.0 00010000:00010000:2.0:1787826403.199177:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826403.199207:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400a00/0x22153cd396b80c90 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab07a7 expref: 22 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.199226:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ce01f45300) 00010000:00010000:2.0:1787826403.199232:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826403.199305:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b80f92 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.199319:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b80f92 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.199329:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b80f92 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.199344:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b80f99 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfec3af0a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.199351:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b80f99 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfec3af0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.199357:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b80f99 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfec3af0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.200162:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b80fa0 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.200176:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b80fa0 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.200186:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b80fa0 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826403.200201:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000050fc945d reply state 000000002a59f53e transno 8589934701 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b80fa0 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.200211:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b80fa0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.200218:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x18:0x0].0x0 (ffff90cf1859a800) 00010000:00010000:2.0:1787826403.200220:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826403.200223:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787826403.200228:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x18:0x0]: returning size 4096 00010000:00010000:2.0:1787826403.200236:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b80f92 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.200242:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b80f92 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.200247:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b80f92 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.200253:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b80f92 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.200259:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826403.200262:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b80f92 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.200279:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b80f92 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.200288:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ce01f45300) 00010000:00010000:2.0:1787826403.200290:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826403.200294:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b80f92 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.200300:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b80f92 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826403.200311:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000050fc945d reply state 000000002a59f53e transno 8589934701 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b80f99 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfec3af0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.200318:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b80f99 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfec3af0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.200324:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfec3af0a (ffff90cf1859a300) 00010000:00010000:2.0:1787826403.200326:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826403.200328:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1787826403.200420:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+23:54844:x1874670563779456:12345-192.168.203.39@tcp:36:mkdir.0 Request processed in 1299us (1733us total) trans 8589934701 rc 0/0 00000100:00100000:2.0:1787826403.200428:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3562 00000100:00080000:3.0:1787826403.200785:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787826403.224925:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826403.225527:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563779584 00000100:00100000:2.0:1787826403.225546:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563779584 00000100:00100000:2.0:1787826403.225614:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3563 00000100:00100000:2.0:1787826403.225624:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03987c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+23:54847:x1874670563779584:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:2.0:1787826403.225884:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826403.225908:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b80fa7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab08cd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.225970:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b80fae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.225985:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b80fae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.226002:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b80fae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826403.226040:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787826403.226043:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826403.226062:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b80fae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.226084:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b80fa7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08cd expref: 25 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.226102:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b80fae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08cd expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.226111:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ce01f45300) 00010000:00010000:2.0:1787826403.226113:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787826403.226117:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834400, rc 0) 00000100:00100000:2.0:1787826403.226217:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03987c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:54847:x1874670563779584:12345-192.168.203.39@tcp:101:dd.0 Request processed in 595us (1301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826403.226225:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3563 00000100:00100000:2.0:1787826403.237798:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826403.237964:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563779712 00000100:00100000:1.0:1787826403.237974:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563779712 00000100:00100000:1.0:1787826403.238033:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3564 00000100:00100000:1.0:1787826403.238043:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03893c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:54847:x1874670563779712:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:1.0:1787826403.238063:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826403.238082:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b80fb5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab08d4 expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.238143:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067800/0x22153cd396b80fbc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.238163:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067800/0x22153cd396b80fbc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.238174:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067800/0x22153cd396b80fbc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.238186:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067e00/0x22153cd396b80fc3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfec3af0a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.238193:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067e00/0x22153cd396b80fc3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfec3af0a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.238199:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067e00/0x22153cd396b80fc3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfec3af0a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.238290:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067200/0x22153cd396b80fca lrc: 3/1,0 mode: --/PR res: [0x200000405:0x18:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.238299:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067200/0x22153cd396b80fca lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x18:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.238307:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067200/0x22153cd396b80fca lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x18:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826403.238344:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x18:0x0]: returning size 4096 00000004:00200000:1.0:1787826403.238347:0:32404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826403.238363:0:32404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067200/0x22153cd396b80fca lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x18:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.238377:0:32404:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067800/0x22153cd396b80fbc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.238388:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067800/0x22153cd396b80fbc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.238395:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067800/0x22153cd396b80fbc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.238402:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067800/0x22153cd396b80fbc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.238408:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0a067800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826403.238412:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067800/0x22153cd396b80fbc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.238420:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067800/0x22153cd396b80fbc lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.238431:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ce01f45300) 00010000:00010000:1.0:1787826403.238434:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826403.238438:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067800/0x22153cd396b80fbc lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.238443:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067800/0x22153cd396b80fbc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.238601:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067e00/0x22153cd396b80fc3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfec3af0a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.238607:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067e00/0x22153cd396b80fc3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfec3af0a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.238613:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067e00/0x22153cd396b80fc3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfec3af0a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.238618:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0a067e00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826403.238621:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067e00/0x22153cd396b80fc3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfec3af0a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.238626:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067e00/0x22153cd396b80fc3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfec3af0a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.238634:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfec3af0a (ffff90cf1859a300) 00010000:00010000:1.0:1787826403.238636:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826403.238639:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067e00/0x22153cd396b80fc3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfec3af0a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.238645:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067e00/0x22153cd396b80fc3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfec3af0a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.238670:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b80fb5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08d4 expref: 26 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.238684:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067200/0x22153cd396b80fca lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x18:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08d4 expref: 25 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.238691:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x18:0x0].0x0 (ffff90cf1859a800) 00010000:00010000:1.0:1787826403.238694:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787826403.238696:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0a067200, rc 0) 00000100:00100000:1.0:1787826403.238870:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03893c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:54847:x1874670563779712:12345-192.168.203.39@tcp:101:dd.0 Request processed in 828us (1081us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826403.238878:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3564 00000100:00100000:1.0:1787826403.250834:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826403.250935:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563779968 00000100:00100000:2.0:1787826403.250945:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563779968 00000100:00100000:2.0:1787826403.251007:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3565 00000100:00100000:2.0:1787826403.251017:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136d43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:54847:x1874670563779968:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:2.0:1787826403.251035:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826403.251057:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b80fd1 lrc: 2/0,0 mode: --/CW res: [0x200000405:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab08db expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.251159:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b80fd8 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.251175:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b80fd8 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.251185:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b80fd8 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.251200:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834e00/0x22153cd396b80fdf lrc: 3/0,1 mode: --/PW res: [0x200000405:0x18:0x0].0x919060dd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.251207:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834e00/0x22153cd396b80fdf lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x18:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.251214:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834e00/0x22153cd396b80fdf lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x18:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787826403.251583:0:8247:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x104:0x0], index 1: 0 00010000:00010000:2.0:1787826403.251709:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834200/0x22153cd396b80fe6 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.251718:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834200/0x22153cd396b80fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.251726:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834200/0x22153cd396b80fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.251755:0:8247:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b80fd8 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.251766:0:8247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b80fd8 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.251772:0:8247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b80fd8 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.251779:0:8247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b80fd8 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.251785:0:8247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826403.251789:0:8247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b80fd8 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.251796:0:8247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b80fd8 lrc: 5/0,0 mode: CW/CW res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.251808:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x18:0x0].0x0 (ffff90cf1859a800) 00010000:00010000:2.0:1787826403.251811:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826403.251815:0:8247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b80fd8 lrc: 3/0,0 mode: --/CW res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.251822:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b80fd8 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826403.251834:0:8247:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b1e4dba7 reply state 00000000a163f909 transno 8589934702 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834e00/0x22153cd396b80fdf lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x18:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.251844:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834e00/0x22153cd396b80fdf lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x18:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.251851:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x18:0x0].0x919060dd (ffff90cf1859a600) 00010000:00010000:2.0:1787826403.251853:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826403.251856:0:8247:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787826403.251883:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b80fd1 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08db expref: 28 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.251897:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834200/0x22153cd396b80fe6 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08db expref: 27 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.251904:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff90cf1859aa00) 00010000:00010000:2.0:1787826403.251905:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826403.251907:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834200, rc 0) 00000100:00100000:2.0:1787826403.251974:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136d43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+28:54847:x1874670563779968:12345-192.168.203.39@tcp:101:dd.0 Request processed in 959us (1150us total) trans 8589934702 rc 0/0 00000100:00100000:2.0:1787826403.251982:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3565 00000100:00100000:0.0:1787826403.255519:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826403.255610:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563780224 00000100:00100000:1.0:1787826403.255620:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563780224 00000100:00100000:1.0:1787826403.255680:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3566 00000100:00100000:1.0:1787826403.255689:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f876580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+28:54847:x1874670563780224:12345-192.168.203.39@tcp:36:dd.0 00010000:00010000:1.0:1787826403.255743:0:16564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826403.255782:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834200/0x22153cd396b80fe6 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08db expref: 28 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.255802:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff90cf1859aa00) 00010000:00010000:1.0:1787826403.255812:0:16564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826403.255977:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b80ff4 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.255990:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b80ff4 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.255999:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b80ff4 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787826403.256038:0:16564:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934703 00000004:00010000:1.0:1787826403.256060:0:16564:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ec72e7bb reply state 000000003ad83fa5 transno 8589934704 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b80ff4 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.256085:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b80ff4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.256091:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff90cf04f8bf00) 00010000:00010000:1.0:1787826403.256093:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826403.256096:0:16564:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826403.256175:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f876580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:54847:x1874670563780224:12345-192.168.203.39@tcp:36:dd.0 Request processed in 487us (705us total) trans 8589934704 rc 0/0 00000100:00100000:1.0:1787826403.256185:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3566 00000020:00080000:1.0:1787826403.256190:0:16564:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787826403.259098:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826403.259185:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563780352 00000100:00100000:2.0:1787826403.259196:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563780352 00000100:00100000:2.0:1787826403.259256:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3567 00000100:00100000:2.0:1787826403.259276:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:54847:x1874670563780352:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:2.0:1787826403.259297:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826403.259314:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b80ffb lrc: 2/0,0 mode: --/CR res: [0x200000405:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab08e2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.259363:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b80ffb lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08e2 expref: 31 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.259375:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b80ffb lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08e2 expref: 31 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.259396:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff90cf04f8bf00) 00010000:00010000:2.0:1787826403.259399:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826403.259402:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835c00, rc 0) 00000100:00100000:2.0:1787826403.259462:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:54847:x1874670563780352:12345-192.168.203.39@tcp:101:dd.0 Request processed in 197us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826403.259488:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3567 00000100:00100000:3.0:1787826403.262716:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826403.264919:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563780480 00000100:00100000:1.0:1787826403.264933:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563780480 00000100:00100000:1.0:1787826403.265024:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1964 00000100:00100000:1.0:1787826403.265035:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05122580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:54847:x1874670563780480:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:1.0:1787826403.265052:0:30696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826403.265071:0:30696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002fc1e6d3/0x22153cd396b81002 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x104:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab08e9 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826403.265096:0:30696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x104:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826403.265116:0:30696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x104:0x0].0x0 since=1349s v=(0 0) 00010000:00010000:1.0:1787826403.265121:0:30696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x104:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826403.265130:0:30696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fc1e6d3/0x22153cd396b81002 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08e9 expref: 8 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.265148:0:30696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002fc1e6d3/0x22153cd396b81002 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08e9 expref: 8 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.265159:0:30696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0a067e00, rc 0) 00000100:00100000:1.0:1787826403.265227:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05122580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:54847:x1874670563780480:12345-192.168.203.39@tcp:101:dd.0 Request processed in 193us (2518us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826403.265233:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1964 00000100:00080000:3.0:1787826403.265798:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826403.269201:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826403.269390:0:25423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563780608 00000100:00100000:2.0:1787826403.269399:0:25423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563780608 00002000:00010000:2.0:1787826403.269436:0:25423:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/260 (134217728->18446744073709551615) 00002000:00100000:2.0:1787826403.269441:0:25423:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf3f8752c0 with x1874670563780608 ext(134217728->18446744073709551615) 00002000:00010000:2.0:1787826403.269467:0:25423:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90cf3f8752c0. 00000100:00100000:2.0:1787826403.269539:0:25423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 747 00000100:00100000:2.0:1787826403.269549:0:25423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2404:x1874670563780608:12345-192.168.203.39@tcp:10:dd.0 00002000:00010000:2.0:1787826403.269738:0:25423:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x104:0x0] updating lvb size from disk: 0 -> 134217728 00002000:00010000:2.0:1787826403.269743:0:25423:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x104:0x0] updating lvb mtime from disk: 0 -> 1787826403 00002000:00010000:2.0:1787826403.269745:0:25423:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x104:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787826403.269748:0:25423:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x104:0x0] updating lvb ctime from disk: 0 -> 1787826403 00002000:00010000:2.0:1787826403.269750:0:25423:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x104:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1787826403.269811:0:25423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563780608:12345-192.168.203.39@tcp:10:dd.0 Request processed in 263us (617us total) trans 17179869640 rc 0/0 00000100:00100000:2.0:1787826403.269818:0:25423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 747 00002000:00010000:2.0:1787826403.269822:0:25423:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/260 (134217728->18446744073709551615) 00002000:00100000:2.0:1787826403.269825:0:25423:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf3f8752c0 with x1874670563780608 ext(134217728->18446744073709551615) 00002000:00010000:2.0:1787826403.269830:0:25423:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90cf3f8752c0. 00000100:00100000:0.0:1787826403.276791:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826403.276871:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563780864 00000100:00100000:3.0:1787826403.276880:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563780864 00000100:00100000:3.0:1787826403.276938:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1047 00000100:00100000:3.0:1787826403.276947:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:54847:x1874670563780864:12345-192.168.203.39@tcp:35:dd.0 00000100:00100000:3.0:1787826403.277231:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+32:54847:x1874670563780864:12345-192.168.203.39@tcp:35:dd.0 Request processed in 283us (448us total) trans 8589934705 rc 0/0 00000100:00100000:3.0:1787826403.277239:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1047 00000100:00100000:3.0:1787826403.306530:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826403.308427:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563780992 00000100:00100000:1.0:1787826403.308455:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563780992 00000100:00100000:1.0:1787826403.308563:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3568 00000100:00100000:1.0:1787826403.308574:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05123480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+32:54853:x1874670563780992:12345-192.168.203.39@tcp:101:truncate.0 00010000:00010000:1.0:1787826403.308599:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826403.308622:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066800/0x22153cd396b81009 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab08f0 expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.308685:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066600/0x22153cd396b81010 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.308701:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066600/0x22153cd396b81010 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.308714:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066600/0x22153cd396b81010 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.308725:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067c00/0x22153cd396b81017 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x18:0x0].0x919060dd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.308733:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067c00/0x22153cd396b81017 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x18:0x0].0x919060dd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.308739:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067c00/0x22153cd396b81017 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x18:0x0].0x919060dd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.308966:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066a00/0x22153cd396b8101e lrc: 3/1,0 mode: --/PR res: [0x200000405:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.308975:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066a00/0x22153cd396b8101e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.308983:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066a00/0x22153cd396b8101e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826403.309020:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x19:0x0]: returning size 134221824 00000004:00200000:1.0:1787826403.309024:0:32404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826403.309043:0:32404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066a00/0x22153cd396b8101e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.309053:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066a00/0x22153cd396b8101e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.309062:0:32404:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066600/0x22153cd396b81010 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.309067:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066600/0x22153cd396b81010 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.309073:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066600/0x22153cd396b81010 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.309079:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066600/0x22153cd396b81010 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.309085:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0a066600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826403.309089:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066600/0x22153cd396b81010 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.309096:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066600/0x22153cd396b81010 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.309108:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x18:0x0].0x0 (ffff90cf1859a800) 00010000:00010000:1.0:1787826403.309110:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826403.309115:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066600/0x22153cd396b81010 lrc: 3/0,0 mode: --/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.309125:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066600/0x22153cd396b81010 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.309138:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067c00/0x22153cd396b81017 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x18:0x0].0x919060dd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.309143:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067c00/0x22153cd396b81017 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x18:0x0].0x919060dd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.309148:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067c00/0x22153cd396b81017 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x18:0x0].0x919060dd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.309153:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0a067c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826403.309155:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067c00/0x22153cd396b81017 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x18:0x0].0x919060dd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.309161:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067c00/0x22153cd396b81017 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x18:0x0].0x919060dd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.309168:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x18:0x0].0x919060dd (ffff90cf1859a600) 00010000:00010000:1.0:1787826403.309171:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826403.309173:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067c00/0x22153cd396b81017 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x18:0x0].0x919060dd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.309179:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067c00/0x22153cd396b81017 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x18:0x0].0x919060dd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.309204:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066800/0x22153cd396b81009 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08f0 expref: 34 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.309221:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066a00/0x22153cd396b8101e lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08f0 expref: 33 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.309228:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff90cf04f8bf00) 00010000:00010000:1.0:1787826403.309230:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826403.309232:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0a066a00, rc 0) 00000100:00100000:1.0:1787826403.309305:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05123480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:54853:x1874670563780992:12345-192.168.203.39@tcp:101:truncate.0 Request processed in 733us (2784us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826403.309313:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3568 00000100:00100000:1.0:1787826403.321260:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826403.321372:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563781120 00000100:00100000:0.0:1787826403.321381:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563781120 00000100:00100000:0.0:1787826403.321439:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3569 00000100:00100000:0.0:1787826403.321457:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:54853:x1874670563781120:12345-192.168.203.39@tcp:101:truncate.0 00010000:00010000:0.0:1787826403.321512:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826403.321533:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b81025 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x19:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab08f7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.321565:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b8102c lrc: 3/1,0 mode: --/PR res: [0x200000405:0x19:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.321578:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b8102c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.321589:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b8102c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.321716:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b81025 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x19:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08f7 expref: 35 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.321735:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b8102c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08f7 expref: 34 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.321743:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff90cf04f8bf00) 00010000:00010000:0.0:1787826403.321747:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787826403.321750:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165ea00, rc 0) 00000100:00100000:0.0:1787826403.321821:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:54853:x1874670563781120:12345-192.168.203.39@tcp:101:truncate.0 Request processed in 366us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826403.321828:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3569 00000100:00100000:0.0:1787826403.333094:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826403.333193:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563781376 00000100:00100000:2.0:1787826403.333203:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563781376 00000100:00100000:2.0:1787826403.333281:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3570 00000100:00100000:2.0:1787826403.333294:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f937840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:54853:x1874670563781376:12345-192.168.203.39@tcp:36:truncate.0 00010000:00010000:2.0:1787826403.333345:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826403.333371:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066a00/0x22153cd396b8101e lrc: 0/0,0 mode: --/PR res: [0x200000405:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08f0 expref: 34 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.333389:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff90cf04f8bf00) 00010000:00010000:2.0:1787826403.333394:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826403.333599:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b81033 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x19:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.333612:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b81033 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.333622:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b81033 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787826403.333661:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934706 00000004:00010000:2.0:1787826403.333682:0:6518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008dd0c9d2 reply state 00000000a5499996 transno 8589934707 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b81033 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.333693:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b81033 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.333699:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff90cf04f8bf00) 00010000:00010000:2.0:1787826403.333702:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826403.333705:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826403.333998:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f937840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:54853:x1874670563781376:12345-192.168.203.39@tcp:36:truncate.0 Request processed in 705us (916us total) trans 8589934707 rc 0/0 00000100:00100000:2.0:1787826403.334009:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3570 00000020:00080000:2.0:1787826403.334014:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787826403.342076:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826403.348123:0:25426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563781504 00000100:00100000:0.0:1787826403.348141:0:25426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563781504 00002000:00010000:0.0:1787826403.348193:0:25426:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/260 (2147483648->18446744073709551615) 00002000:00100000:0.0:1787826403.348198:0:25426:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf136d52c0 with x1874670563781504 ext(2147483648->18446744073709551615) 00002000:00010000:0.0:1787826403.348212:0:25426:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90cf136d52c0. 00000100:00100000:0.0:1787826403.348275:0:25426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 748 00000100:00100000:0.0:1787826403.348288:0:25426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136d52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670563781504:12345-192.168.203.39@tcp:10:truncate.0 00002000:00010000:0.0:1787826403.348517:0:25426:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x104:0x0] updating lvb size from disk: 134217728 -> 2147483648 00002000:00010000:0.0:1787826403.348521:0:25426:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x104:0x0] updating lvb mtime from disk: 1787826403 -> 1787826403 00002000:00010000:0.0:1787826403.348524:0:25426:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x104:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787826403.348526:0:25426:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x104:0x0] updating lvb ctime from disk: 1787826403 -> 1787826403 00002000:00010000:0.0:1787826403.348528:0:25426:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x104:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1787826403.348603:0:25426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136d52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670563781504:12345-192.168.203.39@tcp:10:truncate.0 Request processed in 318us (6537us total) trans 17179869641 rc 0/0 00000100:00100000:0.0:1787826403.348611:0:25426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 748 00002000:00010000:0.0:1787826403.348615:0:25426:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/260 (2147483648->18446744073709551615) 00002000:00100000:0.0:1787826403.348617:0:25426:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf136d52c0 with x1874670563781504 ext(2147483648->18446744073709551615) 00002000:00010000:0.0:1787826403.348622:0:25426:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90cf136d52c0. 00000100:00100000:1.0:1787826403.369423:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826403.369544:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563781760 00000100:00100000:2.0:1787826403.369554:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563781760 00000100:00100000:2.0:1787826403.369618:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3571 00000100:00100000:2.0:1787826403.369628:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:54855:x1874670563781760:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826403.369653:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826403.369676:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835200/0x22153cd396b8103a lrc: 2/0,0 mode: --/CR res: [0x200000405:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab08fe expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.369753:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81041 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.369766:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81041 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.369777:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81041 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.369788:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81048 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x18:0x0].0x919060dd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.369795:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81048 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x18:0x0].0x919060dd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.369802:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81048 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x18:0x0].0x919060dd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.369901:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8104f lrc: 3/1,0 mode: --/PR res: [0x200000405:0x19:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.369915:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8104f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.369922:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8104f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826403.369931:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x19:0x0]: returning size 2147483648 00010000:00010000:2.0:1787826403.370004:0:9966:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81041 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.370013:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81041 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.370019:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81041 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.370026:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81041 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.370032:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826403.370036:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81041 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.370044:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81041 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.370056:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x18:0x0].0x0 (ffff90cf1859a800) 00010000:00010000:2.0:1787826403.370059:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826403.370064:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81041 lrc: 3/0,0 mode: --/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.370071:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81041 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.370086:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81048 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x18:0x0].0x919060dd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.370092:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81048 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x18:0x0].0x919060dd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.370099:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81048 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x18:0x0].0x919060dd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.370105:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826403.370108:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81048 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x18:0x0].0x919060dd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.370114:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81048 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x18:0x0].0x919060dd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.370122:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x18:0x0].0x919060dd (ffff90cf1859a600) 00010000:00010000:2.0:1787826403.370125:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826403.370128:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81048 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x18:0x0].0x919060dd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.370134:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81048 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x18:0x0].0x919060dd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.370168:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835200/0x22153cd396b8103a lrc: 0/0,0 mode: --/CR res: [0x200000405:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08fe expref: 39 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.370181:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8104f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08fe expref: 38 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.370194:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff90cf04f8bf00) 00010000:00010000:2.0:1787826403.370197:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826403.370200:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835a00, rc 0) 00000100:00100000:2.0:1787826403.370262:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:54855:x1874670563781760:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 635us (851us total) trans 8589934708 rc 0/0 00000100:00100000:2.0:1787826403.370280:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3571 00000100:00100000:0.0:1787826403.377145:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826403.379310:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563782016 00000100:00100000:2.0:1787826403.379324:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563782016 00000100:00100000:2.0:1787826403.379394:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3572 00000100:00100000:2.0:1787826403.379404:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f9343c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:54855:x1874670563782016:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826403.379427:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826403.379449:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834200/0x22153cd396b8105d lrc: 2/0,0 mode: --/CW res: [0x200000405:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0905 expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.379885:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81064 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.379900:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81064 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.379910:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81064 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826403.379919:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1a:0x0]: returning size 0 00010000:00010000:2.0:1787826403.379962:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834200/0x22153cd396b8105d lrc: 0/0,0 mode: --/CW res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0905 expref: 41 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.379986:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81064 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0905 expref: 40 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.379994:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1a:0x0].0x0 (ffff90cf1859a200) 00010000:00010000:2.0:1787826403.379997:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826403.380000:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834600, rc 0) 00000100:00100000:2.0:1787826403.380073:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f9343c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:54855:x1874670563782016:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 670us (2936us total) trans 8589934709 rc 0/0 00000100:00100000:2.0:1787826403.380081:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3572 00000100:00100000:3.0:1787826403.387866:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826403.388333:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563782272 00000100:00100000:1.0:1787826403.388342:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563782272 00000100:00100000:1.0:1787826403.388406:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3573 00000100:00100000:1.0:1787826403.388416:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f06940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:54855:x1874670563782272:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826403.388440:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826403.388462:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066600/0x22153cd396b81072 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab090c expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.388606:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067400/0x22153cd396b81079 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.388622:0:16564:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81064 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0905 expref: 41 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.388635:0:16564:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067400/0x22153cd396b81079 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.388667:0:16564:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81064 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0905 expref: 41 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.388680:0:16564:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81064 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0905 expref: 41 pid: 8247 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826403.388694:0:16564:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf136d70c0 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:16564:1874670585217536:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826403.388774:0:16564:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce01ef9480 going to sleep for 11 seconds 00000100:00100000:1.0:1787826403.403563:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826403.403673:0:16564:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf136d70c0 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:16564:1874670585217536:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826403.403700:0:16564:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067400/0x22153cd396b81079 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826403.403774:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563782400 00000100:00100000:3.0:1787826403.403782:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563782400 00010000:00010000:3.0:1787826403.403817:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81064 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0905 expref: 42 pid: 8247 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826403.403846:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1034 00000100:00100000:3.0:1787826403.403854:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136d5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+42:2403:x1874670563782400:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826403.403869:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826403.403876:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81064 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0905 expref: 42 pid: 8247 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826403.403888:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81064 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0905 expref: 42 pid: 8247 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826403.403910:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81064 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0905 expref: 42 pid: 8247 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826403.403926:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1a:0x0].0x0 (ffff90cf1859a200) 00010000:00010000:3.0:1787826403.403931:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067400/0x22153cd396b81079 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826403.403939:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067400/0x22153cd396b81079 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826403.403947:0:10340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067400/0x22153cd396b81079 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826403.403976:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826403.404026:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136d5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+41:2403:x1874670563782400:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 172us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826403.404036:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1034 00010000:00010000:2.0:1787826403.404093:0:16564:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067400/0x22153cd396b81079 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.404099:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067400/0x22153cd396b81079 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826403.404116:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1a:0x0]: returning size 0 00000004:00080000:2.0:1787826403.404263:0:16564:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x104:0x0], index 0: 0 00010000:00010000:2.0:1787826403.404377:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067400/0x22153cd396b81079 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.404385:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067400/0x22153cd396b81079 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.404392:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067400/0x22153cd396b81079 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.404399:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0a067400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826403.404403:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067400/0x22153cd396b81079 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.404411:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067400/0x22153cd396b81079 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.404421:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1a:0x0].0x0 (ffff90cf1859a200) 00010000:00010000:2.0:1787826403.404423:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826403.404427:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067400/0x22153cd396b81079 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.404433:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067400/0x22153cd396b81079 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.404529:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066600/0x22153cd396b81072 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab090c expref: 41 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.404539:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x18:0x0].0x0 (ffff90cf1859a800) 00010000:00010000:2.0:1787826403.404541:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787826403.404545:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066600/0x22153cd396b81072 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x18:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab090c expref: 41 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.404555:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0a066600, rc 0) 00000100:00100000:2.0:1787826403.404580:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f06940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:54855:x1874670563782272:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 16167us (16726us total) trans 8589934710 rc 301/301 00000100:00100000:2.0:1787826403.404587:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3573 00000100:00100000:0.0:1787826403.412710:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826403.412814:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563782656 00000100:00100000:2.0:1787826403.412823:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563782656 00000100:00100000:2.0:1787826403.412876:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1048 00000100:00100000:2.0:1787826403.412885:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f937480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:54855:x1874670563782656:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:2.0:1787826403.413133:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f937480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+41:54855:x1874670563782656:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 249us (432us total) trans 8589934711 rc 0/0 00000100:00100000:2.0:1787826403.413141:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1048 00000100:00100000:1.0:1787826403.416041:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826403.416133:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563782784 00000100:00100000:2.0:1787826403.416142:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563782784 00000100:00100000:2.0:1787826403.416198:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3574 00000100:00100000:2.0:1787826403.416208:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136d70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+41:54855:x1874670563782784:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826403.416230:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826403.416252:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834200/0x22153cd396b81087 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0913 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.416432:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835200/0x22153cd396b8108e lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.416446:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835200/0x22153cd396b8108e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.416618:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835200/0x22153cd396b8108e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826403.416662:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1a:0x0]: returning size 0 00000004:00200000:2.0:1787826403.416666:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826403.416684:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835200/0x22153cd396b8108e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.416709:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834200/0x22153cd396b81087 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0913 expref: 43 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.416726:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835200/0x22153cd396b8108e lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0913 expref: 42 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.416735:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1a:0x0].0x0 (ffff90cf1859a200) 00010000:00010000:2.0:1787826403.416738:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787826403.416741:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835200, rc 0) 00000100:00100000:2.0:1787826403.416833:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136d70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+42:54855:x1874670563782784:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 625us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826403.416840:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3574 00000100:00100000:1.0:1787826403.421565:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826403.421896:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563782912 00000100:00100000:2.0:1787826403.421905:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563782912 00000100:00100000:2.0:1787826403.421977:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1965 00000100:00100000:2.0:1787826403.421988:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+5:2402:x1874670563782912:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826403.422004:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826403.422023:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c25d1558/0x22153cd396b81095 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x104:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab091a expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787826403.422047:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x104:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826403.422069:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x104:0x0].0x0 since=1349s v=(0 0) 00010000:00010000:2.0:1787826403.422073:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x104:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826403.422081:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c25d1558/0x22153cd396b81095 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab091a expref: 6 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.422100:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c25d1558/0x22153cd396b81095 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab091a expref: 6 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.422119:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834200, rc 0) 00000100:00100000:2.0:1787826403.422174:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+6:2402:x1874670563782912:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 188us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826403.422182:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1965 00000100:00080000:3.0:1787826403.422852:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826403.425589:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826403.425763:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563783168 00000100:00100000:1.0:1787826403.425772:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563783168 00000100:00100000:1.0:1787826403.425829:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3575 00000100:00100000:1.0:1787826403.425838:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a1a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+42:54855:x1874670563783168:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826403.425857:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826403.425876:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067800/0x22153cd396b8109c lrc: 2/0,0 mode: --/CR res: [0x200000405:0x19:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0921 expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.425976:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066a00/0x22153cd396b810a3 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x19:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.425992:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066a00/0x22153cd396b810a3 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x19:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.426005:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066a00/0x22153cd396b810a3 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x19:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826403.426016:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x19:0x0]: returning size 2147483648 00010000:00010000:1.0:1787826403.426115:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067800/0x22153cd396b8109c lrc: 0/0,0 mode: --/CR res: [0x200000405:0x19:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0921 expref: 45 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.426135:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066a00/0x22153cd396b810a3 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x19:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0921 expref: 44 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.426145:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff90cf04f8bf00) 00010000:00010000:1.0:1787826403.426149:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787826403.426152:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0a066a00, rc 0) 00000100:00100000:1.0:1787826403.426218:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a1a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:54855:x1874670563783168:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 380us (637us total) trans 8589934712 rc 0/0 00000100:00100000:1.0:1787826403.426225:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3575 00000100:00100000:1.0:1787826403.445777:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826403.445933:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563783296 00000100:00100000:2.0:1787826403.445943:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563783296 00000100:00100000:2.0:1787826403.446007:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1966 00000100:00100000:2.0:1787826403.446017:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563783296:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:2.0:1787826403.446058:0:8545:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000159f1fa4/0x22153cd396b810b1 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.446079:0:8545:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002fc1e6d3/0x22153cd396b81002 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08e9 expref: 10 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.446088:0:8545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x104:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826403.446093:0:8545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x104:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826403.446097:0:8545:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000159f1fa4/0x22153cd396b810b1 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.446130:0:8545:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002fc1e6d3/0x22153cd396b81002 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08e9 expref: 10 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.446144:0:8545:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002fc1e6d3/0x22153cd396b81002 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08e9 expref: 10 pid: 30696 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826403.446164:0:8545:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce038930c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8545:1874670585217664:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826403.446245:0:8545:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f67ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826403.456368:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826403.456461:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563783424 00000100:00100000:0.0:1787826403.456506:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563783424 00002000:00100000:0.0:1787826403.456554:0:8442:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x104:0x0] (134217728->134221823) req@ffff90cf41c84000 x1874670563783424/t0(0) o4->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:4/0 lens 4584/0 e 0 to 0 dl 1787826414 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826403.456564:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf41c84000 with x1874670563783424 ext(134217728->134221823) 00010000:00010000:0.0:1787826403.456572:0:8442:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002fc1e6d3/0x22153cd396b81002 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08e9 expref: 11 pid: 30696 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.456588:0:8442:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002fc1e6d3/0x22153cd396b81002 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08e9 expref: 11 pid: 30696 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826403.456594:0:8442:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90cf41c84000 00000100:00100000:0.0:1787826403.456617:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 23 00000100:00100000:0.0:1787826403.456626:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2404:x1874670563783424:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1787826403.457547:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2404:x1874670563783424:12345-192.168.203.39@tcp:4:dd.0 Request processed in 916us (1184us total) trans 17179869642 rc 0/0 00000100:00100000:0.0:1787826403.457558:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 23 00002000:00100000:0.0:1787826403.457566:0:8442:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x104:0x0] (134217728->134221823) req@ffff90cf41c84000 x1874670563783424/t17179869642(0) o4->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:4/0 lens 4584/448 e 0 to 0 dl 1787826414 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787826403.457574:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf41c84000 with x1874670563783424 ext(134217728->134221823) 00010000:00010000:0.0:1787826403.457582:0:8442:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002fc1e6d3/0x22153cd396b81002 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08e9 expref: 13 pid: 30696 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.457594:0:8442:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002fc1e6d3/0x22153cd396b81002 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08e9 expref: 13 pid: 30696 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826403.457600:0:8442:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90cf41c84000 00000100:00100000:3.0:1787826403.458437:0:8545:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce038930c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8545:1874670585217664:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826403.458463:0:8545:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000159f1fa4/0x22153cd396b810b1 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826403.461375:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826403.461490:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563783552 00000100:00100000:2.0:1787826403.461499:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563783552 00010000:00010000:2.0:1787826403.461538:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002fc1e6d3/0x22153cd396b81002 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08e9 expref: 13 pid: 30696 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826403.461577:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1035 00000100:00100000:2.0:1787826403.461585:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c870c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2403:x1874670563783552:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826403.461599:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787826403.461615:0:6505:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x104:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1787826403.461621:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002fc1e6d3/0x22153cd396b81002 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x104:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08e9 expref: 13 pid: 30696 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.461634:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002fc1e6d3/0x22153cd396b81002 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x104:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08e9 expref: 13 pid: 30696 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.461656:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002fc1e6d3/0x22153cd396b81002 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x104:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08e9 expref: 13 pid: 30696 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.461671:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x104:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826403.461675:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x104:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826403.461680:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000159f1fa4/0x22153cd396b810b1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.461695:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000159f1fa4/0x22153cd396b810b1 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.461725:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826403.461775:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c870c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563783552:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 190us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826403.461783:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1035 00010000:00010000:3.0:1787826403.461965:0:8545:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000159f1fa4/0x22153cd396b810b1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826403.461975:0:8545:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000159f1fa4/0x22153cd396b810b1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826403.461995:0:8545:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000159f1fa4/0x22153cd396b810b1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826403.462003:0:8545:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000159f1fa4/0x22153cd396b810b1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826403.462010:0:8545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000159f1fa4/0x22153cd396b810b1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826403.462018:0:8545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835800 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826403.462022:0:8545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000159f1fa4/0x22153cd396b810b1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826403.462037:0:8545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000159f1fa4/0x22153cd396b810b1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826403.462049:0:8545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000159f1fa4/0x22153cd396b810b1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826403.462057:0:8545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000159f1fa4/0x22153cd396b810b1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826403.462111:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2404:x1874670563783296:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 16096us (16354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826403.462119:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1966 00000100:00100000:3.0:1787826403.465179:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826403.465275:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563783680 00000100:00100000:1.0:1787826403.465284:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563783680 00000100:00100000:1.0:1787826403.465343:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1967 00000100:00100000:1.0:1787826403.465353:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f07840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2402:x1874670563783680:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826403.465372:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826403.465393:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8b52bb3/0x22153cd396b810b8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x104:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0928 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826403.465422:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x104:0x0] initial LVB size: 2147483648, mtime: 0x6a9010e3, atime: 0x0, ctime: 0x6a9010e3, blocks: 0x8 00010000:00010000:1.0:1787826403.465442:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x104:0x0].0x0 since=1349s v=(0 0) 00010000:00010000:1.0:1787826403.465456:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x104:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826403.465467:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8b52bb3/0x22153cd396b810b8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0928 expref: 12 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.465511:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c8b52bb3/0x22153cd396b810b8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0928 expref: 12 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.465524:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0a067800, rc 0) 00000100:00100000:1.0:1787826403.465578:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f07840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2402:x1874670563783680:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 226us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826403.465585:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1967 00000100:00100000:0.0:1787826403.478246:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826403.478362:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826403.478562:0:34485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563783808 00000100:00100000:1.0:1787826403.478572:0:34485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563783808 00000100:00100000:1.0:1787826403.478635:0:34485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 96 00000100:00100000:1.0:1787826403.478646:0:34485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1099f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:307626ff-a376-4faf-93e0-9f55b723d964+10:2404:x1874670563783808:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1787826403.478854:0:34485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1099f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:307626ff-a376-4faf-93e0-9f55b723d964+10:2404:x1874670563783808:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 209us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826403.478862:0:34485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 96 00000100:00100000:2.0:1787826403.479122:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563783936 00000100:00100000:2.0:1787826403.479128:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563783936 00000100:00100000:2.0:1787826403.479179:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1567 00000100:00100000:2.0:1787826403.479186:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:2403:x1874670563783936:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1787826403.479224:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:2403:x1874670563783936:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 39us (990us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826403.479230:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1567 00000100:00080000:0.0:1787826403.479331:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787826403.554997:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826403.555107:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563784064 00000100:00100000:1.0:1787826403.555117:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563784064 00000100:00100000:1.0:1787826403.555172:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1968 00000100:00100000:1.0:1787826403.555182:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563784064:12345-192.168.203.39@tcp:23:lfs.0 00000100:00100000:1.0:1787826403.555301:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563784064:12345-192.168.203.39@tcp:23:lfs.0 Request processed in 120us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826403.555310:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1968 00000100:00100000:3.0:1787826403.569451:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826403.569629:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563784192 00000100:00100000:2.0:1787826403.569639:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563784192 00000100:00100000:2.0:1787826403.569708:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3576 00000100:00100000:2.0:1787826403.569726:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:54855:x1874670563784192:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826403.569749:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826403.569767:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b810bf lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab092f expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.569799:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b810c6 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.569817:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b810c6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.569827:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b810c6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.569930:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b810bf lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab092f expref: 46 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.569949:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b810c6 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab092f expref: 45 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.569959:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1a:0x0].0x0 (ffff90cf1859a200) 00010000:00010000:2.0:1787826403.569962:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787826403.569965:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835800, rc 0) 00000100:00100000:2.0:1787826403.570022:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+45:54855:x1874670563784192:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 298us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826403.570029:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3576 00000100:00100000:3.0:1787826403.577184:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826403.577292:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563784448 00000100:00100000:2.0:1787826403.577302:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563784448 00000100:00100000:2.0:1787826403.577362:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3577 00000100:00100000:2.0:1787826403.577373:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+45:54855:x1874670563784448:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:2.0:1787826403.577428:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826403.577493:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835200/0x22153cd396b8108e lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1a:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0913 expref: 45 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.577510:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1a:0x0].0x0 (ffff90cf1859a200) 00010000:00010000:2.0:1787826403.577515:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826403.577657:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b810cd lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.577683:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b810cd lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.577693:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b810cd lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787826403.577744:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934713 00000004:00010000:2.0:1787826403.577764:0:6518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c021c63c reply state 00000000696db621 transno 8589934714 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b810cd lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.577992:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b810cd lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.577998:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1a:0x0].0x0 (ffff90cf1859a200) 00010000:00010000:2.0:1787826403.578001:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826403.578004:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826403.578097:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+47:54855:x1874670563784448:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 725us (922us total) trans 8589934714 rc 0/0 00000100:00100000:2.0:1787826403.578104:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3577 00000020:00080000:2.0:1787826403.578108:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787826403.585213:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826403.585311:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563784576 00000100:00100000:0.0:1787826403.585321:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563784576 00000100:00100000:0.0:1787826403.585380:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3578 00000100:00100000:0.0:1787826403.585389:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+47:54855:x1874670563784576:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826403.585414:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826403.585432:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b810d4 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0936 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.585522:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b810d4 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0936 expref: 48 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.585543:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b810d4 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0936 expref: 48 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.585561:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1a:0x0].0x0 (ffff90cf1859a200) 00010000:00010000:0.0:1787826403.585563:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826403.585567:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165fc00, rc 0) 00000100:00100000:0.0:1787826403.585626:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:54855:x1874670563784576:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 238us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826403.585633:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3578 00000100:00100000:3.0:1787826403.589910:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826403.590013:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563784704 00000100:00100000:1.0:1787826403.590022:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563784704 00000100:00100000:1.0:1787826403.590080:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1969 00000100:00100000:1.0:1787826403.590091:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+6:54855:x1874670563784704:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826403.590106:0:30696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826403.590124:0:30696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c2ebfbb/0x22153cd396b810db lrc: 2/0,0 mode: --/PW res: [0x280000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab093d expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.590154:0:30696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c25d1558/0x22153cd396b81095 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab091a expref: 7 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.590162:0:30696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x104:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826403.590166:0:30696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x104:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826403.590171:0:30696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c2ebfbb/0x22153cd396b810db lrc: 4/0,0 mode: --/PW res: [0x280000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab093d expref: 7 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.590204:0:30696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c25d1558/0x22153cd396b81095 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab091a expref: 7 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.590218:0:30696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c25d1558/0x22153cd396b81095 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab091a expref: 7 pid: 8435 timeout: 1449 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826403.590237:0:30696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf41c85a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:30696:1874670585217792:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826403.590330:0:30696:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce01ef9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826403.593934:0:30696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf41c85a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:30696:1874670585217792:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826403.593971:0:30696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007c2ebfbb/0x22153cd396b810db lrc: 3/0,0 mode: --/PW res: [0x280000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab093d expref: 7 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.593994:0:30696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0a066600, rc 0) 00000100:00100000:1.0:1787826403.594056:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:54855:x1874670563784704:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 3967us (4293us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826403.594066:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1969 00000100:00100000:3.0:1787826403.595027:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826403.596927:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563784832 00000100:00100000:0.0:1787826403.596941:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563784832 00010000:00010000:0.0:1787826403.596988:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c25d1558/0x22153cd396b81095 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab091a expref: 7 pid: 8435 timeout: 1449 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826403.597089:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1036 00000100:00100000:0.0:1787826403.597099:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2404:x1874670563784832:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826403.597114:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826403.597120:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c25d1558/0x22153cd396b81095 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x104:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab091a expref: 7 pid: 8435 timeout: 1449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.597133:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c25d1558/0x22153cd396b81095 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x104:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab091a expref: 7 pid: 8435 timeout: 1449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.597155:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c25d1558/0x22153cd396b81095 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x104:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab091a expref: 7 pid: 8435 timeout: 1449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.597179:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x104:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826403.597183:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x104:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826403.597189:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007c2ebfbb/0x22153cd396b810db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab093d expref: 6 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.597198:0:10341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c2ebfbb/0x22153cd396b810db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab093d expref: 6 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.597236:0:10341:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000007c2ebfbb/0x22153cd396b810db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab093d expref: 6 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826403.597249:0:10341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03a18f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10341:1874670585217920:192.168.203.39@tcp:105: 00000100:00100000:0.0:1787826403.597347:0:10341:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf18550000 going to sleep for 11 seconds 00000100:00100000:1.0:1787826403.602322:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826403.602405:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563784960 00000100:00100000:2.0:1787826403.602415:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563784960 00002000:00010000:2.0:1787826403.602488:0:8441:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/260 (0->18446744073709551615) 00002000:00100000:2.0:1787826403.602493:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf41c85a40 with x1874670563784960 ext(0->18446744073709551615) 00002000:00010000:2.0:1787826403.602505:0:8441:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf41c85a40. 00000100:00100000:2.0:1787826403.602541:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 749 00000100:00100000:2.0:1787826403.602551:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c85a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2403:x1874670563784960:12345-192.168.203.39@tcp:10:lfs.0 00002000:00010000:2.0:1787826403.602745:0:8441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x104:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787826403.602749:0:8441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x104:0x0] updating lvb mtime from disk: 0 -> 1787826404 00002000:00010000:2.0:1787826403.602751:0:8441:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x104:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787826403.602754:0:8441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x104:0x0] updating lvb ctime from disk: 0 -> 1787826404 00002000:00010000:2.0:1787826403.602756:0:8441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x104:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1787826403.602963:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c85a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2403:x1874670563784960:12345-192.168.203.39@tcp:10:lfs.0 Request processed in 413us (649us total) trans 21474836979 rc 0/0 00000100:00100000:2.0:1787826403.602972:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 749 00002000:00010000:2.0:1787826403.602976:0:8441:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/260 (0->18446744073709551615) 00002000:00100000:2.0:1787826403.602979:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf41c85a40 with x1874670563784960 ext(0->18446744073709551615) 00002000:00010000:2.0:1787826403.602984:0:8441:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf41c85a40. 00000100:00100000:0.0:1787826403.603931:0:10341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03a18f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10341:1874670585217920:192.168.203.39@tcp:105: 00010000:00010000:0.0:1787826403.603957:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826403.603996:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2404:x1874670563784832:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6898us (8973us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826403.604004:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1036 00000100:00100000:3.0:1787826403.607340:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826403.607707:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563785088 00000100:00100000:2.0:1787826403.607725:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563785088 00000100:00100000:2.0:1787826403.607777:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1970 00000100:00100000:2.0:1787826403.607786:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2402:x1874670563785088:12345-192.168.203.39@tcp:23:lfs.0 00000100:00100000:2.0:1787826403.607893:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2402:x1874670563785088:12345-192.168.203.39@tcp:23:lfs.0 Request processed in 108us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826403.607901:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1970 00000100:00100000:3.0:1787826403.611082:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826403.611191:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563785216 00000100:00100000:0.0:1787826403.611200:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563785216 00000100:00100000:0.0:1787826403.611271:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1971 00000100:00100000:0.0:1787826403.611282:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563785216:12345-192.168.203.39@tcp:23:lfs.0 00000100:00100000:0.0:1787826403.611401:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563785216:12345-192.168.203.39@tcp:23:lfs.0 Request processed in 120us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826403.611410:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1971 00000100:00100000:1.0:1787826403.630918:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826403.631250:0:30178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563785344 00000100:00100000:2.0:1787826403.631262:0:30178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563785344 00000100:00100000:2.0:1787826403.631349:0:30178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 750 00000100:00100000:2.0:1787826403.631359:0:30178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c85e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563785344:12345-192.168.203.39@tcp:3:lfs.0 00010000:00010000:2.0:1787826403.631392:0:30178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000088c1e0c0/0x22153cd396b810e2 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.631408:0:30178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x104:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826403.631413:0:30178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x104:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826403.631418:0:30178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088c1e0c0/0x22153cd396b810e2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.631430:0:30178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088c1e0c0/0x22153cd396b810e2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.632240:0:30178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000088c1e0c0/0x22153cd396b810e2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.632252:0:30178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088c1e0c0/0x22153cd396b810e2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.632261:0:30178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088c1e0c0/0x22153cd396b810e2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.632283:0:30178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835200 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826403.632287:0:30178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088c1e0c0/0x22153cd396b810e2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.632296:0:30178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088c1e0c0/0x22153cd396b810e2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.632312:0:30178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088c1e0c0/0x22153cd396b810e2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.632319:0:30178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088c1e0c0/0x22153cd396b810e2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826403.632435:0:30178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c85e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563785344:12345-192.168.203.39@tcp:3:lfs.0 Request processed in 1076us (1524us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787826403.632719:0:30178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 750 00000100:00100000:1.0:1787826403.639976:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826403.640061:0:25422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563785472 00000100:00100000:0.0:1787826403.640071:0:25422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563785472 00000100:00100000:0.0:1787826403.640169:0:25422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 751 00000100:00100000:0.0:1787826403.640179:0:25422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2404:x1874670563785472:12345-192.168.203.39@tcp:4:lfs.0 00010000:00010000:0.0:1787826403.640212:0:25422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b49a3b43/0x22153cd396b810e9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.640233:0:25422:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007c2ebfbb/0x22153cd396b810db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab093d expref: 7 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.640242:0:25422:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x104:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826403.640247:0:25422:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x104:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826403.640252:0:25422:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b49a3b43/0x22153cd396b810e9 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x104:0x0].0x0 rrc: 3 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.640301:0:25422:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007c2ebfbb/0x22153cd396b810db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab093d expref: 7 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.640314:0:25422:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007c2ebfbb/0x22153cd396b810db lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab093d expref: 7 pid: 30696 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826403.640328:0:25422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03a18f00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0000_UUID:25422:1874670585218048:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826403.640414:0:25422:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf18550000 going to sleep for 11 seconds 00000100:00100000:3.0:1787826403.643876:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826403.643983:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563785600 00000100:00100000:2.0:1787826403.643992:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563785600 00010000:00010000:2.0:1787826403.644026:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007c2ebfbb/0x22153cd396b810db lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab093d expref: 8 pid: 30696 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826403.644062:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1037 00000100:00100000:2.0:1787826403.644070:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2403:x1874670563785600:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826403.644083:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826403.644100:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007c2ebfbb/0x22153cd396b810db lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x104:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab093d expref: 8 pid: 30696 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.644114:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007c2ebfbb/0x22153cd396b810db lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x104:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab093d expref: 8 pid: 30696 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.644138:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x104:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826403.644142:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x104:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826403.644148:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b49a3b43/0x22153cd396b810e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x104:0x0].0x0 rrc: 4 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.644159:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b49a3b43/0x22153cd396b810e9 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x104:0x0].0x0 rrc: 4 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.644183:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826403.644229:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2403:x1874670563785600:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 159us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826403.644236:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1037 00010000:00010000:0.0:1787826403.644412:0:25422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c2ebfbb/0x22153cd396b810db lrc: 0/0,0 mode: --/PW res: [0x280000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab093d expref: 7 pid: 30696 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826403.644427:0:25422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03a18f00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0000_UUID:25422:1874670585218048:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826403.644456:0:25422:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b49a3b43/0x22153cd396b810e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x104:0x0].0x0 rrc: 2 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.644465:0:25422:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b49a3b43/0x22153cd396b810e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x104:0x0].0x0 rrc: 2 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.644514:0:25422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b49a3b43/0x22153cd396b810e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x104:0x0].0x0 rrc: 2 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787826403.648178:0:26205:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836980 is committed 00002000:00010000:1.0:1787826403.648290:0:25422:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x104:0x0] updating lvb size from disk: 0 -> 134221824 00002000:00010000:1.0:1787826403.648295:0:25422:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x104:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1787826403.648307:0:25422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b49a3b43/0x22153cd396b810e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x104:0x0].0x0 rrc: 2 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.648319:0:25422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b49a3b43/0x22153cd396b810e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x104:0x0].0x0 rrc: 2 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.648328:0:25422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b49a3b43/0x22153cd396b810e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x104:0x0].0x0 rrc: 2 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.648340:0:25422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165fa00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:1.0:1787826403.648345:0:25422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b49a3b43/0x22153cd396b810e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x104:0x0].0x0 rrc: 2 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.648353:0:25422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b49a3b43/0x22153cd396b810e9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x104:0x0].0x0 rrc: 2 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.648371:0:25422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b49a3b43/0x22153cd396b810e9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x104:0x0].0x0 rrc: 2 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.648379:0:25422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b49a3b43/0x22153cd396b810e9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x104:0x0].0x0 rrc: 2 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826403.648899:0:25422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+5:2404:x1874670563785472:12345-192.168.203.39@tcp:4:lfs.0 Request processed in 8486us (8697us total) trans 21474836980 rc 0/0 00000100:00100000:1.0:1787826403.648909:0:25422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 751 00010000:00010000:0.0:1787826403.652176:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826403.653556:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826403.653681:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563785728 00000100:00100000:1.0:1787826403.653690:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563785728 00000100:00100000:1.0:1787826403.653755:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1972 00000100:00100000:1.0:1787826403.653765:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2402:x1874670563785728:12345-192.168.203.39@tcp:23:lfs.0 00000100:00100000:1.0:1787826403.653871:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2402:x1874670563785728:12345-192.168.203.39@tcp:23:lfs.0 Request processed in 108us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826403.653880:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1972 00000100:00100000:3.0:1787826403.657660:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826403.658027:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563785984 00000100:00100000:1.0:1787826403.658036:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563785984 00000100:00100000:1.0:1787826403.658137:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3579 00000100:00100000:1.0:1787826403.658148:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:54855:x1874670563785984:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:1.0:1787826403.658366:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067e00/0x22153cd396b810f0 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.658383:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067e00/0x22153cd396b810f0 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.658392:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067e00/0x22153cd396b810f0 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787826403.658451:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934715 00000004:00010000:1.0:1787826403.658498:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000016f855e6 reply state 00000000027acb3c transno 8589934716 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067e00/0x22153cd396b810f0 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.658511:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067e00/0x22153cd396b810f0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.658518:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1a:0x0].0x0 (ffff90cf1859a200) 00010000:00010000:1.0:1787826403.658521:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826403.658524:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826403.658614:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+51:54855:x1874670563785984:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 468us (964us total) trans 8589934716 rc 0/0 00000100:00100000:1.0:1787826403.658620:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3579 00000020:00080000:1.0:1787826403.658625:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787826403.661567:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826403.662077:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563786112 00000100:00100000:0.0:1787826403.662087:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563786112 00000100:00100000:0.0:1787826403.662146:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1973 00000100:00100000:0.0:1787826403.662154:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+5:54855:x1874670563786112:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826403.662169:0:28853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826403.662189:0:28853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b49a3b43/0x22153cd396b810f7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x104:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0944 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826403.662213:0:28853:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x104:0x0] initial LVB size: 134221824, mtime: 0x6a9010e4, atime: 0x0, ctime: 0x6a9010e4, blocks: 0x8 00010000:00010000:0.0:1787826403.662233:0:28853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x104:0x0].0x0 since=1349s v=(0 0) 00010000:00010000:0.0:1787826403.662237:0:28853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x104:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826403.662245:0:28853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b49a3b43/0x22153cd396b810f7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0944 expref: 6 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.662276:0:28853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b49a3b43/0x22153cd396b810f7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0944 expref: 6 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.662290:0:28853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165fa00, rc 0) 00000100:00100000:0.0:1787826403.662340:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+6:54855:x1874670563786112:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 187us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826403.662346:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1973 00000100:00100000:3.0:1787826403.665159:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826403.665518:0:30188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563786240 00000100:00100000:2.0:1787826403.665527:0:30188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563786240 00002000:00010000:2.0:1787826403.665565:0:30188:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/260 (2147483648->18446744073709551615) 00002000:00100000:2.0:1787826403.665569:0:30188:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce0373d2c0 with x1874670563786240 ext(2147483648->18446744073709551615) 00002000:00010000:2.0:1787826403.665581:0:30188:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90ce0373d2c0. 00000100:00100000:2.0:1787826403.665615:0:30188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 752 00000100:00100000:2.0:1787826403.665624:0:30188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+6:2404:x1874670563786240:12345-192.168.203.39@tcp:10:lfs.0 00002000:00010000:2.0:1787826403.665823:0:30188:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x104:0x0] updating lvb size from disk: 134221824 -> 2147483648 00002000:00010000:2.0:1787826403.665826:0:30188:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x104:0x0] updating lvb mtime from disk: 1787826404 -> 1787826404 00002000:00010000:2.0:1787826403.665828:0:30188:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x104:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787826403.665830:0:30188:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x104:0x0] updating lvb ctime from disk: 1787826404 -> 1787826404 00002000:00010000:2.0:1787826403.665832:0:30188:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x104:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1787826403.665889:0:30188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2404:x1874670563786240:12345-192.168.203.39@tcp:10:lfs.0 Request processed in 265us (738us total) trans 21474836981 rc 0/0 00000100:00100000:2.0:1787826403.665897:0:30188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 752 00002000:00010000:2.0:1787826403.665900:0:30188:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/260 (2147483648->18446744073709551615) 00002000:00100000:2.0:1787826403.665903:0:30188:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce0373d2c0 with x1874670563786240 ext(2147483648->18446744073709551615) 00002000:00010000:2.0:1787826403.665908:0:30188:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90ce0373d2c0. 00000100:00100000:3.0:1787826403.669620:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826403.669771:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563786368 00000100:00100000:1.0:1787826403.669780:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563786368 00000100:00100000:1.0:1787826403.669835:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3580 00000100:00100000:1.0:1787826403.669844:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+51:54855:x1874670563786368:12345-192.168.203.39@tcp:44:lfs.0 00000001:00080000:0.0:1787826403.671683:0:34481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934716 is committed 00010000:00010000:1.0:1787826403.671799:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b80f99 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfec3af0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.671811:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b80f99 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfec3af0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.671819:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b80f99 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfec3af0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.671825:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826403.671829:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b80f99 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfec3af0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.671837:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b80f99 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfec3af0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.671853:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfec3af0a (ffff90cf1859a300) 00010000:00010000:1.0:1787826403.671856:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826403.671860:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b80f99 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfec3af0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.671865:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b80f99 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfec3af0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.671884:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b80fa0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.671891:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b80fa0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.671897:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b80fa0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.671903:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826403.671905:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b80fa0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.671910:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b80fa0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.671917:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x18:0x0].0x0 (ffff90cf1859a800) 00010000:00010000:1.0:1787826403.671920:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826403.671922:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b80fa0 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.671928:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b80fa0 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.671943:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834e00/0x22153cd396b80fdf lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x18:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.671950:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834e00/0x22153cd396b80fdf lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x18:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.671955:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834e00/0x22153cd396b80fdf lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x18:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.671960:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834e00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826403.671963:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834e00/0x22153cd396b80fdf lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x18:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.671969:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834e00/0x22153cd396b80fdf lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x18:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.671982:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x18:0x0].0x919060dd (ffff90cf1859a600) 00010000:00010000:1.0:1787826403.671984:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826403.671987:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834e00/0x22153cd396b80fdf lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x18:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.671992:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834e00/0x22153cd396b80fdf lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x18:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.672005:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b80ff4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.672011:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b80ff4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.672016:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b80ff4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.672021:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0a066200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826403.672024:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b80ff4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.672030:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b80ff4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.672038:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff90cf04f8bf00) 00010000:00010000:1.0:1787826403.672040:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826403.672042:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b80ff4 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.672048:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b80ff4 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.672063:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b81033 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.672069:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b81033 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.672075:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b81033 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.672081:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826403.672084:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b81033 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.672089:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b81033 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.672096:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff90cf04f8bf00) 00010000:00010000:1.0:1787826403.672099:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826403.672101:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b81033 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.672108:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b81033 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.672116:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b810cd lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.672122:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b810cd lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.672128:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b810cd lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.672133:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826403.672136:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b810cd lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.672142:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b810cd lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.672148:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1a:0x0].0x0 (ffff90cf1859a200) 00010000:00010000:1.0:1787826403.672150:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826403.672153:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b810cd lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.672158:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b810cd lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.672166:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067e00/0x22153cd396b810f0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.672172:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067e00/0x22153cd396b810f0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.672177:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067e00/0x22153cd396b810f0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.672182:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0a067e00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826403.672184:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067e00/0x22153cd396b810f0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.672190:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067e00/0x22153cd396b810f0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.672201:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1a:0x0].0x0 (ffff90cf1859a200) 00010000:00010000:1.0:1787826403.672203:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826403.672206:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067e00/0x22153cd396b810f0 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.672211:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067e00/0x22153cd396b810f0 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826403.672865:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+29:54855:x1874670563786368:12345-192.168.203.39@tcp:44:lfs.0 Request processed in 3015us (3247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826403.672875:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3580 00000100:00100000:3.0:1787826403.675589:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826403.675698:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563786496 00000100:00100000:1.0:1787826403.675707:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563786496 00000100:00100000:0.0:1787826403.676069:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1974 00000100:00100000:0.0:1787826403.676080:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2404:x1874670563786496:12345-192.168.203.39@tcp:16:lfs.0 00000001:00080000:3.0:1787826403.677950:0:26205:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836981 is committed 00000100:00100000:0.0:1787826403.679167:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+6:2404:x1874670563786496:12345-192.168.203.39@tcp:16:lfs.0 Request processed in 3083us (3580us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826403.679180:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1974 00000100:00100000:3.0:1787826403.695090:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826403.695192:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563786624 00000100:00100000:2.0:1787826403.695201:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563786624 00000100:00100000:2.0:1787826403.695255:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1975 00000100:00100000:2.0:1787826403.695274:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563786624:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:2.0:1787826403.695314:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000088c1e0c0/0x22153cd396b810fe lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.695330:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x104:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826403.695334:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x104:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826403.695340:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088c1e0c0/0x22153cd396b810fe lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.695354:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088c1e0c0/0x22153cd396b810fe lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.695377:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000088c1e0c0/0x22153cd396b810fe lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.695384:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088c1e0c0/0x22153cd396b810fe lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.695392:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088c1e0c0/0x22153cd396b810fe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.695399:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835200 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826403.695403:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088c1e0c0/0x22153cd396b810fe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.695411:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088c1e0c0/0x22153cd396b810fe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.695424:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088c1e0c0/0x22153cd396b810fe lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.695431:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088c1e0c0/0x22153cd396b810fe lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826403.695555:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563786624:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 292us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826403.695563:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1975 00000100:00100000:3.0:1787826403.699464:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826403.699698:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563786880 00000100:00100000:1.0:1787826403.699717:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563786880 00000100:00100000:1.0:1787826403.699776:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3581 00000100:00100000:1.0:1787826403.699787:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+29:54855:x1874670563786880:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:1.0:1787826403.699886:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067e00/0x22153cd396b81105 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.699903:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067e00/0x22153cd396b81105 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.699916:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067e00/0x22153cd396b81105 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826403.700032:0:32404:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007f15d311 reply state 00000000ec174541 transno 8589934717 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067e00/0x22153cd396b81105 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.700045:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067e00/0x22153cd396b81105 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.700052:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1a:0x0].0x0 (ffff90cf1859a200) 00010000:00010000:1.0:1787826403.700056:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826403.700060:0:32404:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826403.700158:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:54855:x1874670563786880:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 372us (716us total) trans 8589934717 rc 0/0 00000100:00100000:1.0:1787826403.700165:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3581 00000100:00100000:3.0:1787826403.703348:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826403.703460:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563787008 00000100:00100000:0.0:1787826403.703507:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563787008 00000100:00100000:0.0:1787826403.703562:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1976 00000100:00100000:0.0:1787826403.703571:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf2f796050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+6:2404:x1874670563787008:12345-192.168.203.39@tcp:2:lfs.0 00002000:00010000:0.0:1787826403.703727:0:8437:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x104:0x0] updating lvb size from disk: 2147483648 -> 2147483648 00002000:00010000:0.0:1787826403.703731:0:8437:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x104:0x0] updating lvb mtime from disk: 1787826404 -> 1787826403 00002000:00010000:0.0:1787826403.703734:0:8437:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x104:0x0] updating lvb atime from disk: 0 -> 1787826403 00002000:00010000:0.0:1787826403.703737:0:8437:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x104:0x0] updating lvb ctime from disk: 1787826404 -> 1787826404 00002000:00010000:0.0:1787826403.703739:0:8437:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x104:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1787826403.703789:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf2f796050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2404:x1874670563787008:12345-192.168.203.39@tcp:2:lfs.0 Request processed in 218us (447us total) trans 21474836982 rc 0/0 00000100:00100000:0.0:1787826403.703796:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1976 00000100:00100000:3.0:1787826403.707028:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826403.707294:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563787264 00000100:00100000:2.0:1787826403.707303:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563787264 00000100:00100000:2.0:1787826403.707362:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3582 00000100:00100000:2.0:1787826403.707371:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:54855:x1874670563787264:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:2.0:1787826403.707427:0:8247:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826403.707505:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8104f lrc: 0/0,0 mode: --/PR res: [0x200000405:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08fe expref: 31 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.707526:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff90cf04f8bf00) 00010000:00010000:2.0:1787826403.707531:0:8247:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826403.707579:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835200/0x22153cd396b8110c lrc: 3/0,1 mode: --/PW res: [0x200000405:0x19:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.707591:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835200/0x22153cd396b8110c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.707601:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835200/0x22153cd396b8110c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826403.707702:0:8247:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001f395a1c reply state 00000000ab5feaf7 transno 8589934718 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835200/0x22153cd396b8110c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.707726:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835200/0x22153cd396b8110c lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.707732:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff90cf04f8bf00) 00010000:00010000:2.0:1787826403.707734:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826403.707738:0:8247:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826403.707839:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+32:54855:x1874670563787264:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 468us (820us total) trans 8589934718 rc 0/0 00000100:00100000:2.0:1787826403.707845:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3582 00000100:00100000:1.0:1787826403.712461:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826403.713007:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563787392 00000100:00100000:0.0:1787826403.713017:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563787392 00000100:00100000:0.0:1787826403.713079:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1977 00000100:00100000:0.0:1787826403.713088:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab90780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:54855:x1874670563787392:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826403.713106:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826403.713125:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004185bcb5/0x22153cd396b81113 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab094b expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.713156:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c8b52bb3/0x22153cd396b810b8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0928 expref: 13 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.713164:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x104:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826403.713168:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x104:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826403.713173:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004185bcb5/0x22153cd396b81113 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab094b expref: 13 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.713205:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c8b52bb3/0x22153cd396b810b8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0928 expref: 13 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.713218:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c8b52bb3/0x22153cd396b810b8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0928 expref: 13 pid: 8436 timeout: 1449 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826403.713237:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03a18f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1874670585218176:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826403.713412:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf18550000 going to sleep for 11 seconds 00000100:00100000:3.0:1787826403.719103:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826403.719176:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563787520 00000100:00100000:2.0:1787826403.719185:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563787520 00010000:00010000:2.0:1787826403.719224:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c8b52bb3/0x22153cd396b810b8 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0928 expref: 14 pid: 8436 timeout: 1449 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826403.719273:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1038 00000100:00100000:2.0:1787826403.719283:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563787520:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826403.719297:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826403.719316:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c8b52bb3/0x22153cd396b810b8 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x104:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0928 expref: 14 pid: 8436 timeout: 1449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.719329:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c8b52bb3/0x22153cd396b810b8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x104:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0928 expref: 14 pid: 8436 timeout: 1449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.719356:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x104:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826403.719360:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x104:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826403.719365:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004185bcb5/0x22153cd396b81113 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x104:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab094b expref: 14 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.719374:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004185bcb5/0x22153cd396b81113 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x104:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab094b expref: 14 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.719407:0:6503:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004185bcb5/0x22153cd396b81113 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x104:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab094b expref: 14 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826403.719420:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03890000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6503:1874670585218304:192.168.203.39@tcp:105: 00000100:00100000:2.0:1787826403.719526:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f67ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826403.723103:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03890000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6503:1874670585218304:192.168.203.39@tcp:105: 00010000:00010000:2.0:1787826403.723129:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826403.723188:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563787520:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3906us (4095us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826403.723200:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1038 00010000:00010000:1.0:1787826403.726155:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8b52bb3/0x22153cd396b810b8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0928 expref: 13 pid: 8436 timeout: 1449 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826403.726177:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03a18f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1874670585218176:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826403.726208:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004185bcb5/0x22153cd396b81113 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab094b expref: 12 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.726223:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165ee00, rc 0) 00000100:00100000:1.0:1787826403.726292:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab90780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:54855:x1874670563787392:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 13205us (13841us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826403.726300:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1977 00000100:00100000:0.0:1787826403.734942:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826403.735017:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563787648 00000100:00100000:1.0:1787826403.735027:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563787648 00000100:00100000:1.0:1787826403.735094:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1978 00000100:00100000:1.0:1787826403.735104:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a1b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563787648:12345-192.168.203.39@tcp:2:lfs.0 00002000:00010000:1.0:1787826403.735241:0:28853:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x104:0x0] updating lvb size from disk: 2147483648 -> 2147483648 00002000:00010000:1.0:1787826403.735245:0:28853:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x104:0x0] updating lvb mtime from disk: 1787826403 -> 1787826403 00002000:00010000:1.0:1787826403.735248:0:28853:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x104:0x0] updating lvb atime from disk: 0 -> 1787826403 00002000:00010000:1.0:1787826403.735250:0:28853:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x104:0x0] updating lvb ctime from disk: 1787826403 -> 1787826404 00002000:00010000:1.0:1787826403.735252:0:28853:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x104:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1787826403.735317:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a1b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2404:x1874670563787648:12345-192.168.203.39@tcp:2:lfs.0 Request processed in 214us (385us total) trans 17179869643 rc 0/0 00000100:00100000:1.0:1787826403.735325:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1978 00000100:00100000:3.0:1787826403.738575:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826403.738918:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563787904 00000100:00100000:2.0:1787826403.738928:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563787904 00000100:00100000:2.0:1787826403.738985:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1049 00000100:00100000:2.0:1787826403.738995:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3957a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+32:54855:x1874670563787904:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:2.0:1787826403.739070:0:6522:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000405:0x19:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066a00/0x22153cd396b810a3 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x19:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0921 expref: 32 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.739110:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8111a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x19:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.739122:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b80ffb lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08e2 expref: 32 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.739130:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b8102c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08f7 expref: 32 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.739136:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8111a lrc: 5/0,1 mode: --/EX res: [0x200000405:0x19:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.739167:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b8102c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08f7 expref: 32 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.739178:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b8102c lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08f7 expref: 32 pid: 6519 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826403.739191:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03890000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585218432:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826403.739285:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b80ffb lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08e2 expref: 32 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.739294:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b80ffb lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08e2 expref: 32 pid: 6520 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826403.739302:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03891e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585218560:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826403.739326:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f67ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826403.752040:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03891e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585218560:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826403.752131:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03890000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585218432:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826403.752155:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8111a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x19:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826403.756011:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826403.756177:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826403.759934:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563788160 00000100:00100000:2.0:1787826403.759949:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563788160 00010000:00010000:2.0:1787826403.760003:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b8102c lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08f7 expref: 33 pid: 6519 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826403.760656:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563788032 00000100:00100000:2.0:1787826403.760671:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563788032 00010000:00010000:2.0:1787826403.760694:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b80ffb lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08e2 expref: 34 pid: 6520 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826403.760719:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1039 00000100:00100000:2.0:1787826403.760728:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:2404:x1874670563788160:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826403.760744:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826403.760752:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b8102c lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08f7 expref: 34 pid: 6519 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.760765:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b8102c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08f7 expref: 34 pid: 6519 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.760789:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b8102c lrc: 0/0,0 mode: --/PR res: [0x200000405:0x19:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08f7 expref: 34 pid: 6519 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.760806:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff90cf04f8bf00) 00010000:00010000:2.0:1787826403.760812:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8111a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x19:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.760820:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8111a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x19:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.760827:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826403.760888:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:2404:x1874670563788160:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 161us (4887us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826403.760896:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1039 00000100:00100000:2.0:1787826403.760916:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1040 00000100:00100000:2.0:1787826403.760923:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf185dc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+32:2404:x1874670563788032:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826403.760931:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826403.760935:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b80ffb lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08e2 expref: 32 pid: 6520 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.760945:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b80ffb lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08e2 expref: 32 pid: 6520 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.760958:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b80ffb lrc: 0/0,0 mode: --/CR res: [0x200000405:0x19:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08e2 expref: 32 pid: 6520 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.760967:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff90cf04f8bf00) 00010000:00010000:2.0:1787826403.760970:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8111a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x19:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.760978:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8111a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x19:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.760985:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8111a lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x19:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.761008:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826403.761028:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf185dc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:2404:x1874670563788032:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 105us (4851us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826403.761034:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1040 00010000:00010000:2.0:1787826403.761088:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8111a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x19:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.761095:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8111a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x19:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.761115:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81121 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.761124:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b810c6 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab092f expref: 30 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.761133:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b810d4 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0936 expref: 30 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.761141:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81121 lrc: 5/0,1 mode: --/EX res: [0x200000405:0x1a:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.761170:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b810d4 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0936 expref: 30 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.761182:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b810d4 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0936 expref: 30 pid: 6519 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826403.761196:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03893480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585218688:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826403.761251:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b810c6 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab092f expref: 30 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.761261:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b810c6 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab092f expref: 30 pid: 16564 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826403.761287:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03890f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585218816:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826403.761309:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f67eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787826403.765339:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826403.765520:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563788288 00000100:00100000:1.0:1787826403.765529:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563788288 00010000:00010000:1.0:1787826403.765567:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b810d4 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0936 expref: 31 pid: 6519 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826403.765608:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1041 00000100:00100000:1.0:1787826403.765617:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:2402:x1874670563788288:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826403.765630:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826403.765637:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b810d4 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0936 expref: 31 pid: 6519 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.765655:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b810d4 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0936 expref: 31 pid: 6519 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.765686:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1a:0x0].0x0 (ffff90cf1859a200) 00010000:00010000:1.0:1787826403.765692:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81121 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1a:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.765700:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81121 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1a:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.765706:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826403.765760:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:2402:x1874670563788288:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 143us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826403.765768:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1041 00000100:00100000:3.0:1787826403.766932:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826403.767056:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563788416 00000100:00100000:1.0:1787826403.767062:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563788416 00010000:00010000:1.0:1787826403.767087:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b810c6 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab092f expref: 31 pid: 16564 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826403.767121:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1042 00000100:00100000:1.0:1787826403.767130:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:2403:x1874670563788416:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826403.767140:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826403.767147:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b810c6 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab092f expref: 31 pid: 16564 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.767158:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b810c6 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab092f expref: 31 pid: 16564 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.767176:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1a:0x0].0x0 (ffff90cf1859a200) 00010000:00010000:1.0:1787826403.767181:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81121 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1a:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.767190:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81121 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1a:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.767198:0:10340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81121 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1a:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.767216:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826403.767245:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:2403:x1874670563788416:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 117us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826403.767251:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1042 00010000:00010000:2.0:1787826403.772012:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b810d4 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0936 expref: 30 pid: 6519 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826403.772041:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03893480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585218688:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826403.772057:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b810c6 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab092f expref: 29 pid: 16564 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826403.772068:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03890f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585218816:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826403.772094:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81121 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.772104:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81121 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.772110:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81121 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826403.772430:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03890f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1874670585218944:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787826403.772527:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826403.772567:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f67ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1787826403.772599:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585218944 00000100:00100000:3.0:1787826403.772606:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585218944 00000100:00100000:3.0:1787826403.772655:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1407 00000100:00100000:3.0:1787826403.772675:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03893480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6522:x1874670585218944:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787826403.774500:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03893480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6522:x1874670585218944:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 1829us (1966us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826403.774512:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1407 00000100:00100000:0.0:1787826403.775855:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03890f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1874670585218944:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787826403.775957:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03a18780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1874670585219072:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787826403.776014:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826403.776091:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf117b0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787826403.779322:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585219072 00000100:00100000:3.0:1787826403.779339:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585219072 00000100:00100000:3.0:1787826403.779411:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1408 00000100:00100000:3.0:1787826403.779422:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a19e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6522:x1874670585219072:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787826403.779799:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a19e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6522:x1874670585219072:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 377us (3783us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826403.779811:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1408 00000100:00100000:0.0:1787826403.783223:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03a18780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1874670585219072:0@lo:1000:mdt_rdpg00_001.0 00000040:00080000:0.0:1787826403.785727:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000bd0:0x2:0x0].2, 280 off35208 00000001:00080000:0.0:1787826403.785753:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934719 00000100:00100000:0.0:1787826403.785859:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03a18780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1874670585219200:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787826403.785924:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826403.785963:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f67ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1787826403.786010:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585219200 00000100:00100000:3.0:1787826403.786021:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585219200 00000100:00100000:3.0:1787826403.786080:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1409 00000100:00100000:3.0:1787826403.786090:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a1ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6522:x1874670585219200:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787826403.786237:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a1ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6522:x1874670585219200:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 148us (312us total) trans 21474836983 rc 0/0 00000100:00100000:3.0:1787826403.786246:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1409 00000100:00100000:0.0:1787826403.786379:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03a18780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1874670585219200:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787826403.786410:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03a18f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1874670585219328:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787826403.786649:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826403.786730:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a180c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826403.786771:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585219328 00000100:00100000:3.0:1787826403.786775:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585219328 00000100:00100000:3.0:1787826403.786841:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1410 00000100:00100000:3.0:1787826403.786849:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1366a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6522:x1874670585219328:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787826403.786947:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1366a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6522:x1874670585219328:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 99us (297us total) trans 17179869644 rc 0/0 00000100:00100000:3.0:1787826403.786955:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1410 00000100:00100000:0.0:1787826403.787010:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03a18f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1874670585219328:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787826403.787086:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934720 00010000:00010000:0.0:1787826403.787114:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81121 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.787125:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81121 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.787132:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81121 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.787138:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826403.787142:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81121 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.787150:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81121 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.787166:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1a:0x0].0x0 (ffff90cf1859a200) 00010000:00010000:0.0:1787826403.787169:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787826403.787173:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81121 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.787179:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81121 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.787193:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8111a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x19:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.787198:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8111a lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x19:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.787204:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8111a lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x19:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.787209:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826403.787212:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8111a lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x19:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.787218:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8111a lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x19:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.787225:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff90cf04f8bf00) 00010000:00010000:0.0:1787826403.787227:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787826403.787230:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8111a lrc: 2/0,0 mode: --/EX res: [0x200000405:0x19:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.787236:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8111a lrc: 0/0,0 mode: --/EX res: [0x200000405:0x19:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.787247:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff90cf04f8bf00) 00010000:00010000:0.0:1787826403.787250:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787826403.787257:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066a00/0x22153cd396b810a3 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x19:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0921 expref: 31 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826403.787360:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3957a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:54855:x1874670563787904:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 48367us (48793us total) trans 8589934721 rc 0/0 00000100:00100000:0.0:1787826403.787369:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1049 00000020:00080000:0.0:1787826403.787372:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1787826403.795043:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826403.795316:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563788544 00000100:00100000:1.0:1787826403.795326:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563788544 00000100:00100000:1.0:1787826403.795428:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3583 00000100:00100000:1.0:1787826403.795452:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1366b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:54855:x1874670563788544:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826403.795507:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826403.795528:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066800/0x22153cd396b81128 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0952 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.795587:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066800/0x22153cd396b81128 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0952 expref: 31 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.795602:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066800/0x22153cd396b81128 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0952 expref: 31 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.795621:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff90cf04f8bf00) 00010000:00010000:1.0:1787826403.795624:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826403.795629:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0a066800, rc 0) 00000100:00100000:1.0:1787826403.795738:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1366b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:54855:x1874670563788544:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 301us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826403.795751:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3583 00000100:00100000:1.0:1787826403.799667:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826403.799897:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563788800 00000100:00100000:3.0:1787826403.799907:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563788800 00000100:00100000:3.0:1787826403.799962:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1050 00000100:00100000:3.0:1787826403.799972:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab90f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:54855:x1874670563788800:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:3.0:1787826403.800312:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab90f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+32:54855:x1874670563788800:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 340us (664us total) trans 8589934722 rc 0/0 00000100:00100000:3.0:1787826403.800319:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1050 00000100:00100000:3.0:1787826403.806416:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826403.811185:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563789056 00000100:00100000:0.0:1787826403.811200:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563789056 00000100:00100000:0.0:1787826403.811289:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1051 00000100:00100000:0.0:1787826403.811299:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+32:54855:x1874670563789056:12345-192.168.203.39@tcp:35:lfs.0 00000004:00080000:0.0:1787826403.811694:0:6522:0:(mdd_object.c:4014:mdd_close()) Object [0x200000405:0x1a:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:0.0:1787826403.812682:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b8112f lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.812703:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b8112f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.812714:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b8112f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.812723:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b8112f lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.812730:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b8112f lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.812736:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b8112f lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.813043:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826403.813060:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b8112f lrc: 4/0,0 mode: PW/PW res: [0x200000405:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.813068:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165ec00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:1.0:1787826403.813072:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b8112f lrc: 4/0,0 mode: PW/PW res: [0x200000405:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.813079:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b8112f lrc: 5/0,0 mode: PW/PW res: [0x200000405:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.813094:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1a:0x0].0x0 (ffff90cf1859a200) 00010000:00010000:1.0:1787826403.813097:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787826403.813101:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b8112f lrc: 3/0,0 mode: --/PW res: [0x200000405:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.813110:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826403.813112:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826403.813113:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826403.813664:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826403.813672:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b8112f lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826403.813790:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:54855:x1874670563789056:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 2489us (7379us total) trans 8589934723 rc 0/0 00000100:00100000:0.0:1787826403.813800:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1051 00000100:00100000:2.0:1787826403.847203:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826403.847312:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563789312 00000100:00100000:0.0:1787826403.847322:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563789312 00000100:00100000:0.0:1787826403.847385:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3584 00000100:00100000:0.0:1787826403.847396:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03892d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:54856:x1874670563789312:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:0.0:1787826403.847422:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826403.847457:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b81136 lrc: 2/0,0 mode: --/CW res: [0x200000405:0x18:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0959 expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.847621:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8113d lrc: 3/1,0 mode: --/CR res: [0x200000405:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.847636:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8113d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.847646:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8113d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.847661:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81144 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x18:0x0].0x919060dd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.847669:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81144 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x18:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.847675:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81144 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x18:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.847730:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b8114b lrc: 3/1,0 mode: --/PR res: [0x200000405:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.847739:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b8114b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.847746:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b8114b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826403.847754:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x19:0x0]: returning size 2147483648 00010000:00010000:0.0:1787826403.847834:0:9966:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8113d lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.847842:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8113d lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.847848:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8113d lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.847854:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8113d lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.847860:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165fe00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826403.847864:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8113d lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.847871:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8113d lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.847882:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x18:0x0].0x0 (ffff90cf1859a800) 00010000:00010000:0.0:1787826403.847886:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826403.847890:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8113d lrc: 3/0,0 mode: --/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.847896:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8113d lrc: 0/0,0 mode: --/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.847909:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81144 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x18:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.847915:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81144 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x18:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.847923:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81144 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x18:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.847928:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165e200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826403.847930:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81144 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x18:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.847935:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81144 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x18:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.847941:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x18:0x0].0x919060dd (ffff90ce01f45600) 00010000:00010000:0.0:1787826403.847943:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826403.847946:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81144 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x18:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.847951:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81144 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x18:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.847988:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b81136 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0959 expref: 36 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.848001:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b8114b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0959 expref: 35 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.848007:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff90cf04f8bf00) 00010000:00010000:0.0:1787826403.848010:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826403.848012:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165f600, rc 0) 00000100:00100000:0.0:1787826403.848076:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03892d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:54856:x1874670563789312:12345-192.168.203.39@tcp:101:dd.0 Request processed in 682us (883us total) trans 8589934724 rc 0/0 00000100:00100000:0.0:1787826403.848086:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3584 00000100:00100000:1.0:1787826403.858339:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826403.858432:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563789568 00000100:00100000:0.0:1787826403.858442:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563789568 00000100:00100000:0.0:1787826403.858549:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3585 00000100:00100000:0.0:1787826403.858559:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab92940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:54856:x1874670563789568:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:0.0:1787826403.858581:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826403.858584:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:0.0:1787826403.858621:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b8114b lrc: 0/0,0 mode: --/PR res: [0x200000405:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0959 expref: 35 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.858645:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066800/0x22153cd396b81128 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x19:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0952 expref: 34 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.858658:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff90cf04f8bf00) 00010000:00010000:0.0:1787826403.858663:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826403.858675:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b81159 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0960 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.858721:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81160 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.858735:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81160 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x19:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.858745:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81160 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x19:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787826403.858963:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].21, 88 off9968 00000004:00080000:0.0:1787826403.858972:0:6519:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1349870499987ns, next at 1334727867157ns, rc = 0 00000040:00080000:0.0:1787826403.859002:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].21, 88 off9944 00000004:00080000:0.0:1787826403.859008:0:6519:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1349870536287ns, next at 1334727181995ns, rc = 0 00000001:00080000:0.0:1787826403.862280:0:34481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934725 is committed 00000004:00080000:0.0:1787826403.862293:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 22 committed 00010000:00010000:3.0:1787826403.862394:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067e00/0x22153cd396b81105 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826403.862410:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067e00/0x22153cd396b81105 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826403.862417:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067e00/0x22153cd396b81105 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826403.862423:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0a067e00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826403.862427:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067e00/0x22153cd396b81105 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826403.862452:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067e00/0x22153cd396b81105 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826403.862468:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1a:0x0].0x0 (ffff90cf1859a200) 00010000:00010000:3.0:1787826403.862490:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826403.862496:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067e00/0x22153cd396b81105 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826403.862504:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067e00/0x22153cd396b81105 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826403.862598:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835200/0x22153cd396b8110c lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826403.862605:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835200/0x22153cd396b8110c lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826403.862610:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835200/0x22153cd396b8110c lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826403.862615:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826403.862619:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835200/0x22153cd396b8110c lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826403.862625:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835200/0x22153cd396b8110c lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826403.862633:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff90cf04f8bf00) 00010000:00010000:3.0:1787826403.862636:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826403.862639:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835200/0x22153cd396b8110c lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826403.862644:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835200/0x22153cd396b8110c lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826403.863230:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab92580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585219456:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787826403.863309:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826403.863647:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585219456 00000100:00100000:3.0:1787826403.863655:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585219456 00000100:00100000:3.0:1787826403.863712:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1979 00000100:00100000:3.0:1787826403.863722:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03892940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3647:x1874670585219456:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1787826403.863862:0:30696:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x104:0x0] updating lvb size from disk: 2147483648 -> 2147483648 00002000:00010000:3.0:1787826403.863866:0:30696:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x104:0x0] updating lvb mtime from disk: 1787826403 -> 1787826403 00002000:00010000:3.0:1787826403.863868:0:30696:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x104:0x0] updating lvb atime from disk: 1787826403 -> 1787826403 00002000:00010000:3.0:1787826403.863870:0:30696:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x104:0x0] updating lvb ctime from disk: 1787826404 -> 1787826404 00002000:00010000:3.0:1787826403.863872:0:30696:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x104:0x0] updating lvb blocks from disk: 8 -> 8 00000004:00080000:0.0:1787826403.863952:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 21 committed 00000020:00080000:0.0:1787826403.863976:0:34481:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90cf18550000 refcount 2 committed 0 result 0 batchid 4294969327 00000020:00080000:0.0:1787826403.863981:0:34481:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cf3ab37000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90cf117b0a80 00000020:00080000:0.0:1787826403.863984:0:34481:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cf3ab37500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90cf18550840 00000020:00080000:0.0:1787826403.863986:0:34481:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cf3ab37f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90ce04622e00 00000020:00080000:0.0:1787826403.863989:0:34481:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000bd0:0x2:0x0].2 00010000:00010000:0.0:1787826403.864070:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81160 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0960 expref: 25 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.864081:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff90cf04f8bf00) 00010000:00010000:0.0:1787826403.864084:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1787826403.864098:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b81159 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0960 expref: 25 pid: 6519 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.864115:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81160 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0960 expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.864140:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff90cf04f8bf00) 00010000:00010000:0.0:1787826403.864143:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1787826403.864145:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165e200, rc 0) 00000100:00100000:0.0:1787826403.864190:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab92940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:54856:x1874670563789568:12345-192.168.203.39@tcp:101:dd.0 Request processed in 5632us (5862us total) trans 8589934725 rc 0/0 00000100:00100000:0.0:1787826403.864202:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3585 00000100:00100000:1.0:1787826403.864323:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787826403.864336:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab91680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585219584:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787826403.864369:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826403.864405:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585219584 00000100:00100000:1.0:1787826403.864409:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585219584 00000100:00100000:1.0:1787826403.864449:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1980 00000100:00100000:1.0:1787826403.864456:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab92d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3645:x1874670585219584:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1787826403.864546:0:30398:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x104:0x0] updating lvb size from disk: 2147483648 -> 2147483648 00002000:00010000:1.0:1787826403.864550:0:30398:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x104:0x0] updating lvb mtime from disk: 1787826403 -> 1787826403 00002000:00010000:1.0:1787826403.864552:0:30398:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x104:0x0] updating lvb atime from disk: 1787826403 -> 1787826403 00002000:00010000:1.0:1787826403.864554:0:30398:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x104:0x0] updating lvb ctime from disk: 1787826404 -> 1787826404 00002000:00010000:1.0:1787826403.864556:0:30398:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x104:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1787826403.864584:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab92d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:3645:x1874670585219584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 128us (214us total) trans 17179869645 rc 0/0 00000100:00100000:1.0:1787826403.864590:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1980 00000004:00080000:1.0:1787826403.864628:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3ab91680/2, rc 0, transno 17179869645 00000100:00100000:1.0:1787826403.864634:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab91680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585219584:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787826403.865235:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03892940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+7:3647:x1874670585219456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1513us (1924us total) trans 21474836984 rc 0/0 00000100:00100000:3.0:1787826403.865243:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1979 00000004:00080000:2.0:1787826403.865394:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3ab92580/2, rc 0, transno 21474836984 00000100:00100000:2.0:1787826403.865401:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab92580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585219456:0@lo:2:osp-syn-0-0.0 00000020:00080000:2.0:1787826403.865416:0:34512:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969327 committed batchid 4294969326 00000020:00080000:2.0:1787826403.867448:0:34512:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969326 00000100:00100000:3.0:1787826403.869369:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826403.869646:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563789696 00000100:00100000:2.0:1787826403.869656:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563789696 00000100:00100000:2.0:1787826403.869758:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3586 00000100:00100000:2.0:1787826403.869768:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:54856:x1874670563789696:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:2.0:1787826403.869790:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826403.869810:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b81167 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0967 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.869843:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834e00/0x22153cd396b8116e lrc: 3/1,0 mode: --/PR res: [0x200000405:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.869856:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834e00/0x22153cd396b8116e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.869867:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834e00/0x22153cd396b8116e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.869981:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b81167 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0967 expref: 26 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.869999:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834e00/0x22153cd396b8116e lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0967 expref: 25 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.870009:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff90cf04f8bf00) 00010000:00010000:2.0:1787826403.870012:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787826403.870016:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834e00, rc 0) 00000100:00100000:2.0:1787826403.870083:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:54856:x1874670563789696:12345-192.168.203.39@tcp:101:dd.0 Request processed in 317us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826403.870091:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3586 00000100:00100000:3.0:1787826403.873559:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826403.873659:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563789952 00000100:00100000:0.0:1787826403.873667:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563789952 00000100:00100000:0.0:1787826403.873723:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1052 00000100:00100000:0.0:1787826403.873733:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:54856:x1874670563789952:12345-192.168.203.39@tcp:35:dd.0 00000100:00100000:0.0:1787826403.873954:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:54856:x1874670563789952:12345-192.168.203.39@tcp:35:dd.0 Request processed in 222us (403us total) trans 8589934726 rc 0/0 00000100:00100000:0.0:1787826403.873963:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1052 00000100:00100000:3.0:1787826403.889571:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826403.889767:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563790080 00000100:00100000:1.0:1787826403.889777:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563790080 00000100:00100000:1.0:1787826403.889837:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3587 00000100:00100000:1.0:1787826403.889846:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:54857:x1874670563790080:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826403.889869:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826403.889889:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067800/0x22153cd396b81175 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x18:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab096e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.889949:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b8117c lrc: 3/1,0 mode: --/CR res: [0x200000405:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.889963:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b8117c lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.889974:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b8117c lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.889989:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066600/0x22153cd396b81183 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x18:0x0].0x919060dd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.889996:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066600/0x22153cd396b81183 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x18:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.890001:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066600/0x22153cd396b81183 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x18:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.890071:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067c00/0x22153cd396b8118a lrc: 3/1,0 mode: --/PR res: [0x200000405:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.890080:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067c00/0x22153cd396b8118a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.890090:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067c00/0x22153cd396b8118a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826403.890127:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x19:0x0]: returning size 2147483648 00000004:00200000:1.0:1787826403.890132:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826403.890151:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067c00/0x22153cd396b8118a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.890161:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067c00/0x22153cd396b8118a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.890169:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b8117c lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.890176:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b8117c lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.890182:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b8117c lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.890188:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b8117c lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.890193:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0a066200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826403.890197:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b8117c lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.890204:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b8117c lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.890215:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x18:0x0].0x0 (ffff90cf1859a800) 00010000:00010000:1.0:1787826403.890218:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826403.890223:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b8117c lrc: 3/0,0 mode: --/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.890229:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b8117c lrc: 0/0,0 mode: --/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.890245:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066600/0x22153cd396b81183 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x18:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.890250:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066600/0x22153cd396b81183 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x18:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.890255:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066600/0x22153cd396b81183 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x18:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.890259:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0a066600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826403.890274:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066600/0x22153cd396b81183 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x18:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.890280:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066600/0x22153cd396b81183 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x18:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.890286:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x18:0x0].0x919060dd (ffff90cf04f8b100) 00010000:00010000:1.0:1787826403.890289:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826403.890292:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066600/0x22153cd396b81183 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x18:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.890297:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066600/0x22153cd396b81183 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x18:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.890324:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067800/0x22153cd396b81175 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab096e expref: 28 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.890338:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067c00/0x22153cd396b8118a lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab096e expref: 27 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.890345:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff90cf04f8bf00) 00010000:00010000:1.0:1787826403.890347:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826403.890350:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0a067c00, rc 0) 00000100:00100000:1.0:1787826403.890413:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:54857:x1874670563790080:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 567us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826403.890421:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3587 00000100:00100000:3.0:1787826403.895859:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826403.896044:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563790336 00000100:00100000:1.0:1787826403.896054:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563790336 00000100:00100000:1.0:1787826403.896115:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3588 00000100:00100000:1.0:1787826403.896125:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:54857:x1874670563790336:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826403.896145:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826403.896165:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067800/0x22153cd396b81191 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x18:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0975 expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.896288:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066600/0x22153cd396b81198 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x19:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.896302:0:32404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067c00/0x22153cd396b8118a lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab096e expref: 28 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.896311:0:32404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066600/0x22153cd396b81198 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x19:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.896342:0:32404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067c00/0x22153cd396b8118a lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab096e expref: 28 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.896356:0:32404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067c00/0x22153cd396b8118a lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab096e expref: 28 pid: 6520 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826403.896370:0:32404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab90b40 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:32404:1874670585219712:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826403.896459:0:32404:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf013f1180 going to sleep for 11 seconds 00000100:00100000:3.0:1787826403.900286:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826403.900364:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563790464 00000100:00100000:2.0:1787826403.900372:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563790464 00010000:00010000:2.0:1787826403.900409:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067c00/0x22153cd396b8118a lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab096e expref: 29 pid: 6520 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826403.900460:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1043 00000100:00100000:2.0:1787826403.900468:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+29:2404:x1874670563790464:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826403.900512:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826403.900518:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067c00/0x22153cd396b8118a lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab096e expref: 29 pid: 6520 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.900532:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067c00/0x22153cd396b8118a lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab096e expref: 29 pid: 6520 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.900554:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff90cf04f8bf00) 00010000:00010000:2.0:1787826403.900559:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066600/0x22153cd396b81198 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x19:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.900568:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066600/0x22153cd396b81198 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x19:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.900580:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066600/0x22153cd396b81198 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x19:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.900597:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826403.900641:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+29:2404:x1874670563790464:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 174us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826403.900648:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1043 00010000:00010000:1.0:1787826403.901195:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067c00/0x22153cd396b8118a lrc: 0/0,0 mode: --/PR res: [0x200000405:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab096e expref: 28 pid: 6520 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826403.901212:0:32404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab90b40 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:32404:1874670585219712:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826403.901234:0:32404:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066600/0x22153cd396b81198 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x19:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.901243:0:32404:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066600/0x22153cd396b81198 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x19:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.901248:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066600/0x22153cd396b81198 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x19:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826403.901276:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x19:0x0]: returning size 2147483648 00010000:00010000:1.0:1787826403.901403:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067800/0x22153cd396b81191 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x18:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0975 expref: 29 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.901418:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066600/0x22153cd396b81198 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x19:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0975 expref: 28 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.901426:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff90cf04f8bf00) 00010000:00010000:1.0:1787826403.901429:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787826403.901432:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0a066600, rc 0) 00000100:00100000:1.0:1787826403.901611:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+28:54857:x1874670563790336:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 5486us (5761us total) trans 8589934727 rc 0/0 00000100:00100000:1.0:1787826403.901618:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3588 00000100:00100000:3.0:1787826403.905590:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826403.905688:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563790592 00000100:00100000:0.0:1787826403.905697:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563790592 00000100:00100000:0.0:1787826403.905751:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3589 00000100:00100000:0.0:1787826403.905766:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+28:54857:x1874670563790592:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826403.905788:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826403.905809:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b811a6 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x19:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab097c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.905917:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b811ad lrc: 3/1,0 mode: --/PR res: [0x200000405:0x19:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.905932:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066600/0x22153cd396b81198 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x19:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0975 expref: 29 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.905940:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b811ad lrc: 4/1,0 mode: --/PR res: [0x200000405:0x19:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.905973:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066600/0x22153cd396b81198 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x19:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0975 expref: 29 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.905991:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066600/0x22153cd396b81198 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x19:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0975 expref: 29 pid: 32404 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826403.906004:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf1366ad00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1874670585219840:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826403.906088:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f67e300 going to sleep for 11 seconds 00000100:00100000:3.0:1787826403.909336:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826403.909437:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563790720 00000100:00100000:2.0:1787826403.909457:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563790720 00010000:00010000:2.0:1787826403.909531:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066600/0x22153cd396b81198 lrc: 5/0,0 mode: CW/CW res: [0x200000405:0x19:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0975 expref: 30 pid: 32404 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826403.909562:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1044 00000100:00100000:2.0:1787826403.909571:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:2404:x1874670563790720:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826403.909586:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826403.909593:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066600/0x22153cd396b81198 lrc: 5/0,0 mode: CW/CW res: [0x200000405:0x19:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0975 expref: 30 pid: 32404 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.909607:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066600/0x22153cd396b81198 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x19:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0975 expref: 30 pid: 32404 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.909632:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff90cf04f8bf00) 00010000:00010000:2.0:1787826403.909637:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b811ad lrc: 3/1,0 mode: --/PR res: [0x200000405:0x19:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.909645:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b811ad lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.909657:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b811ad lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.909674:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826403.909727:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:2404:x1874670563790720:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 157us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826403.909735:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1044 00010000:00010000:0.0:1787826403.910271:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066600/0x22153cd396b81198 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x19:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0975 expref: 29 pid: 32404 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826403.910291:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf1366ad00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1874670585219840:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826403.910311:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b811ad lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.910321:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b811ad lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.910327:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b811ad lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826403.910372:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x19:0x0]: returning size 2147483648 00000004:00200000:0.0:1787826403.910377:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826403.910396:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b811ad lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.910426:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b811a6 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab097c expref: 29 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.910453:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b811ad lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab097c expref: 28 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.910462:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff90cf04f8bf00) 00010000:00010000:0.0:1787826403.910465:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826403.910468:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165fe00, rc 0) 00000100:00100000:0.0:1787826403.910557:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+28:54857:x1874670563790592:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 4798us (4977us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826403.910565:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3589 00000100:00100000:3.0:1787826403.915021:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826403.915514:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563790976 00000100:00100000:2.0:1787826403.915525:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563790976 00000100:00100000:2.0:1787826403.915587:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3590 00000100:00100000:2.0:1787826403.915597:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+28:54857:x1874670563790976:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826403.915616:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826403.915637:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b811b4 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x19:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0983 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.915746:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b811bb lrc: 3/0,1 mode: --/PW res: [0x200000405:0x19:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.915760:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b811bb lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x19:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.915772:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b811bb lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x19:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826403.915785:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x19:0x0]: returning size 2147483648 00010000:00010000:2.0:1787826403.915887:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b811b4 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x19:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0983 expref: 31 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.915904:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b811bb lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x19:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0983 expref: 30 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.915914:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff90cf04f8bf00) 00010000:00010000:2.0:1787826403.915917:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787826403.915920:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834800, rc 0) 00000100:00100000:2.0:1787826403.915978:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:54857:x1874670563790976:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 383us (967us total) trans 8589934728 rc 0/0 00000100:00100000:2.0:1787826403.915985:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3590 00000100:00100000:3.0:1787826403.919303:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826403.919387:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563791104 00000100:00100000:0.0:1787826403.919397:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563791104 00000100:00100000:0.0:1787826403.919460:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1981 00000100:00100000:0.0:1787826403.919505:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2404:x1874670563791104:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:0.0:1787826403.919547:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bd432a2/0x22153cd396b811c9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.919566:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004185bcb5/0x22153cd396b81113 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab094b expref: 13 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.919576:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x104:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826403.919580:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x104:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826403.919585:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003bd432a2/0x22153cd396b811c9 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.919616:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004185bcb5/0x22153cd396b81113 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab094b expref: 13 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.919629:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004185bcb5/0x22153cd396b81113 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab094b expref: 13 pid: 8436 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826403.919644:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf1366ad00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1874670585219968:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826403.919712:0:8437:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f67e300 going to sleep for 11 seconds 00000100:00100000:0.0:1787826403.922066:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf1366ad00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1874670585219968:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826403.922095:0:8437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003bd432a2/0x22153cd396b811c9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826403.923793:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826403.924713:0:30176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563791232 00000100:00100000:2.0:1787826403.924721:0:30176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563791232 00002000:00100000:2.0:1787826403.924766:0:30176:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x2c0000401:0x104:0x0] (134217728->134221823) req@ffff90cf361e4000 x1874670563791232/t0(0) o4->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:4/0 lens 4584/0 e 0 to 0 dl 1787826414 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826403.924776:0:30176:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf361e4000 with x1874670563791232 ext(134217728->134221823) 00010000:00010000:2.0:1787826403.924785:0:30176:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004185bcb5/0x22153cd396b81113 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab094b expref: 14 pid: 8436 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.924799:0:30176:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004185bcb5/0x22153cd396b81113 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab094b expref: 14 pid: 8436 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787826403.924807:0:30176:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90cf361e4000 00000100:00100000:2.0:1787826403.924838:0:30176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 24 00000100:00100000:2.0:1787826403.924846:0:30176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563791232:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1787826403.925667:0:30176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2404:x1874670563791232:12345-192.168.203.39@tcp:4:dd.0 Request processed in 817us (1877us total) trans 17179869646 rc 0/0 00000100:00100000:2.0:1787826403.925676:0:30176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 24 00002000:00100000:2.0:1787826403.925684:0:30176:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x2c0000401:0x104:0x0] (134217728->134221823) req@ffff90cf361e4000 x1874670563791232/t17179869646(0) o4->09ed01c7-7b8c-4e06-9d82-a6b70e42014a@192.168.203.39@tcp:4/0 lens 4584/448 e 0 to 0 dl 1787826414 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787826403.925692:0:30176:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf361e4000 with x1874670563791232 ext(134217728->134221823) 00010000:00010000:2.0:1787826403.925699:0:30176:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004185bcb5/0x22153cd396b81113 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab094b expref: 16 pid: 8436 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826403.925711:0:30176:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004185bcb5/0x22153cd396b81113 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab094b expref: 16 pid: 8436 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787826403.925718:0:30176:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90cf361e4000 00000100:00100000:3.0:1787826403.928829:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826403.928884:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563791360 00000100:00100000:0.0:1787826403.928893:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563791360 00010000:00010000:0.0:1787826403.928928:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004185bcb5/0x22153cd396b81113 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab094b expref: 16 pid: 8436 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826403.928969:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1045 00000100:00100000:0.0:1787826403.928977:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b432580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2402:x1874670563791360:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826403.928990:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787826403.929005:0:10341:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x104:0x0] updating lvb mtime from disk: 1787826403 -> 1787826404 00010000:00010000:0.0:1787826403.929012:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004185bcb5/0x22153cd396b81113 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x104:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab094b expref: 16 pid: 8436 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.929025:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004185bcb5/0x22153cd396b81113 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x104:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab094b expref: 16 pid: 8436 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.929046:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004185bcb5/0x22153cd396b81113 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x104:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab094b expref: 16 pid: 8436 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.929068:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x104:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826403.929072:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x104:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826403.929078:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003bd432a2/0x22153cd396b811c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.929089:0:10341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003bd432a2/0x22153cd396b811c9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.929113:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826403.929721:0:8437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003bd432a2/0x22153cd396b811c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.929735:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003bd432a2/0x22153cd396b811c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.929767:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bd432a2/0x22153cd396b811c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.929776:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003bd432a2/0x22153cd396b811c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.929784:0:8437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003bd432a2/0x22153cd396b811c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.929791:0:8437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165ec00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:1.0:1787826403.929794:0:8437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003bd432a2/0x22153cd396b811c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.929802:0:8437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003bd432a2/0x22153cd396b811c9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.929821:0:8437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003bd432a2/0x22153cd396b811c9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.929829:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003bd432a2/0x22153cd396b811c9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826403.929959:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b432580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2402:x1874670563791360:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 979us (1134us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826403.929969:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1045 00000100:00100000:1.0:1787826403.931604:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563791104:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 12126us (12301us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826403.931618:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1981 00000100:00100000:2.0:1787826403.934873:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826403.934943:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563791616 00000100:00100000:1.0:1787826403.934953:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563791616 00000100:00100000:1.0:1787826403.935012:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3591 00000100:00100000:1.0:1787826403.935022:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03890780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:54857:x1874670563791616:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:1.0:1787826403.935069:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1787826403.935097:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b811ad lrc: 0/0,0 mode: --/PR res: [0x200000405:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab097c expref: 30 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.935118:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81160 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x19:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0960 expref: 29 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.935128:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff90cf04f8bf00) 00010000:00010000:1.0:1787826403.935133:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826403.935161:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067c00/0x22153cd396b811d0 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.935174:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067c00/0x22153cd396b811d0 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x19:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.935184:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067c00/0x22153cd396b811d0 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x19:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787826403.935386:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].22, 88 off10056 00000004:00080000:1.0:1787826403.935394:0:6520:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1349946922142ns, next at 1334727867157ns, rc = 0 00000040:00080000:1.0:1787826403.935448:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].22, 88 off10032 00000004:00080000:1.0:1787826403.935453:0:6520:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1349946981135ns, next at 1334727181995ns, rc = 0 00000001:00080000:1.0:1787826403.937069:0:34481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934729 is committed 00000004:00080000:1.0:1787826403.937080:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 23 committed 00000100:00100000:3.0:1787826403.937279:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787826403.937300:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf1366ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585220096:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787826403.937360:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826403.937460:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585220096 00000100:00100000:0.0:1787826403.937467:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585220096 00000100:00100000:0.0:1787826403.937536:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1982 00000100:00100000:0.0:1787826403.937544:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b430780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:3644:x1874670585220096:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1787826403.937673:0:30694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x104:0x0] updating lvb size from disk: 2147483648 -> 2147483648 00002000:00010000:0.0:1787826403.937677:0:30694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x104:0x0] updating lvb mtime from disk: 1787826403 -> 1787826403 00002000:00010000:0.0:1787826403.937679:0:30694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x104:0x0] updating lvb atime from disk: 1787826403 -> 1787826403 00002000:00010000:0.0:1787826403.937682:0:30694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x104:0x0] updating lvb ctime from disk: 1787826404 -> 1787826404 00002000:00010000:0.0:1787826403.937684:0:30694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x104:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1787826403.937719:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b430780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+8:3644:x1874670585220096:12345-0@lo:2:osp-syn-0-0.0 Request processed in 175us (358us total) trans 21474836985 rc 0/0 00000100:00100000:0.0:1787826403.937726:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1982 00000004:00080000:3.0:1787826403.937867:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf1366ad00/2, rc 0, transno 21474836985 00000100:00100000:3.0:1787826403.937874:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf1366ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585220096:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1787826403.938402:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 22 committed 00000020:00080000:1.0:1787826403.938430:0:34481:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969327 batchid updated 00000004:00010000:1.0:1787826403.938505:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006a6e3580 reply state 0000000046136c48 transno 8589934729 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067c00/0x22153cd396b811d0 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x19:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.938525:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067c00/0x22153cd396b811d0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.938535:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff90cf04f8bf00) 00010000:00010000:1.0:1787826403.938538:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1787826403.938542:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1787826403.938617:0:6520:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1787826403.938633:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03890780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:54857:x1874670563791616:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 3611us (3767us total) trans 8589934729 rc 0/0 00000100:00100000:1.0:1787826403.938640:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3591 00010000:00010000:1.0:1787826403.938664:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067c00/0x22153cd396b811d0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.938673:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067c00/0x22153cd396b811d0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.938684:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067c00/0x22153cd396b811d0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.938690:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0a067c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826403.938694:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067c00/0x22153cd396b811d0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.938702:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067c00/0x22153cd396b811d0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.938713:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff90cf04f8bf00) 00010000:00010000:1.0:1787826403.938715:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826403.938719:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067c00/0x22153cd396b811d0 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.938726:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067c00/0x22153cd396b811d0 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787826403.938946:0:34512:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969327 00000020:00080000:2.0:1787826403.939032:0:34512:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 4294969327 cancel update log [0x200000bd0:0x2:0x0].2: rc = 0 00000020:00080000:2.0:1787826403.939040:0:34512:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969327 00000100:00100000:2.0:1787826403.939426:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787826403.939453:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0b432d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585220224:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787826403.939527:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826403.939668:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585220224 00000100:00100000:3.0:1787826403.939675:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585220224 00000100:00100000:3.0:1787826403.939720:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1983 00000100:00100000:3.0:1787826403.939728:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce038912c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3647:x1874670585220224:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787826403.939872:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce038912c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3647:x1874670585220224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 144us (344us total) trans 17179869647 rc 0/0 00000100:00100000:3.0:1787826403.939879:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1983 00000004:00080000:3.0:1787826403.939916:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce0b432d00/2, rc 0, transno 17179869647 00000100:00100000:3.0:1787826403.939921:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0b432d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585220224:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787826403.942180:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826403.942247:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563791744 00000100:00100000:1.0:1787826403.942255:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563791744 00000100:00100000:1.0:1787826403.942320:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3592 00000100:00100000:1.0:1787826403.942329:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b432940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:54857:x1874670563791744:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826403.942350:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826403.942370:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b811d7 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab098a expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.942422:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b811d7 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab098a expref: 26 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.942578:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b811d7 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab098a expref: 26 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.942600:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff90cf04f8bf00) 00010000:00010000:1.0:1787826403.942603:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826403.942607:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0a066200, rc 0) 00000100:00100000:1.0:1787826403.942663:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b432940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:54857:x1874670563791744:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 334us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826403.942671:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3592 00000100:00100000:3.0:1787826403.945556:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826403.945984:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563791872 00000100:00100000:0.0:1787826403.945994:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563791872 00000100:00100000:0.0:1787826403.946057:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3593 00000100:00100000:0.0:1787826403.946067:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b431a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:54857:x1874670563791872:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826403.946085:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826403.946104:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b811de lrc: 2/0,0 mode: --/CR res: [0x200000405:0x19:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0991 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.946190:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b811e5 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x19:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.946204:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b811e5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.946216:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b811e5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826403.946243:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x19:0x0]: returning size 2147483648 00000004:00200000:0.0:1787826403.946249:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826403.946275:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b811e5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.946301:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b811de lrc: 0/0,0 mode: --/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0991 expref: 28 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.946321:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b811e5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0991 expref: 27 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826403.946329:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff90cf04f8bf00) 00010000:00010000:0.0:1787826403.946331:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826403.946334:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165f600, rc 0) 00000100:00100000:0.0:1787826403.946394:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b431a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:54857:x1874670563791872:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 329us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826403.946401:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3593 00000100:00100000:3.0:1787826403.949976:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826403.950061:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563792000 00000100:00100000:1.0:1787826403.950070:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563792000 00000100:00100000:1.0:1787826403.950131:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1984 00000100:00100000:1.0:1787826403.950141:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b431680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563792000:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826403.950157:0:30398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826403.950177:0:30398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009befb8a5/0x22153cd396b811ec lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x104:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0998 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826403.950202:0:30398:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x104:0x0] initial LVB size: 2147483648, mtime: 0x6a9010e4, atime: 0x6a9010e3, ctime: 0x6a9010e4, blocks: 0x8 00010000:00010000:1.0:1787826403.950223:0:30398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x104:0x0].0x0 since=1349s v=(0 0) 00010000:00010000:1.0:1787826403.950228:0:30398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x104:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826403.950239:0:30398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009befb8a5/0x22153cd396b811ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0998 expref: 15 pid: 30398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.950254:0:30398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009befb8a5/0x22153cd396b811ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0998 expref: 15 pid: 30398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826403.950284:0:30398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0a067400, rc 0) 00000100:00100000:1.0:1787826403.950345:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b431680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2404:x1874670563792000:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 205us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826403.950352:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1984 00000100:00100000:3.0:1787826404.001238:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826404.001352:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563792128 00000100:00100000:1.0:1787826404.001362:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563792128 00000100:00100000:1.0:1787826404.001421:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1985 00000100:00100000:1.0:1787826404.001431:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b4303c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2402:x1874670563792128:12345-192.168.203.39@tcp:23:lfs.0 00000100:00100000:1.0:1787826404.001689:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b4303c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2402:x1874670563792128:12345-192.168.203.39@tcp:23:lfs.0 Request processed in 258us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826404.001697:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1985 00000100:00100000:3.0:1787826404.005015:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826404.005233:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563792256 00000100:00100000:2.0:1787826404.005243:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563792256 00000100:00100000:2.0:1787826404.005311:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1986 00000100:00100000:2.0:1787826404.005320:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b433840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2401:x1874670563792256:12345-192.168.203.39@tcp:23:lfs.0 00000100:00100000:2.0:1787826404.005670:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b433840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2401:x1874670563792256:12345-192.168.203.39@tcp:23:lfs.0 Request processed in 349us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826404.005679:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1986 00000100:00100000:2.0:1787826404.008936:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826404.009030:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563792512 00000100:00100000:0.0:1787826404.009039:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563792512 00000100:00100000:0.0:1787826404.009096:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3594 00000100:00100000:0.0:1787826404.009106:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03890f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:54857:x1874670563792512:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:0.0:1787826404.009159:0:9966:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826404.009188:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b811e5 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0991 expref: 27 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826404.009206:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff90cf04f8bf00) 00010000:00010000:0.0:1787826404.009211:0:9966:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826404.009391:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b811f3 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x19:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826404.009406:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b811f3 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826404.009416:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b811f3 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787826404.009632:0:9966:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934730 00000004:00010000:0.0:1787826404.009655:0:9966:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e218fe32 reply state 00000000077144d7 transno 8589934731 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b811f3 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826404.009669:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b811f3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826404.009675:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff90cf04f8bf00) 00010000:00010000:0.0:1787826404.009678:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826404.009682:0:9966:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787826404.009773:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03890f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+29:54857:x1874670563792512:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 667us (845us total) trans 8589934731 rc 0/0 00000100:00100000:0.0:1787826404.009781:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3594 00000020:00080000:0.0:1787826404.009786:0:9966:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787826404.012685:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826404.012838:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563792640 00000100:00100000:0.0:1787826404.012848:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563792640 00000100:00100000:0.0:1787826404.012902:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1987 00000100:00100000:0.0:1787826404.012912:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b4321c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:54857:x1874670563792640:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826404.012928:0:30694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826404.012946:0:30694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a67399c/0x22153cd396b811fa lrc: 2/0,0 mode: --/PW res: [0x280000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab099f expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826404.012975:0:30694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b49a3b43/0x22153cd396b810f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0944 expref: 8 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826404.012982:0:30694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x104:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787826404.012987:0:30694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x104:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826404.012992:0:30694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a67399c/0x22153cd396b811fa lrc: 4/0,0 mode: --/PW res: [0x280000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab099f expref: 8 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826404.013026:0:30694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b49a3b43/0x22153cd396b810f7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0944 expref: 8 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826404.013039:0:30694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b49a3b43/0x22153cd396b810f7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0944 expref: 8 pid: 28853 timeout: 1450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826404.013059:0:30694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f8761c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:30694:1874670585220352:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826404.013139:0:30694:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f67e300 going to sleep for 11 seconds 00000100:00100000:3.0:1787826404.016414:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826404.016532:0:30694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f8761c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:30694:1874670585220352:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826404.016564:0:30694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005a67399c/0x22153cd396b811fa lrc: 3/0,0 mode: --/PW res: [0x280000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab099f expref: 8 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826404.016584:0:30694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165fc00, rc 0) 00000100:00100000:0.0:1787826404.016641:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b4321c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:54857:x1874670563792640:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 3730us (3965us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826404.016648:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1987 00000100:00100000:1.0:1787826404.016774:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563792768 00000100:00100000:1.0:1787826404.016781:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563792768 00010000:00010000:1.0:1787826404.016814:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b49a3b43/0x22153cd396b810f7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0944 expref: 8 pid: 28853 timeout: 1450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826404.016851:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1046 00000100:00100000:1.0:1787826404.016859:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b433c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2403:x1874670563792768:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826404.016873:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826404.016878:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b49a3b43/0x22153cd396b810f7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x104:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0944 expref: 8 pid: 28853 timeout: 1450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826404.016889:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b49a3b43/0x22153cd396b810f7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x104:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0944 expref: 8 pid: 28853 timeout: 1450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826404.016914:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b49a3b43/0x22153cd396b810f7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x104:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0944 expref: 8 pid: 28853 timeout: 1450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826404.016928:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x104:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826404.016932:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x104:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826404.016939:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005a67399c/0x22153cd396b811fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab099f expref: 7 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826404.016950:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a67399c/0x22153cd396b811fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab099f expref: 7 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826404.016981:0:6503:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005a67399c/0x22153cd396b811fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab099f expref: 7 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826404.016994:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab90b40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6503:1874670585220480:192.168.203.39@tcp:105: 00000100:00100000:1.0:1787826404.017045:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf013f1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826404.020734:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826404.020836:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab90b40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6503:1874670585220480:192.168.203.39@tcp:105: 00010000:00010000:1.0:1787826404.020859:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826404.020922:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b433c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2403:x1874670563792768:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4063us (4515us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826404.020933:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1046 00000100:00100000:3.0:1787826404.021353:0:20692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563792896 00000100:00100000:3.0:1787826404.021361:0:20692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563792896 00002000:00010000:3.0:1787826404.021396:0:20692:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/260 (0->18446744073709551615) 00002000:00100000:3.0:1787826404.021401:0:20692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce03890000 with x1874670563792896 ext(0->18446744073709551615) 00002000:00010000:3.0:1787826404.021411:0:20692:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90ce03890000. 00000100:00100000:3.0:1787826404.021455:0:20692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 753 00000100:00100000:3.0:1787826404.021464:0:20692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03890000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2404:x1874670563792896:12345-192.168.203.39@tcp:10:lfs.0 00002000:00010000:3.0:1787826404.021716:0:20692:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x104:0x0] updating lvb size from disk: 2147483648 -> 0 00002000:00010000:3.0:1787826404.021720:0:20692:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x104:0x0] updating lvb mtime from disk: 1787826403 -> 1787826404 00002000:00010000:3.0:1787826404.021723:0:20692:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x104:0x0] updating lvb atime from disk: 1787826403 -> 1787826403 00002000:00010000:3.0:1787826404.021725:0:20692:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x104:0x0] updating lvb ctime from disk: 1787826404 -> 1787826404 00002000:00010000:3.0:1787826404.021727:0:20692:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x104:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:3.0:1787826404.021765:0:20692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03890000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2404:x1874670563792896:12345-192.168.203.39@tcp:10:lfs.0 Request processed in 302us (1038us total) trans 21474836986 rc 0/0 00000100:00100000:3.0:1787826404.021772:0:20692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 753 00002000:00010000:3.0:1787826404.021775:0:20692:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/260 (0->18446744073709551615) 00002000:00100000:3.0:1787826404.021778:0:20692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce03890000 with x1874670563792896 ext(0->18446744073709551615) 00002000:00010000:3.0:1787826404.021783:0:20692:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90ce03890000. 00000100:00100000:2.0:1787826404.028552:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826404.029058:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563793024 00000100:00100000:1.0:1787826404.029067:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563793024 00000100:00100000:1.0:1787826404.029131:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3595 00000100:00100000:1.0:1787826404.029141:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03891e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+29:54857:x1874670563793024:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826404.029164:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826404.029184:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067c00/0x22153cd396b81201 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x19:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab09a6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826404.029289:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067800/0x22153cd396b81208 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x19:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826404.029305:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067800/0x22153cd396b81208 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826404.029316:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067800/0x22153cd396b81208 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826404.029344:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x19:0x0]: returning size 0 00000004:00200000:1.0:1787826404.029349:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826404.029368:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067800/0x22153cd396b81208 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826404.029392:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067c00/0x22153cd396b81201 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab09a6 expref: 31 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826404.029408:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067800/0x22153cd396b81208 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab09a6 expref: 30 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826404.029416:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff90cf04f8bf00) 00010000:00010000:1.0:1787826404.029419:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826404.029423:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0a067800, rc 0) 00000100:00100000:1.0:1787826404.030044:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03891e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:54857:x1874670563793024:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 901us (1498us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826404.030057:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3595 00000100:00100000:1.0:1787826404.034019:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826404.034107:0:25423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563793152 00000100:00100000:2.0:1787826404.034116:0:25423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563793152 00000100:00100000:2.0:1787826404.034201:0:25423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 754 00000100:00100000:2.0:1787826404.034211:0:25423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab90b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2402:x1874670563793152:12345-192.168.203.39@tcp:3:lfs.0 00010000:00010000:2.0:1787826404.034278:0:25423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c25d1558/0x22153cd396b8120f lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.034294:0:25423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x104:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787826404.034299:0:25423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x104:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826404.034306:0:25423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c25d1558/0x22153cd396b8120f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.034322:0:25423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c25d1558/0x22153cd396b8120f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.035137:0:25423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c25d1558/0x22153cd396b8120f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.035149:0:25423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c25d1558/0x22153cd396b8120f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.035158:0:25423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c25d1558/0x22153cd396b8120f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.035165:0:25423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834200 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826404.035170:0:25423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c25d1558/0x22153cd396b8120f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.035178:0:25423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c25d1558/0x22153cd396b8120f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.035195:0:25423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c25d1558/0x22153cd396b8120f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.035203:0:25423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c25d1558/0x22153cd396b8120f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826404.035288:0:25423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab90b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2402:x1874670563793152:12345-192.168.203.39@tcp:3:lfs.0 Request processed in 1076us (1276us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787826404.035297:0:25423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 754 00000100:00100000:3.0:1787826404.039992:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826404.040071:0:25426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563793280 00000100:00100000:0.0:1787826404.040081:0:25426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563793280 00000100:00100000:0.0:1787826404.040149:0:25426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 755 00000100:00100000:0.0:1787826404.040159:0:25426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b431e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2403:x1874670563793280:12345-192.168.203.39@tcp:4:lfs.0 00010000:00010000:0.0:1787826404.040190:0:25426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002972f1b9/0x22153cd396b81216 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826404.040208:0:25426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005a67399c/0x22153cd396b811fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab099f expref: 8 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826404.040217:0:25426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x104:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826404.040221:0:25426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x104:0x0].0x0 since=0s v=(2 0) 00010000:00010000:0.0:1787826404.040225:0:25426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002972f1b9/0x22153cd396b81216 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x104:0x0].0x0 rrc: 3 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826404.040269:0:25426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005a67399c/0x22153cd396b811fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab099f expref: 8 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826404.040284:0:25426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005a67399c/0x22153cd396b811fa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab099f expref: 8 pid: 30694 timeout: 1450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826404.040298:0:25426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f8761c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0000_UUID:25426:1874670585220608:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826404.040373:0:25426:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f67e300 going to sleep for 11 seconds 00000100:00100000:3.0:1787826404.043301:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826404.043392:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563793408 00000100:00100000:1.0:1787826404.043400:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563793408 00010000:00010000:1.0:1787826404.043450:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005a67399c/0x22153cd396b811fa lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab099f expref: 9 pid: 30694 timeout: 1450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826404.043521:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1047 00000100:00100000:1.0:1787826404.043530:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf185df850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670563793408:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826404.043544:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826404.043564:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005a67399c/0x22153cd396b811fa lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x104:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab099f expref: 9 pid: 30694 timeout: 1450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826404.043578:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005a67399c/0x22153cd396b811fa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x104:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab099f expref: 9 pid: 30694 timeout: 1450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826404.043603:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x104:0x0].0x0 since=0s v=(2 0) 00010000:00010000:1.0:1787826404.043608:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x104:0x0].0x0 since=0s v=(2 0) 00010000:00010000:1.0:1787826404.043614:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002972f1b9/0x22153cd396b81216 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x104:0x0].0x0 rrc: 4 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826404.043625:0:10340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002972f1b9/0x22153cd396b81216 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x104:0x0].0x0 rrc: 4 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826404.043644:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826404.043684:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf185df850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670563793408:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 155us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826404.043692:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1047 00010000:00010000:0.0:1787826404.045143:0:25426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a67399c/0x22153cd396b811fa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab099f expref: 8 pid: 30694 timeout: 1450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826404.045164:0:25426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f8761c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0000_UUID:25426:1874670585220608:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826404.045186:0:25426:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002972f1b9/0x22153cd396b81216 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x104:0x0].0x0 rrc: 2 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826404.045197:0:25426:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002972f1b9/0x22153cd396b81216 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x104:0x0].0x0 rrc: 2 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826404.045204:0:25426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002972f1b9/0x22153cd396b81216 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x104:0x0].0x0 rrc: 2 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787826404.047518:0:26205:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836987 is committed 00000001:00080000:3.0:1787826404.047535:0:26205:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836985 is committed 00002000:00010000:0.0:1787826404.047712:0:25426:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x104:0x0] updating lvb size from disk: 0 -> 134221824 00002000:00010000:0.0:1787826404.047717:0:25426:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x104:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1787826404.047731:0:25426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002972f1b9/0x22153cd396b81216 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x104:0x0].0x0 rrc: 2 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826404.047742:0:25426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002972f1b9/0x22153cd396b81216 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x104:0x0].0x0 rrc: 2 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826404.047749:0:25426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002972f1b9/0x22153cd396b81216 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x104:0x0].0x0 rrc: 2 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826404.047756:0:25426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165ea00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826404.047760:0:25426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002972f1b9/0x22153cd396b81216 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x104:0x0].0x0 rrc: 2 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826404.047768:0:25426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002972f1b9/0x22153cd396b81216 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x104:0x0].0x0 rrc: 2 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826404.047787:0:25426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002972f1b9/0x22153cd396b81216 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x104:0x0].0x0 rrc: 2 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826404.047794:0:25426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002972f1b9/0x22153cd396b81216 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x104:0x0].0x0 rrc: 2 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826404.047886:0:25426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b431e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+5:2403:x1874670563793280:12345-192.168.203.39@tcp:4:lfs.0 Request processed in 7725us (7900us total) trans 21474836987 rc 0/0 00000100:00100000:0.0:1787826404.047896:0:25426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 755 00000100:00100000:3.0:1787826404.051127:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826404.051351:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563793536 00000100:00100000:0.0:1787826404.051361:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563793536 00000100:00100000:0.0:1787826404.051461:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1988 00000100:00100000:0.0:1787826404.051490:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b430b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2403:x1874670563793536:12345-192.168.203.39@tcp:23:lfs.0 00000100:00100000:0.0:1787826404.051629:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b430b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2403:x1874670563793536:12345-192.168.203.39@tcp:23:lfs.0 Request processed in 160us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826404.051637:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1988 00000100:00100000:3.0:1787826404.054940:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826404.055186:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563793792 00000100:00100000:2.0:1787826404.055195:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563793792 00000100:00100000:2.0:1787826404.055256:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3596 00000100:00100000:2.0:1787826404.055277:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b433480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:54857:x1874670563793792:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:2.0:1787826404.055327:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826404.055353:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067800/0x22153cd396b81208 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab09a6 expref: 30 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.055371:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff90cf04f8bf00) 00010000:00010000:2.0:1787826404.055376:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826404.055588:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834200/0x22153cd396b8121d lrc: 3/0,1 mode: --/PW res: [0x200000405:0x19:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.055607:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834200/0x22153cd396b8121d lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.055618:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834200/0x22153cd396b8121d lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787826404.055661:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934732 00000004:00010000:2.0:1787826404.055684:0:6518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e4582508 reply state 000000007c711f54 transno 8589934733 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834200/0x22153cd396b8121d lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.055696:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834200/0x22153cd396b8121d lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.055703:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff90cf04f8bf00) 00010000:00010000:2.0:1787826404.055706:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826404.055709:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826404.056064:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b433480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+32:54857:x1874670563793792:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 788us (1130us total) trans 8589934733 rc 0/0 00000100:00100000:2.0:1787826404.056073:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3596 00000020:00080000:2.0:1787826404.056078:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787826404.058416:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826404.058558:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563793920 00000100:00100000:1.0:1787826404.058567:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563793920 00000100:00100000:1.0:1787826404.058623:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1989 00000100:00100000:1.0:1787826404.058631:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b4330c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+5:54857:x1874670563793920:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826404.058646:0:30398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826404.058667:0:30398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c2ebfbb/0x22153cd396b81224 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x104:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab09ad expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826404.058692:0:30398:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x104:0x0] initial LVB size: 134221824, mtime: 0x6a9010e4, atime: 0x6a9010e3, ctime: 0x6a9010e4, blocks: 0x8 00010000:00010000:1.0:1787826404.058713:0:30398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x104:0x0].0x0 since=1350s v=(0 0) 00010000:00010000:1.0:1787826404.058718:0:30398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x104:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826404.058726:0:30398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c2ebfbb/0x22153cd396b81224 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab09ad expref: 6 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826404.058742:0:30398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007c2ebfbb/0x22153cd396b81224 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab09ad expref: 6 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826404.058754:0:30398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0a066600, rc 0) 00000100:00100000:1.0:1787826404.058817:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b4330c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+6:54857:x1874670563793920:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 187us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826404.058824:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1989 00000100:00100000:3.0:1787826404.063675:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826404.063764:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563794048 00000100:00100000:0.0:1787826404.063773:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563794048 00002000:00010000:0.0:1787826404.063808:0:8442:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/260 (134221824->18446744073709551615) 00002000:00100000:0.0:1787826404.063813:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce0b430000 with x1874670563794048 ext(134221824->18446744073709551615) 00002000:00010000:0.0:1787826404.063824:0:8442:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90ce0b430000. 00000100:00100000:0.0:1787826404.063855:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 756 00000100:00100000:0.0:1787826404.063862:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b430000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+6:2404:x1874670563794048:12345-192.168.203.39@tcp:10:lfs.0 00002000:00010000:0.0:1787826404.063987:0:8442:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x104:0x0] updating lvb size from disk: 134221824 -> 134221824 00002000:00010000:0.0:1787826404.063991:0:8442:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x104:0x0] updating lvb mtime from disk: 1787826404 -> 1787826404 00002000:00010000:0.0:1787826404.063993:0:8442:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x104:0x0] updating lvb atime from disk: 1787826403 -> 1787826403 00002000:00010000:0.0:1787826404.063996:0:8442:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x104:0x0] updating lvb ctime from disk: 1787826404 -> 1787826404 00002000:00010000:0.0:1787826404.063999:0:8442:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x104:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1787826404.064061:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b430000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2404:x1874670563794048:12345-192.168.203.39@tcp:10:lfs.0 Request processed in 199us (394us total) trans 21474836988 rc 0/0 00000100:00100000:0.0:1787826404.064069:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 756 00002000:00010000:0.0:1787826404.064072:0:8442:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/260 (134221824->18446744073709551615) 00002000:00100000:0.0:1787826404.064075:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90ce0b430000 with x1874670563794048 ext(134221824->18446744073709551615) 00002000:00010000:0.0:1787826404.064079:0:8442:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90ce0b430000. 00000100:00100000:3.0:1787826404.067113:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826404.067209:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563794176 00000100:00100000:2.0:1787826404.067218:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563794176 00000100:00100000:2.0:1787826404.067284:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3597 00000100:00100000:2.0:1787826404.067294:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b432580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+32:54857:x1874670563794176:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826404.067314:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826404.067334:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b8122b lrc: 2/0,0 mode: --/CR res: [0x200000405:0x19:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab09b4 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.067419:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81232 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x19:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.067434:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81232 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.067460:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81232 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826404.067524:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x19:0x0]: returning size 134221824 00000004:00200000:2.0:1787826404.067529:0:16564:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826404.067547:0:16564:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81232 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.067574:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b8122b lrc: 0/0,0 mode: --/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab09b4 expref: 34 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.067589:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81232 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab09b4 expref: 33 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.067599:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff90cf04f8bf00) 00010000:00010000:2.0:1787826404.067601:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826404.067604:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834a00, rc 0) 00000100:00100000:2.0:1787826404.067662:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b432580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:54857:x1874670563794176:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 370us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826404.067669:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3597 00000100:00100000:3.0:1787826404.070579:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826404.070860:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563794432 00000100:00100000:2.0:1787826404.070868:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563794432 00000100:00100000:2.0:1787826404.070958:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3598 00000100:00100000:2.0:1787826404.070967:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b433c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:54857:x1874670563794432:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:2.0:1787826404.071012:0:8247:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826404.071038:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81232 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab09b4 expref: 33 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.071056:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff90cf04f8bf00) 00010000:00010000:2.0:1787826404.071060:0:8247:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826404.071195:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b81239 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x19:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.071207:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b81239 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.071216:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b81239 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787826404.071250:0:8247:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934734 00000004:00010000:2.0:1787826404.071279:0:8247:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ed2b6377 reply state 00000000a7a42599 transno 8589934735 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b81239 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.071290:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b81239 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.071297:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff90cf04f8bf00) 00010000:00010000:2.0:1787826404.071300:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826404.071302:0:8247:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826404.071374:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b433c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:54857:x1874670563794432:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 408us (804us total) trans 8589934735 rc 0/0 00000100:00100000:2.0:1787826404.071381:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3598 00000020:00080000:2.0:1787826404.071386:0:8247:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787826404.073655:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826404.073852:0:30172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563794560 00000100:00100000:0.0:1787826404.073860:0:30172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563794560 00002000:00010000:0.0:1787826404.073898:0:30172:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/260 (2147483648->18446744073709551615) 00002000:00100000:0.0:1787826404.073903:0:30172:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf136cc780 with x1874670563794560 ext(2147483648->18446744073709551615) 00002000:00010000:0.0:1787826404.073915:0:30172:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf136cc780. 00000100:00100000:0.0:1787826404.073951:0:30172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 757 00000100:00100000:0.0:1787826404.073960:0:30172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136cc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2403:x1874670563794560:12345-192.168.203.39@tcp:10:lfs.0 00002000:00010000:0.0:1787826404.074127:0:30172:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x104:0x0] updating lvb size from disk: 134221824 -> 2147483648 00002000:00010000:0.0:1787826404.074131:0:30172:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x104:0x0] updating lvb mtime from disk: 1787826404 -> 1787826404 00002000:00010000:0.0:1787826404.074133:0:30172:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x104:0x0] updating lvb atime from disk: 1787826403 -> 1787826403 00002000:00010000:0.0:1787826404.074136:0:30172:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x104:0x0] updating lvb ctime from disk: 1787826404 -> 1787826404 00002000:00010000:0.0:1787826404.074139:0:30172:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x104:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1787826404.074187:0:30172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136cc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2403:x1874670563794560:12345-192.168.203.39@tcp:10:lfs.0 Request processed in 228us (537us total) trans 21474836989 rc 0/0 00000100:00100000:0.0:1787826404.074195:0:30172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 757 00002000:00010000:0.0:1787826404.074198:0:30172:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/260 (2147483648->18446744073709551615) 00002000:00100000:0.0:1787826404.074201:0:30172:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf136cc780 with x1874670563794560 ext(2147483648->18446744073709551615) 00002000:00010000:0.0:1787826404.074205:0:30172:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf136cc780. 00000100:00100000:3.0:1787826404.088198:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826404.088294:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563794688 00000100:00100000:1.0:1787826404.088304:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563794688 00000100:00100000:1.0:1787826404.088360:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3599 00000100:00100000:1.0:1787826404.088370:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136ccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:54857:x1874670563794688:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826404.088395:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826404.088416:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067e00/0x22153cd396b81240 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x19:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab09bb expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826404.088538:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066800/0x22153cd396b81247 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x19:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826404.088553:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066800/0x22153cd396b81247 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826404.088566:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066800/0x22153cd396b81247 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826404.088591:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x19:0x0]: returning size 2147483648 00000004:00200000:1.0:1787826404.088595:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826404.088611:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066800/0x22153cd396b81247 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826404.088638:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067e00/0x22153cd396b81240 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab09bb expref: 37 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826404.088656:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066800/0x22153cd396b81247 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab09bb expref: 36 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826404.088664:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff90cf04f8bf00) 00010000:00010000:1.0:1787826404.088666:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826404.088670:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0a066800, rc 0) 00000100:00100000:1.0:1787826404.088728:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136ccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:54857:x1874670563794688:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 359us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826404.088736:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3599 00000100:00100000:3.0:1787826404.091868:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826404.091962:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563794944 00000100:00100000:2.0:1787826404.091972:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563794944 00000100:00100000:2.0:1787826404.092030:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3600 00000100:00100000:2.0:1787826404.092040:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136ce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:54857:x1874670563794944:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:2.0:1787826404.092092:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826404.092119:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066800/0x22153cd396b81247 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab09bb expref: 36 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.092139:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff90cf04f8bf00) 00010000:00010000:2.0:1787826404.092144:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826404.092312:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b8124e lrc: 3/0,1 mode: --/PW res: [0x200000405:0x19:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.092326:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b8124e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.092336:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b8124e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787826404.092380:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934736 00000004:00010000:2.0:1787826404.092402:0:6518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f8e53cc5 reply state 0000000038aea868 transno 8589934737 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b8124e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.092414:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b8124e lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.092420:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff90cf04f8bf00) 00010000:00010000:2.0:1787826404.092422:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826404.092425:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826404.092562:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136ce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:54857:x1874670563794944:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 524us (703us total) trans 8589934737 rc 0/0 00000100:00100000:2.0:1787826404.092569:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3600 00000020:00080000:2.0:1787826404.092574:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787826404.094905:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826404.094975:0:30173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563795072 00000100:00100000:2.0:1787826404.094983:0:30173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563795072 00002000:00010000:2.0:1787826404.095015:0:30173:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/260 (2147483648->18446744073709551615) 00002000:00100000:2.0:1787826404.095019:0:30173:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf136cf0c0 with x1874670563795072 ext(2147483648->18446744073709551615) 00002000:00010000:2.0:1787826404.095031:0:30173:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf136cf0c0. 00000100:00100000:2.0:1787826404.095064:0:30173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 758 00000100:00100000:2.0:1787826404.095073:0:30173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2402:x1874670563795072:12345-192.168.203.39@tcp:10:lfs.0 00002000:00010000:2.0:1787826404.095184:0:30173:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x104:0x0] updating lvb size from disk: 2147483648 -> 2147483648 00002000:00010000:2.0:1787826404.095187:0:30173:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x104:0x0] updating lvb mtime from disk: 1787826404 -> 1787826404 00002000:00010000:2.0:1787826404.095190:0:30173:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x104:0x0] updating lvb atime from disk: 1787826403 -> 1787826403 00002000:00010000:2.0:1787826404.095192:0:30173:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x104:0x0] updating lvb ctime from disk: 1787826404 -> 1787826404 00002000:00010000:2.0:1787826404.095194:0:30173:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x104:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1787826404.095248:0:30173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2402:x1874670563795072:12345-192.168.203.39@tcp:10:lfs.0 Request processed in 176us (350us total) trans 21474836990 rc 0/0 00000100:00100000:2.0:1787826404.095254:0:30173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 758 00002000:00010000:2.0:1787826404.095258:0:30173:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/260 (2147483648->18446744073709551615) 00002000:00100000:2.0:1787826404.095270:0:30173:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf136cf0c0 with x1874670563795072 ext(2147483648->18446744073709551615) 00002000:00010000:2.0:1787826404.095274:0:30173:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf136cf0c0. 00000100:00100000:1.0:1787826404.097703:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826404.097804:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563795328 00000100:00100000:2.0:1787826404.097814:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563795328 00000100:00100000:2.0:1787826404.097872:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3601 00000100:00100000:2.0:1787826404.097881:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:54857:x1874670563795328:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:2.0:1787826404.097980:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81255 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x19:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.097997:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81255 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.098013:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81255 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826404.098107:0:9966:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007530fce8 reply state 0000000067bb9bec transno 8589934738 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81255 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.098119:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81255 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.098126:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff90cf04f8bf00) 00010000:00010000:2.0:1787826404.098129:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826404.098132:0:9966:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826404.098206:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:54857:x1874670563795328:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 325us (510us total) trans 8589934738 rc 0/0 00000100:00100000:2.0:1787826404.098212:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3601 00000100:00100000:1.0:1787826404.102065:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826404.102136:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563795456 00000100:00100000:2.0:1787826404.102145:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563795456 00000100:00100000:2.0:1787826404.102199:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1990 00000100:00100000:2.0:1787826404.102208:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:54857:x1874670563795456:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826404.102224:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826404.102242:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088c1e0c0/0x22153cd396b8125c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab09c2 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.102283:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009befb8a5/0x22153cd396b811ec lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0998 expref: 16 pid: 30398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.102293:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x104:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826404.102298:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x104:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826404.102303:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088c1e0c0/0x22153cd396b8125c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab09c2 expref: 16 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.102333:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009befb8a5/0x22153cd396b811ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0998 expref: 16 pid: 30398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.102347:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009befb8a5/0x22153cd396b811ec lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0998 expref: 16 pid: 30398 timeout: 1450 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826404.102361:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03892580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1874670585220736:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826404.102452:0:8435:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10b3bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787826404.105664:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826404.105766:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563795584 00000100:00100000:0.0:1787826404.105775:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563795584 00010000:00010000:0.0:1787826404.105814:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009befb8a5/0x22153cd396b811ec lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0998 expref: 17 pid: 30398 timeout: 1450 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826404.105853:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1048 00000100:00100000:0.0:1787826404.105862:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+17:2403:x1874670563795584:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826404.105877:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826404.105898:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009befb8a5/0x22153cd396b811ec lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x104:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0998 expref: 17 pid: 30398 timeout: 1450 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826404.105912:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009befb8a5/0x22153cd396b811ec lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x104:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0998 expref: 17 pid: 30398 timeout: 1450 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826404.105937:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x104:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826404.105941:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x104:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826404.105948:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000088c1e0c0/0x22153cd396b8125c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x104:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab09c2 expref: 17 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826404.105958:0:10341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088c1e0c0/0x22153cd396b8125c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x104:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab09c2 expref: 17 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826404.105993:0:10341:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000088c1e0c0/0x22153cd396b8125c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x104:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab09c2 expref: 17 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826404.106006:0:10341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f8761c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10341:1874670585220864:192.168.203.39@tcp:105: 00000100:00100000:0.0:1787826404.106080:0:10341:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f67e300 going to sleep for 11 seconds 00010000:00010000:2.0:1787826404.106285:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009befb8a5/0x22153cd396b811ec lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x104:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0998 expref: 17 pid: 30398 timeout: 1450 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826404.106300:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03892580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1874670585220736:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826404.106323:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000088c1e0c0/0x22153cd396b8125c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab09c2 expref: 16 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.106334:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835200, rc 0) 00000100:00100000:2.0:1787826404.106363:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:54857:x1874670563795456:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 4156us (4306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826404.106371:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1990 00000100:00100000:0.0:1787826404.109627:0:10341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f8761c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10341:1874670585220864:192.168.203.39@tcp:105: 00010000:00010000:0.0:1787826404.109654:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826404.109704:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2403:x1874670563795584:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3843us (4050us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826404.109714:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1048 00000100:00100000:3.0:1787826404.112278:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826404.112365:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563795712 00000100:00100000:1.0:1787826404.112375:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563795712 00000100:00100000:1.0:1787826404.112429:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1991 00000100:00100000:1.0:1787826404.112616:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136ce580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2403:x1874670563795712:12345-192.168.203.39@tcp:2:lfs.0 00002000:00010000:1.0:1787826404.112770:0:8437:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x104:0x0] updating lvb size from disk: 2147483648 -> 2147483648 00002000:00010000:1.0:1787826404.112774:0:8437:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x104:0x0] updating lvb mtime from disk: 1787826404 -> 1787826404 00002000:00010000:1.0:1787826404.112776:0:8437:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x104:0x0] updating lvb atime from disk: 1787826403 -> 1787826403 00002000:00010000:1.0:1787826404.112779:0:8437:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x104:0x0] updating lvb ctime from disk: 1787826404 -> 1787826404 00002000:00010000:1.0:1787826404.112781:0:8437:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x104:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1787826404.112969:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136ce580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2403:x1874670563795712:12345-192.168.203.39@tcp:2:lfs.0 Request processed in 530us (707us total) trans 17179869648 rc 0/0 00000100:00100000:1.0:1787826404.112977:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1991 00000100:00100000:3.0:1787826404.115712:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826404.115818:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563795968 00000100:00100000:0.0:1787826404.115829:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563795968 00000100:00100000:0.0:1787826404.115888:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1053 00000100:00100000:0.0:1787826404.115898:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136cde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:54857:x1874670563795968:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:0.0:1787826404.115961:0:6522:0:(mdt_open.c:2504:mdt_close_resync_done()) ### [0x200000405:0x19:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b811bb lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x19:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0983 expref: 40 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826404.116010:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81263 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x19:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826404.116022:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b811d7 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab098a expref: 40 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826404.116031:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81263 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x19:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826404.116062:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b811d7 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab098a expref: 40 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826404.116082:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b811d7 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab098a expref: 40 pid: 32404 timeout: 1450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826404.116095:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f8761c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585220992:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826404.116171:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f67e300 going to sleep for 11 seconds 00000100:00100000:3.0:1787826404.119196:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826404.119362:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f8761c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585220992:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826404.119388:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81263 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x19:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826404.119847:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563796096 00000100:00100000:1.0:1787826404.119854:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563796096 00010000:00010000:1.0:1787826404.119891:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b811d7 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab098a expref: 41 pid: 32404 timeout: 1450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826404.119972:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1049 00000100:00100000:1.0:1787826404.119983:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136cfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+41:2403:x1874670563796096:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826404.119998:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826404.120005:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b811d7 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab098a expref: 41 pid: 32404 timeout: 1450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826404.120023:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b811d7 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab098a expref: 41 pid: 32404 timeout: 1450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826404.120045:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b811d7 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x19:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab098a expref: 41 pid: 32404 timeout: 1450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826404.120060:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff90cf04f8bf00) 00010000:00010000:1.0:1787826404.120065:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81263 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x19:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826404.120074:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81263 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x19:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826404.120082:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81263 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x19:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826404.120110:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826404.120161:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136cfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:2403:x1874670563796096:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 180us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826404.120168:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1049 00010000:00010000:0.0:1787826404.120217:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81263 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x19:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826404.120228:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81263 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x19:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787826404.120466:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].23, 88 off10144 00000004:00080000:0.0:1787826404.120507:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1350132034617ns, next at 1334727867157ns, rc = 0 00000040:00080000:0.0:1787826404.120564:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].23, 88 off10120 00000004:00080000:0.0:1787826404.120571:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1350132099589ns, next at 1334727181995ns, rc = 0 00000001:00080000:1.0:1787826404.123767:0:34481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934739 is committed 00000004:00080000:1.0:1787826404.123779:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 24 committed 00000004:00080000:1.0:1787826404.123792:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 23 committed 00000004:00010000:0.0:1787826404.123952:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008c68f735 reply state 000000006711b7e4 transno 8589934739 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81263 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x19:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826404.123975:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81263 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826404.123985:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff90cf04f8bf00) 00010000:00010000:0.0:1787826404.123989:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1787826404.123993:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787826404.123998:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff90cf04f8bf00) 00010000:00010000:0.0:1787826404.124000:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787826404.124008:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b811bb lrc: 0/0,0 mode: --/PW res: [0x200000405:0x19:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0983 expref: 30 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1787826404.124116:0:6522:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1787826404.124129:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136cde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:54857:x1874670563795968:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 8232us (8426us total) trans 8589934739 rc 0/0 00000100:00100000:0.0:1787826404.124138:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1053 00010000:00010000:0.0:1787826404.124165:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81263 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826404.124172:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81263 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826404.124179:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81263 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826404.124185:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165ea00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826404.124190:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81263 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826404.124197:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81263 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826404.124207:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff90cf04f8bf00) 00010000:00010000:0.0:1787826404.124210:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826404.124214:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81263 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826404.124220:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81263 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826404.124379:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787826404.124396:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f8761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585221120:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787826404.124458:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826404.124524:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585221120 00000100:00100000:1.0:1787826404.124529:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585221120 00000100:00100000:1.0:1787826404.124582:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1992 00000100:00100000:1.0:1787826404.124590:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab921c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874670585221120:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787826404.124712:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x104:0x0] updating lvb size from disk: 2147483648 -> 2147483648 00002000:00010000:1.0:1787826404.124716:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x104:0x0] updating lvb mtime from disk: 1787826404 -> 1787826404 00002000:00010000:1.0:1787826404.124719:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x104:0x0] updating lvb atime from disk: 1787826403 -> 1787826403 00002000:00010000:1.0:1787826404.124721:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x104:0x0] updating lvb ctime from disk: 1787826404 -> 1787826404 00002000:00010000:1.0:1787826404.124723:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x104:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1787826404.124767:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab921c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1874670585221120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 166us (298us total) trans 21474836991 rc 0/0 00000100:00100000:1.0:1787826404.124775:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1992 00000100:00080000:1.0:1787826404.124792:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826404.124822:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836985 gen 2 00000004:00080000:1.0:1787826404.124827:0:3646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474836983 committed transno 21474836985 00000004:00080000:1.0:1787826404.124844:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3ab92580, transno 21474836984 00000004:00080000:1.0:1787826404.124851:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf1366ad00, transno 21474836985 00000100:00100000:1.0:1787826404.124858:0:3646:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff90cf3f8761c0 x1874670585221120/t21474836991(21474836991) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1787826420 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1787826404.124868:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3f8761c0/2, rc 0, transno 21474836991 00000100:00100000:1.0:1787826404.124872:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f8761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585221120:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787826404.125971:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf136ced00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585221248:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787826404.126013:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826404.126091:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585221248 00000100:00100000:3.0:1787826404.126096:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585221248 00000100:00100000:3.0:1787826404.126150:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1993 00000100:00100000:3.0:1787826404.126159:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab92580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3644:x1874670585221248:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1787826404.126252:0:14864:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x104:0x0] updating lvb size from disk: 2147483648 -> 2147483648 00002000:00010000:3.0:1787826404.126255:0:14864:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x104:0x0] updating lvb mtime from disk: 1787826404 -> 1787826404 00002000:00010000:3.0:1787826404.126258:0:14864:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x104:0x0] updating lvb atime from disk: 1787826403 -> 1787826403 00002000:00010000:3.0:1787826404.126271:0:14864:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x104:0x0] updating lvb ctime from disk: 1787826404 -> 1787826404 00002000:00010000:3.0:1787826404.126273:0:14864:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x104:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1787826404.126311:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab92580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3644:x1874670585221248:12345-0@lo:2:osp-syn-1-0.0 Request processed in 154us (297us total) trans 17179869649 rc 0/0 00000100:00100000:3.0:1787826404.126317:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1993 00000100:00080000:1.0:1787826404.126373:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1787826404.126400:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf136ced00/2, rc 0, transno 17179869649 00000100:00100000:1.0:1787826404.126405:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf136ced00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585221248:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787826404.129027:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826404.129095:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563796224 00000100:00100000:1.0:1787826404.129103:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563796224 00000100:00100000:1.0:1787826404.129164:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3602 00000100:00100000:1.0:1787826404.129174:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:54857:x1874670563796224:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826404.129197:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826404.129218:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067e00/0x22153cd396b8126a lrc: 2/0,0 mode: --/CR res: [0x200000405:0x19:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab09c9 expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826404.129284:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067e00/0x22153cd396b8126a lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab09c9 expref: 31 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826404.129297:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067e00/0x22153cd396b8126a lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab09c9 expref: 31 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826404.129314:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff90cf04f8bf00) 00010000:00010000:1.0:1787826404.129317:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826404.129321:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0a067e00, rc 0) 00000100:00100000:1.0:1787826404.129376:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:54857:x1874670563796224:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 204us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826404.129383:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3602 00000100:00100000:0.0:1787826404.132734:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826404.132986:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563796480 00000100:00100000:3.0:1787826404.132995:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563796480 00000100:00100000:3.0:1787826404.133046:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1054 00000100:00100000:3.0:1787826404.133055:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf39578850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:54857:x1874670563796480:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:3.0:1787826404.133253:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf39578850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+32:54857:x1874670563796480:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 198us (525us total) trans 8589934740 rc 0/0 00000100:00100000:3.0:1787826404.133269:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1054 00010000:00010000:2.0:1787826404.133520:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b811f3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.133537:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b811f3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.133544:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b811f3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.133551:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165ee00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826404.133555:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b811f3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.133563:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b811f3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.133577:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff90cf04f8bf00) 00010000:00010000:2.0:1787826404.133580:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826404.133584:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b811f3 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.133591:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b811f3 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.133603:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834200/0x22153cd396b8121d lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.133608:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834200/0x22153cd396b8121d lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.133614:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834200/0x22153cd396b8121d lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.133619:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826404.133622:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834200/0x22153cd396b8121d lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.133628:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834200/0x22153cd396b8121d lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.133635:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff90cf04f8bf00) 00010000:00010000:2.0:1787826404.133636:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826404.133639:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834200/0x22153cd396b8121d lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.133644:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834200/0x22153cd396b8121d lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.133653:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b81239 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.133658:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b81239 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.133664:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b81239 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.133668:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826404.133671:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b81239 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.133677:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b81239 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.133683:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff90cf04f8bf00) 00010000:00010000:2.0:1787826404.133685:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826404.133688:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b81239 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.133694:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b81239 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.133703:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b8124e lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.133708:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b8124e lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.133714:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b8124e lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.133718:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826404.133721:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b8124e lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.133727:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b8124e lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.133733:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff90cf04f8bf00) 00010000:00010000:2.0:1787826404.133735:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826404.133737:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b8124e lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.133742:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b8124e lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.133750:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81255 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.133943:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81255 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.133952:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81255 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.133957:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826404.133960:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81255 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.133967:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81255 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.133975:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff90cf04f8bf00) 00010000:00010000:2.0:1787826404.133977:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826404.133980:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81255 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.133986:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81255 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826404.146860:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826404.146987:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563796608 00000100:00100000:2.0:1787826404.146995:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563796608 00000100:00100000:2.0:1787826404.147040:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3603 00000100:00100000:2.0:1787826404.147048:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049ba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:54858:x1874670563796608:12345-192.168.203.39@tcp:101:stat.0 00010000:00010000:2.0:1787826404.147071:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826404.147090:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81271 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x18:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab09d0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.147146:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81278 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.147158:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81278 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.147170:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81278 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.147182:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8127f lrc: 3/1,0 mode: --/PR res: [0x200000405:0x18:0x0].0x919060dd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.147188:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8127f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x18:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.147194:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8127f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x18:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.147271:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834200/0x22153cd396b81286 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.147279:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834200/0x22153cd396b81286 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.147285:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834200/0x22153cd396b81286 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826404.147323:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x19:0x0]: returning size 2147483648 00000004:00200000:2.0:1787826404.147327:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826404.147346:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834200/0x22153cd396b81286 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.147357:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834200/0x22153cd396b81286 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.147367:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81278 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.147377:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81278 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.147383:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81278 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.147389:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81278 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.147394:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826404.147398:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81278 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.147405:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81278 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.147417:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x18:0x0].0x0 (ffff90cf1859a800) 00010000:00010000:2.0:1787826404.147419:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826404.147424:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81278 lrc: 3/0,0 mode: --/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.147429:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81278 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.147457:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8127f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x18:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.147464:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8127f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x18:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.147498:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8127f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x18:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.147504:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826404.147507:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8127f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x18:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.147512:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8127f lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x18:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.147519:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x18:0x0].0x919060dd (ffff90cf1859a900) 00010000:00010000:2.0:1787826404.147522:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826404.147525:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8127f lrc: 2/0,0 mode: --/PR res: [0x200000405:0x18:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.147530:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8127f lrc: 0/0,0 mode: --/PR res: [0x200000405:0x18:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.147561:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81271 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab09d0 expref: 28 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.147574:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834200/0x22153cd396b81286 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab09d0 expref: 27 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826404.147581:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff90cf04f8bf00) 00010000:00010000:2.0:1787826404.147583:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826404.147586:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834200, rc 0) 00000100:00100000:2.0:1787826404.147636:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049ba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:54858:x1874670563796608:12345-192.168.203.39@tcp:101:stat.0 Request processed in 588us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826404.147643:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3603 00010000:00010000:0.0:1787826404.676463:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826405.699593:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826406.732080:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826407.684016:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787826407.684037:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585221504:0@lo:400:kworker.0 00000100:00100000:1.0:1787826407.684101:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826407.684179:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf1366ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874670585221632:0@lo:400:kworker.0 00000100:00100000:1.0:1787826407.684208:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826407.684280:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787826407.684288:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0373c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874670585222016:0@lo:400:kworker.0 00000100:00100000:1.0:1787826407.684311:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826407.684345:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf361e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874670585222144:0@lo:400:kworker.0 00000100:00100000:1.0:1787826407.684367:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826407.684394:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585221632 00000100:00100000:1.0:1787826407.684402:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585221632 00000100:00100000:1.0:1787826407.684454:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585222016 00000100:00100000:1.0:1787826407.684457:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585222016 00000100:00100000:1.0:1787826407.684505:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585222144 00000100:00100000:1.0:1787826407.684507:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585222144 00000100:00100000:1.0:1787826407.684525:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1568 00000100:00100000:1.0:1787826407.684534:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a18780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874670585221632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826407.684584:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a18780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874670585221632:12345-0@lo:400:kworker.0 Request processed in 51us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826407.684591:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1568 00000100:00100000:1.0:1787826407.684606:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1569 00000100:00100000:1.0:1787826407.684611:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874670585222016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826407.684635:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874670585222016:12345-0@lo:400:kworker.0 Request processed in 24us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826407.684640:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1569 00000100:00100000:1.0:1787826407.684649:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1570 00000100:00100000:1.0:1787826407.684654:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874670585222144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826407.684675:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874670585222144:12345-0@lo:400:kworker.0 Request processed in 21us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826407.684680:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1570 00000100:00080000:1.0:1787826407.684698:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787826407.684702:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787826407.684727:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf361e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874670585222144:0@lo:400:kworker.0 00000100:00100000:1.0:1787826407.684737:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0373c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874670585222016:0@lo:400:kworker.0 00000100:00100000:1.0:1787826407.684747:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf1366ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874670585221632:0@lo:400:kworker.0 00000100:00100000:1.0:1787826407.684799:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787826407.684805:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0373c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585222528:0@lo:400:kworker.0 00000100:00100000:1.0:1787826407.684831:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826407.684867:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0300f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585222656:0@lo:400:kworker.0 00000100:00100000:1.0:1787826407.684887:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826407.684912:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585222656 00000100:00100000:1.0:1787826407.684915:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585222656 00000100:00100000:1.0:1787826407.684946:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 928 00000100:00100000:1.0:1787826407.684951:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3647:x1874670585222656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826407.684982:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3647:x1874670585222656:12345-0@lo:400:kworker.0 Request processed in 31us (93us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826407.684988:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 928 00000100:00080000:1.0:1787826407.685003:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826407.685017:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0300f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585222656:0@lo:400:kworker.0 00000100:00100000:3.0:1787826407.685172:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab93840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e3c550b8-2c3c-46c3-ad36-671c284167ea:3645:1874670585221376:0@lo:400:kworker.0 00000100:00100000:3.0:1787826407.685210:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826407.685253:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0373f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585221888:0@lo:400:kworker.0 00000100:00100000:3.0:1787826407.685277:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826407.685303:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf1366ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874670585222400:0@lo:400:kworker.0 00000100:00100000:3.0:1787826407.685325:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826407.685345:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03984000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874670585222912:0@lo:400:kworker.0 00000100:00100000:3.0:1787826407.685364:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826407.685382:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787826407.685389:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0373ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585221760:0@lo:400:kworker.0 00000100:00100000:3.0:1787826407.685410:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826407.685426:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf361e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1874670585222272:0@lo:400:kworker.0 00000100:00100000:3.0:1787826407.685447:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826407.685462:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0300f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585222784:0@lo:400:kworker.0 00000100:00100000:3.0:1787826407.685505:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826407.685529:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585222400 00000100:00100000:3.0:1787826407.685533:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585222400 00000100:00100000:3.0:1787826407.685563:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585222912 00000100:00100000:3.0:1787826407.685565:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585222912 00000100:00100000:3.0:1787826407.685577:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585222272 00000100:00100000:3.0:1787826407.685580:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585222272 00000100:00100000:3.0:1787826407.685595:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1571 00000100:00100000:3.0:1787826407.685601:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874670585222400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826407.685636:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874670585222400:12345-0@lo:400:kworker.0 Request processed in 35us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826407.685642:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1571 00000100:00100000:3.0:1787826407.685656:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1572 00000100:00100000:3.0:1787826407.685662:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874670585222912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826407.685688:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874670585222912:12345-0@lo:400:kworker.0 Request processed in 26us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826407.685694:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1572 00000100:00100000:3.0:1787826407.685705:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1573 00000100:00100000:3.0:1787826407.685710:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05122940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874670585222272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826407.685734:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05122940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874670585222272:12345-0@lo:400:kworker.0 Request processed in 24us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826407.685739:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1573 00000100:00080000:3.0:1787826407.685759:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787826407.685762:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787826407.685781:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf361e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1874670585222272:0@lo:400:kworker.0 00000100:00100000:3.0:1787826407.685790:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf1366ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874670585222400:0@lo:400:kworker.0 00000100:00100000:3.0:1787826407.685798:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03984000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874670585222912:0@lo:400:kworker.0 00000100:00100000:0.0:1787826407.685875:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585221888 00000100:00100000:0.0:1787826407.685880:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585221888 00000100:00100000:0.0:1787826407.685920:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585221760 00000100:00100000:0.0:1787826407.685924:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585221760 00000100:00100000:0.0:1787826407.685941:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585222784 00000100:00100000:0.0:1787826407.685944:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585222784 00000100:00100000:0.0:1787826407.685963:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 929 00000100:00100000:0.0:1787826407.685969:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136cde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3645:x1874670585221888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826407.686006:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136cde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3645:x1874670585221888:12345-0@lo:400:kworker.0 Request processed in 37us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826407.686012:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 929 00000100:00100000:0.0:1787826407.686025:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 930 00000100:00100000:0.0:1787826407.686029:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136d6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3645:x1874670585221760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826407.686053:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136d6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3645:x1874670585221760:12345-0@lo:400:kworker.0 Request processed in 24us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826407.686057:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 930 00000100:00100000:0.0:1787826407.686066:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 931 00000100:00100000:0.0:1787826407.686071:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce051203c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3645:x1874670585222784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826407.686095:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce051203c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3645:x1874670585222784:12345-0@lo:400:kworker.0 Request processed in 23us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826407.686099:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 931 00000100:00100000:1.0:1787826407.689092:0:34488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585221376 00000100:00100000:1.0:1787826407.689104:0:34488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585221376 00000100:00100000:1.0:1787826407.689175:0:34488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787826407.689183:0:34488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1099d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3c550b8-2c3c-46c3-ad36-671c284167ea+24:3645:x1874670585221376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826407.689271:0:34488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1099d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3c550b8-2c3c-46c3-ad36-671c284167ea+24:3645:x1874670585221376:12345-0@lo:400:kworker.0 Request processed in 89us (4061us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826407.689277:0:34488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787826407.689431:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585221504 00000100:00100000:2.0:1787826407.689435:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585221504 00000100:00100000:2.0:1787826407.689466:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585222528 00000100:00100000:2.0:1787826407.689483:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585222528 00000100:00100000:2.0:1787826407.689498:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1411 00000100:00100000:2.0:1787826407.689503:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab90f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3647:x1874670585221504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826407.689546:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab90f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3647:x1874670585221504:12345-0@lo:400:kworker.0 Request processed in 42us (5445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826407.689552:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1411 00000100:00100000:2.0:1787826407.689565:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1412 00000100:00100000:2.0:1787826407.689570:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f937480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874670585222528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826407.689595:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f937480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874670585222528:12345-0@lo:400:kworker.0 Request processed in 25us (4764us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826407.689600:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1412 00000100:00100000:2.0:1787826407.689669:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce038930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585223040:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787826407.689698:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826407.689733:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585223040 00000100:00100000:2.0:1787826407.689736:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585223040 00000100:00100000:2.0:1787826407.689753:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1413 00000100:00100000:2.0:1787826407.689758:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03893840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874670585223040:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787826407.689780:0:7796:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446191104 avail 1299951616 00000100:00100000:2.0:1787826407.689812:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03893840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874670585223040:12345-0@lo:41:osp-pre-1-0.0 Request processed in 54us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826407.689818:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1413 00000100:00100000:2.0:1787826407.689853:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce038930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585223040:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787826407.689880:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0373c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585222528:0@lo:400:kworker.0 00000100:00100000:2.0:1787826407.689892:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585221504:0@lo:400:kworker.0 00000100:00100000:1.0:1787826407.690088:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787826407.690096:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03984780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585223168:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826407.690119:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826407.690144:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585223168 00000100:00100000:1.0:1787826407.690148:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585223168 00000100:00100000:1.0:1787826407.690169:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1414 00000100:00100000:1.0:1787826407.690175:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03984000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3646:x1874670585223168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787826407.690192:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445883904 avail 1299644416 00000100:00100000:1.0:1787826407.690224:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03984000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3646:x1874670585223168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 49us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826407.690230:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1414 00000100:00100000:1.0:1787826407.690267:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03984780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585223168:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1787826407.690385:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787826407.690390:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826407.690423:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0373ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585221760:0@lo:400:kworker.0 00000100:00100000:3.0:1787826407.690439:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0300f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585222784:0@lo:400:kworker.0 00000100:00100000:3.0:1787826407.690449:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab93840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e3c550b8-2c3c-46c3-ad36-671c284167ea:3645:1874670585221376:0@lo:400:kworker.0 00000100:00100000:3.0:1787826407.690460:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0373f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585221888:0@lo:400:kworker.0 00010000:00010000:1.0:1787826407.748784:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826408.196097:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03984780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585223296:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826408.196169:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826408.196274:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585223296 00000100:00100000:1.0:1787826408.196283:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585223296 00000100:00100000:1.0:1787826408.196335:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 774 00000100:00100000:1.0:1787826408.196344:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874670585223296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787826408.196373:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 186235712 pending 0 free 3919187968 avail 3687665664 00000100:00100000:1.0:1787826408.196420:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874670585223296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826408.196427:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 774 00000100:00100000:1.0:1787826408.196488:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03984780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585223296:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826408.196812:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787826408.196822:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce038930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585223424:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787826408.196862:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826408.197177:0:12021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585223424 00000100:00100000:2.0:1787826408.197182:0:12021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585223424 00000100:00100000:2.0:1787826408.197218:0:12021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 775 00000100:00100000:2.0:1787826408.197225:0:12021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049b9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1874670585223424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787826408.197249:0:12021:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 186235712 pending 0 free 3919187968 avail 3687665664 00000100:00100000:2.0:1787826408.197295:0:12021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049b9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1874670585223424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826408.197302:0:12021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 775 00000100:00100000:3.0:1787826408.197484:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce05120000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585223552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787826408.197517:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826408.197550:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585223552 00000100:00100000:0.0:1787826408.197556:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585223552 00000100:00100000:0.0:1787826408.197605:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 776 00000100:00100000:0.0:1787826408.197612:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05121e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3646:x1874670585223552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787826408.197630:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 160066368 pending 57344 free 3920248832 avail 3688726528 00000100:00100000:0.0:1787826408.197661:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05121e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3646:x1874670585223552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826408.197671:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 776 00000100:00100000:3.0:1787826408.197800:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce05120000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585223552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787826408.197901:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03890b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585223680:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826408.197928:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826408.198117:0:12021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585223680 00000100:00100000:0.0:1787826408.198122:0:12021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585223680 00000100:00100000:1.0:1787826408.198131:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce038930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585223424:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787826408.198159:0:12021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 777 00000100:00100000:0.0:1787826408.198168:0:12021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03892580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874670585223680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787826408.198179:0:12021:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 160066368 pending 57344 free 3920248832 avail 3688726528 00000100:00100000:0.0:1787826408.198218:0:12021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03892580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874670585223680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826408.198225:0:12021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 777 00000100:00100000:1.0:1787826408.198444:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03890b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585223680:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826408.602009:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826408.602047:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826408.602080:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826408.602102:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826408.602127:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826408.602157:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563797248 00000100:00100000:1.0:1787826408.602164:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563797248 00000100:00100000:1.0:1787826408.602217:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563797120 00000100:00100000:1.0:1787826408.602220:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563797120 00000100:00100000:1.0:1787826408.602257:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 932 00000100:00100000:1.0:1787826408.602279:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2402:x1874670563797248:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1787826408.602350:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2402:x1874670563797248:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 85us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826408.602358:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 932 00000100:00100000:1.0:1787826408.602375:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 933 00000100:00100000:1.0:1787826408.602381:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecaed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2402:x1874670563797120:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1787826408.602425:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecaed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2402:x1874670563797120:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 44us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826408.602431:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 933 00000100:00100000:3.0:1787826408.602603:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563796992 00000100:00100000:3.0:1787826408.602607:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563796992 00000100:00100000:3.0:1787826408.602648:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563796864 00000100:00100000:3.0:1787826408.602651:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563796864 00000100:00100000:3.0:1787826408.602684:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1574 00000100:00100000:3.0:1787826408.602692:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03984780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:2402:x1874670563796992:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1787826408.602722:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03984780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:2402:x1874670563796992:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 31us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826408.602728:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1574 00000100:00100000:3.0:1787826408.602743:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1575 00000100:00100000:3.0:1787826408.602749:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:2402:x1874670563796864:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1787826408.602775:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:2402:x1874670563796864:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 26us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826408.602781:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1575 00000100:00080000:3.0:1787826408.602800:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787826408.602804:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787826408.602807:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787826408.602808:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826408.603101:0:34487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563796736 00000100:00100000:0.0:1787826408.603106:0:34487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563796736 00000100:00100000:0.0:1787826408.603147:0:34487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 98 00000100:00100000:0.0:1787826408.603155:0:34487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1099cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:307626ff-a376-4faf-93e0-9f55b723d964+10:2402:x1874670563796736:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1787826408.603182:0:34487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1099cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:307626ff-a376-4faf-93e0-9f55b723d964+10:2402:x1874670563796736:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 28us (1184us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826408.603189:0:34487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 98 00000001:00080000:0.0:1787826408.720530:0:27651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179869649 is committed 00000001:00080000:0.0:1787826408.720546:0:27651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179869648 is committed 00010000:00010000:0.0:1787826408.771789:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787826409.735116:0:26205:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836991 is committed 00000001:00080000:1.0:1787826409.735132:0:26205:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836990 is committed 00000001:00080000:0.0:1787826409.736551:0:34481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934740 is committed 00010000:00010000:3.0:1787826409.809451:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826410.819792:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787826411.190670:0:36289:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 60b: mirror merge/split cancel client's in-memory layout gen ========================================================== 06:26:50 (1787826410) 00000100:00100000:1.0:1787826411.326983:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826411.327145:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563797376 00000100:00100000:3.0:1787826411.327154:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563797376 00000100:00100000:3.0:1787826411.327244:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3604 00000100:00100000:3.0:1787826411.327254:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:55438:x1874670563797376:12345-192.168.203.39@tcp:41:stat.0 00000004:00000024:3.0:1787826411.327301:0:32404:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 7839436800 avail 7376334848 00000100:00100000:3.0:1787826411.327363:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:55438:x1874670563797376:12345-192.168.203.39@tcp:41:stat.0 Request processed in 110us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826411.327371:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3604 00000100:00080000:0.0:1787826411.327423:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787826411.378985:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826411.380591:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563797504 00000100:00100000:3.0:1787826411.380601:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563797504 00000100:00100000:3.0:1787826411.380655:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3605 00000100:00100000:3.0:1787826411.380664:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049b92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:55442:x1874670563797504:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826411.380684:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826411.380704:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b8128d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab09d7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.380764:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81294 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.380779:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81294 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.380791:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81294 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.380806:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b8129b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.380812:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b8129b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.380821:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b8129b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.380861:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81294 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.380868:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81294 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.380874:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81294 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.380881:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81294 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.380888:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826411.380893:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81294 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.380900:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81294 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.380912:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ce01f45300) 00010000:00010000:3.0:1787826411.380915:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826411.380919:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81294 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.380926:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81294 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.380938:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b8129b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.380944:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b8129b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.380950:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b8129b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.380954:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826411.380957:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b8129b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.380963:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b8129b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.380970:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe1895f91 (ffff90cf39656000) 00010000:00010000:3.0:1787826411.380972:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826411.380975:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b8129b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.380981:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b8129b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.381014:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b8128d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab09d7 expref: 27 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.381025:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ce01f45300) 00010000:00010000:3.0:1787826411.381027:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826411.381031:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b8128d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab09d7 expref: 27 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.381040:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400800, rc 0) 00000100:00100000:3.0:1787826411.381101:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049b92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:55442:x1874670563797504:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 438us (2125us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826411.381109:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3605 00000100:00100000:1.0:1787826411.405959:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826411.406317:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563797760 00000100:00100000:3.0:1787826411.406327:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563797760 00000100:00100000:3.0:1787826411.406383:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3606 00000100:00100000:3.0:1787826411.406393:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:55442:x1874670563797760:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:3.0:1787826411.406446:0:8247:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826411.406508:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b80fae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab08cd expref: 26 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.406526:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ce01f45300) 00010000:00010000:3.0:1787826411.406531:0:8247:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826411.406587:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b812a2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.406601:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b812a2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.406611:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b812a2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.406625:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b812a9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.406632:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b812a9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.406639:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b812a9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787826411.407928:0:8247:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000bd0:0x2:0x0].3, 2160 off37368 00000040:00080000:3.0:1787826411.408007:0:8247:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000405:0x2:0x0].2, 2360 off37488 00000004:00080000:3.0:1787826411.408014:0:8247:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff90ce04aa5f00 with version 9 00000004:00080000:0.0:1787826411.408083:0:34498:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff90cf39def9c0 version 9 rpc_version 9 00000020:00100000:0.0:1787826411.408116:0:34498:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826411.408126:0:34498:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff90ce049bb0c0 x1874670585223936/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 4224/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826411.408155:0:34498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce049bb0c0 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:34498:1874670585223936:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826411.408222:0:34498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826411.408300:0:34498:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f67e300 going to sleep for 11 seconds 00000100:00100000:2.0:1787826411.408667:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585223936 00000100:00100000:2.0:1787826411.408675:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585223936 00000100:00100000:2.0:1787826411.408749:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1415 00000100:00100000:2.0:1787826411.408758:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049b8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:34498:x1874670585223936:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826411.409207:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049b8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:34498:x1874670585223936:12345-0@lo:1000:osp_up1-0.0 Request processed in 449us (996us total) trans 4294967717 rc 0/0 00000100:00100000:2.0:1787826411.409224:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1415 00000100:00100000:0.0:1787826411.409319:0:34498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce049bb0c0 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:34498:1874670585223936:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1787826411.409527:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b812b0 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.409543:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b812b0 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.409554:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b812b0 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.409571:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b812b7 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.409578:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b812b7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.409584:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b812b7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.409611:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf2f400000/0x22153cd396b812be lrc: 3/0,1 mode: --/PW res: [0x240000405:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.409619:0:8247:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf2f400000/0x22153cd396b812be lrc: 3/0,1 mode: --/PW res: [0x240000405:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.409628:0:8247:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf2f400000/0x22153cd396b812be lrc: 3/0,1 mode: --/PW res: [0x240000405:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826411.409642:0:8247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce05120000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8247:1874670585224064:0@lo:101:mdt00_003.0 00000100:00100000:3.0:1787826411.409673:0:8247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826411.409998:0:8247:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10aba6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826411.410021:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585224064 00000100:00100000:1.0:1787826411.410026:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585224064 00000100:00100000:2.0:1787826411.410067:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1416 00000100:00100000:2.0:1787826411.410075:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05122580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8247:x1874670585224064:12345-0@lo:101:mdt00_003.0 00010000:00010000:2.0:1787826411.410091:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826411.410106:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b812c5 lrc: 2/0,0 mode: --/PW res: [0x240000405:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x22153cd396b812be expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.410125:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b812c5 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x22153cd396b812be expref: 7 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.410138:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b812c5 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x22153cd396b812be expref: 7 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.410145:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x4:0x0].0x0 (ffff90cf1859ac00) 00010000:00010000:2.0:1787826411.410148:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826411.410151:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835000, rc 0) 00000100:00100000:2.0:1787826411.410189:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05122580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:8247:x1874670585224064:12345-0@lo:101:mdt00_003.0 Request processed in 116us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826411.410195:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1416 00000100:00100000:3.0:1787826411.410268:0:8247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce05120000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8247:1874670585224064:0@lo:101:mdt00_003.0 00010000:00010000:3.0:1787826411.410283:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf2f400000/0x22153cd396b812be lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x22153cd396b812c5 expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.410295:0:8247:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf2f400000/0x22153cd396b812be lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x22153cd396b812c5 expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826411.410313:0:8247:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000017ddd17e reply state 0000000080854ff0 transno 8589934741 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b812b7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.410325:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b812b7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.410331:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf39656f00) 00010000:00010000:3.0:1787826411.410334:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826411.410337:0:8247:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787826411.410342:0:8247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf2f400000/0x22153cd396b812be lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x22153cd396b812c5 expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.410349:0:8247:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf2f400000/0x22153cd396b812be lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x22153cd396b812c5 expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787826411.410358:0:8247:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000405:0x4:0x0] 00000004:00010000:3.0:1787826411.410365:0:8247:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000017ddd17e reply state 0000000080854ff0 transno 8589934741 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b812b0 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.410374:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b812b0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.410384:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c:0x0].0x0 (ffff90cf39656800) 00010000:00010000:3.0:1787826411.410386:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826411.410388:0:8247:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:3.0:1787826411.410394:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1c:0x0]: returning size 4096 00010000:00010000:3.0:1787826411.410402:0:8247:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b812a2 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.410407:0:8247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b812a2 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.410414:0:8247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b812a2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.410420:0:8247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b812a2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.410425:0:8247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826411.410430:0:8247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b812a2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.410437:0:8247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b812a2 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.410448:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ce01f45300) 00010000:00010000:3.0:1787826411.410450:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826411.410454:0:8247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b812a2 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.410459:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b812a2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826411.410503:0:8247:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000017ddd17e reply state 0000000080854ff0 transno 8589934741 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b812a9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.410513:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b812a9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.410519:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe1895f91 (ffff90cf39656000) 00010000:00010000:3.0:1787826411.410522:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826411.410524:0:8247:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:3.0:1787826411.410590:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:55442:x1874670563797760:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 4198us (4638us total) trans 8589934741 rc 0/0 00000100:00100000:3.0:1787826411.410597:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3606 00000100:00100000:3.0:1787826411.438429:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826411.438821:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563797888 00000100:00100000:1.0:1787826411.438830:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563797888 00000100:00100000:1.0:1787826411.438890:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3607 00000100:00100000:1.0:1787826411.438902:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:55443:x1874670563797888:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826411.438928:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826411.438948:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067400/0x22153cd396b812cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab09de expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.439007:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067c00/0x22153cd396b812d3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.439019:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067c00/0x22153cd396b812d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.439030:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067c00/0x22153cd396b812d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826411.439073:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787826411.439077:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826411.439095:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067c00/0x22153cd396b812d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.439116:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067400/0x22153cd396b812cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab09de expref: 29 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.439134:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067c00/0x22153cd396b812d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab09de expref: 28 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.439143:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ce01f45300) 00010000:00010000:1.0:1787826411.439147:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787826411.439150:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0a067c00, rc 0) 00000100:00100000:1.0:1787826411.439223:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+28:55443:x1874670563797888:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 324us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826411.439231:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3607 00000100:00100000:0.0:1787826411.445936:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826411.446030:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563798016 00000100:00100000:1.0:1787826411.446040:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563798016 00000100:00100000:1.0:1787826411.446099:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3608 00000100:00100000:1.0:1787826411.446109:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049b9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+28:55443:x1874670563798016:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826411.446128:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826411.446147:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067400/0x22153cd396b812da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab09e5 expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.446206:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b812e1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.446230:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b812e1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.446242:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b812e1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.446256:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067800/0x22153cd396b812e8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.446264:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067800/0x22153cd396b812e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.446271:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067800/0x22153cd396b812e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.446349:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066800/0x22153cd396b812ef lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.446359:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066800/0x22153cd396b812ef lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.446371:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066800/0x22153cd396b812ef lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826411.446463:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1c:0x0]: returning size 4096 00000004:00200000:1.0:1787826411.446468:0:9966:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:1.0:1787826411.446521:0:9966:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066800/0x22153cd396b812ef lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.446534:0:9966:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b812e1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.446542:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b812e1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.446549:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b812e1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.446556:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b812e1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.446563:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0a066200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826411.446567:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b812e1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.446575:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b812e1 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.446588:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ce01f45300) 00010000:00010000:1.0:1787826411.446592:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826411.446596:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b812e1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.446608:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b812e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.446622:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067800/0x22153cd396b812e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.446627:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067800/0x22153cd396b812e8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.446633:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067800/0x22153cd396b812e8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.446637:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0a067800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826411.446640:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067800/0x22153cd396b812e8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.446645:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067800/0x22153cd396b812e8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.446652:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe1895f91 (ffff90cf39656000) 00010000:00010000:1.0:1787826411.446654:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826411.446657:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067800/0x22153cd396b812e8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.446663:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067800/0x22153cd396b812e8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.446687:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067400/0x22153cd396b812da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab09e5 expref: 30 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.446700:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066800/0x22153cd396b812ef lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1c:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab09e5 expref: 29 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.446708:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c:0x0].0x0 (ffff90cf39656800) 00010000:00010000:1.0:1787826411.446710:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787826411.446718:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0a066800, rc 0) 00000100:00100000:1.0:1787826411.446773:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049b9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+29:55443:x1874670563798016:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 664us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826411.446781:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3608 00000100:00100000:2.0:1787826411.450504:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826411.450584:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563798144 00000100:00100000:3.0:1787826411.450593:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563798144 00000100:00100000:3.0:1787826411.450649:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3609 00000100:00100000:3.0:1787826411.450659:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce038930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+29:55443:x1874670563798144:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826411.450677:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826411.450696:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b812f6 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab09ec expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.450749:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b812fd lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.450763:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b812fd lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.450773:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b812fd lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826411.450816:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd0:0x4:0x0]: returning size 4096 00000004:00200000:3.0:1787826411.450821:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1787826411.450854:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b812f6 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab09ec expref: 31 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.450871:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b812fd lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab09ec expref: 30 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.450879:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf39656f00) 00010000:00010000:3.0:1787826411.450882:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787826411.450886:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400400, rc 0) 00000100:00100000:3.0:1787826411.450941:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce038930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:55443:x1874670563798144:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 283us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826411.450948:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3609 00000100:00100000:0.0:1787826411.453830:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826411.453901:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563798272 00000100:00100000:3.0:1787826411.453910:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563798272 00000100:00100000:3.0:1787826411.453979:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3610 00000100:00100000:3.0:1787826411.453990:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:55443:x1874670563798272:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826411.454009:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826411.454029:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b81304 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab09f3 expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.454105:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400a00/0x22153cd396b8130b lrc: 3/1,0 mode: --/PR res: [0x240000405:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.454120:0:8247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b812c5 lrc: 2/0,0 mode: PW/PW res: [0x240000405:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x22153cd396b812be expref: 6 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.454128:0:8247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400a00/0x22153cd396b8130b lrc: 4/1,0 mode: --/PR res: [0x240000405:0x4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.454160:0:8247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b812c5 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x22153cd396b812be expref: 6 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826411.454175:0:8247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0300f840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8247:1874670585224192:0@lo:104: 00000100:00100000:3.0:1787826411.454231:0:8247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826411.454281:0:8247:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10aba6c0 going to sleep for 11 seconds 00000100:00080000:0.0:1787826411.454373:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787826411.454439:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585224192 00000100:00100000:2.0:1787826411.454444:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585224192 00000100:00100000:2.0:1787826411.454511:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787826411.454519:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1366ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:8247:x1874670585224192:12345-0@lo:104: 00010000:00010000:2.0:1787826411.454530:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf2f400000/0x22153cd396b812be lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x22153cd396b812c5 expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.454582:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787826411.454587:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1366ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:8247:x1874670585224192:12345-0@lo:104: Request processed in 70us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826411.454593:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00010000:00010000:0.0:1787826411.454683:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826411.454691:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf2f400000/0x22153cd396b812be lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x22153cd396b812c5 expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.454700:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400000 already unused, calling callback (ffffffffc18ffee0) 00010000:00010000:0.0:1787826411.454706:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf2f400000/0x22153cd396b812be lrc: 4/0,0 mode: PW/PW res: [0x240000405:0x4:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x22153cd396b812c5 expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826411.454715:0:6507:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf2f400000/0x22153cd396b812be lrc: 4/0,0 mode: PW/PW res: [0x240000405:0x4:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x22153cd396b812c5 expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.454745:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf2f400000/0x22153cd396b812be lrc: 2/0,0 mode: --/PW res: [0x240000405:0x4:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x22153cd396b812c5 expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.454752:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787826411.454791:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf2f400000/0x22153cd396b812be lrc: 1/0,0 mode: --/PW res: [0x240000405:0x4:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x22153cd396b812c5 expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.454799:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff90cf2f400000/0x22153cd396b812be lrc: 0/0,0 mode: --/PW res: [0x240000405:0x4:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x22153cd396b812c5 expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.454826:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826411.454828:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826411.454830:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826411.455006:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce049b9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585224320:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826411.455039:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826411.455232:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585224320 00000100:00100000:0.0:1787826411.455236:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585224320 00010000:00010000:0.0:1787826411.455257:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b812c5 lrc: 4/0,0 mode: PW/PW res: [0x240000405:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x22153cd396b812be expref: 7 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826411.455287:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1050 00000100:00100000:0.0:1787826411.455294:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+7:3644:x1874670585224320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787826411.455303:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787826411.456222:0:8247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0300f840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8247:1874670585224192:0@lo:104: 00010000:00010000:3.0:1787826411.456248:0:8247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400a00/0x22153cd396b8130b lrc: 3/1,0 mode: --/PR res: [0x240000405:0x4:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787826411.457614:0:7449:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967717 is committed 00010000:00010000:0.0:1787826411.457710:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b812c5 lrc: 0/0,0 mode: --/PW res: [0x240000405:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x22153cd396b812be expref: 6 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.457726:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x4:0x0].0x0 (ffff90cf1859ac00) 00010000:00010000:0.0:1787826411.457732:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400a00/0x22153cd396b8130b lrc: 3/1,0 mode: --/PR res: [0x240000405:0x4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.457741:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400a00/0x22153cd396b8130b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.457749:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400a00/0x22153cd396b8130b lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.457780:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826411.457910:0:8247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400a00/0x22153cd396b8130b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.457918:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400a00/0x22153cd396b8130b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826411.457971:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x4:0x0]: returning size 4096 00000004:00200000:3.0:1787826411.457976:0:8247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1787826411.458017:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b81304 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab09f3 expref: 28 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.458032:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400a00/0x22153cd396b8130b lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab09f3 expref: 27 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.458039:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x4:0x0].0x0 (ffff90cf1859ac00) 00010000:00010000:3.0:1787826411.458041:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787826411.458044:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400a00, rc 0) 00000100:00100000:3.0:1787826411.458094:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:55443:x1874670563798272:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 4105us (4273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826411.458103:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3610 00000100:00100000:0.0:1787826411.458161:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874670585224320:12345-0@lo:103:ldlm_bl.0 Request processed in 2867us (3121us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826411.458170:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1050 00000100:00100000:0.0:1787826411.461157:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826411.461230:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563798400 00000100:00100000:3.0:1787826411.461239:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563798400 00000100:00100000:3.0:1787826411.461297:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3611 00000100:00100000:3.0:1787826411.461308:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049b8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:55443:x1874670563798400:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826411.461326:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826411.461346:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b81312 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab09fa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.461421:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b81319 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.461434:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b81319 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.461445:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b81319 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.461460:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b81320 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.461466:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b81320 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.461503:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b81320 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.461562:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b81319 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.461575:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b81319 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.461582:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b81319 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.461589:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826411.461593:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b81319 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.461601:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b81319 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.461613:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf39656f00) 00010000:00010000:3.0:1787826411.461616:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826411.461621:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b81319 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.461628:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b81319 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.461640:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b81320 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.461646:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b81320 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.461653:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b81320 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.461658:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826411.461662:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b81320 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.461667:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b81320 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.461674:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf39656c00) 00010000:00010000:3.0:1787826411.461676:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826411.461679:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b81320 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.461685:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b81320 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.461715:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b81312 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab09fa expref: 31 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.461725:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf39656f00) 00010000:00010000:3.0:1787826411.461728:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826411.461732:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b81312 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab09fa expref: 31 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.461740:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400800, rc 0) 00000100:00100000:3.0:1787826411.461786:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049b8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:55443:x1874670563798400:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 481us (639us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826411.461793:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3611 00000100:00100000:1.0:1787826411.462638:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce049b9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585224320:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787826411.466420:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826411.466615:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563798656 00000100:00100000:3.0:1787826411.466625:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563798656 00000100:00100000:3.0:1787826411.466688:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3612 00000100:00100000:3.0:1787826411.466698:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03890b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:55443:x1874670563798656:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826411.466717:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826411.466720:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787826411.466747:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b812fd lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab09ec expref: 30 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.466780:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf39656f00) 00010000:00010000:3.0:1787826411.466786:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826411.466799:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b81327 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0a01 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.466912:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b8132e lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.466926:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b8132e lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.466935:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b8132e lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.466949:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b81335 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.466955:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b81335 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.466962:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b81335 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.467326:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b8133c lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.467341:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b8133c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.467348:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b8133c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826411.467358:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:3.0:1787826411.467382:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b8132e lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.467390:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b8132e lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.467409:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b8132e lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.467416:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b8132e lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.467422:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826411.467426:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b8132e lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.467435:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b8132e lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.467444:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf39656f00) 00010000:00010000:3.0:1787826411.467447:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826411.467450:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b8132e lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.467458:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b8132e lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826411.467497:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d31ada05 reply state 00000000c9f3300f transno 8589934742 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b81335 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.467508:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b81335 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.467515:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf39656100) 00010000:00010000:3.0:1787826411.467517:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826411.467519:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787826411.467545:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b81327 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a01 expref: 32 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.467558:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b8133c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a01 expref: 31 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.467565:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656300) 00010000:00010000:3.0:1787826411.467566:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826411.467568:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401000, rc 0) 00000100:00100000:3.0:1787826411.467624:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03890b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+32:55443:x1874670563798656:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 928us (1216us total) trans 8589934742 rc 0/0 00000100:00100000:3.0:1787826411.467632:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3612 00000100:00100000:0.0:1787826411.479294:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826411.479523:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563798912 00000100:00100000:2.0:1787826411.479532:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563798912 00000100:00100000:2.0:1787826411.479644:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3613 00000100:00100000:2.0:1787826411.479655:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049bb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+32:55443:x1874670563798912:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826411.479681:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826411.479730:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8134a lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0a08 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.479841:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81351 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.479856:0:16564:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b8133c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a01 expref: 33 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.479864:0:16564:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81351 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.479897:0:16564:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b8133c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a01 expref: 33 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.479910:0:16564:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b8133c lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a01 expref: 33 pid: 6519 timeout: 1457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826411.479924:0:16564:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab93840 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:16564:1874670585224448:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826411.480007:0:16564:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a2dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826411.483956:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826411.484018:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563799040 00000100:00100000:3.0:1787826411.484026:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563799040 00010000:00010000:3.0:1787826411.484066:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b8133c lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a01 expref: 34 pid: 6519 timeout: 1457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826411.484106:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1051 00000100:00100000:3.0:1787826411.484115:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:2404:x1874670563799040:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826411.484131:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826411.484138:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b8133c lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a01 expref: 34 pid: 6519 timeout: 1457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.484151:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b8133c lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a01 expref: 34 pid: 6519 timeout: 1457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.484174:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656300) 00010000:00010000:3.0:1787826411.484179:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81351 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.484188:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81351 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.484196:0:10340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81351 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.484228:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826411.484285:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:2404:x1874670563799040:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 170us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826411.484292:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1051 00010000:00010000:2.0:1787826411.485879:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b8133c lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a01 expref: 33 pid: 6519 timeout: 1457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826411.485903:0:16564:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab93840 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:16564:1874670585224448:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826411.485926:0:16564:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81351 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.485940:0:16564:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81351 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.485946:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81351 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826411.485968:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00080000:2.0:1787826411.486125:0:16564:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x105:0x0], index 1: 0 00010000:00010000:2.0:1787826411.486238:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81351 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.486245:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81351 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.486252:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81351 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.486259:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826411.486263:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81351 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.486271:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81351 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.486285:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656300) 00010000:00010000:2.0:1787826411.486288:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826411.486292:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81351 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.486298:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81351 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.486346:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8134a lrc: 1/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a08 expref: 33 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.486356:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656300) 00010000:00010000:2.0:1787826411.486359:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787826411.486362:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8134a lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a08 expref: 33 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.486377:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835a00, rc 0) 00000100:00100000:2.0:1787826411.486711:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049bb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+32:55443:x1874670563798912:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 7057us (7426us total) trans 8589934743 rc 301/301 00000100:00100000:2.0:1787826411.486720:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3613 00000100:00100000:0.0:1787826411.492217:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826411.492305:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563799296 00000100:00100000:3.0:1787826411.492314:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563799296 00000100:00100000:3.0:1787826411.492411:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1055 00000100:00100000:3.0:1787826411.492422:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049ba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+32:55443:x1874670563799296:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:3.0:1787826411.492887:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049ba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:55443:x1874670563799296:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 466us (686us total) trans 8589934744 rc 0/0 00000100:00100000:3.0:1787826411.492895:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1055 00000100:00100000:2.0:1787826411.496037:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826411.496127:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563799552 00000100:00100000:0.0:1787826411.496136:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563799552 00000100:00100000:0.0:1787826411.496223:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1056 00000100:00100000:0.0:1787826411.496233:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab93840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:55443:x1874670563799552:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:0.0:1787826411.496519:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab93840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:55443:x1874670563799552:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 287us (490us total) trans 8589934745 rc 0/0 00000100:00100000:0.0:1787826411.496528:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1056 00000100:00100000:1.0:1787826411.513456:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826411.513762:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563799808 00000100:00100000:3.0:1787826411.513773:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563799808 00000100:00100000:3.0:1787826411.513835:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3614 00000100:00100000:3.0:1787826411.513844:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f05a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:55444:x1874670563799808:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826411.513870:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826411.513891:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b8135f lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0a0f expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.513959:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b81366 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.513973:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b81366 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.513984:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b81366 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.513997:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b8136d lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.514004:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b8136d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.514011:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b8136d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.514110:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b81374 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.514118:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b81374 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.514128:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b81374 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826411.514136:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:3.0:1787826411.514200:0:8247:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b81366 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.514207:0:8247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b81366 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.514224:0:8247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b81366 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.514231:0:8247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b81366 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.514237:0:8247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826411.514241:0:8247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b81366 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.514247:0:8247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b81366 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.514258:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf39656f00) 00010000:00010000:3.0:1787826411.514261:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826411.514265:0:8247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b81366 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.514272:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b81366 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.514283:0:8247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b8136d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.514289:0:8247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b8136d lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.514295:0:8247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b8136d lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.514299:0:8247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826411.514302:0:8247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b8136d lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.514307:0:8247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b8136d lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.514313:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf39656100) 00010000:00010000:3.0:1787826411.514315:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826411.514317:0:8247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b8136d lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.514322:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b8136d lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.514349:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b8135f lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a0f expref: 37 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.514360:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b81374 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a0f expref: 36 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.514366:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826411.514369:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826411.514371:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400800, rc 0) 00000100:00100000:3.0:1787826411.514764:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f05a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55444:x1874670563799808:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 914us (1313us total) trans 8589934746 rc 0/0 00000100:00100000:3.0:1787826411.514772:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3614 00000100:00100000:1.0:1787826411.521117:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826411.521191:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563799936 00000100:00100000:0.0:1787826411.521200:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563799936 00000100:00100000:0.0:1787826411.521278:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1994 00000100:00100000:0.0:1787826411.521288:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f04b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2401:x1874670563799936:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826411.521305:0:30696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826411.521325:0:30696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b81382 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x105:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0a16 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826411.521351:0:30696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x105:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826411.521369:0:30696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x105:0x0].0x0 since=1357s v=(0 0) 00010000:00010000:0.0:1787826411.521375:0:30696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x105:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826411.521384:0:30696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b81382 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x105:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a16 expref: 9 pid: 30696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.521402:0:30696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b81382 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x105:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a16 expref: 9 pid: 30696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.521423:0:30696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165e400, rc 0) 00000100:00100000:0.0:1787826411.521508:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f04b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2401:x1874670563799936:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 221us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826411.521516:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1994 00000100:00080000:3.0:1787826411.521743:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826411.525634:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826411.525857:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563800192 00000100:00100000:3.0:1787826411.525866:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563800192 00000100:00100000:3.0:1787826411.525922:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1057 00000100:00100000:3.0:1787826411.525931:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55444:x1874670563800192:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:3.0:1787826411.526155:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:55444:x1874670563800192:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 224us (529us total) trans 8589934747 rc 0/0 00000100:00100000:3.0:1787826411.526163:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1057 00000100:00100000:2.0:1787826411.529925:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826411.530020:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563800448 00000100:00100000:1.0:1787826411.530028:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563800448 00000100:00100000:1.0:1787826411.530090:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3615 00000100:00100000:1.0:1787826411.530099:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:55444:x1874670563800448:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826411.530122:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826411.530141:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b81389 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0a1d expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.530250:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067800/0x22153cd396b81390 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.530264:0:9966:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b81374 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a0f expref: 38 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.530278:0:9966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067800/0x22153cd396b81390 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.530307:0:9966:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b81374 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a0f expref: 38 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.530319:0:9966:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b81374 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a0f expref: 38 pid: 8247 timeout: 1457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826411.530331:0:9966:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce04f07840 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9966:1874670585224576:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826411.530406:0:9966:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf1850c300 going to sleep for 11 seconds 00000100:00100000:2.0:1787826411.534767:0:9966:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce04f07840 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9966:1874670585224576:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826411.534798:0:9966:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067800/0x22153cd396b81390 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826411.536333:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826411.536651:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563800576 00000100:00100000:1.0:1787826411.536661:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563800576 00010000:00010000:1.0:1787826411.536698:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b81374 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a0f expref: 39 pid: 8247 timeout: 1457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826411.536831:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1052 00000100:00100000:1.0:1787826411.536842:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+39:2404:x1874670563800576:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826411.536856:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826411.536863:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b81374 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a0f expref: 39 pid: 8247 timeout: 1457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.536875:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b81374 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a0f expref: 39 pid: 8247 timeout: 1457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.536898:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b81374 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a0f expref: 39 pid: 8247 timeout: 1457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.536915:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826411.536920:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067800/0x22153cd396b81390 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.536929:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067800/0x22153cd396b81390 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.536937:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067800/0x22153cd396b81390 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.536965:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826411.537026:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:2404:x1874670563800576:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 186us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826411.537034:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1052 00010000:00010000:2.0:1787826411.537085:0:9966:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067800/0x22153cd396b81390 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.537093:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067800/0x22153cd396b81390 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826411.537113:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:2.0:1787826411.537254:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b81389 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a1d expref: 39 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.537269:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067800/0x22153cd396b81390 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a1d expref: 38 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826411.537277:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826411.537279:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787826411.537281:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0a067800, rc 0) 00000100:00100000:2.0:1787826411.537306:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:55444:x1874670563800448:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 7209us (7391us total) trans 8589934748 rc 0/0 00000100:00100000:2.0:1787826411.537313:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3615 00000100:00100000:3.0:1787826411.541542:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826411.541737:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563800832 00000100:00100000:0.0:1787826411.541755:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563800832 00000100:00100000:0.0:1787826411.541821:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3616 00000100:00100000:0.0:1787826411.541831:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:55444:x1874670563800832:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826411.541856:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826411.541876:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b8139e lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0a24 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.542331:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b813a5 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.542347:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b813a5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.542358:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b813a5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826411.542368:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1e:0x0]: returning size 0 00010000:00010000:0.0:1787826411.542739:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b8139e lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a24 expref: 41 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.542866:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b813a5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a24 expref: 40 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.542881:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e:0x0].0x0 (ffff90cf0c7da900) 00010000:00010000:0.0:1787826411.542884:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826411.542887:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165f400, rc 0) 00000100:00100000:0.0:1787826411.542985:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55444:x1874670563800832:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1155us (1454us total) trans 8589934749 rc 0/0 00000100:00100000:0.0:1787826411.542994:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3616 00000100:00100000:2.0:1787826411.551080:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826411.551173:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563801088 00000100:00100000:3.0:1787826411.551183:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563801088 00000100:00100000:3.0:1787826411.551257:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3617 00000100:00100000:3.0:1787826411.551267:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55444:x1874670563801088:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826411.551292:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826411.551314:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b813b3 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0a2b expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.551424:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b813ba lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.551440:0:16564:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b813a5 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a24 expref: 41 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.551450:0:16564:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b813ba lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.551517:0:16564:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b813a5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a24 expref: 41 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.551531:0:16564:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b813a5 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a24 expref: 41 pid: 6520 timeout: 1457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826411.551546:0:16564:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf361e5a40 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:16564:1874670585224704:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826411.551624:0:16564:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10abaf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826411.554876:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826411.555008:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563801216 00000100:00100000:0.0:1787826411.555016:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563801216 00010000:00010000:0.0:1787826411.555059:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b813a5 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a24 expref: 42 pid: 6520 timeout: 1457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826411.555102:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1053 00000100:00100000:0.0:1787826411.555111:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c870c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+42:2403:x1874670563801216:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826411.555126:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826411.555133:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b813a5 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a24 expref: 42 pid: 6520 timeout: 1457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.555148:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b813a5 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a24 expref: 42 pid: 6520 timeout: 1457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.555171:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e:0x0].0x0 (ffff90cf0c7da900) 00010000:00010000:0.0:1787826411.555176:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b813ba lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.555186:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b813ba lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.555199:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b813ba lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.555229:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826411.555274:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c870c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+42:2403:x1874670563801216:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 164us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826411.555282:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1053 00010000:00010000:3.0:1787826411.555365:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b813a5 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a24 expref: 41 pid: 6520 timeout: 1457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826411.555397:0:16564:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf361e5a40 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:16564:1874670585224704:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826411.555420:0:16564:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b813ba lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.555430:0:16564:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b813ba lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.555436:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b813ba lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826411.555453:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1e:0x0]: returning size 0 00000004:00080000:3.0:1787826411.555615:0:16564:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x105:0x0], index 0: 0 00010000:00010000:3.0:1787826411.555700:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b813ba lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.555709:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b813ba lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.555721:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b813ba lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.555728:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826411.555732:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b813ba lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.555741:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b813ba lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.555750:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e:0x0].0x0 (ffff90cf0c7da900) 00010000:00010000:3.0:1787826411.555753:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826411.555986:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b813ba lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.555995:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b813ba lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.556040:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b813b3 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a2b expref: 41 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.556052:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e:0x0].0x0 (ffff90cf0c7da900) 00010000:00010000:3.0:1787826411.556054:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787826411.556058:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b813b3 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a2b expref: 41 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.556072:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401200, rc 0) 00000100:00100000:3.0:1787826411.556103:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55444:x1874670563801088:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 4838us (8427us total) trans 8589934750 rc 301/301 00000100:00100000:3.0:1787826411.556114:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3617 00000100:00100000:2.0:1787826411.559976:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826411.560068:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563801472 00000100:00100000:0.0:1787826411.560077:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563801472 00000100:00100000:0.0:1787826411.560155:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1058 00000100:00100000:0.0:1787826411.560165:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f80a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55444:x1874670563801472:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:0.0:1787826411.560505:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f80a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+41:55444:x1874670563801472:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 341us (538us total) trans 8589934751 rc 0/0 00000100:00100000:0.0:1787826411.560513:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1058 00000100:00100000:2.0:1787826411.563292:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826411.563668:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563801600 00000100:00100000:1.0:1787826411.563677:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563801600 00000100:00100000:1.0:1787826411.563767:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3618 00000100:00100000:1.0:1787826411.563778:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f80ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+41:55444:x1874670563801600:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826411.563802:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826411.563822:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067400/0x22153cd396b813c8 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0a32 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.563910:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b813cf lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.563925:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067800/0x22153cd396b81390 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a1d expref: 42 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.563938:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b813cf lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.563969:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067800/0x22153cd396b81390 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a1d expref: 42 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.563983:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067800/0x22153cd396b81390 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a1d expref: 42 pid: 9966 timeout: 1457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826411.563997:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce04f061c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1874670585224832:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826411.564177:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf1850c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826411.567062:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce04f061c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1874670585224832:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826411.567088:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b813cf lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826411.568933:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826411.569219:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563801728 00000100:00100000:1.0:1787826411.569228:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563801728 00010000:00010000:1.0:1787826411.569267:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067800/0x22153cd396b81390 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a1d expref: 43 pid: 9966 timeout: 1457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826411.569308:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1054 00000100:00100000:1.0:1787826411.569317:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf185de850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:2404:x1874670563801728:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826411.569331:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826411.569338:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067800/0x22153cd396b81390 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a1d expref: 43 pid: 9966 timeout: 1457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.569356:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067800/0x22153cd396b81390 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a1d expref: 43 pid: 9966 timeout: 1457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.569379:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067800/0x22153cd396b81390 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a1d expref: 43 pid: 9966 timeout: 1457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.569410:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826411.569416:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b813cf lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.569426:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b813cf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.569433:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b813cf lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.569458:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826411.569553:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf185de850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+42:2404:x1874670563801728:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 235us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826411.569560:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1054 00010000:00010000:3.0:1787826411.570240:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b813cf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.570251:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b813cf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826411.570302:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:3.0:1787826411.570306:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826411.570324:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b813cf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.570355:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067400/0x22153cd396b813c8 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a32 expref: 42 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.570373:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b813cf lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a32 expref: 41 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.570396:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826411.570399:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826411.570402:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0a066200, rc 0) 00000100:00100000:3.0:1787826411.570514:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f80ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+41:55444:x1874670563801600:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 6737us (7229us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826411.570522:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3618 00000100:00100000:2.0:1787826411.580186:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826411.580293:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563801856 00000100:00100000:1.0:1787826411.580303:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563801856 00000100:00100000:1.0:1787826411.580362:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3619 00000100:00100000:1.0:1787826411.580371:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f809e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+41:55444:x1874670563801856:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826411.580404:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826411.580427:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067800/0x22153cd396b813d6 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0a39 expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.580546:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067400/0x22153cd396b813dd lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.580560:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067400/0x22153cd396b813dd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.580572:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067400/0x22153cd396b813dd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826411.580613:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1e:0x0]: returning size 0 00000004:00200000:1.0:1787826411.580618:0:9966:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826411.580636:0:9966:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067400/0x22153cd396b813dd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.580661:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067800/0x22153cd396b813d6 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a39 expref: 43 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.580678:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067400/0x22153cd396b813dd lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a39 expref: 42 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.580687:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e:0x0].0x0 (ffff90cf04f8b300) 00010000:00010000:1.0:1787826411.580690:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787826411.580694:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0a067400, rc 0) 00000100:00100000:1.0:1787826411.580750:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f809e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+42:55444:x1874670563801856:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 380us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826411.580758:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3619 00000100:00100000:2.0:1787826411.584237:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826411.584310:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563801984 00000100:00100000:0.0:1787826411.584319:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563801984 00000100:00100000:0.0:1787826411.584381:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1995 00000100:00100000:0.0:1787826411.584397:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+6:2401:x1874670563801984:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826411.584413:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826411.584433:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e32bc9b1/0x22153cd396b813e4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x105:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0a40 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826411.584456:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x105:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826411.584500:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x105:0x0].0x0 since=1357s v=(0 0) 00010000:00010000:0.0:1787826411.584505:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x105:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826411.584515:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e32bc9b1/0x22153cd396b813e4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a40 expref: 7 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.584534:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e32bc9b1/0x22153cd396b813e4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a40 expref: 7 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.584548:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165e000, rc 0) 00000100:00100000:0.0:1787826411.584590:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2401:x1874670563801984:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 194us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826411.584596:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1995 00000100:00080000:3.0:1787826411.584857:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826411.588539:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826411.588696:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563802240 00000100:00100000:0.0:1787826411.588706:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563802240 00000100:00100000:0.0:1787826411.588771:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3620 00000100:00100000:0.0:1787826411.588782:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+42:55444:x1874670563802240:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826411.588802:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826411.588823:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b813eb lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0a47 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.588919:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b813f2 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.588933:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b813f2 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.588944:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b813f2 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826411.588956:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:0.0:1787826411.589050:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b813eb lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a47 expref: 45 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.589074:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b813f2 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a47 expref: 44 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.589083:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826411.589086:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787826411.589090:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165ee00, rc 0) 00000100:00100000:0.0:1787826411.589151:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55444:x1874670563802240:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 371us (622us total) trans 8589934752 rc 0/0 00000100:00100000:0.0:1787826411.589159:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3620 00000100:00100000:2.0:1787826411.595111:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826411.595201:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563802368 00000100:00100000:0.0:1787826411.595221:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563802368 00000100:00100000:0.0:1787826411.595276:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1996 00000100:00100000:0.0:1787826411.595286:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563802368:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:0.0:1787826411.595325:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002972f1b9/0x22153cd396b81400 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x105:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.595341:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x105:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826411.595346:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x105:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826411.595352:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002972f1b9/0x22153cd396b81400 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.595367:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002972f1b9/0x22153cd396b81400 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.595392:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002972f1b9/0x22153cd396b81400 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.595401:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002972f1b9/0x22153cd396b81400 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.595411:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002972f1b9/0x22153cd396b81400 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.595419:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165ea00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826411.595424:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002972f1b9/0x22153cd396b81400 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.595433:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002972f1b9/0x22153cd396b81400 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.595449:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002972f1b9/0x22153cd396b81400 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.595458:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002972f1b9/0x22153cd396b81400 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826411.595575:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563802368:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 289us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826411.595583:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1996 00000100:00100000:2.0:1787826411.659784:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826411.659908:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563802496 00000100:00100000:3.0:1787826411.659917:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563802496 00000100:00100000:3.0:1787826411.659981:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3621 00000100:00100000:3.0:1787826411.659990:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55444:x1874670563802496:12345-192.168.203.39@tcp:44:lfs.0 00000001:00080000:0.0:1787826411.662903:0:34481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934752 is committed 00010000:00010000:3.0:1787826411.663009:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b812a9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.663021:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b812a9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.663028:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b812a9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.663035:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826411.663040:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b812a9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.663048:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b812a9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.663065:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe1895f91 (ffff90cf39656000) 00010000:00010000:3.0:1787826411.663068:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826411.663073:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b812a9 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.663078:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b812a9 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.663100:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b812b0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.663106:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b812b0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.663112:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b812b0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.663118:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826411.663121:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b812b0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.663127:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b812b0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.663137:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c:0x0].0x0 (ffff90cf39656800) 00010000:00010000:3.0:1787826411.663139:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826411.663142:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b812b0 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.663147:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b812b0 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.663156:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b812b7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.663162:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b812b7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.663168:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b812b7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.663172:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826411.663175:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b812b7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.663181:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b812b7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.663192:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf39656f00) 00010000:00010000:3.0:1787826411.663195:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826411.663198:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b812b7 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.663204:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b812b7 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.663231:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b81335 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.663238:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b81335 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.663244:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b81335 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.663248:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401e00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826411.663251:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b81335 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.663257:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b81335 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.663264:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf39656100) 00010000:00010000:3.0:1787826411.663267:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826411.663270:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b81335 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.663277:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b81335 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826411.663623:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:55444:x1874670563802496:12345-192.168.203.39@tcp:44:lfs.0 Request processed in 3628us (3842us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826411.663635:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3621 00000100:00100000:3.0:1787826411.668537:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826411.668918:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563802624 00000100:00100000:1.0:1787826411.668927:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563802624 00000100:00100000:1.0:1787826411.669073:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1997 00000100:00100000:1.0:1787826411.669084:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2404:x1874670563802624:12345-192.168.203.39@tcp:16:lfs.0 00000100:00100000:1.0:1787826411.669189:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2404:x1874670563802624:12345-192.168.203.39@tcp:16:lfs.0 Request processed in 106us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826411.669195:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1997 00000100:00100000:2.0:1787826411.696040:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826411.696137:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563802752 00000100:00100000:1.0:1787826411.696147:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563802752 00000100:00100000:1.0:1787826411.696203:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1998 00000100:00100000:1.0:1787826411.696221:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563802752:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:1.0:1787826411.696264:0:30398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c8b52bb3/0x22153cd396b81407 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x105:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.696282:0:30398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x105:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826411.696287:0:30398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x105:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826411.696293:0:30398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8b52bb3/0x22153cd396b81407 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.696307:0:30398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8b52bb3/0x22153cd396b81407 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.696333:0:30398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c8b52bb3/0x22153cd396b81407 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.696340:0:30398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8b52bb3/0x22153cd396b81407 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.696355:0:30398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8b52bb3/0x22153cd396b81407 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.696363:0:30398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0a067800 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:1.0:1787826411.696368:0:30398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8b52bb3/0x22153cd396b81407 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.696377:0:30398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8b52bb3/0x22153cd396b81407 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.696412:0:30398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8b52bb3/0x22153cd396b81407 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.696420:0:30398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8b52bb3/0x22153cd396b81407 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826411.696680:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563802752:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 460us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826411.696688:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1998 00000100:00100000:2.0:1787826411.708700:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826411.711646:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563803008 00000100:00100000:3.0:1787826411.711659:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563803008 00000100:00100000:0.0:1787826411.713310:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3622 00000100:00100000:0.0:1787826411.713323:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:55444:x1874670563803008:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:0.0:1787826411.713666:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826411.713694:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067400/0x22153cd396b813dd lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1e:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a39 expref: 30 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.713714:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e:0x0].0x0 (ffff90cf04f8b300) 00010000:00010000:0.0:1787826411.713723:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826411.713854:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b8140e lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.713869:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b8140e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.713880:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b8140e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826411.713993:0:6518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f4266a01 reply state 00000000fb9d8f12 transno 8589934753 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b8140e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.714005:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b8140e lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.714011:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e:0x0].0x0 (ffff90cf3abcb100) 00010000:00010000:0.0:1787826411.714014:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826411.714017:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787826411.714123:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:55444:x1874670563803008:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 802us (5431us total) trans 8589934753 rc 0/0 00000100:00100000:0.0:1787826411.714131:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3622 00000100:00100000:2.0:1787826411.719015:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826411.722697:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563803136 00000100:00100000:3.0:1787826411.722709:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563803136 00000100:00100000:3.0:1787826411.722878:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3623 00000100:00100000:3.0:1787826411.722889:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:55444:x1874670563803136:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826411.722913:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826411.722934:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b81415 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0a4e expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.722988:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b81415 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a4e expref: 32 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.723001:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b81415 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a4e expref: 32 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.723019:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e:0x0].0x0 (ffff90cf3abcb100) 00010000:00010000:3.0:1787826411.723022:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826411.723026:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401200, rc 0) 00000100:00100000:3.0:1787826411.723094:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+32:55444:x1874670563803136:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 207us (4089us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826411.723100:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3623 00000100:00100000:2.0:1787826411.730297:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826411.730370:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563803264 00000100:00100000:0.0:1787826411.730387:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563803264 00000100:00100000:0.0:1787826411.730445:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1999 00000100:00100000:0.0:1787826411.730456:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2404:x1874670563803264:12345-192.168.203.39@tcp:2:lfs.0 00002000:00010000:0.0:1787826411.730648:0:30696:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x105:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787826411.730652:0:30696:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x105:0x0] updating lvb mtime from disk: 0 -> 1787826412 00002000:00010000:0.0:1787826411.730655:0:30696:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x105:0x0] updating lvb atime from disk: 0 -> 1787826412 00002000:00010000:0.0:1787826411.730657:0:30696:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x105:0x0] updating lvb ctime from disk: 0 -> 1787826412 00002000:00010000:0.0:1787826411.730659:0:30696:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x105:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1787826411.730707:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2404:x1874670563803264:12345-192.168.203.39@tcp:2:lfs.0 Request processed in 253us (420us total) trans 21474836992 rc 0/0 00000100:00100000:0.0:1787826411.730716:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1999 00000100:00100000:2.0:1787826411.746794:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826411.746917:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563803520 00000100:00100000:3.0:1787826411.746927:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563803520 00000100:00100000:3.0:1787826411.746983:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3624 00000100:00100000:3.0:1787826411.746992:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+32:55444:x1874670563803520:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:3.0:1787826411.747041:0:8247:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826411.747067:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b813cf lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a32 expref: 32 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.747086:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826411.747091:0:8247:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826411.747148:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b8141c lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.747161:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b8141c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.747171:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b8141c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826411.747273:0:8247:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000de801c45 reply state 000000003b0103f8 transno 8589934754 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b8141c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.747284:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b8141c lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.747289:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826411.747292:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826411.747295:0:8247:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826411.747531:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:55444:x1874670563803520:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 390us (596us total) trans 8589934754 rc 0/0 00000100:00100000:3.0:1787826411.747543:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3624 00000100:00100000:2.0:1787826411.749943:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826411.750074:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563803648 00000100:00100000:3.0:1787826411.750083:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563803648 00000100:00100000:3.0:1787826411.750136:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3625 00000100:00100000:3.0:1787826411.750145:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:55444:x1874670563803648:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826411.750165:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826411.750184:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b81423 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0a55 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.750244:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b81423 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a55 expref: 34 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.750258:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b81423 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a55 expref: 34 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.750273:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826411.750276:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826411.750279:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400c00, rc 0) 00000100:00100000:3.0:1787826411.750332:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:55444:x1874670563803648:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 188us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826411.750339:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3625 00000100:00100000:3.0:1787826411.752766:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826411.752852:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563803776 00000100:00100000:1.0:1787826411.752860:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563803776 00000100:00100000:1.0:1787826411.752904:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2000 00000100:00100000:1.0:1787826411.752914:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670563803776:12345-192.168.203.39@tcp:2:lfs.0 00002000:00010000:1.0:1787826411.753076:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x105:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787826411.753080:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x105:0x0] updating lvb mtime from disk: 0 -> 1787826412 00002000:00010000:1.0:1787826411.753083:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x105:0x0] updating lvb atime from disk: 0 -> 1787826412 00002000:00010000:1.0:1787826411.753086:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x105:0x0] updating lvb ctime from disk: 0 -> 1787826412 00002000:00010000:1.0:1787826411.753088:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x105:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1787826411.753146:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670563803776:12345-192.168.203.39@tcp:2:lfs.0 Request processed in 234us (387us total) trans 17179869650 rc 0/0 00000100:00100000:1.0:1787826411.753154:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2000 00000100:00100000:2.0:1787826411.760355:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826411.760460:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563804032 00000100:00100000:0.0:1787826411.760507:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563804032 00000100:00100000:0.0:1787826411.760569:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1059 00000100:00100000:0.0:1787826411.760579:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3957b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:55444:x1874670563804032:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:0.0:1787826411.760650:0:14257:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000405:0x1d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b813f2 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a47 expref: 34 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.760687:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b8142a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.760700:0:14257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b81423 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a55 expref: 34 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.760708:0:14257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b8142a lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.760739:0:14257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b81423 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a55 expref: 34 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.760757:0:14257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b81423 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a55 expref: 34 pid: 16564 timeout: 1457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826411.760772:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce049bad00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585224960:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826411.760851:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf087ac6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826411.771119:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826411.771219:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563804160 00000100:00100000:1.0:1787826411.771227:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563804160 00010000:00010000:1.0:1787826411.771268:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b81423 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a55 expref: 35 pid: 16564 timeout: 1457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826411.771315:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1055 00000100:00100000:1.0:1787826411.771326:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:2404:x1874670563804160:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826411.771343:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826411.771350:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b81423 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a55 expref: 35 pid: 16564 timeout: 1457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.771363:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b81423 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a55 expref: 35 pid: 16564 timeout: 1457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.771386:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826411.771400:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b8142a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.771410:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b8142a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.771423:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b8142a lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.771442:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826411.771540:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:2404:x1874670563804160:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 215us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826411.771548:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1055 00010000:00010000:0.0:1787826411.771968:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b81423 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a55 expref: 34 pid: 16564 timeout: 1457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826411.771985:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce049bad00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585224960:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826411.772005:0:14257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b8142a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.772014:0:14257:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b8142a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.772020:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b8142a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.772039:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81431 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.772050:0:14257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b81415 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a4e expref: 33 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.772057:0:14257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81431 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.772082:0:14257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b81415 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a4e expref: 33 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.772095:0:14257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b81415 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a4e expref: 33 pid: 32404 timeout: 1457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826411.772107:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce049bad00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585225088:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826411.772202:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf087ac6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826411.784139:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826411.784290:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce049bad00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585225088:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826411.784319:0:14257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81431 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826411.786745:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563804288 00000100:00100000:3.0:1787826411.786761:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563804288 00010000:00010000:3.0:1787826411.786807:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b81415 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a4e expref: 34 pid: 32404 timeout: 1457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826411.786916:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1056 00000100:00100000:3.0:1787826411.786927:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:2403:x1874670563804288:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826411.786941:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826411.786948:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b81415 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a4e expref: 34 pid: 32404 timeout: 1457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.786961:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b81415 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a4e expref: 34 pid: 32404 timeout: 1457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.786986:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b81415 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a4e expref: 34 pid: 32404 timeout: 1457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.787003:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e:0x0].0x0 (ffff90cf3abcb100) 00010000:00010000:3.0:1787826411.787007:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81431 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.787017:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81431 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.787024:0:10340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81431 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.787058:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826411.787124:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:2403:x1874670563804288:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 198us (2994us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826411.787131:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1056 00010000:00010000:0.0:1787826411.788317:0:14257:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81431 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.788332:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81431 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826411.788715:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce049bad00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585225216:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1787826411.788774:0:14257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826411.788823:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf087ac540 going to sleep for 11 seconds 00000100:00100000:2.0:1787826411.789516:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585225216 00000100:00100000:2.0:1787826411.789523:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585225216 00000100:00080000:0.0:1787826411.789562:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826411.789589:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1417 00000100:00100000:2.0:1787826411.789598:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049bbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:14257:x1874670585225216:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1787826411.789733:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049bbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:14257:x1874670585225216:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 135us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826411.789744:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1417 00000100:00100000:0.0:1787826411.790035:0:14257:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869649 gen 2 00000004:00080000:0.0:1787826411.790041:0:14257:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869644 committed transno 17179869649 00000004:00080000:0.0:1787826411.790060:0:14257:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3ab91680, transno 17179869645 00000004:00080000:0.0:1787826411.790114:0:14257:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce0b432d00, transno 17179869647 00000004:00080000:0.0:1787826411.794056:0:14257:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf136ced00, transno 17179869649 00000100:00100000:0.0:1787826411.794075:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce049bad00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585225216:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1787826411.799740:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce04f061c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585225344:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1787826411.799814:0:14257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826411.799844:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf1850ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1787826411.799927:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585225344 00000100:00100000:2.0:1787826411.799935:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585225344 00000100:00100000:2.0:1787826411.800035:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1418 00000100:00100000:2.0:1787826411.800045:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f07840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:14257:x1874670585225344:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1787826411.800165:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f07840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:14257:x1874670585225344:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 120us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826411.800173:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1418 00000100:00100000:3.0:1787826411.801567:0:14257:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836991 gen 2 00000004:00080000:3.0:1787826411.801579:0:14257:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3f8761c0, transno 21474836991 00000100:00100000:3.0:1787826411.801592:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce04f061c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585225344:0@lo:1000:mdt_rdpg00_002.0 00000040:00080000:3.0:1787826411.801785:0:14257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000bd0:0x2:0x0].4, 280 off37648 00000001:00080000:3.0:1787826411.801793:0:14257:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934755 00000100:00100000:3.0:1787826411.801856:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3abc0780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585225472:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1787826411.801927:0:14257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826411.801957:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10aba600 going to sleep for 11 seconds 00000100:00100000:3.0:1787826411.803568:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585225472 00000100:00100000:3.0:1787826411.803579:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585225472 00000100:00100000:3.0:1787826411.803630:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1419 00000100:00100000:3.0:1787826411.803638:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:14257:x1874670585225472:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1787826411.803793:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:14257:x1874670585225472:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 155us (1866us total) trans 21474836993 rc 0/0 00000100:00100000:3.0:1787826411.803801:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1419 00000100:00100000:3.0:1787826411.803847:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3abc0780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585225472:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1787826411.803885:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3abc0f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585225600:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1787826411.803914:0:14257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826411.803932:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10aba600 going to sleep for 11 seconds 00000100:00080000:0.0:1787826411.803991:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826411.805754:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585225600 00000100:00100000:3.0:1787826411.805765:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585225600 00000100:00100000:3.0:1787826411.805852:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1420 00000100:00100000:3.0:1787826411.805862:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:14257:x1874670585225600:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1787826411.806016:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14257:x1874670585225600:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 156us (2101us total) trans 17179869651 rc 0/0 00000100:00100000:3.0:1787826411.806024:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1420 00000100:00100000:3.0:1787826411.809752:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3abc0f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585225600:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:3.0:1787826411.809861:0:14257:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934756 00010000:00010000:3.0:1787826411.809900:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81431 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.809911:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81431 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.809919:0:14257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81431 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.809926:0:14257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165fa00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826411.809930:0:14257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81431 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.809938:0:14257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81431 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.809953:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e:0x0].0x0 (ffff90cf3abcb100) 00010000:00010000:3.0:1787826411.809956:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787826411.809961:0:14257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81431 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.809968:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81431 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.809983:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b8142a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.809990:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b8142a lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.810001:0:14257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b8142a lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.810006:0:14257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165fc00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826411.810009:0:14257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b8142a lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.810015:0:14257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b8142a lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.810022:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826411.810025:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787826411.810028:0:14257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b8142a lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.810034:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b8142a lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.810044:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826411.810046:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787826411.810053:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b813f2 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a47 expref: 35 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826411.810155:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3957b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:55444:x1874670563804032:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 49577us (49810us total) trans 8589934757 rc 0/0 00000100:00100000:3.0:1787826411.810165:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1059 00000020:00080000:3.0:1787826411.810170:0:14257:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1787826411.821034:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826411.821133:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563804416 00000100:00100000:1.0:1787826411.821143:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563804416 00000100:00100000:1.0:1787826411.821218:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3626 00000100:00100000:1.0:1787826411.821228:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab16940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:55444:x1874670563804416:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826411.821254:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826411.821274:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067800/0x22153cd396b81438 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0a5c expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.821344:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067800/0x22153cd396b81438 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a5c expref: 35 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.821360:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067800/0x22153cd396b81438 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a5c expref: 35 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.821380:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826411.821383:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826411.821387:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0a067800, rc 0) 00000100:00100000:1.0:1787826411.821453:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab16940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:55444:x1874670563804416:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 226us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826411.821460:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3626 00000100:00100000:2.0:1787826411.826420:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826411.833741:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563804672 00000100:00100000:0.0:1787826411.833756:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563804672 00000100:00100000:1.0:1787826411.834368:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1060 00000100:00100000:1.0:1787826411.834381:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:55444:x1874670563804672:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:1.0:1787826411.834845:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55444:x1874670563804672:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 464us (8432us total) trans 8589934758 rc 0/0 00000100:00100000:1.0:1787826411.834853:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1060 00000100:00100000:2.0:1787826411.838300:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826411.838376:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563804928 00000100:00100000:3.0:1787826411.838439:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563804928 00000100:00100000:3.0:1787826411.838705:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1061 00000100:00100000:3.0:1787826411.838715:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55444:x1874670563804928:12345-192.168.203.39@tcp:35:lfs.0 00000004:00080000:3.0:1787826411.838899:0:14257:0:(mdd_object.c:4014:mdd_close()) Object [0x200000405:0x1e:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:3.0:1787826411.838973:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b8143f lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.838990:0:14257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b8143f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.839000:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b8143f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.839009:0:14257:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b8143f lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.839015:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b8143f lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.839021:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b8143f lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.839045:0:14257:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787826411.839121:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:55444:x1874670563804928:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 407us (830us total) trans 8589934759 rc 0/0 00000100:00100000:3.0:1787826411.839129:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1061 00010000:00010000:1.0:1787826411.839361:0:7460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826411.839370:0:7460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b8143f lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.839379:0:7460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401200 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:1.0:1787826411.839383:0:7460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b8143f lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.839391:0:7460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b8143f lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.839404:0:7460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e:0x0].0x0 (ffff90cf3abcb100) 00010000:00010000:1.0:1787826411.839407:0:7460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787826411.839412:0:7460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b8143f lrc: 1/0,0 mode: --/PW res: [0x200000405:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.839419:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b8143f lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.839431:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826411.839433:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826411.839435:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826411.847187:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826411.883352:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826411.883598:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563805056 00000100:00100000:3.0:1787826411.883608:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563805056 00000100:00100000:3.0:1787826411.883716:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3627 00000100:00100000:3.0:1787826411.883727:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab17c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:55446:x1874670563805056:12345-192.168.203.39@tcp:101:getfattr.0 00010000:00010000:3.0:1787826411.883750:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826411.883775:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81446 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0a63 expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.883838:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b8144d lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.883852:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b8144d lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.883863:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b8144d lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.883879:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b81454 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.883886:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b81454 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.883893:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b81454 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.883960:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b8145b lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.883969:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b8145b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.883977:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b8145b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826411.884013:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:3.0:1787826411.884017:0:32404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826411.884054:0:32404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b8145b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.884066:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b8145b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.884074:0:32404:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b8144d lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.884092:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b8144d lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.884098:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b8144d lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.884103:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b8144d lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.884109:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826411.884114:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b8144d lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.884121:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b8144d lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.884131:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf39656100) 00010000:00010000:3.0:1787826411.884134:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826411.884138:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b8144d lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.884145:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b8144d lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.884159:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b81454 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.884166:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b81454 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.884171:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b81454 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.884176:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826411.884179:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b81454 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.884185:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b81454 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.884191:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf39656f00) 00010000:00010000:3.0:1787826411.884194:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826411.884196:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b81454 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.884202:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b81454 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.884244:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81446 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a63 expref: 39 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.884259:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b8145b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a63 expref: 38 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.884266:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826411.884269:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826411.884272:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401600, rc 0) 00000100:00100000:3.0:1787826411.884332:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab17c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:55446:x1874670563805056:12345-192.168.203.39@tcp:101:getfattr.0 Request processed in 607us (990us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826411.884339:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3627 00000100:00100000:2.0:1787826411.931747:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826411.931807:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563805312 00000100:00100000:3.0:1787826411.931818:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563805312 00000100:00100000:3.0:1787826411.931885:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3628 00000100:00100000:3.0:1787826411.931896:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab93840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:55450:x1874670563805312:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826411.931917:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826411.931948:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81462 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0a6a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826411.932106:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1c:0x0]: returning size 4096 00010000:00010000:3.0:1787826411.932192:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81462 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a6a expref: 40 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.932218:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ce01f45300) 00010000:00010000:3.0:1787826411.932222:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787826411.932227:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81462 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a6a expref: 40 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826411.932242:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401a00, rc 0) 00000100:00100000:3.0:1787826411.932302:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab93840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+39:55450:x1874670563805312:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 408us (563us total) trans 8589934760 rc 301/301 00000100:00100000:3.0:1787826411.932310:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3628 00000100:00100000:2.0:1787826411.937250:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826411.937580:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563805440 00000100:00100000:0.0:1787826411.937590:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563805440 00000100:00100000:0.0:1787826411.937728:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3629 00000100:00100000:0.0:1787826411.937739:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+39:55450:x1874670563805440:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:0.0:1787826411.937832:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b81470 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.937849:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b81470 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.937860:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b81470 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.937871:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81477 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.937877:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81477 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.937883:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81477 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.937952:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8147e lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.937961:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8147e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.937967:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8147e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826411.938004:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:0.0:1787826411.938007:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826411.938017:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8147e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.938027:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b81470 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.938034:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b81470 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.938041:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b81470 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.938046:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165f600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826411.938050:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b81470 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.938056:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b81470 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.938068:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf3abcb300) 00010000:00010000:0.0:1787826411.938071:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826411.938075:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b81470 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.938082:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b81470 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.938100:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81477 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.938111:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81477 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.938116:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81477 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.938121:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165e200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826411.938124:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81477 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.938130:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81477 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.938137:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf3abcbe00) 00010000:00010000:0.0:1787826411.938140:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826411.938142:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81477 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.938148:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81477 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.938159:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8147e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.938165:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8147e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.938171:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8147e lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.938176:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165fe00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826411.938179:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8147e lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.938186:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8147e lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.938192:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826411.938195:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826411.938197:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8147e lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.938203:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8147e lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826411.938290:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+39:55450:x1874670563805440:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 553us (1048us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826411.938299:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3629 00000100:00100000:2.0:1787826411.943294:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826411.943391:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563805696 00000100:00100000:1.0:1787826411.943409:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563805696 00000100:00100000:1.0:1787826411.943465:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1062 00000100:00100000:1.0:1787826411.943539:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab91680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+39:55450:x1874670563805696:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:1.0:1787826411.943794:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab91680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55450:x1874670563805696:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 258us (511us total) trans 8589934761 rc 0/0 00000100:00100000:1.0:1787826411.943802:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1062 00000100:00100000:2.0:1787826411.969722:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826411.970164:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563805952 00000100:00100000:0.0:1787826411.970174:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563805952 00000100:00100000:0.0:1787826411.971307:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3630 00000100:00100000:0.0:1787826411.971325:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55452:x1874670563805952:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826411.971351:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826411.971371:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b81485 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0a71 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.971508:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b8148c lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.971523:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b8148c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.971537:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b8148c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826411.971547:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:0.0:1787826411.971646:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b81485 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a71 expref: 43 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.971664:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b8148c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a71 expref: 42 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.971673:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826411.971676:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826411.971680:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165e200, rc 0) 00000100:00100000:0.0:1787826411.971748:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+42:55452:x1874670563805952:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 431us (2040us total) trans 8589934762 rc 0/0 00000100:00100000:0.0:1787826411.971765:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3630 00000100:00100000:2.0:1787826411.979819:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826411.979945:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563806208 00000100:00100000:3.0:1787826411.979954:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563806208 00000100:00100000:3.0:1787826411.980042:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1063 00000100:00100000:3.0:1787826411.980053:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+42:55452:x1874670563806208:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:3.0:1787826411.980284:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55452:x1874670563806208:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 232us (474us total) trans 8589934763 rc 0/0 00000100:00100000:3.0:1787826411.980292:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1063 00000100:00100000:2.0:1787826411.993778:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826411.993811:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826411.993921:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563806592 00000100:00100000:1.0:1787826411.993930:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563806592 00000100:00100000:1.0:1787826411.993984:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3631 00000100:00100000:1.0:1787826411.993993:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55452:x1874670563806592:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826411.994016:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826411.994036:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066a00/0x22153cd396b8149a lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0a78 expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.994135:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b814a1 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.994150:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b814a1 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.994164:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b814a1 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826411.994175:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:1.0:1787826411.994281:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066a00/0x22153cd396b8149a lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a78 expref: 46 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.994300:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b814a1 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a78 expref: 45 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826411.994310:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826411.994313:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787826411.994317:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0a066200, rc 0) 00000100:00100000:1.0:1787826411.994364:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+45:55452:x1874670563806592:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 372us (552us total) trans 8589934764 rc 0/0 00000100:00100000:1.0:1787826411.994372:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3631 00000100:00100000:0.0:1787826411.995629:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563806336 00000100:00100000:0.0:1787826411.995638:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563806336 00000100:00100000:0.0:1787826411.995697:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 349 00000100:00100000:0.0:1787826411.995705:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+45:2403:x1874670563806336:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826411.995718:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826411.995737:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b8148c lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a71 expref: 45 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826411.995753:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826411.995757:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826411.995793:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:2403:x1874670563806336:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 89us (2025us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826411.995800:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 349 00000100:00100000:3.0:1787826412.006238:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826412.007317:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563806848 00000100:00100000:1.0:1787826412.007328:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563806848 00000100:00100000:1.0:1787826412.007386:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3632 00000100:00100000:1.0:1787826412.007396:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55452:x1874670563806848:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826412.007422:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826412.007444:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067400/0x22153cd396b814af lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0a7f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.007598:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70fe00/0x22153cd396b814b6 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.007612:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b8145b lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a63 expref: 45 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.007621:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70fe00/0x22153cd396b814b6 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.007654:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b8145b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a63 expref: 45 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.007667:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b8145b lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a63 expref: 45 pid: 32404 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826412.007680:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce04f061c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1874670585225728:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826412.007759:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf1850c900 going to sleep for 11 seconds 00000100:00100000:1.0:1787826412.011823:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce04f061c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1874670585225728:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826412.011865:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70fe00/0x22153cd396b814b6 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826412.013197:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826412.015731:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563806976 00000100:00100000:2.0:1787826412.015744:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563806976 00010000:00010000:2.0:1787826412.015791:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b8145b lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a63 expref: 46 pid: 32404 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826412.016499:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1057 00000100:00100000:2.0:1787826412.016513:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f80a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+46:2404:x1874670563806976:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826412.016531:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826412.016540:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b8145b lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a63 expref: 46 pid: 32404 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.016555:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b8145b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a63 expref: 46 pid: 32404 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.016577:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b8145b lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a63 expref: 46 pid: 32404 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.016592:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826412.016598:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70fe00/0x22153cd396b814b6 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.016609:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70fe00/0x22153cd396b814b6 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.016617:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70fe00/0x22153cd396b814b6 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.016647:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826412.016762:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f80a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+45:2404:x1874670563806976:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 252us (3568us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826412.016770:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1057 00010000:00010000:3.0:1787826412.018436:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70fe00/0x22153cd396b814b6 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.018450:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70fe00/0x22153cd396b814b6 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826412.018489:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:3.0:1787826412.018622:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067400/0x22153cd396b814af lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a7f expref: 46 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.018643:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70fe00/0x22153cd396b814b6 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a7f expref: 45 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.018653:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826412.018656:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787826412.018659:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0a70fe00, rc 0) 00000100:00100000:3.0:1787826412.018707:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+45:55452:x1874670563806848:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 11312us (12479us total) trans 8589934765 rc 0/0 00000100:00100000:3.0:1787826412.018716:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3632 00000100:00100000:2.0:1787826412.023916:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826412.024101:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563807104 00000100:00100000:0.0:1787826412.024110:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563807104 00000100:00100000:0.0:1787826412.024164:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1064 00000100:00100000:0.0:1787826412.024174:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+45:55452:x1874670563807104:12345-192.168.203.39@tcp:33:lfs.0 00000100:00100000:0.0:1787826412.024339:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+45:55452:x1874670563807104:12345-192.168.203.39@tcp:33:lfs.0 Request processed in 166us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826412.024347:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1064 00000100:00100000:0.0:1787826412.041064:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826412.041161:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563807360 00000100:00100000:3.0:1787826412.041171:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563807360 00000100:00100000:3.0:1787826412.041248:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1065 00000100:00100000:3.0:1787826412.041258:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3957a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+45:55452:x1874670563807360:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:3.0:1787826412.041532:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3957a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+46:55452:x1874670563807360:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 275us (477us total) trans 8589934766 rc 0/0 00000100:00100000:3.0:1787826412.041542:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1065 00000100:00100000:2.0:1787826412.048795:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826412.048953:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563807616 00000100:00100000:0.0:1787826412.048963:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563807616 00000100:00100000:0.0:1787826412.049022:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3633 00000100:00100000:0.0:1787826412.049031:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+46:55452:x1874670563807616:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826412.049055:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826412.049058:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:0.0:1787826412.049083:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70fe00/0x22153cd396b814b6 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a7f expref: 46 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.049106:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066200/0x22153cd396b814a1 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a78 expref: 45 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.049117:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826412.049121:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826412.049135:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b814c4 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0a86 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.049243:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b814cb lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.049256:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b814cb lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.049267:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b814cb lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826412.049278:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:0.0:1787826412.049367:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b814c4 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a86 expref: 47 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.049388:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b814cb lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a86 expref: 46 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.049397:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826412.049400:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787826412.049403:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165f600, rc 0) 00000100:00100000:0.0:1787826412.049462:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+46:55452:x1874670563807616:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 432us (675us total) trans 8589934767 rc 0/0 00000100:00100000:0.0:1787826412.049519:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3633 00000100:00100000:2.0:1787826412.059043:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826412.059179:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563807872 00000100:00100000:3.0:1787826412.059188:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563807872 00000100:00100000:3.0:1787826412.059254:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1066 00000100:00100000:3.0:1787826412.059264:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+46:55452:x1874670563807872:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:3.0:1787826412.059342:0:6521:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000405:0x1d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b814cb lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a86 expref: 46 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.059396:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b814d9 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.059410:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067800/0x22153cd396b81438 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a5c expref: 46 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.059420:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b814d9 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.059452:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067800/0x22153cd396b81438 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a5c expref: 46 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.059466:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067800/0x22153cd396b81438 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a5c expref: 46 pid: 9966 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826412.059519:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab143c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1874670585225856:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826412.059598:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10aba6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826412.069156:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826412.069241:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563808000 00000100:00100000:0.0:1787826412.069250:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563808000 00010000:00010000:0.0:1787826412.069291:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067800/0x22153cd396b81438 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a5c expref: 47 pid: 9966 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826412.069331:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1058 00000100:00100000:0.0:1787826412.069341:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+47:2403:x1874670563808000:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826412.069357:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826412.069363:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067800/0x22153cd396b81438 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a5c expref: 47 pid: 9966 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.069386:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067800/0x22153cd396b81438 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a5c expref: 47 pid: 9966 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.069415:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826412.069421:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b814d9 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.069431:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b814d9 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.069440:0:10340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b814d9 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.069458:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826412.069532:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+47:2403:x1874670563808000:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 191us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826412.069539:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1058 00010000:00010000:3.0:1787826412.069751:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067800/0x22153cd396b81438 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a5c expref: 46 pid: 9966 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826412.069786:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab143c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1874670585225856:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826412.069809:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b814d9 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.069819:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b814d9 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.069825:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b814d9 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.069985:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b814d9 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.069993:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b814d9 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.070001:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b814d9 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.070007:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826412.070011:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b814d9 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.070019:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b814d9 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.070028:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826412.070031:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787826412.070035:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b814d9 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.070042:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b814d9 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.070051:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826412.070054:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787826412.070058:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b814cb lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a86 expref: 45 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826412.070152:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+45:55452:x1874670563807872:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 10889us (11117us total) trans 8589934768 rc -22/-22 00000100:00100000:3.0:1787826412.070160:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1066 00000100:00100000:0.0:1787826412.092758:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826412.092922:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563808128 00000100:00100000:3.0:1787826412.092931:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563808128 00000100:00100000:3.0:1787826412.093035:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3634 00000100:00100000:3.0:1787826412.093045:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049ba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+45:55452:x1874670563808128:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826412.093074:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826412.093094:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b814e0 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0a8d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.093154:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b814e0 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a8d expref: 46 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.093168:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b814e0 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a8d expref: 46 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.093190:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826412.093194:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826412.093198:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401a00, rc 0) 00000100:00100000:3.0:1787826412.093271:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049ba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+46:55452:x1874670563808128:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 228us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826412.093278:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3634 00000100:00100000:2.0:1787826412.107251:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826412.107363:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563808384 00000100:00100000:3.0:1787826412.107373:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563808384 00000100:00100000:3.0:1787826412.107516:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3635 00000100:00100000:3.0:1787826412.107526:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+46:55452:x1874670563808384:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826412.107544:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826412.107567:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b814e7 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0a94 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.108089:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b814ee lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.108103:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b814ee lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.108114:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b814ee lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826412.108125:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:3.0:1787826412.108161:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b814e7 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a94 expref: 49 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.108189:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b814ee lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a94 expref: 48 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.108198:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff90cf39656f00) 00010000:00010000:3.0:1787826412.108201:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826412.108215:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401400, rc 0) 00000100:00100000:3.0:1787826412.108265:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55452:x1874670563808384:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 741us (1024us total) trans 8589934769 rc 0/0 00000100:00100000:3.0:1787826412.108274:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3635 00000100:00100000:2.0:1787826412.120117:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826412.121188:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563808640 00000100:00100000:3.0:1787826412.121200:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563808640 00000100:00100000:3.0:1787826412.121283:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3636 00000100:00100000:3.0:1787826412.121302:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55452:x1874670563808640:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826412.121328:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826412.121350:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b814fc lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0a9b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.121505:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b81503 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.121521:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b81503 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.121532:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b81503 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826412.121545:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:2.0:1787826412.121847:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b814fc lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a9b expref: 51 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.121867:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b81503 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a9b expref: 50 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.121875:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826412.121878:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787826412.121882:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400600, rc 0) 00000100:00100000:2.0:1787826412.121950:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+50:55452:x1874670563808640:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 658us (1842us total) trans 8589934770 rc 0/0 00000100:00100000:2.0:1787826412.121958:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3636 00000100:00100000:0.0:1787826412.130009:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826412.130391:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563808896 00000100:00100000:1.0:1787826412.130400:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563808896 00000100:00100000:1.0:1787826412.130521:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1067 00000100:00100000:1.0:1787826412.130531:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049bad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+50:55452:x1874670563808896:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:1.0:1787826412.130608:0:6522:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000405:0x1d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b81503 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a9b expref: 50 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.130651:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70e600/0x22153cd396b81511 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.130663:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b814e0 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a8d expref: 50 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.130671:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70e600/0x22153cd396b81511 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.130699:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b814e0 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a8d expref: 50 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.130713:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b814e0 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a8d expref: 50 pid: 6520 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826412.130733:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce04f061c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585225984:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826412.130820:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf1850c900 going to sleep for 11 seconds 00000100:00100000:0.0:1787826412.142811:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826412.146325:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce04f061c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585225984:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826412.146364:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70e600/0x22153cd396b81511 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826412.147899:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563809024 00000100:00100000:2.0:1787826412.147912:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563809024 00010000:00010000:2.0:1787826412.147960:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b814e0 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a8d expref: 51 pid: 6520 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826412.148014:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1059 00000100:00100000:2.0:1787826412.148024:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+51:2404:x1874670563809024:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826412.148044:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826412.148050:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b814e0 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a8d expref: 51 pid: 6520 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.148075:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b814e0 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a8d expref: 51 pid: 6520 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.148099:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b814e0 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a8d expref: 51 pid: 6520 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.148116:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826412.148120:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70e600/0x22153cd396b81511 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.148129:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70e600/0x22153cd396b81511 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.148138:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70e600/0x22153cd396b81511 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.148179:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826412.148258:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+50:2404:x1874670563809024:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 234us (5457us total) trans 0 rc 0/0 00010000:00010000:0.0:1787826412.148261:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70e600/0x22153cd396b81511 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826412.148270:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1059 00010000:00010000:0.0:1787826412.148275:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70e600/0x22153cd396b81511 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.148299:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81518 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.148311:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b814ee lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a94 expref: 49 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.148319:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81518 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.148350:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b814ee lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a94 expref: 49 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.148364:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b814ee lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a94 expref: 49 pid: 16564 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826412.148377:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce049b9a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585226112:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826412.148430:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf1817e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826412.157841:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826412.157955:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce049b9a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585226112:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826412.157982:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81518 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826412.158358:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563809152 00000100:00100000:3.0:1787826412.158366:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563809152 00010000:00010000:3.0:1787826412.158412:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b814ee lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a94 expref: 50 pid: 16564 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826412.158449:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1060 00000100:00100000:3.0:1787826412.158459:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf185ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+50:2403:x1874670563809152:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826412.158513:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826412.158521:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b814ee lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a94 expref: 50 pid: 16564 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.158533:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b814ee lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a94 expref: 50 pid: 16564 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.158556:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b814ee lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a94 expref: 50 pid: 16564 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.158571:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff90cf39656f00) 00010000:00010000:3.0:1787826412.158576:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81518 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.158585:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81518 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.158593:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81518 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.158811:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826412.158869:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf185ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:2403:x1874670563809152:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 410us (1036us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826412.158878:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1060 00010000:00010000:2.0:1787826412.161287:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81518 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.164049:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81518 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826412.167877:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce049b83c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1874670585226240:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787826412.167945:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826412.168014:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf078fff00 going to sleep for 11 seconds 00000100:00100000:3.0:1787826412.170607:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585226240 00000100:00100000:3.0:1787826412.170621:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585226240 00000100:00100000:0.0:1787826412.174857:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1421 00000100:00100000:0.0:1787826412.174871:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf07dbe050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6522:x1874670585226240:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787826412.175004:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf07dbe050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6522:x1874670585226240:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 136us (7059us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826412.175012:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1421 00000100:00100000:1.0:1787826412.175285:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce049b83c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1874670585226240:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787826412.175368:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934771 00000001:00080000:1.0:1787826412.175499:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934772 00010000:00010000:1.0:1787826412.175524:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81518 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.175536:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81518 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.175543:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81518 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.175550:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165e200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826412.175554:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81518 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.175560:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81518 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.175579:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff90cf39656f00) 00010000:00010000:1.0:1787826412.175581:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787826412.175586:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81518 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.175592:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81518 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.175612:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70e600/0x22153cd396b81511 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.175618:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70e600/0x22153cd396b81511 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.175623:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70e600/0x22153cd396b81511 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.175628:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0a70e600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826412.175631:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70e600/0x22153cd396b81511 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.175637:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70e600/0x22153cd396b81511 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.175646:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826412.175648:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787826412.175651:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70e600/0x22153cd396b81511 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.175657:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70e600/0x22153cd396b81511 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.175674:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826412.175676:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787826412.175683:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b81503 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a9b expref: 51 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826412.175765:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049bad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+50:55452:x1874670563808896:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 45235us (45767us total) trans 8589934773 rc 0/0 00000100:00100000:1.0:1787826412.175774:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1067 00000020:00080000:1.0:1787826412.175778:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1787826412.181573:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826412.181651:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563809280 00000100:00100000:3.0:1787826412.181660:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563809280 00000100:00100000:3.0:1787826412.181710:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3637 00000100:00100000:3.0:1787826412.181719:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049b8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+50:55452:x1874670563809280:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826412.181740:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826412.181758:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b8151f lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0aa2 expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.181811:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b8151f lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0aa2 expref: 51 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.181825:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b8151f lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0aa2 expref: 51 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.181841:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826412.181844:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826412.181848:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401400, rc 0) 00000100:00100000:3.0:1787826412.181902:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049b8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+51:55452:x1874670563809280:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 185us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826412.181909:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3637 00000100:00100000:0.0:1787826412.189088:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826412.189183:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563809536 00000100:00100000:3.0:1787826412.189193:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563809536 00000100:00100000:3.0:1787826412.189260:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1068 00000100:00100000:3.0:1787826412.189270:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049bbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+51:55452:x1874670563809536:12345-192.168.203.39@tcp:35:lfs.0 00000004:00080000:2.0:1787826412.190059:0:6521:0:(mdd_object.c:4014:mdd_close()) Object [0x200000405:0x1f:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787826412.190117:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].24, 64 off10208 00000004:00080000:2.0:1787826412.190127:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1358201655636ns, next at 1359201653446ns, rc = 0 00000001:00080000:2.0:1787826412.190134:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934774 00010000:00010000:2.0:1787826412.190185:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81526 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.190201:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81526 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.190221:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81526 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.190229:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81526 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.190235:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81526 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.190241:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81526 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.190263:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826412.190395:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826412.190403:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81526 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.190410:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834600 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826412.190413:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81526 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.190420:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81526 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.190433:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff90cf39e67b00) 00010000:00010000:0.0:1787826412.190436:0:8451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787826412.190440:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81526 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.190446:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81526 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.190463:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826412.190465:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826412.190467:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826412.190879:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049bbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55452:x1874670563809536:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 1606us (1796us total) trans 8589934775 rc 0/0 00000100:00100000:2.0:1787826412.190888:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1068 00000020:00080000:2.0:1787826412.190894:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787826412.194467:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826412.194609:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563809792 00000100:00100000:1.0:1787826412.194618:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563809792 00000100:00100000:1.0:1787826412.194679:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1069 00000100:00100000:1.0:1787826412.194689:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049b83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55452:x1874670563809792:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:1.0:1787826412.194912:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049b83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+54:55452:x1874670563809792:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 223us (455us total) trans 8589934776 rc 0/0 00000100:00100000:1.0:1787826412.194920:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1069 00000100:00100000:0.0:1787826412.235560:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826412.235793:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563809920 00000100:00100000:3.0:1787826412.235803:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563809920 00000100:00100000:3.0:1787826412.235866:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3638 00000100:00100000:3.0:1787826412.235877:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+54:55454:x1874670563809920:12345-192.168.203.39@tcp:101:getfattr.0 00010000:00010000:3.0:1787826412.235901:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826412.235924:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b8152d lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0aa9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.235988:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b81534 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.236002:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b81534 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.236014:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b81534 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.236029:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b8153b lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.236036:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b8153b lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.236042:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b8153b lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.236115:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81542 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.236124:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81542 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.236131:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81542 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826412.236169:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:3.0:1787826412.236173:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826412.236191:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81542 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.236317:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81542 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.236329:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b81534 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.236335:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b81534 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.236341:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b81534 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.236347:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b81534 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.236353:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826412.236357:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b81534 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.236365:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b81534 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.236376:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf39656100) 00010000:00010000:3.0:1787826412.236379:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826412.236384:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b81534 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.236390:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b81534 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.236413:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b8153b lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.236420:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b8153b lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.236426:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b8153b lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.236431:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826412.236434:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b8153b lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.236439:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b8153b lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.236447:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf39656000) 00010000:00010000:3.0:1787826412.236449:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826412.236452:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b8153b lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.236458:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b8153b lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.236818:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b8152d lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0aa9 expref: 56 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.236844:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81542 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0aa9 expref: 55 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.236852:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826412.236854:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826412.236857:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401a00, rc 0) 00000100:00100000:2.0:1787826412.236991:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+55:55454:x1874670563809920:12345-192.168.203.39@tcp:101:getfattr.0 Request processed in 1115us (1440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826412.237000:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3638 00000100:00100000:3.0:1787826412.241035:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826412.241129:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563810048 00000100:00100000:0.0:1787826412.241139:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563810048 00000100:00100000:0.0:1787826412.241218:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2001 00000100:00100000:0.0:1787826412.241227:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2403:x1874670563810048:12345-192.168.203.39@tcp:101:getfattr.0 00010000:00010000:0.0:1787826412.241244:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826412.241261:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d39501d2/0x22153cd396b81549 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x105:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0ab0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.241287:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x105:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787826412.241300:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x105:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826412.241308:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d39501d2/0x22153cd396b81549 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ab0 expref: 9 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.241327:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d39501d2/0x22153cd396b81549 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ab0 expref: 9 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.241341:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165e600, rc 0) 00000100:00100000:0.0:1787826412.241731:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670563810048:12345-192.168.203.39@tcp:101:getfattr.0 Request processed in 504us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826412.241738:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2001 00000100:00100000:1.0:1787826412.306929:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826412.307513:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563810304 00000100:00100000:3.0:1787826412.307523:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563810304 00000100:00100000:3.0:1787826412.307581:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3639 00000100:00100000:3.0:1787826412.307591:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+55:55458:x1874670563810304:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826412.307610:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826412.307630:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b81550 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0ab7 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826412.307788:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1c:0x0]: returning size 4096 00010000:00010000:3.0:1787826412.307881:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b81550 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ab7 expref: 57 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.307897:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ce01f45300) 00010000:00010000:3.0:1787826412.307900:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787826412.307906:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b81550 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ab7 expref: 57 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.307919:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400200, rc 0) 00000100:00100000:3.0:1787826412.307983:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+56:55458:x1874670563810304:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 393us (1064us total) trans 8589934777 rc 301/301 00000100:00100000:3.0:1787826412.307991:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3639 00000100:00100000:0.0:1787826412.315724:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826412.315877:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563810432 00000100:00100000:2.0:1787826412.315888:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563810432 00000100:00100000:2.0:1787826412.315950:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3640 00000100:00100000:2.0:1787826412.315961:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049b9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+56:55458:x1874670563810432:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:2.0:1787826412.316042:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b8155e lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.316059:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b8155e lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.316070:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b8155e lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.316082:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81565 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.316089:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81565 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.316096:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81565 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.316178:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8156c lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.316187:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8156c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.316194:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8156c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826412.316243:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:2.0:1787826412.316247:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826412.316259:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8156c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.316271:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b8155e lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.316278:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b8155e lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.316284:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b8155e lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.316300:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b8155e lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.316306:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826412.316310:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b8155e lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.316318:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b8155e lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.316329:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf39e67800) 00010000:00010000:2.0:1787826412.316331:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826412.316336:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b8155e lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.316341:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b8155e lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.316361:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81565 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.316367:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81565 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.316372:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81565 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.316386:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826412.316390:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81565 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.316396:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81565 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.316404:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf39e67f00) 00010000:00010000:2.0:1787826412.316407:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826412.316410:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81565 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.316416:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81565 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.316428:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8156c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.316434:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8156c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.316438:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8156c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.316443:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826412.316446:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8156c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.316451:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8156c lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.316457:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826412.316459:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826412.316462:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8156c lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.316466:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8156c lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826412.316592:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049b9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+56:55458:x1874670563810432:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 632us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826412.316600:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3640 00000100:00100000:1.0:1787826412.322751:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826412.322881:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563810688 00000100:00100000:2.0:1787826412.322891:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563810688 00000100:00100000:2.0:1787826412.322947:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1070 00000100:00100000:2.0:1787826412.322957:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf39579c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+56:55458:x1874670563810688:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:2.0:1787826412.323195:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf39579c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+57:55458:x1874670563810688:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 238us (452us total) trans 8589934778 rc 0/0 00000100:00100000:2.0:1787826412.323212:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1070 00000100:00100000:1.0:1787826412.355126:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826412.355235:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563810944 00000100:00100000:3.0:1787826412.355246:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563810944 00000100:00100000:3.0:1787826412.355311:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3641 00000100:00100000:3.0:1787826412.355322:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f05e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+57:55460:x1874670563810944:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826412.355346:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826412.355367:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b81573 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0abe expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.355517:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b8157a lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.355532:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b8157a lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.355545:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b8157a lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826412.355557:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:3.0:1787826412.355660:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b81573 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0abe expref: 60 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.355678:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b8157a lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0abe expref: 59 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.355687:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826412.355690:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787826412.355694:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400600, rc 0) 00000100:00100000:3.0:1787826412.355908:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f05e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55460:x1874670563810944:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 587us (790us total) trans 8589934779 rc 0/0 00000100:00100000:3.0:1787826412.355916:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3641 00000100:00100000:0.0:1787826412.363602:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826412.363715:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563811072 00000100:00100000:2.0:1787826412.363724:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563811072 00000100:00100000:2.0:1787826412.363788:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2002 00000100:00100000:2.0:1787826412.363799:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049bad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563811072:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826412.363817:0:30695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826412.363836:0:30695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b81588 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x105:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0ac5 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.363861:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x105:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826412.363866:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x105:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826412.363875:0:30695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b81588 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ac5 expref: 10 pid: 30695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.363892:0:30695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b81588 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ac5 expref: 10 pid: 30695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.363905:0:30695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834a00, rc 0) 00000100:00100000:2.0:1787826412.363963:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049bad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563811072:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 165us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826412.363970:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2002 00000100:00100000:2.0:1787826412.373969:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826412.374055:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563811328 00000100:00100000:0.0:1787826412.374064:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563811328 00000100:00100000:0.0:1787826412.374128:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3642 00000100:00100000:0.0:1787826412.374136:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3960ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55460:x1874670563811328:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826412.374166:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826412.374185:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b8158f lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0acc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.374548:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81596 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.374568:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81542 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0aa9 expref: 60 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.374577:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81596 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.374608:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81542 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0aa9 expref: 60 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.374622:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81542 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0aa9 expref: 60 pid: 6520 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826412.374635:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce049bbc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1874670585226368:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826412.374786:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce02725cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826412.377566:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce049bbc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1874670585226368:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826412.377575:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00010000:00010000:2.0:1787826412.377598:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81596 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826412.377678:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563811456 00000100:00100000:1.0:1787826412.377685:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563811456 00010000:00010000:1.0:1787826412.377734:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81542 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0aa9 expref: 61 pid: 6520 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826412.377773:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1061 00000100:00100000:1.0:1787826412.377784:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab143c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+61:2403:x1874670563811456:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826412.377799:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826412.377806:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81542 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0aa9 expref: 61 pid: 6520 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.377819:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81542 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0aa9 expref: 61 pid: 6520 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.377842:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81542 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0aa9 expref: 61 pid: 6520 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.377858:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826412.377863:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81596 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.377872:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81596 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.377880:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81596 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.377908:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826412.377960:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab143c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:2403:x1874670563811456:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 177us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826412.377968:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1061 00010000:00010000:0.0:1787826412.378164:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81596 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.378173:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81596 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826412.378196:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:0.0:1787826412.378453:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b8158f lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0acc expref: 61 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.378521:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81596 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0acc expref: 60 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.378530:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826412.378533:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787826412.378536:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165e200, rc 0) 00000100:00100000:0.0:1787826412.378573:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3960ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:55460:x1874670563811328:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 4438us (4612us total) trans 8589934780 rc 0/0 00000100:00100000:0.0:1787826412.378581:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3642 00000100:00100000:3.0:1787826412.388418:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826412.388514:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563811712 00000100:00100000:0.0:1787826412.388524:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563811712 00000100:00100000:0.0:1787826412.388591:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3643 00000100:00100000:0.0:1787826412.388602:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:55460:x1874670563811712:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826412.388628:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826412.388654:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b815a4 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0ad3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.389126:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b815ab lrc: 3/1,0 mode: --/PR res: [0x200000405:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.389140:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b815ab lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.389155:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b815ab lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826412.389166:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x20:0x0]: returning size 0 00010000:00010000:0.0:1787826412.389220:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b815a4 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ad3 expref: 63 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.389245:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b815ab lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ad3 expref: 62 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.389258:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x20:0x0].0x0 (ffff90cf3abcb300) 00010000:00010000:0.0:1787826412.389261:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826412.389264:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165ee00, rc 0) 00000100:00100000:0.0:1787826412.389321:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+62:55460:x1874670563811712:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 721us (913us total) trans 8589934781 rc 0/0 00000100:00100000:0.0:1787826412.389328:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3643 00000100:00100000:1.0:1787826412.404167:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826412.404675:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563811968 00000100:00100000:3.0:1787826412.404686:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563811968 00000100:00100000:3.0:1787826412.404755:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3644 00000100:00100000:3.0:1787826412.404766:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+62:55460:x1874670563811968:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826412.404790:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826412.404811:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b815b9 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0ada expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.404920:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b815c0 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.404935:0:8247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b815ab lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ad3 expref: 63 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.404945:0:8247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b815c0 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.404977:0:8247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b815ab lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ad3 expref: 63 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.404991:0:8247:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b815ab lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ad3 expref: 63 pid: 6518 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826412.405004:0:8247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab15680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8247:1874670585226496:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826412.405233:0:8247:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10aba000 going to sleep for 11 seconds 00000100:00100000:3.0:1787826412.413357:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826412.413578:0:8247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab15680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8247:1874670585226496:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826412.413606:0:8247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b815c0 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826412.418144:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563812096 00000100:00100000:1.0:1787826412.418158:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563812096 00010000:00010000:1.0:1787826412.418216:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b815ab lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ad3 expref: 64 pid: 6518 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826412.418319:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1062 00000100:00100000:1.0:1787826412.418328:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab15a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+64:2403:x1874670563812096:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826412.418344:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826412.418351:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b815ab lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ad3 expref: 64 pid: 6518 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.418363:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b815ab lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ad3 expref: 64 pid: 6518 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.418401:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b815ab lrc: 0/0,0 mode: --/PR res: [0x200000405:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ad3 expref: 64 pid: 6518 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.418417:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x20:0x0].0x0 (ffff90cf3abcb300) 00010000:00010000:1.0:1787826412.418421:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b815c0 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.418429:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b815c0 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.418436:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b815c0 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.418466:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826412.418557:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab15a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+63:2403:x1874670563812096:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 230us (5209us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826412.418565:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1062 00010000:00010000:0.0:1787826412.420615:0:8247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b815c0 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.420631:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b815c0 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826412.420651:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x20:0x0]: returning size 0 00000004:00080000:0.0:1787826412.420821:0:8247:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x106:0x0], index 1: 0 00010000:00010000:0.0:1787826412.420927:0:8247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b815c0 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.420935:0:8247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b815c0 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.420940:0:8247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b815c0 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.420946:0:8247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826412.420950:0:8247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b815c0 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.420958:0:8247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b815c0 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.420972:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x20:0x0].0x0 (ffff90cf3abcb300) 00010000:00010000:0.0:1787826412.420976:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826412.420980:0:8247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b815c0 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.420987:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b815c0 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.421037:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b815b9 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x20:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ada expref: 63 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.421064:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x20:0x0].0x0 (ffff90cf3abcb300) 00010000:00010000:0.0:1787826412.421066:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787826412.421071:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b815b9 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x20:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ada expref: 63 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.421086:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401800, rc 0) 00000100:00100000:0.0:1787826412.421142:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+62:55460:x1874670563811968:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 16377us (16985us total) trans 8589934782 rc 301/301 00000100:00100000:0.0:1787826412.421151:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3644 00000100:00100000:1.0:1787826412.426110:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826412.426187:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563812352 00000100:00100000:2.0:1787826412.426198:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563812352 00000100:00100000:2.0:1787826412.426295:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1071 00000100:00100000:2.0:1787826412.426305:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f05680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+62:55460:x1874670563812352:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:2.0:1787826412.426607:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f05680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+63:55460:x1874670563812352:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 303us (504us total) trans 8589934783 rc 0/0 00000100:00100000:2.0:1787826412.426615:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1071 00000100:00100000:0.0:1787826412.434358:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826412.434504:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563812480 00000100:00100000:1.0:1787826412.434513:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563812480 00000100:00100000:1.0:1787826412.434574:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3645 00000100:00100000:1.0:1787826412.434584:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049ba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+63:55460:x1874670563812480:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826412.434606:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826412.434626:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70e600/0x22153cd396b815ce lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0ae1 expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.434712:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70fe00/0x22153cd396b815d5 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.434726:0:9966:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81596 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0acc expref: 64 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.434736:0:9966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70fe00/0x22153cd396b815d5 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.434779:0:9966:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81596 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0acc expref: 64 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.434793:0:9966:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81596 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0acc expref: 64 pid: 6520 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826412.434807:0:9966:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce04f07840 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9966:1874670585226624:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826412.434898:0:9966:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf1850c900 going to sleep for 11 seconds 00000100:00100000:3.0:1787826412.444567:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826412.444736:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563812608 00000100:00100000:0.0:1787826412.444745:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563812608 00010000:00010000:0.0:1787826412.444804:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81596 lrc: 5/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0acc expref: 65 pid: 6520 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826412.444863:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1063 00000100:00100000:0.0:1787826412.444873:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab16d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+65:2404:x1874670563812608:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826412.444887:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826412.444898:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81596 lrc: 5/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0acc expref: 65 pid: 6520 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.444912:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81596 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0acc expref: 65 pid: 6520 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.445089:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826412.445094:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70fe00/0x22153cd396b815d5 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.445104:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70fe00/0x22153cd396b815d5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.445112:0:10340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70fe00/0x22153cd396b815d5 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.445131:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826412.445191:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab16d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+65:2404:x1874670563812608:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 318us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826412.445198:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1063 00010000:00010000:1.0:1787826412.445626:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81596 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0acc expref: 64 pid: 6520 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826412.445646:0:9966:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce04f07840 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9966:1874670585226624:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826412.445668:0:9966:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70fe00/0x22153cd396b815d5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.445679:0:9966:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70fe00/0x22153cd396b815d5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.445685:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70fe00/0x22153cd396b815d5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826412.445738:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:1.0:1787826412.445744:0:9966:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826412.445775:0:9966:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70fe00/0x22153cd396b815d5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.445805:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70e600/0x22153cd396b815ce lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ae1 expref: 64 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.445821:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70fe00/0x22153cd396b815d5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ae1 expref: 63 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.445830:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826412.445832:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826412.445835:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0a70fe00, rc 0) 00000100:00100000:1.0:1787826412.445932:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049ba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+63:55460:x1874670563812480:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 11349us (11582us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826412.445941:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3645 00000100:00100000:2.0:1787826412.457216:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826412.457321:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563812736 00000100:00100000:1.0:1787826412.457331:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563812736 00000100:00100000:1.0:1787826412.457589:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2003 00000100:00100000:1.0:1787826412.457601:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2402:x1874670563812736:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826412.457621:0:30398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826412.457639:0:30398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c43350b1/0x22153cd396b815dc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x105:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0ae8 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.457665:0:30398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x105:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826412.457669:0:30398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x105:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826412.457678:0:30398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c43350b1/0x22153cd396b815dc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ae8 expref: 11 pid: 30398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.457695:0:30398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c43350b1/0x22153cd396b815dc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ae8 expref: 11 pid: 30398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.457709:0:30398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0a70e600, rc 0) 00000100:00100000:1.0:1787826412.457768:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2402:x1874670563812736:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 170us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826412.457776:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2003 00000100:00100000:2.0:1787826412.462005:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826412.462081:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563812864 00000100:00100000:0.0:1787826412.462101:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563812864 00000100:00100000:0.0:1787826412.462163:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3646 00000100:00100000:0.0:1787826412.462172:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+63:55460:x1874670563812864:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826412.462193:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826412.462225:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b815e3 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0aef expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.462294:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b815ea lrc: 3/1,0 mode: --/PR res: [0x200000405:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.462308:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b815ea lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x20:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.462319:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b815ea lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x20:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826412.462361:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x20:0x0]: returning size 0 00000004:00200000:0.0:1787826412.462366:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826412.462382:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b815ea lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x20:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.462418:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b815e3 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0aef expref: 65 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.462437:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b815ea lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x20:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0aef expref: 64 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.462445:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x20:0x0].0x0 (ffff90cf3abcb300) 00010000:00010000:0.0:1787826412.462448:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787826412.462452:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165f600, rc 0) 00000100:00100000:0.0:1787826412.462542:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+64:55460:x1874670563812864:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 370us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826412.462550:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3646 00000100:00100000:2.0:1787826412.468575:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826412.468675:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563812992 00000100:00100000:0.0:1787826412.468686:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563812992 00000100:00100000:0.0:1787826412.468734:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2004 00000100:00100000:0.0:1787826412.468744:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2402:x1874670563812992:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826412.468762:0:30696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826412.468782:0:30696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac666fdd/0x22153cd396b815f1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x106:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0af6 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826412.468809:0:30696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x106:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826412.468829:0:30696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x106:0x0].0x0 since=1358s v=(0 0) 00010000:00010000:0.0:1787826412.468834:0:30696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x106:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826412.468845:0:30696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac666fdd/0x22153cd396b815f1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x106:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0af6 expref: 11 pid: 30696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.468864:0:30696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ac666fdd/0x22153cd396b815f1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x106:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0af6 expref: 11 pid: 30696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.468879:0:30696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165fe00, rc 0) 00000100:00100000:0.0:1787826412.468940:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2402:x1874670563812992:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 197us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826412.468948:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2004 00000100:00100000:3.0:1787826412.472067:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826412.472292:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563813248 00000100:00100000:2.0:1787826412.472302:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563813248 00000100:00100000:2.0:1787826412.472357:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3647 00000100:00100000:2.0:1787826412.472366:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab14780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+64:55460:x1874670563813248:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826412.472395:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826412.472416:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b815f8 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0afd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.472542:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b815ff lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.472557:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b815ff lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.472568:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b815ff lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826412.472580:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:2.0:1787826412.472667:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b815f8 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0afd expref: 67 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.472684:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b815ff lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0afd expref: 66 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.472693:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826412.472696:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787826412.472699:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835000, rc 0) 00000100:00100000:2.0:1787826412.472742:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab14780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+66:55460:x1874670563813248:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 377us (683us total) trans 8589934784 rc 0/0 00000100:00100000:2.0:1787826412.472749:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3647 00000100:00100000:2.0:1787826412.477572:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826412.477659:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563813376 00000100:00100000:1.0:1787826412.477669:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563813376 00000100:00100000:1.0:1787826412.477728:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2005 00000100:00100000:1.0:1787826412.477738:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2402:x1874670563813376:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826412.477755:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826412.477772:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8b52bb3/0x22153cd396b8160d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x105:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0b04 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.477795:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x105:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826412.477800:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x105:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826412.477808:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8b52bb3/0x22153cd396b8160d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b04 expref: 12 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.477825:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c8b52bb3/0x22153cd396b8160d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b04 expref: 12 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.477838:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0a067800, rc 0) 00000100:00100000:1.0:1787826412.477904:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2402:x1874670563813376:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 167us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826412.477910:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2005 00000100:00100000:0.0:1787826412.486196:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826412.486898:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563813504 00000100:00100000:3.0:1787826412.486908:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563813504 00000100:00100000:3.0:1787826412.486963:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2006 00000100:00100000:3.0:1787826412.486974:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049b92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563813504:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826412.486993:0:8545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826412.487011:0:8545:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000482bb568/0x22153cd396b81614 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x105:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0b0b expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.487036:0:8545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x105:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826412.487040:0:8545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x105:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826412.487049:0:8545:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000482bb568/0x22153cd396b81614 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b0b expref: 13 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.487067:0:8545:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000482bb568/0x22153cd396b81614 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b0b expref: 13 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.487080:0:8545:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400200, rc 0) 00000100:00100000:3.0:1787826412.487155:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049b92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2403:x1874670563813504:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 182us (967us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826412.487162:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2006 00000100:00100000:3.0:1787826412.496760:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826412.496859:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563813632 00000100:00100000:2.0:1787826412.496870:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563813632 00000100:00100000:2.0:1787826412.496930:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2007 00000100:00100000:2.0:1787826412.496941:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab15e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2404:x1874670563813632:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:2.0:1787826412.496982:0:30695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d9e5b8b8/0x22153cd396b8161b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x105:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.497000:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x105:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826412.497004:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x105:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826412.497009:0:30695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9e5b8b8/0x22153cd396b8161b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.497022:0:30695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9e5b8b8/0x22153cd396b8161b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.497048:0:30695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d9e5b8b8/0x22153cd396b8161b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.497059:0:30695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9e5b8b8/0x22153cd396b8161b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.497066:0:30695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9e5b8b8/0x22153cd396b8161b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.497072:0:30695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834400 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826412.497075:0:30695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9e5b8b8/0x22153cd396b8161b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.497101:0:30695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9e5b8b8/0x22153cd396b8161b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.497116:0:30695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9e5b8b8/0x22153cd396b8161b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x105:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.497124:0:30695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9e5b8b8/0x22153cd396b8161b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x105:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826412.497356:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab15e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2404:x1874670563813632:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 415us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826412.497364:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2007 00000100:00100000:1.0:1787826412.509639:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826412.513574:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563813760 00000100:00100000:3.0:1787826412.513589:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563813760 00000100:00100000:2.0:1787826412.516409:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2008 00000100:00100000:2.0:1787826412.516434:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f07840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2404:x1874670563813760:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826412.516457:0:14864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826412.516498:0:14864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9e5b8b8/0x22153cd396b81622 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x105:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0b12 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.516525:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x105:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826412.516529:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x105:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826412.516537:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9e5b8b8/0x22153cd396b81622 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b12 expref: 14 pid: 14864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.516552:0:14864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9e5b8b8/0x22153cd396b81622 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b12 expref: 14 pid: 14864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.516565:0:14864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834400, rc 0) 00000100:00100000:2.0:1787826412.516627:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f07840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563813760:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 198us (6997us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826412.516635:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2008 00000100:00100000:0.0:1787826412.594356:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826412.594449:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563813888 00000100:00100000:3.0:1787826412.594459:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563813888 00000100:00100000:3.0:1787826412.594546:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2009 00000100:00100000:3.0:1787826412.594556:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049b9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2403:x1874670563813888:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826412.594574:0:30696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826412.594592:0:30696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b33b8f4a/0x22153cd396b81629 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x105:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0b19 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.594618:0:30696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x105:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826412.594623:0:30696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x105:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826412.594632:0:30696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b33b8f4a/0x22153cd396b81629 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b19 expref: 15 pid: 30696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.594649:0:30696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b33b8f4a/0x22153cd396b81629 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b19 expref: 15 pid: 30696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.594662:0:30696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401600, rc 0) 00000100:00100000:3.0:1787826412.594724:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049b9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2403:x1874670563813888:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 169us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826412.594731:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2009 00000100:00100000:3.0:1787826412.598249:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826412.600126:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563814016 00000100:00100000:1.0:1787826412.600140:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563814016 00000100:00100000:1.0:1787826412.600226:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2010 00000100:00100000:1.0:1787826412.600237:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab16580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:55460:x1874670563814016:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826412.600256:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826412.600275:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009befb8a5/0x22153cd396b81630 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x105:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0b20 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.600302:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x105:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826412.600307:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x105:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826412.600315:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009befb8a5/0x22153cd396b81630 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b20 expref: 16 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.600330:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009befb8a5/0x22153cd396b81630 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b20 expref: 16 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.600348:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90ce0a067400, rc 0) 00000100:00100000:1.0:1787826412.603018:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab16580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:55460:x1874670563814016:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 2769us (4764us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826412.603030:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2010 00000100:00100000:2.0:1787826412.606901:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826412.606989:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563814144 00000100:00100000:3.0:1787826412.607000:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563814144 00000100:00100000:3.0:1787826412.607061:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2011 00000100:00100000:3.0:1787826412.607072:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2404:x1874670563814144:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826412.607099:0:8545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826412.607119:0:8545:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d747c98/0x22153cd396b81637 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x105:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0b27 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.607145:0:8545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x105:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826412.607149:0:8545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x105:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826412.607158:0:8545:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d747c98/0x22153cd396b81637 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b27 expref: 17 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.607175:0:8545:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004d747c98/0x22153cd396b81637 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b27 expref: 17 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.607188:0:8545:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401200, rc 0) 00000100:00100000:3.0:1787826412.607263:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+17:2404:x1874670563814144:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 192us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826412.607271:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2011 00000100:00100000:0.0:1787826412.609953:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826412.610340:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563814272 00000100:00100000:3.0:1787826412.610351:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563814272 00000100:00100000:3.0:1787826412.610423:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3648 00000100:00100000:3.0:1787826412.610433:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+66:55460:x1874670563814272:12345-192.168.203.39@tcp:44:lfs.0 00000001:00080000:0.0:1787826412.613878:0:34481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934784 is committed 00000004:00080000:0.0:1787826412.613914:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 24 committed 00000020:00080000:0.0:1787826412.613965:0:34481:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90cf1850cc00 refcount 2 committed 0 result 0 batchid 4294969329 00000020:00080000:0.0:1787826412.613970:0:34481:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cf2f580600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90cf10aba0c0 00000020:00080000:0.0:1787826412.613973:0:34481:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cf03844f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90cf1850c6c0 00000020:00080000:0.0:1787826412.613976:0:34481:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cf03844300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90ce04622400 00000020:00080000:0.0:1787826412.613979:0:34481:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000bd0:0x2:0x0].4 00000020:00080000:3.0:1787826412.614073:0:34512:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969327 00000100:00100000:3.0:1787826412.614223:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:55460:x1874670563814272:12345-192.168.203.39@tcp:44:lfs.0 Request processed in 3787us (4275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826412.614234:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3648 00010000:00010000:2.0:1787826412.614942:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b8140e lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.614953:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b8140e lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.614960:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b8140e lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.614965:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165ea00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826412.614970:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b8140e lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.614977:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b8140e lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.614993:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e:0x0].0x0 (ffff90cf3abcb100) 00010000:00010000:2.0:1787826412.614996:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826412.615000:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b8140e lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.615006:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b8140e lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.615032:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b8141c lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.615038:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b8141c lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.615044:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b8141c lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.615048:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401e00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826412.615051:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b8141c lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.615056:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b8141c lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.615063:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826412.615066:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826412.615068:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b8141c lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.615077:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b8141c lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826412.616070:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce04f070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585226752:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787826412.616151:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826412.616250:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585226752 00000100:00100000:1.0:1787826412.616258:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585226752 00000100:00100000:1.0:1787826412.616307:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2012 00000100:00100000:1.0:1787826412.616316:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3645:x1874670585226752:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787826412.616341:0:28853:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:261 count 1 00010000:00010000:1.0:1787826412.616363:0:28853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0ad9192/0x22153cd396b8163e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x105:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.616397:0:28853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b81382 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a16 expref: 10 pid: 30696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.616405:0:28853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x105:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787826412.616410:0:28853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x105:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826412.616415:0:28853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0ad9192/0x22153cd396b8163e lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.616451:0:28853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b81382 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a16 expref: 10 pid: 30696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.616466:0:28853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b81382 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a16 expref: 10 pid: 30696 timeout: 1458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826412.616508:0:28853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce04f07c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28853:1874670585226880:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826412.616573:0:28853:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf1850c900 going to sleep for 11 seconds 00000100:00100000:3.0:1787826412.617149:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826412.618526:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563814400 00000100:00100000:1.0:1787826412.618538:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563814400 00000100:00100000:1.0:1787826412.618593:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2013 00000100:00100000:1.0:1787826412.618602:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf2f795050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2403:x1874670563814400:12345-192.168.203.39@tcp:16:lfs.0 00000100:00100000:1.0:1787826412.618693:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf2f795050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2403:x1874670563814400:12345-192.168.203.39@tcp:16:lfs.0 Request processed in 92us (1546us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826412.618701:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2013 00000100:00100000:3.0:1787826412.621443:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826412.621576:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563814528 00000100:00100000:2.0:1787826412.621583:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563814528 00010000:00010000:2.0:1787826412.621620:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b81382 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a16 expref: 11 pid: 30696 timeout: 1458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826412.621660:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1064 00000100:00100000:2.0:1787826412.621669:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2403:x1874670563814528:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826412.621683:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826412.621689:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b81382 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x105:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a16 expref: 11 pid: 30696 timeout: 1458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.621702:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b81382 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x105:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a16 expref: 11 pid: 30696 timeout: 1458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.621729:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x105:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826412.621733:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x105:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826412.621740:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b0ad9192/0x22153cd396b8163e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x105:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.621750:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0ad9192/0x22153cd396b8163e lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x105:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.621771:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826412.621818:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2403:x1874670563814528:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 149us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826412.621826:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1064 00010000:00010000:1.0:1787826412.622663:0:28853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b81382 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a16 expref: 10 pid: 30696 timeout: 1458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826412.622681:0:28853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce04f07c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28853:1874670585226880:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826412.622701:0:28853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b0ad9192/0x22153cd396b8163e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x105:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.622712:0:28853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b0ad9192/0x22153cd396b8163e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x105:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.622719:0:28853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0ad9192/0x22153cd396b8163e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x105:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.622728:0:28853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0ad9192/0x22153cd396b8163e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x105:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.622736:0:28853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0ad9192/0x22153cd396b8163e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x105:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.622751:0:28853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787826412.622924:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3645:x1874670585226752:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6608us (6772us total) trans 17179869652 rc 0/0 00000100:00100000:1.0:1787826412.622932:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2012 00000004:00080000:1.0:1787826412.623153:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce04f070c0/2, rc 0, transno 17179869652 00000100:00100000:1.0:1787826412.623160:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce04f070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585226752:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1787826412.623346:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826412.623354:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0ad9192/0x22153cd396b8163e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x105:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.623363:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0a066a00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826412.623368:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0ad9192/0x22153cd396b8163e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x105:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.623377:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0ad9192/0x22153cd396b8163e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x105:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.623408:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0ad9192/0x22153cd396b8163e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x105:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.623417:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0ad9192/0x22153cd396b8163e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x105:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.623434:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826412.623436:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826412.623438:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826412.634453:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826412.634657:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563814656 00000100:00100000:3.0:1787826412.634668:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563814656 00000100:00100000:3.0:1787826412.634723:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2014 00000100:00100000:3.0:1787826412.634733:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049b8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+17:2403:x1874670563814656:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:3.0:1787826412.634776:0:30696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b81645 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x105:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.634793:0:30696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x105:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826412.634796:0:30696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x105:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826412.634802:0:30696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b81645 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.636006:0:30696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b81645 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.636041:0:30696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b81645 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.636051:0:30696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b81645 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.636059:0:30696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b81645 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.636066:0:30696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400c00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826412.636070:0:30696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b81645 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.636079:0:30696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b81645 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.636096:0:30696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b81645 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x105:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.636103:0:30696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b81645 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x105:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826412.636225:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049b8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+17:2403:x1874670563814656:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 1491us (1778us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826412.636238:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2014 00000100:00100000:0.0:1787826412.639016:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826412.639112:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563814912 00000100:00100000:1.0:1787826412.639122:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563814912 00000100:00100000:1.0:1787826412.639177:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3649 00000100:00100000:1.0:1787826412.639187:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049bb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+32:55460:x1874670563814912:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:1.0:1787826412.639250:0:9966:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826412.639279:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b815ea lrc: 0/0,0 mode: --/PR res: [0x200000405:0x20:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0aef expref: 32 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.639297:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x20:0x0].0x0 (ffff90cf3abcb300) 00010000:00010000:1.0:1787826412.639308:0:9966:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826412.639340:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066a00/0x22153cd396b8164c lrc: 3/0,1 mode: --/PW res: [0x200000405:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.639352:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066a00/0x22153cd396b8164c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.639361:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066a00/0x22153cd396b8164c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826412.639539:0:9966:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000681c7392 reply state 000000004fb29208 transno 8589934785 ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066a00/0x22153cd396b8164c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.639551:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066a00/0x22153cd396b8164c lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.639558:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x20:0x0].0x0 (ffff90cf04f8b100) 00010000:00010000:1.0:1787826412.639560:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826412.639563:0:9966:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826412.639652:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049bb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:55460:x1874670563814912:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 466us (643us total) trans 8589934785 rc 0/0 00000100:00100000:1.0:1787826412.639659:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3649 00000100:00100000:2.0:1787826412.645077:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826412.645182:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563815040 00000100:00100000:0.0:1787826412.645192:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563815040 00000100:00100000:0.0:1787826412.645256:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3650 00000100:00100000:0.0:1787826412.645271:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:55460:x1874670563815040:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826412.645292:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826412.645312:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b81653 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0b2e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.645368:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b81653 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b2e expref: 34 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.645398:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b81653 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b2e expref: 34 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.645418:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x20:0x0].0x0 (ffff90cf04f8b100) 00010000:00010000:0.0:1787826412.645421:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826412.645425:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165f400, rc 0) 00000100:00100000:0.0:1787826412.645522:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:55460:x1874670563815040:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 253us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826412.645530:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3650 00000100:00100000:2.0:1787826412.653936:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826412.656240:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563815168 00000100:00100000:0.0:1787826412.656253:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563815168 00000100:00100000:0.0:1787826412.656398:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2015 00000100:00100000:0.0:1787826412.656408:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:55460:x1874670563815168:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826412.656425:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826412.656444:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a27ec96/0x22153cd396b8165a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0b35 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.656496:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ac666fdd/0x22153cd396b815f1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0af6 expref: 11 pid: 30696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.656506:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x106:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826412.656511:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x106:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826412.656516:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a27ec96/0x22153cd396b8165a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b35 expref: 11 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.656548:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ac666fdd/0x22153cd396b815f1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0af6 expref: 11 pid: 30696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.656561:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ac666fdd/0x22153cd396b815f1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0af6 expref: 11 pid: 30696 timeout: 1458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826412.656574:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce049ba940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1874670585227008:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826412.656666:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e33c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826412.664790:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826412.664999:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563815296 00000100:00100000:3.0:1787826412.665008:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563815296 00010000:00010000:3.0:1787826412.665043:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ac666fdd/0x22153cd396b815f1 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0af6 expref: 12 pid: 30696 timeout: 1458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826412.665088:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1065 00000100:00100000:3.0:1787826412.665097:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f04b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563815296:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826412.665110:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826412.665133:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ac666fdd/0x22153cd396b815f1 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x106:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0af6 expref: 12 pid: 30696 timeout: 1458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.665146:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ac666fdd/0x22153cd396b815f1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x106:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0af6 expref: 12 pid: 30696 timeout: 1458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.665171:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x106:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826412.665175:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x106:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826412.665182:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009a27ec96/0x22153cd396b8165a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x106:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b35 expref: 12 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.665193:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a27ec96/0x22153cd396b8165a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x106:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b35 expref: 12 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.665237:0:6503:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009a27ec96/0x22153cd396b8165a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x106:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b35 expref: 12 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826412.665252:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab16940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6503:1874670585227136:192.168.203.39@tcp:105: 00000100:00100000:3.0:1787826412.665332:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10aba900 going to sleep for 11 seconds 00010000:00010000:0.0:1787826412.666128:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac666fdd/0x22153cd396b815f1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x106:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0af6 expref: 12 pid: 30696 timeout: 1458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826412.666147:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce049ba940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1874670585227008:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826412.666173:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009a27ec96/0x22153cd396b8165a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b35 expref: 11 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.666189:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165f600, rc 0) 00000100:00100000:0.0:1787826412.666242:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:55460:x1874670563815168:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 9835us (12316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826412.666249:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2015 00000100:00100000:1.0:1787826412.673216:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826412.673441:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab16940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6503:1874670585227136:192.168.203.39@tcp:105: 00010000:00010000:3.0:1787826412.673467:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826412.673562:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f04b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670563815296:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 8465us (8779us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826412.673574:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1065 00000100:00100000:2.0:1787826412.675018:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563815424 00000100:00100000:2.0:1787826412.675029:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563815424 00000100:00100000:2.0:1787826412.675212:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2016 00000100:00100000:2.0:1787826412.675222:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f07840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563815424:12345-192.168.203.39@tcp:2:lfs.0 00002000:00010000:2.0:1787826412.675413:0:8545:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x106:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787826412.675417:0:8545:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x106:0x0] updating lvb mtime from disk: 0 -> 1787826412 00002000:00010000:2.0:1787826412.675421:0:8545:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x106:0x0] updating lvb atime from disk: 0 -> 1787826412 00002000:00010000:2.0:1787826412.675423:0:8545:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x106:0x0] updating lvb ctime from disk: 0 -> 1787826413 00002000:00010000:2.0:1787826412.675424:0:8545:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x106:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1787826412.675504:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f07840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2404:x1874670563815424:12345-192.168.203.39@tcp:2:lfs.0 Request processed in 284us (2309us total) trans 17179869653 rc 0/0 00000100:00100000:2.0:1787826412.675512:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2016 00000100:00100000:1.0:1787826412.682720:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826412.682820:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563815680 00000100:00100000:3.0:1787826412.682830:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563815680 00000100:00100000:3.0:1787826412.682892:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3651 00000100:00100000:3.0:1787826412.682902:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f07c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:55460:x1874670563815680:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:3.0:1787826412.682955:0:32404:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826412.682983:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a70fe00/0x22153cd396b815d5 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ae1 expref: 34 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.683003:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826412.683008:0:32404:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826412.683056:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b81661 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.683069:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b81661 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.683079:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b81661 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826412.683271:0:32404:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000025df4848 reply state 000000007c711f54 transno 8589934786 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b81661 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.683284:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b81661 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.683290:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826412.683293:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826412.683296:0:32404:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826412.684307:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f07c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:55460:x1874670563815680:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 1403us (1592us total) trans 8589934786 rc 0/0 00000100:00100000:3.0:1787826412.684316:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3651 00000100:00100000:3.0:1787826412.695611:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826412.699308:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563815808 00000100:00100000:2.0:1787826412.699324:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563815808 00000100:00100000:2.0:1787826412.699938:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2017 00000100:00100000:2.0:1787826412.699951:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab16940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+17:55460:x1874670563815808:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826412.699971:0:30695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826412.699991:0:30695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000382351a4/0x22153cd396b81668 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x105:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0b3c expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.700022:0:30695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e32bc9b1/0x22153cd396b813e4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a40 expref: 18 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.700037:0:30695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004d747c98/0x22153cd396b81637 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b27 expref: 18 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.700045:0:30695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009befb8a5/0x22153cd396b81630 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b20 expref: 18 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.700054:0:30695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b33b8f4a/0x22153cd396b81629 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b19 expref: 18 pid: 30696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.700061:0:30695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9e5b8b8/0x22153cd396b81622 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b12 expref: 18 pid: 14864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.700069:0:30695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000482bb568/0x22153cd396b81614 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b0b expref: 18 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.700076:0:30695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c8b52bb3/0x22153cd396b8160d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b04 expref: 18 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.700612:0:30695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c43350b1/0x22153cd396b815dc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ae8 expref: 18 pid: 30398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.700620:0:30695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b81588 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ac5 expref: 18 pid: 30695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.700633:0:30695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d39501d2/0x22153cd396b81549 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ab0 expref: 18 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.700642:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x105:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826412.700647:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x105:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826412.700653:0:30695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000382351a4/0x22153cd396b81668 lrc: 13/0,0 mode: --/PW res: [0x280000401:0x105:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b3c expref: 18 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.700695:0:30695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d39501d2/0x22153cd396b81549 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ab0 expref: 18 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.700711:0:30695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d39501d2/0x22153cd396b81549 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ab0 expref: 18 pid: 8435 timeout: 1458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826412.700726:0:30695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce044d30c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:30695:1874670585227264:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826412.701288:0:30695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b81588 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ac5 expref: 18 pid: 30695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.701300:0:30695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b81588 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ac5 expref: 18 pid: 30695 timeout: 1458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826412.701310:0:30695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce044d0780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:30695:1874670585227392:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826412.701343:0:30695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c43350b1/0x22153cd396b815dc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ae8 expref: 18 pid: 30398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.701354:0:30695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c43350b1/0x22153cd396b815dc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ae8 expref: 18 pid: 30398 timeout: 1458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826412.701363:0:30695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce044d2580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:30695:1874670585227520:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826412.701410:0:30695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c8b52bb3/0x22153cd396b8160d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b04 expref: 18 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.701420:0:30695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c8b52bb3/0x22153cd396b8160d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b04 expref: 18 pid: 8436 timeout: 1458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826412.701429:0:30695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce044d3c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:30695:1874670585227648:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826412.701457:0:30695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000482bb568/0x22153cd396b81614 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b0b expref: 18 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.701467:0:30695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000482bb568/0x22153cd396b81614 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b0b expref: 18 pid: 8545 timeout: 1458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826412.701508:0:30695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce044d1a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:30695:1874670585227776:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826412.701546:0:30695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d9e5b8b8/0x22153cd396b81622 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b12 expref: 18 pid: 14864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.701554:0:30695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d9e5b8b8/0x22153cd396b81622 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b12 expref: 18 pid: 14864 timeout: 1458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826412.701563:0:30695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce044d0b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:30695:1874670585227904:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826412.701590:0:30695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b33b8f4a/0x22153cd396b81629 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b19 expref: 18 pid: 30696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.701600:0:30695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b33b8f4a/0x22153cd396b81629 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b19 expref: 18 pid: 30696 timeout: 1458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826412.701609:0:30695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce044d0f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:30695:1874670585228032:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826412.702241:0:30695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009befb8a5/0x22153cd396b81630 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b20 expref: 18 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.702253:0:30695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009befb8a5/0x22153cd396b81630 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b20 expref: 18 pid: 8436 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826412.702264:0:30695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce044d3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:30695:1874670585228160:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826412.702306:0:30695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004d747c98/0x22153cd396b81637 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b27 expref: 18 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.702315:0:30695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004d747c98/0x22153cd396b81637 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b27 expref: 18 pid: 8545 timeout: 1458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826412.702324:0:30695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce044d1e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:30695:1874670585228288:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826412.702348:0:30695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e32bc9b1/0x22153cd396b813e4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a40 expref: 18 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.702358:0:30695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e32bc9b1/0x22153cd396b813e4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a40 expref: 18 pid: 8436 timeout: 1458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826412.702365:0:30695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce044d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:30695:1874670585228416:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826412.702381:0:30695:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a2d180 going to sleep for 11 seconds 00000100:00100000:2.0:1787826412.713259:0:30695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce044d30c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:30695:1874670585227264:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826412.713277:0:30695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce044d0780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:30695:1874670585227392:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826412.716028:0:30695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce044d2580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:30695:1874670585227520:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826412.716059:0:30695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce044d3c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:30695:1874670585227648:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826412.716070:0:30695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce044d1a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:30695:1874670585227776:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826412.716079:0:30695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce044d0b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:30695:1874670585227904:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826412.716098:0:30695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce044d0f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:30695:1874670585228032:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826412.716106:0:30695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce044d3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:30695:1874670585228160:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826412.716114:0:30695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce044d1e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:30695:1874670585228288:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826412.716122:0:30695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce044d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:30695:1874670585228416:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826412.716181:0:30695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000382351a4/0x22153cd396b81668 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x105:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b3c expref: 18 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.716222:0:30695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834c00, rc 0) 00000100:00100000:2.0:1787826412.716286:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab16940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+18:55460:x1874670563815808:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 16338us (20684us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826412.716295:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2017 00000100:00100000:1.0:1787826412.718464:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826412.718530:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826412.718561:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826412.718586:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826412.718605:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826412.718621:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826412.718632:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826412.718644:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826412.718663:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826412.718790:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563815936 00000100:00100000:0.0:1787826412.718801:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563815936 00010000:00010000:0.0:1787826412.718841:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d39501d2/0x22153cd396b81549 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ab0 expref: 18 pid: 8435 timeout: 1458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826412.718867:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563816192 00000100:00100000:0.0:1787826412.718870:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563816192 00010000:00010000:0.0:1787826412.718882:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c43350b1/0x22153cd396b815dc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ae8 expref: 19 pid: 30398 timeout: 1458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826412.718894:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563816448 00000100:00100000:0.0:1787826412.718897:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563816448 00010000:00010000:0.0:1787826412.718909:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b33b8f4a/0x22153cd396b81629 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b19 expref: 20 pid: 30696 timeout: 1458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826412.718920:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563816704 00000100:00100000:0.0:1787826412.718922:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563816704 00010000:00010000:0.0:1787826412.718934:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004d747c98/0x22153cd396b81637 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b27 expref: 21 pid: 8545 timeout: 1458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826412.718944:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563816960 00000100:00100000:0.0:1787826412.718946:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563816960 00010000:00010000:0.0:1787826412.718959:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000482bb568/0x22153cd396b81614 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b0b expref: 22 pid: 8545 timeout: 1458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826412.718969:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563816064 00000100:00100000:0.0:1787826412.718971:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563816064 00010000:00010000:0.0:1787826412.718981:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b81588 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ac5 expref: 23 pid: 30695 timeout: 1458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826412.718992:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563816320 00000100:00100000:0.0:1787826412.718994:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563816320 00010000:00010000:0.0:1787826412.719005:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d9e5b8b8/0x22153cd396b81622 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b12 expref: 24 pid: 14864 timeout: 1458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826412.719017:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563816576 00000100:00100000:0.0:1787826412.719019:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563816576 00010000:00010000:0.0:1787826412.719030:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009befb8a5/0x22153cd396b81630 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b20 expref: 25 pid: 8436 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826412.719042:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563816832 00000100:00100000:0.0:1787826412.719045:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563816832 00010000:00010000:0.0:1787826412.719056:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c8b52bb3/0x22153cd396b8160d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b04 expref: 26 pid: 8436 timeout: 1458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826412.719071:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1066 00000100:00100000:0.0:1787826412.719079:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f04780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+26:2404:x1874670563815936:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826412.719110:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826412.719129:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d39501d2/0x22153cd396b81549 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ab0 expref: 26 pid: 8435 timeout: 1458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.719144:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d39501d2/0x22153cd396b81549 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ab0 expref: 26 pid: 8435 timeout: 1458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.719168:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d39501d2/0x22153cd396b81549 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x105:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ab0 expref: 26 pid: 8435 timeout: 1458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.719186:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826412.719257:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f04780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+25:2404:x1874670563815936:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 178us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826412.719265:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1066 00000100:00100000:0.0:1787826412.719285:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1067 00000100:00100000:0.0:1787826412.719292:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf185dc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+24:2404:x1874670563816192:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826412.719301:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826412.719310:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c43350b1/0x22153cd396b815dc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ae8 expref: 24 pid: 30398 timeout: 1458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.719320:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c43350b1/0x22153cd396b815dc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ae8 expref: 24 pid: 30398 timeout: 1458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.719333:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c43350b1/0x22153cd396b815dc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x105:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ae8 expref: 24 pid: 30398 timeout: 1458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.719343:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826412.719362:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf185dc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+23:2404:x1874670563816192:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 71us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826412.719369:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1067 00000100:00100000:0.0:1787826412.719422:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1068 00000100:00100000:0.0:1787826412.719430:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f06580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+22:2404:x1874670563816448:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826412.719438:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826412.719447:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b33b8f4a/0x22153cd396b81629 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b19 expref: 22 pid: 30696 timeout: 1458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.719458:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b33b8f4a/0x22153cd396b81629 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b19 expref: 22 pid: 30696 timeout: 1458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.719516:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b33b8f4a/0x22153cd396b81629 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x105:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b19 expref: 22 pid: 30696 timeout: 1458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.719527:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826412.719547:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f06580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+21:2404:x1874670563816448:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 118us (985us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826412.719554:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1068 00000100:00100000:0.0:1787826412.719566:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1069 00000100:00100000:0.0:1787826412.719572:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f06d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+20:2404:x1874670563816704:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826412.719581:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826412.719590:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004d747c98/0x22153cd396b81637 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b27 expref: 20 pid: 8545 timeout: 1458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.719606:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004d747c98/0x22153cd396b81637 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b27 expref: 20 pid: 8545 timeout: 1458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.719619:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d747c98/0x22153cd396b81637 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x105:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b27 expref: 20 pid: 8545 timeout: 1458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.719627:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826412.719645:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f06d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+19:2404:x1874670563816704:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 73us (1058us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826412.719651:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1069 00000100:00100000:0.0:1787826412.719664:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1070 00000100:00100000:0.0:1787826412.719670:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+18:2404:x1874670563816960:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826412.719677:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826412.719685:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000482bb568/0x22153cd396b81614 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b0b expref: 18 pid: 8545 timeout: 1458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.719695:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000482bb568/0x22153cd396b81614 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b0b expref: 18 pid: 8545 timeout: 1458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.719707:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000482bb568/0x22153cd396b81614 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x105:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b0b expref: 18 pid: 8545 timeout: 1458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.719716:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826412.719733:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+17:2404:x1874670563816960:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 64us (1128us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826412.719739:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1070 00000100:00100000:0.0:1787826412.719754:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1071 00000100:00100000:0.0:1787826412.719760:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f06940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2404:x1874670563816064:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826412.719766:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826412.719775:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b81588 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ac5 expref: 16 pid: 30695 timeout: 1458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.719786:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b81588 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ac5 expref: 16 pid: 30695 timeout: 1458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.719798:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b81588 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x105:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ac5 expref: 16 pid: 30695 timeout: 1458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.719809:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826412.719827:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f06940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2404:x1874670563816064:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 67us (1204us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826412.719833:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1071 00000100:00100000:0.0:1787826412.719845:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1072 00000100:00100000:0.0:1787826412.719851:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f052c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563816320:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826412.719858:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826412.719866:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d9e5b8b8/0x22153cd396b81622 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b12 expref: 14 pid: 14864 timeout: 1458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.719882:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d9e5b8b8/0x22153cd396b81622 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b12 expref: 14 pid: 14864 timeout: 1458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.719894:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9e5b8b8/0x22153cd396b81622 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x105:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b12 expref: 14 pid: 14864 timeout: 1458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.719903:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826412.719919:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f052c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2404:x1874670563816320:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 68us (1286us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826412.719925:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1072 00000100:00100000:0.0:1787826412.719939:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1073 00000100:00100000:0.0:1787826412.719945:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f05a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563816576:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826412.719953:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826412.719961:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009befb8a5/0x22153cd396b81630 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b20 expref: 12 pid: 8436 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.719971:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009befb8a5/0x22153cd396b81630 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b20 expref: 12 pid: 8436 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.719983:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009befb8a5/0x22153cd396b81630 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x105:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b20 expref: 12 pid: 8436 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.719993:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826412.720011:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f05a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2404:x1874670563816576:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 67us (1366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826412.720018:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1073 00000100:00100000:0.0:1787826412.720030:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1074 00000100:00100000:0.0:1787826412.720036:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf185dd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563816832:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826412.720043:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826412.720051:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c8b52bb3/0x22153cd396b8160d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b04 expref: 10 pid: 8436 timeout: 1458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.720060:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c8b52bb3/0x22153cd396b8160d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b04 expref: 10 pid: 8436 timeout: 1458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.720094:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8b52bb3/0x22153cd396b8160d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x105:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b04 expref: 10 pid: 8436 timeout: 1458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.720103:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826412.720118:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf185dd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563816832:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 83us (1455us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826412.720124:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1074 00000100:00100000:1.0:1787826412.723610:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826412.724713:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563817088 00000100:00100000:0.0:1787826412.724724:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563817088 00010000:00010000:0.0:1787826412.724821:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e32bc9b1/0x22153cd396b813e4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a40 expref: 9 pid: 8436 timeout: 1458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826412.724911:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1075 00000100:00100000:0.0:1787826412.724922:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f061c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563817088:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826412.724940:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826412.724963:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e32bc9b1/0x22153cd396b813e4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a40 expref: 9 pid: 8436 timeout: 1458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.724988:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e32bc9b1/0x22153cd396b813e4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x105:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a40 expref: 9 pid: 8436 timeout: 1458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.725013:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e32bc9b1/0x22153cd396b813e4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x105:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0a40 expref: 9 pid: 8436 timeout: 1458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.725030:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x105:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826412.725034:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x105:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826412.725042:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000382351a4/0x22153cd396b81668 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b3c expref: 8 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.725053:0:10340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000382351a4/0x22153cd396b81668 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b3c expref: 8 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.725326:0:10340:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000382351a4/0x22153cd396b81668 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b3c expref: 8 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826412.725342:0:10340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce049ba940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10340:1874670585228544:192.168.203.39@tcp:105: 00000100:00100000:0.0:1787826412.725545:0:10340:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826412.729445:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826412.729580:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563817216 00000100:00100000:2.0:1787826412.729591:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563817216 00000100:00100000:2.0:1787826412.729646:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2018 00000100:00100000:2.0:1787826412.729656:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f05e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563817216:12345-192.168.203.39@tcp:2:lfs.0 00002000:00010000:2.0:1787826412.729804:0:14864:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x105:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787826412.729808:0:14864:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x105:0x0] updating lvb mtime from disk: 1787826412 -> 1787826412 00002000:00010000:2.0:1787826412.729811:0:14864:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x105:0x0] updating lvb atime from disk: 1787826412 -> 1787826412 00002000:00010000:2.0:1787826412.729813:0:14864:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x105:0x0] updating lvb ctime from disk: 1787826412 -> 1787826413 00002000:00010000:2.0:1787826412.729815:0:14864:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x105:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1787826412.729869:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f05e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563817216:12345-192.168.203.39@tcp:2:lfs.0 Request processed in 214us (433us total) trans 21474836994 rc 0/0 00000100:00100000:2.0:1787826412.729876:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2018 00000100:00100000:0.0:1787826412.732051:0:10340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce049ba940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10340:1874670585228544:192.168.203.39@tcp:105: 00010000:00010000:0.0:1787826412.732077:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826412.732140:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f061c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563817088:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 7219us (8540us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826412.732148:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1075 00000100:00100000:1.0:1787826412.735062:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826412.735701:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563817472 00000100:00100000:0.0:1787826412.735711:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563817472 00000100:00100000:0.0:1787826412.735784:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1072 00000100:00100000:0.0:1787826412.735795:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f06580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:55460:x1874670563817472:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:0.0:1787826412.735876:0:6522:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000405:0x1d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b815ff lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0afd expref: 35 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.735916:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b8166f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.735929:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b8151f lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0aa2 expref: 35 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.735938:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b8157a lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0abe expref: 35 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.735946:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b8166f lrc: 5/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.735979:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b8157a lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0abe expref: 35 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.735993:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b8157a lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0abe expref: 35 pid: 32404 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826412.736008:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce049ba940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585228672:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826412.736272:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b8151f lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0aa2 expref: 35 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.736283:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b8151f lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0aa2 expref: 35 pid: 8247 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826412.736294:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce049b8b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585228800:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826412.736318:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826412.740671:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826412.740796:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce049ba940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585228672:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826412.740809:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce049b8b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585228800:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826412.740836:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b8166f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826412.741108:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563817728 00000100:00100000:2.0:1787826412.741115:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563817728 00000100:00100000:2.0:1787826412.741172:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1073 00000100:00100000:2.0:1787826412.741182:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f06d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:42221:x1874670563817728:12345-192.168.203.39@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787826412.741421:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f06d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:42221:x1874670563817728:12345-192.168.203.39@tcp:35:ldlm_bl.0 Request processed in 239us (757us total) trans 8589934787 rc 0/0 00000100:00100000:2.0:1787826412.741430:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1073 00000100:00100000:1.0:1787826412.746779:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826412.747095:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563817856 00000100:00100000:3.0:1787826412.747104:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563817856 00010000:00010000:3.0:1787826412.747146:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b8151f lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0aa2 expref: 37 pid: 8247 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826412.747197:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1076 00000100:00100000:3.0:1787826412.747216:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:2404:x1874670563817856:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826412.747231:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826412.747239:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b8151f lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0aa2 expref: 37 pid: 8247 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.747251:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b8151f lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0aa2 expref: 37 pid: 8247 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.747276:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b8151f lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0aa2 expref: 37 pid: 8247 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.747293:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826412.747298:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b8166f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.747306:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b8166f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.747312:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826412.747369:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:2404:x1874670563817856:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 155us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826412.747392:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1076 00000100:00100000:1.0:1787826412.750772:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826412.751003:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563817984 00000100:00100000:2.0:1787826412.751013:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563817984 00010000:00010000:2.0:1787826412.751054:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b8157a lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0abe expref: 36 pid: 32404 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826412.751102:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1077 00000100:00100000:2.0:1787826412.751111:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f06940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:2404:x1874670563817984:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826412.751127:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826412.751135:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b8157a lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0abe expref: 36 pid: 32404 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.751148:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b8157a lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0abe expref: 36 pid: 32404 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.751169:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b8157a lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0abe expref: 36 pid: 32404 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.751186:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826412.751192:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b8166f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.751210:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b8166f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.751218:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b8166f lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.751249:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826412.751299:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f06940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:2404:x1874670563817984:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 189us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826412.751307:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1077 00010000:00010000:0.0:1787826412.752064:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b8166f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.752086:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b8166f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.752113:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b81676 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.752128:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b81653 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b2e expref: 34 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.752137:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b81676 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x20:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.752181:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b81653 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b2e expref: 34 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.752196:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b81653 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b2e expref: 34 pid: 6518 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826412.752223:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce049b8b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585228928:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826412.752305:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826412.757296:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826412.757383:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563818112 00000100:00100000:3.0:1787826412.757398:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563818112 00010000:00010000:3.0:1787826412.757436:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b81653 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b2e expref: 35 pid: 6518 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826412.757507:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1078 00000100:00100000:3.0:1787826412.757518:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f052c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:2404:x1874670563818112:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826412.757533:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826412.757541:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b81653 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x20:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b2e expref: 35 pid: 6518 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.757554:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b81653 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x20:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b2e expref: 35 pid: 6518 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.757577:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x20:0x0].0x0 (ffff90cf04f8b100) 00010000:00010000:3.0:1787826412.757583:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b81676 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x20:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.757593:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b81676 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x20:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.757601:0:10340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b81676 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x20:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.757621:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826412.757664:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f052c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:2404:x1874670563818112:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 149us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826412.757672:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1078 00010000:00010000:0.0:1787826412.757913:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b81653 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b2e expref: 34 pid: 6518 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826412.757929:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce049b8b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585228928:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826412.757949:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b81676 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.757956:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b81676 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.757961:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b81676 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826412.758243:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce049b8b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1874670585229056:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787826412.758324:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826412.758462:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3780 going to sleep for 11 seconds 00000100:00100000:2.0:1787826412.759917:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585229056 00000100:00100000:2.0:1787826412.759928:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585229056 00000100:00100000:2.0:1787826412.760161:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1422 00000100:00100000:2.0:1787826412.760172:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049ba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6522:x1874670585229056:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787826412.760348:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049ba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6522:x1874670585229056:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 178us (2023us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826412.760357:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1422 00000100:00100000:1.0:1787826412.761045:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce049b8b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1874670585229056:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787826412.761210:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce04f05a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1874670585229184:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787826412.761258:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826412.761334:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf1850c000 going to sleep for 11 seconds 00000100:00100000:2.0:1787826412.761587:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585229184 00000100:00100000:2.0:1787826412.761594:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585229184 00000100:00100000:2.0:1787826412.761670:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1423 00000100:00100000:2.0:1787826412.761678:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f04b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6522:x1874670585229184:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787826412.761771:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f04b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6522:x1874670585229184:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 93us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826412.761778:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1423 00000100:00100000:1.0:1787826412.761844:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce04f05a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1874670585229184:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787826412.761974:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934788 00000100:00100000:1.0:1787826412.762036:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce04f05a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1874670585229312:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787826412.762064:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826412.762320:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf1850c300 going to sleep for 11 seconds 00000100:00100000:0.0:1787826412.762422:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585229312 00000100:00100000:0.0:1787826412.762427:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585229312 00000100:00100000:0.0:1787826412.762456:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1424 00000100:00100000:0.0:1787826412.762463:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f04780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6522:x1874670585229312:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787826412.762606:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f04780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6522:x1874670585229312:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 143us (541us total) trans 17179869654 rc 0/0 00000100:00100000:0.0:1787826412.762614:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1424 00000100:00100000:1.0:1787826412.762768:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce04f05a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1874670585229312:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787826412.762828:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934789 00010000:00010000:1.0:1787826412.762854:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b81676 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.762865:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b81676 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.762873:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b81676 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.762880:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165e600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826412.762885:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b81676 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.762893:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b81676 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.762909:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x20:0x0].0x0 (ffff90cf04f8b100) 00010000:00010000:1.0:1787826412.762912:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787826412.762917:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b81676 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.762924:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b81676 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.762939:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b8166f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.762946:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b8166f lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.762952:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b8166f lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.762958:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165e000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826412.762961:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b8166f lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.762968:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b8166f lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.762975:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826412.762977:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787826412.762980:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b8166f lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.762986:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b8166f lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.763002:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826412.763005:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787826412.763011:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b815ff lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0afd expref: 36 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826412.763108:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f06580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:55460:x1874670563817472:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 27315us (28054us total) trans 8589934790 rc 0/0 00000100:00100000:1.0:1787826412.763117:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1072 00000020:00080000:1.0:1787826412.763121:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1787826412.766824:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826412.766901:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563818240 00000100:00100000:3.0:1787826412.766912:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563818240 00000100:00100000:3.0:1787826412.766963:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3652 00000100:00100000:3.0:1787826412.766973:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136ce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:55460:x1874670563818240:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826412.767000:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826412.767020:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b8167d lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0b43 expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.767074:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b8167d lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b43 expref: 36 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.767098:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b8167d lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b43 expref: 36 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.767116:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826412.767119:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826412.767123:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401400, rc 0) 00000100:00100000:3.0:1787826412.767186:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136ce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55460:x1874670563818240:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 214us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826412.767194:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3652 00000100:00100000:0.0:1787826412.772869:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826412.773665:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563818496 00000100:00100000:2.0:1787826412.773677:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563818496 00000100:00100000:0.0:1787826412.773907:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1074 00000100:00100000:0.0:1787826412.773917:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55460:x1874670563818496:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:0.0:1787826412.774242:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:55460:x1874670563818496:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 325us (1380us total) trans 8589934791 rc 0/0 00000100:00100000:0.0:1787826412.774259:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1074 00000100:00100000:0.0:1787826412.778541:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826412.778611:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563818752 00000100:00100000:1.0:1787826412.778621:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563818752 00000100:00100000:1.0:1787826412.778680:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1075 00000100:00100000:1.0:1787826412.778692:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf39578450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:55460:x1874670563818752:12345-192.168.203.39@tcp:35:lfs.0 00000004:00080000:1.0:1787826412.778877:0:6522:0:(mdd_object.c:4014:mdd_close()) Object [0x200000405:0x20:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:1.0:1787826412.778952:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b81684 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.778967:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b81684 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.778978:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b81684 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.778985:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b81684 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.778990:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b81684 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.778997:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b81684 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.779245:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787826412.779330:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf39578450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:55460:x1874670563818752:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 642us (797us total) trans 8589934792 rc 0/0 00000100:00100000:1.0:1787826412.779338:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1075 00010000:00010000:0.0:1787826412.780353:0:7460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826412.780364:0:7460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b81684 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.780380:0:7460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46b200 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826412.780385:0:7460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b81684 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.780400:0:7460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b81684 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.780415:0:7460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x20:0x0].0x0 (ffff90cf04f8b100) 00010000:00010000:0.0:1787826412.780418:0:7460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787826412.780422:0:7460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b81684 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.780428:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b81684 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.780445:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826412.780447:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826412.780448:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826412.803889:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787826412.803912:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf136cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585229440:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826412.803979:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826412.804069:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585229440 00000100:00100000:1.0:1787826412.804076:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585229440 00000100:00100000:1.0:1787826412.804141:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1425 00000100:00100000:1.0:1787826412.804151:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049b9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3647:x1874670585229440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787826412.804187:0:7796:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445871616 avail 1299632128 00000100:00100000:1.0:1787826412.804246:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049b9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3647:x1874670585229440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826412.804253:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1425 00000100:00100000:1.0:1787826412.804294:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf136cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585229440:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787826412.804689:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787826412.804700:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce049b83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585229568:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787826412.804731:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826412.804809:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585229568 00000100:00100000:0.0:1787826412.804814:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585229568 00000100:00100000:0.0:1787826412.804851:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1426 00000100:00100000:0.0:1787826412.804858:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874670585229568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787826412.804877:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446182912 avail 1299943424 00000100:00100000:0.0:1787826412.804911:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874670585229568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 53us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826412.804917:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1426 00000100:00100000:2.0:1787826412.804982:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967717 gen 2 00000004:00080000:2.0:1787826412.804988:0:3646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967717 committed transno 4294967717 00000020:00080000:2.0:1787826412.804993:0:3646:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90cf10aba180 refcount 2 committed 0 result 0 batchid 4294969328 00000020:00080000:2.0:1787826412.804996:0:3646:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cf39612600 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90ce04aa5f00 00000020:00080000:2.0:1787826412.805000:0:3646:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000405:0x2:0x0].2 00000020:00080000:2.0:1787826412.805002:0:3646:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cf39612700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90cf3a83ce00 00000020:00080000:2.0:1787826412.805005:0:3646:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000bd0:0x2:0x0].3 00000100:00100000:2.0:1787826412.805039:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce049b83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585229568:0@lo:41:osp-pre-1-0.0 00000020:00080000:0.0:1787826412.805100:0:34512:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969329 committed batchid 4294969327 00000020:00080000:0.0:1787826412.805154:0:34512:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969327 00000100:00100000:3.0:1787826412.805807:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585229952:0@lo:400:kworker.0 00000100:00100000:3.0:1787826412.805845:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826412.805869:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab15a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874670585230464:0@lo:400:kworker.0 00000100:00100000:3.0:1787826412.805892:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826412.805913:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787826412.805919:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab14f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585230080:0@lo:400:kworker.0 00000100:00100000:3.0:1787826412.805940:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826412.805956:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab16d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1874670585230592:0@lo:400:kworker.0 00000100:00100000:3.0:1787826412.805976:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826412.806003:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585229952 00000100:00100000:3.0:1787826412.806008:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585229952 00000100:00100000:3.0:1787826412.806048:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585230080 00000100:00100000:3.0:1787826412.806051:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585230080 00000100:00100000:3.0:1787826412.806071:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 934 00000100:00100000:3.0:1787826412.806079:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874670585229952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826412.806568:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874670585229952:12345-0@lo:400:kworker.0 Request processed in 489us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826412.806577:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 934 00000100:00100000:3.0:1787826412.806596:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 935 00000100:00100000:3.0:1787826412.806604:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab16580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874670585230080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826412.806636:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab16580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874670585230080:12345-0@lo:400:kworker.0 Request processed in 34us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826412.806642:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 935 00000100:00080000:3.0:1787826412.806660:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787826412.806664:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826412.806689:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab17840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874670585229824:0@lo:400:kworker.0 00000100:00100000:3.0:1787826412.806717:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826412.806747:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1874670585230336:0@lo:400:kworker.0 00000100:00100000:3.0:1787826412.806769:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826412.806791:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787826412.806796:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab17c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e3c550b8-2c3c-46c3-ad36-671c284167ea:3645:1874670585229696:0@lo:400:kworker.0 00000100:00100000:3.0:1787826412.806823:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826412.806849:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab14b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874670585230208:0@lo:400:kworker.0 00000100:00100000:3.0:1787826412.806870:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826412.806885:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874670585230720:0@lo:400:kworker.0 00000100:00100000:3.0:1787826412.806904:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826412.806930:0:34488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585229696 00000100:00100000:3.0:1787826412.806935:0:34488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585229696 00000100:00100000:3.0:1787826412.806970:0:34488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787826412.806978:0:34488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1099c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3c550b8-2c3c-46c3-ad36-671c284167ea+24:3645:x1874670585229696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826412.807013:0:34488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1099c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3c550b8-2c3c-46c3-ad36-671c284167ea+24:3645:x1874670585229696:12345-0@lo:400:kworker.0 Request processed in 36us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826412.807020:0:34488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787826412.807060:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab17c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e3c550b8-2c3c-46c3-ad36-671c284167ea:3645:1874670585229696:0@lo:400:kworker.0 00000100:00100000:0.0:1787826412.807197:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab14f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585230080:0@lo:400:kworker.0 00000100:00100000:0.0:1787826412.807225:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585229952:0@lo:400:kworker.0 00000100:00100000:1.0:1787826412.807292:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585230464 00000100:00100000:1.0:1787826412.807296:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585230464 00000100:00100000:1.0:1787826412.807339:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585230592 00000100:00100000:1.0:1787826412.807342:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585230592 00000100:00100000:1.0:1787826412.807356:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585229824 00000100:00100000:1.0:1787826412.807358:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585229824 00000100:00100000:1.0:1787826412.807368:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585230336 00000100:00100000:1.0:1787826412.807370:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585230336 00000100:00100000:1.0:1787826412.807398:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585230208 00000100:00100000:1.0:1787826412.807401:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585230208 00000100:00100000:1.0:1787826412.807412:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585230720 00000100:00100000:1.0:1787826412.807414:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585230720 00000100:00100000:1.0:1787826412.807426:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1576 00000100:00100000:1.0:1787826412.807431:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab15e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874670585230464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826412.807491:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab15e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874670585230464:12345-0@lo:400:kworker.0 Request processed in 60us (1598us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826412.807497:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1576 00000100:00100000:1.0:1787826412.807510:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1577 00000100:00100000:1.0:1787826412.807517:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874670585230592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826412.807545:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874670585230592:12345-0@lo:400:kworker.0 Request processed in 30us (1569us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826412.807552:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1577 00000100:00100000:1.0:1787826412.807561:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1578 00000100:00100000:1.0:1787826412.807566:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab15680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874670585229824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826412.807750:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1579 00000100:00100000:3.0:1787826412.807758:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874670585230336:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787826412.807822:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787826412.807826:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787826412.809806:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab15680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874670585229824:12345-0@lo:400:kworker.0 Request processed in 2230us (3079us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826412.809819:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1578 00000100:00100000:1.0:1787826412.809855:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1580 00000100:00100000:1.0:1787826412.809869:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874670585230208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826412.817726:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874670585230336:12345-0@lo:400:kworker.0 Request processed in 9958us (10945us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826412.817740:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1579 00000100:00100000:3.0:1787826412.817791:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1581 00000100:00100000:3.0:1787826412.817803:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874670585230720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826412.817871:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874670585230720:12345-0@lo:400:kworker.0 Request processed in 72us (10965us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826412.817877:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1581 00000100:00100000:0.0:1787826412.818229:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826412.818299:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563818880 00000100:00100000:3.0:1787826412.818307:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563818880 00000100:00100000:3.0:1787826412.818350:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3653 00000100:00100000:3.0:1787826412.818358:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049b83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:55463:x1874670563818880:12345-192.168.203.39@tcp:101:getfattr.0 00010000:00010000:3.0:1787826412.818387:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826412.818409:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b8168b lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0b4a expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.818492:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b81692 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.818507:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b81692 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.818518:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b81692 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.818533:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b81699 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.818540:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b81699 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.818547:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b81699 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.818616:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b816a0 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.818625:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b816a0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.818631:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b816a0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826412.818668:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:3.0:1787826412.818672:0:16564:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826412.818689:0:16564:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b816a0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.818703:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b816a0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.818711:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b81692 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.818716:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b81692 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.818721:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b81692 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.818726:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826412.818730:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b81692 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.818736:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b81692 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.818746:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf39656100) 00010000:00010000:3.0:1787826412.818749:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826412.818753:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b81692 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.818758:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b81692 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.818770:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b81699 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.818775:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b81699 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.818781:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b81699 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.818786:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826412.818788:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b81699 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.818794:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b81699 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.818799:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf39656000) 00010000:00010000:3.0:1787826412.818801:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826412.818804:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b81699 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.818809:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b81699 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.818839:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b8168b lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b4a expref: 40 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.818852:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b816a0 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b4a expref: 39 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.818858:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826412.818860:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826412.818862:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400600, rc 0) 00000100:00100000:3.0:1787826412.818903:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049b83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+39:55463:x1874670563818880:12345-192.168.203.39@tcp:101:getfattr.0 Request processed in 545us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826412.818912:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3653 00000100:00100000:0.0:1787826412.822768:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab16d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1874670585230592:0@lo:400:kworker.0 00000100:00100000:0.0:1787826412.822786:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab15a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874670585230464:0@lo:400:kworker.0 00000100:00100000:1.0:1787826412.825989:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874670585230208:12345-0@lo:400:kworker.0 Request processed in 16116us (19106us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826412.826005:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1580 00000100:00100000:2.0:1787826412.829957:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab14b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874670585230208:0@lo:400:kworker.0 00000100:00100000:2.0:1787826412.829979:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874670585230720:0@lo:400:kworker.0 00000100:00100000:2.0:1787826412.829991:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab17840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874670585229824:0@lo:400:kworker.0 00000100:00100000:2.0:1787826412.830001:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1874670585230336:0@lo:400:kworker.0 00000100:00100000:2.0:1787826412.869933:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826412.870018:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563819136 00000100:00100000:3.0:1787826412.870028:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563819136 00000100:00100000:3.0:1787826412.870098:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3654 00000100:00100000:3.0:1787826412.870109:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+39:55467:x1874670563819136:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826412.870130:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826412.870151:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b816a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0b51 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826412.870306:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1c:0x0]: returning size 4096 00010000:00010000:3.0:1787826412.870409:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b816a7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b51 expref: 41 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.870423:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ce01f45300) 00010000:00010000:3.0:1787826412.870427:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787826412.870432:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b816a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b51 expref: 41 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.870445:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400800, rc 0) 00000100:00100000:3.0:1787826412.870543:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55467:x1874670563819136:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 435us (618us total) trans 8589934793 rc 301/301 00000100:00100000:3.0:1787826412.870552:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3654 00010000:00010000:1.0:1787826412.870672:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826412.876054:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826412.876194:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563819264 00000100:00100000:3.0:1787826412.876212:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563819264 00000100:00100000:3.0:1787826412.876274:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3655 00000100:00100000:3.0:1787826412.876284:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55467:x1874670563819264:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:3.0:1787826412.876360:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b816b5 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.876391:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b816b5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.876403:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b816b5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.876416:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b816bc lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.876422:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b816bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.876428:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b816bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.876538:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b816c3 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.876548:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b816c3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.876553:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b816c3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826412.876593:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:3.0:1787826412.876597:0:32404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826412.876609:0:32404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b816c3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.876621:0:32404:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b816b5 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.876627:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b816b5 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.876633:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b816b5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.876640:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b816b5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.876646:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826412.876650:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b816b5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.876658:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b816b5 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.876669:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf39656100) 00010000:00010000:3.0:1787826412.876672:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826412.876676:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b816b5 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.876683:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b816b5 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.876701:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b816bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.876707:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b816bc lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.876713:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b816bc lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.876719:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826412.876722:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b816bc lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.876727:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b816bc lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.876734:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf39656000) 00010000:00010000:3.0:1787826412.876736:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826412.876739:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b816bc lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.876744:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b816bc lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.876755:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b816c3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.876762:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b816c3 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.876767:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b816c3 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.876771:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826412.876774:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b816c3 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.876779:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b816c3 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.876789:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826412.876792:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826412.876795:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b816c3 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.876800:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b816c3 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826412.876866:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55467:x1874670563819264:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 583us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826412.876874:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3655 00000100:00100000:3.0:1787826412.880902:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826412.881223:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563819520 00000100:00100000:0.0:1787826412.881232:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563819520 00000100:00100000:0.0:1787826412.881290:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1076 00000100:00100000:0.0:1787826412.881300:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55467:x1874670563819520:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:0.0:1787826412.881586:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+41:55467:x1874670563819520:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 285us (691us total) trans 8589934794 rc 0/0 00000100:00100000:0.0:1787826412.881594:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1076 00000100:00100000:0.0:1787826412.907424:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826412.907580:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563819776 00000100:00100000:3.0:1787826412.907590:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563819776 00000100:00100000:3.0:1787826412.907685:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3656 00000100:00100000:3.0:1787826412.907695:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+41:55469:x1874670563819776:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826412.907719:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826412.907740:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b816ca lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0b58 expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.907845:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b816d1 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.907860:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b816d1 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.907872:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b816d1 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826412.907888:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:3.0:1787826412.907992:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b816ca lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b58 expref: 44 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.908009:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b816d1 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b58 expref: 43 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.908018:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826412.908020:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787826412.908023:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400000, rc 0) 00000100:00100000:3.0:1787826412.908132:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55469:x1874670563819776:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 439us (718us total) trans 8589934795 rc 0/0 00000100:00100000:3.0:1787826412.908141:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3656 00000100:00100000:1.0:1787826412.919535:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826412.919771:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563820032 00000100:00100000:2.0:1787826412.919781:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563820032 00000100:00100000:2.0:1787826412.919844:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3657 00000100:00100000:2.0:1787826412.919854:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136cde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55469:x1874670563820032:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826412.919878:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826412.919899:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b816df lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0b5f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.920006:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b816e6 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.920020:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b816a0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b4a expref: 44 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.920029:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b816e6 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.920062:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b816a0 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b4a expref: 44 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.920079:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b816a0 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b4a expref: 44 pid: 16564 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826412.920091:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce044d3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1874670585230848:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826412.920178:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a2d480 going to sleep for 11 seconds 00000100:00100000:1.0:1787826412.928636:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826412.929214:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563820160 00000100:00100000:3.0:1787826412.929223:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563820160 00010000:00010000:3.0:1787826412.929273:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b816a0 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b4a expref: 45 pid: 16564 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826412.929285:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce044d3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1874670585230848:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826412.929308:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b816e6 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826412.929319:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1079 00000100:00100000:3.0:1787826412.929328:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136ccf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+45:2404:x1874670563820160:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826412.929342:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826412.929350:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b816a0 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b4a expref: 45 pid: 16564 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.929361:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b816a0 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b4a expref: 45 pid: 16564 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.929399:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b816a0 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b4a expref: 45 pid: 16564 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.929413:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826412.929417:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b816e6 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.929426:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b816e6 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.929434:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b816e6 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826412.929460:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826412.929490:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b816e6 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.929498:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b816e6 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826412.929522:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000100:00100000:3.0:1787826412.929583:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136ccf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:2404:x1874670563820160:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 255us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826412.929591:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1079 00010000:00010000:2.0:1787826412.929795:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b816df lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b5f expref: 45 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.929812:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b816e6 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b5f expref: 44 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.929819:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826412.929822:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787826412.929824:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835c00, rc 0) 00000100:00100000:2.0:1787826412.929849:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136cde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55469:x1874670563820032:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 9997us (10324us total) trans 8589934796 rc 0/0 00000100:00100000:2.0:1787826412.929856:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3657 00000100:00100000:3.0:1787826412.932835:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826412.932966:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563820288 00000100:00100000:1.0:1787826412.932974:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563820288 00000100:00100000:1.0:1787826412.933030:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1077 00000100:00100000:1.0:1787826412.933040:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55469:x1874670563820288:12345-192.168.203.39@tcp:33:lfs.0 00000100:00100000:1.0:1787826412.933207:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55469:x1874670563820288:12345-192.168.203.39@tcp:33:lfs.0 Request processed in 159us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826412.933214:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1077 00000100:00100000:1.0:1787826412.936867:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826412.937265:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563820544 00000100:00100000:2.0:1787826412.937274:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563820544 00000100:00100000:2.0:1787826412.937330:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1078 00000100:00100000:2.0:1787826412.937339:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136ce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55469:x1874670563820544:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:2.0:1787826412.937565:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136ce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+45:55469:x1874670563820544:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 226us (706us total) trans 8589934797 rc 0/0 00000100:00100000:2.0:1787826412.937574:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1078 00000100:00100000:2.0:1787826412.949340:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826412.949445:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563820800 00000100:00100000:0.0:1787826412.949455:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563820800 00000100:00100000:0.0:1787826412.949553:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3658 00000100:00100000:0.0:1787826412.949563:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+45:55469:x1874670563820800:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826412.949587:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826412.949591:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:0.0:1787826412.949617:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b816e6 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b5f expref: 45 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.949640:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b816d1 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b58 expref: 44 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.949651:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826412.949657:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826412.949670:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b816f4 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0b66 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.949767:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b816fb lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.949785:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b816fb lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.949796:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b816fb lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826412.949807:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:0.0:1787826412.949900:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b816f4 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b66 expref: 46 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.949914:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b816fb lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b66 expref: 45 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.949922:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826412.949924:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787826412.949926:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165ee00, rc 0) 00000100:00100000:0.0:1787826412.949975:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+45:55469:x1874670563820800:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 414us (645us total) trans 8589934798 rc 0/0 00000100:00100000:0.0:1787826412.949983:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3658 00000100:00100000:3.0:1787826412.954584:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826412.954687:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563821056 00000100:00100000:0.0:1787826412.954696:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563821056 00000100:00100000:0.0:1787826412.954768:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1079 00000100:00100000:0.0:1787826412.954777:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+45:55469:x1874670563821056:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:0.0:1787826412.954855:0:14257:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000405:0x1d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b816fb lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b66 expref: 45 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.954892:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81709 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.954905:0:14257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b8167d lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b43 expref: 45 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.954914:0:14257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81709 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.954946:0:14257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b8167d lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b43 expref: 45 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.954959:0:14257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b8167d lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b43 expref: 45 pid: 8247 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826412.954973:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce049b8b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585230976:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826412.955053:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3540 going to sleep for 11 seconds 00000100:00100000:0.0:1787826412.958362:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce049b8b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585230976:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826412.958391:0:14257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81709 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826412.959752:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826412.962803:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563821184 00000100:00100000:0.0:1787826412.962874:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563821184 00010000:00010000:1.0:1787826412.963063:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b8167d lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b43 expref: 46 pid: 8247 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826412.963148:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1080 00000100:00100000:1.0:1787826412.963158:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+46:2403:x1874670563821184:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826412.963171:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826412.963178:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b8167d lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b43 expref: 46 pid: 8247 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.963191:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b8167d lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b43 expref: 46 pid: 8247 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.963225:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b8167d lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b43 expref: 46 pid: 8247 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.963242:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826412.963248:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81709 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.963257:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81709 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.963269:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81709 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.963299:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826412.963356:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+45:2403:x1874670563821184:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 200us (3610us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826412.963364:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1080 00010000:00010000:0.0:1787826412.963581:0:14257:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81709 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.963589:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81709 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.963724:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81709 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.963736:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81709 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.963742:0:14257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81709 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.963748:0:14257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165e200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826412.963752:0:14257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81709 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.963759:0:14257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81709 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.963768:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826412.963771:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787826412.963774:0:14257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81709 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.963781:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81709 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826412.963791:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826412.963793:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787826412.963797:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b816fb lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b66 expref: 44 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826412.963928:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55469:x1874670563821056:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 9141us (9341us total) trans 8589934799 rc -22/-22 00000100:00100000:0.0:1787826412.963937:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1079 00000100:00100000:3.0:1787826412.978736:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826412.978850:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563821312 00000100:00100000:2.0:1787826412.978861:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563821312 00000100:00100000:2.0:1787826412.978921:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3659 00000100:00100000:2.0:1787826412.978930:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55469:x1874670563821312:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826412.978954:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826412.978977:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81710 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0b6d expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.979035:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81710 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b6d expref: 45 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.979050:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81710 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b6d expref: 45 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826412.979069:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826412.979073:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826412.979077:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835800, rc 0) 00000100:00100000:2.0:1787826412.979139:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+45:55469:x1874670563821312:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 210us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826412.979147:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3659 00000100:00100000:0.0:1787826412.991917:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826412.992069:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563821568 00000100:00100000:3.0:1787826412.992145:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563821568 00000100:00100000:3.0:1787826412.992256:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3660 00000100:00100000:3.0:1787826412.992265:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049b8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+45:55469:x1874670563821568:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826412.992713:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826412.992740:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b81717 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0b74 expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.993179:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b8171e lrc: 3/1,0 mode: --/PR res: [0x200000405:0x21:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.993193:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b8171e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.993218:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b8171e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826412.993228:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x21:0x0]: returning size 0 00010000:00010000:1.0:1787826412.993281:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b81717 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b74 expref: 48 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.993302:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b8171e lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b74 expref: 47 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826412.993310:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x21:0x0].0x0 (ffff90cf04f8b600) 00010000:00010000:1.0:1787826412.993313:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826412.993316:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46a800, rc 0) 00000100:00100000:1.0:1787826412.993378:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049b8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+47:55469:x1874670563821568:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1113us (1469us total) trans 8589934800 rc 0/0 00000100:00100000:1.0:1787826412.993386:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3660 00000100:00100000:1.0:1787826413.001900:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826413.001992:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563821824 00000100:00100000:2.0:1787826413.002002:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563821824 00000100:00100000:2.0:1787826413.002095:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3661 00000100:00100000:2.0:1787826413.002105:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+47:55469:x1874670563821824:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826413.002129:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826413.002151:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8172c lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0b7b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.002266:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81733 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.002281:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81733 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.002296:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81733 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826413.002308:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:2.0:1787826413.002418:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8172c lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b7b expref: 50 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.002437:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81733 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b7b expref: 49 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.002447:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826413.002450:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787826413.002454:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834600, rc 0) 00000100:00100000:2.0:1787826413.002548:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:55469:x1874670563821824:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 444us (657us total) trans 8589934801 rc 0/0 00000100:00100000:2.0:1787826413.002556:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3661 00000100:00080000:0.0:1787826413.002989:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787826413.009991:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826413.010234:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563822080 00000100:00100000:1.0:1787826413.010245:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563822080 00000100:00100000:1.0:1787826413.010305:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1080 00000100:00100000:1.0:1787826413.010315:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf39579850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:55469:x1874670563822080:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:1.0:1787826413.010404:0:6522:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000405:0x1d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81733 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b7b expref: 49 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.010446:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b81741 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.010459:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81710 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b6d expref: 49 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.010468:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b81741 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.010540:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81710 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b6d expref: 49 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.010554:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81710 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b6d expref: 49 pid: 16564 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826413.010568:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf136ced00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585231104:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826413.010659:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf1850cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826413.015527:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826413.015627:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563822208 00000100:00100000:2.0:1787826413.015636:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563822208 00010000:00010000:2.0:1787826413.015675:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81710 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b6d expref: 50 pid: 16564 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826413.015718:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1081 00000100:00100000:2.0:1787826413.015728:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf185dd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+50:2404:x1874670563822208:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826413.015745:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826413.015752:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81710 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b6d expref: 50 pid: 16564 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.015766:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81710 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b6d expref: 50 pid: 16564 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.015790:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826413.015795:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b81741 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.015815:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b81741 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.015823:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b81741 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.015846:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826413.015904:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf185dd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+50:2404:x1874670563822208:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 177us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826413.015913:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1081 00010000:00010000:0.0:1787826413.016618:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81710 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b6d expref: 49 pid: 16564 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826413.016636:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf136ced00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585231104:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826413.016658:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b81741 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.016667:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b81741 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.016672:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b81741 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.016691:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b81748 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.016703:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b8171e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b74 expref: 48 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.016711:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b81748 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x21:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.016743:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b8171e lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b74 expref: 48 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.016755:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b8171e lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b74 expref: 48 pid: 8247 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826413.016774:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce049bad00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585231232:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826413.016850:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3540 going to sleep for 11 seconds 00000100:00100000:0.0:1787826413.023928:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce049bad00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585231232:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826413.023959:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b81748 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x21:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826413.028211:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826413.028290:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563822336 00000100:00100000:2.0:1787826413.028299:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563822336 00010000:00010000:2.0:1787826413.028340:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b8171e lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b74 expref: 49 pid: 8247 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826413.028371:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1082 00000100:00100000:2.0:1787826413.028382:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:2403:x1874670563822336:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826413.028398:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826413.028405:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b8171e lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b74 expref: 49 pid: 8247 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.028418:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b8171e lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b74 expref: 49 pid: 8247 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.028440:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b8171e lrc: 0/0,0 mode: --/PR res: [0x200000405:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b74 expref: 49 pid: 8247 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.028457:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x21:0x0].0x0 (ffff90cf04f8b600) 00010000:00010000:2.0:1787826413.028463:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b81748 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x21:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.028596:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b81748 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x21:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.028610:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b81748 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x21:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.028643:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826413.028707:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:2403:x1874670563822336:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 327us (516us total) trans 0 rc 0/0 00010000:00010000:1.0:1787826413.028714:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b81748 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x21:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826413.028715:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1082 00010000:00010000:1.0:1787826413.028722:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b81748 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x21:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826413.029054:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf136cfc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1874670585231360:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787826413.029101:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826413.029138:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3f7d8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826413.029191:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585231360 00000100:00100000:2.0:1787826413.029196:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585231360 00000100:00100000:2.0:1787826413.029254:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1427 00000100:00100000:2.0:1787826413.029261:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136ced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6522:x1874670585231360:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787826413.029332:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136ced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6522:x1874670585231360:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 72us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826413.029339:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1427 00000100:00080000:1.0:1787826413.029794:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826413.029830:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf136cfc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1874670585231360:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787826413.029881:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934802 00000001:00080000:1.0:1787826413.029940:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934803 00010000:00010000:1.0:1787826413.029960:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b81748 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x21:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.029970:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b81748 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x21:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.029977:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b81748 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x21:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.029984:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165ee00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826413.029989:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b81748 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x21:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.029997:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b81748 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x21:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.030012:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x21:0x0].0x0 (ffff90cf04f8b600) 00010000:00010000:1.0:1787826413.030015:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787826413.030019:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b81748 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x21:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.030026:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b81748 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x21:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.030044:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b81741 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.030052:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b81741 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.030057:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b81741 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.030063:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46a600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826413.030066:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b81741 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.030071:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b81741 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.030079:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826413.030082:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787826413.030085:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b81741 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.030091:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b81741 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.030106:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826413.030109:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787826413.030114:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81733 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b7b expref: 50 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826413.030215:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf39579850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:55469:x1874670563822080:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 19900us (20233us total) trans 8589934804 rc 0/0 00000100:00100000:1.0:1787826413.030223:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1080 00000020:00080000:1.0:1787826413.030227:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1787826413.036928:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826413.037077:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563822464 00000100:00100000:3.0:1787826413.037086:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563822464 00000100:00100000:3.0:1787826413.037140:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3662 00000100:00100000:3.0:1787826413.037150:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136ce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:55469:x1874670563822464:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826413.037173:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826413.037194:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b8174f lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0b82 expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.037265:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b8174f lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b82 expref: 50 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.037279:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b8174f lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b82 expref: 50 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.037300:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826413.037303:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826413.037307:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400600, rc 0) 00000100:00100000:3.0:1787826413.037391:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136ce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+50:55469:x1874670563822464:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 235us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826413.037399:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3662 00000100:00100000:2.0:1787826413.040956:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826413.041159:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563822720 00000100:00100000:0.0:1787826413.041168:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563822720 00000100:00100000:0.0:1787826413.041226:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1081 00000100:00100000:0.0:1787826413.041235:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+50:55469:x1874670563822720:12345-192.168.203.39@tcp:35:lfs.0 00000004:00080000:0.0:1787826413.041714:0:14257:0:(mdd_object.c:4014:mdd_close()) Object [0x200000405:0x21:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787826413.041778:0:14257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].24, 64 off10184 00000004:00080000:0.0:1787826413.041788:0:14257:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1359053316414ns, next at 1360053314505ns, rc = 0 00000001:00080000:0.0:1787826413.041794:0:14257:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934805 00010000:00010000:0.0:1787826413.041828:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b81756 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x21:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.041843:0:14257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b81756 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.041853:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b81756 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.041861:0:14257:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b81756 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.041868:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b81756 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.041875:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b81756 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.041898:0:14257:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787826413.041980:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+52:55469:x1874670563822720:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 745us (1032us total) trans 8589934806 rc 0/0 00000100:00100000:0.0:1787826413.041988:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1081 00000020:00080000:0.0:1787826413.041992:0:14257:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787826413.042051:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826413.042058:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b81756 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.042065:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165ec00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826413.042068:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b81756 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.042076:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b81756 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.042088:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x21:0x0].0x0 (ffff90ce036ca000) 00010000:00010000:2.0:1787826413.042091:0:8451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787826413.042095:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b81756 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.042101:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b81756 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.042116:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826413.042118:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826413.042119:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826413.046318:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826413.046417:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563822976 00000100:00100000:1.0:1787826413.046427:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563822976 00000100:00100000:1.0:1787826413.046791:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1082 00000100:00100000:1.0:1787826413.046804:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049bad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+52:55469:x1874670563822976:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:1.0:1787826413.047025:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049bad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55469:x1874670563822976:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 224us (715us total) trans 8589934807 rc 0/0 00000100:00100000:1.0:1787826413.047034:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1082 00000100:00100000:1.0:1787826413.079226:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826413.079324:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563823104 00000100:00100000:0.0:1787826413.079334:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563823104 00000100:00100000:0.0:1787826413.079405:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3663 00000100:00100000:0.0:1787826413.079416:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136cfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55471:x1874670563823104:12345-192.168.203.39@tcp:101:getfattr.0 00010000:00010000:0.0:1787826413.079439:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826413.079463:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b8175d lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0b89 expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.079562:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81764 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.079576:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81764 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.079588:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81764 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.079614:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b8176b lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.079626:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b8176b lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.079633:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b8176b lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.079709:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81772 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.079719:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81772 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.079726:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81772 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826413.079763:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:0.0:1787826413.079767:0:9966:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826413.079796:0:9966:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81772 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.079808:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81772 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.079818:0:9966:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81764 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.079825:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81764 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.079832:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81764 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.079843:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81764 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.079850:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165e200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826413.079854:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81764 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.079863:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81764 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.079876:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90ce036ca400) 00010000:00010000:0.0:1787826413.079880:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826413.079884:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81764 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.079891:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81764 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.079906:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b8176b lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.079913:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b8176b lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.079918:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b8176b lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.079923:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165ee00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826413.079926:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b8176b lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.079936:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b8176b lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.079942:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90ce036ca700) 00010000:00010000:0.0:1787826413.079945:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826413.079947:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b8176b lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.079953:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b8176b lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.079979:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b8175d lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b89 expref: 55 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.079994:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81772 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b89 expref: 54 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.080001:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826413.080004:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826413.080006:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165ea00, rc 0) 00000100:00100000:0.0:1787826413.080066:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136cfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+54:55471:x1874670563823104:12345-192.168.203.39@tcp:101:getfattr.0 Request processed in 652us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826413.080073:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3663 00000100:00100000:3.0:1787826413.089957:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826413.090068:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563823232 00000100:00100000:0.0:1787826413.090077:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563823232 00000100:00100000:0.0:1787826413.090148:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2019 00000100:00100000:0.0:1787826413.090158:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2404:x1874670563823232:12345-192.168.203.39@tcp:101:getfattr.0 00010000:00010000:0.0:1787826413.090179:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826413.090209:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003bd432a2/0x22153cd396b81779 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0b90 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826413.090267:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce049b92c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1874670585231488:192.168.203.39@tcp:106: 00000100:00100000:0.0:1787826413.090348:0:8435:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3300 going to sleep for 11 seconds 00000100:00080000:1.0:1787826413.090928:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826413.094066:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce049b92c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1874670585231488:192.168.203.39@tcp:106: 00010000:00010000:0.0:1787826413.094104:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003bd432a2/0x22153cd396b81779 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b90 expref: 12 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.094127:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003bd432a2/0x22153cd396b81779 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b90 expref: 12 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.094141:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165ec00, rc 0) 00000100:00100000:0.0:1787826413.094209:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2404:x1874670563823232:12345-192.168.203.39@tcp:101:getfattr.0 Request processed in 4043us (4254us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826413.094217:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2019 00000100:00100000:3.0:1787826413.139097:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826413.139392:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563823488 00000100:00100000:1.0:1787826413.139403:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563823488 00000100:00100000:1.0:1787826413.139507:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3664 00000100:00100000:1.0:1787826413.139518:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+54:55475:x1874670563823488:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826413.139536:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826413.139558:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b81780 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0b97 expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826413.139987:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1c:0x0]: returning size 4096 00010000:00010000:1.0:1787826413.140077:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b81780 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b97 expref: 56 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.140093:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ce01f45300) 00010000:00010000:1.0:1787826413.140096:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787826413.140101:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b81780 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b97 expref: 56 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.140114:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46b000, rc 0) 00000100:00100000:1.0:1787826413.140179:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+55:55475:x1874670563823488:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 663us (1093us total) trans 8589934808 rc 301/301 00000100:00100000:1.0:1787826413.140186:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3664 00000100:00100000:3.0:1787826413.149584:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826413.149930:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563823616 00000100:00100000:0.0:1787826413.149941:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563823616 00000100:00100000:0.0:1787826413.150001:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3665 00000100:00100000:0.0:1787826413.150011:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+55:55475:x1874670563823616:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:0.0:1787826413.150088:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b8178e lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.150105:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b8178e lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.150117:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b8178e lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.150130:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81795 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.150138:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81795 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.150146:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81795 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.150231:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b8179c lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.150241:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b8179c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.150248:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b8179c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826413.150286:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:0.0:1787826413.150290:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826413.150303:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b8179c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.150316:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b8178e lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.150322:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b8178e lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.150331:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b8178e lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.150337:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b8178e lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.150343:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165ee00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826413.150347:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b8178e lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.150355:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b8178e lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.150367:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90ce036ca400) 00010000:00010000:0.0:1787826413.150582:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826413.150587:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b8178e lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.150708:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b8178e lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.150728:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81795 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.150734:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81795 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.150740:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81795 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.150745:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165e200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826413.150749:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81795 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.150764:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81795 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.150773:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90ce036ca700) 00010000:00010000:0.0:1787826413.150776:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826413.150779:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81795 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.150784:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81795 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.150796:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b8179c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.150802:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b8179c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.150808:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b8179c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.150813:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165fc00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826413.150816:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b8179c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.150821:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b8179c lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.150827:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826413.150829:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826413.150832:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b8179c lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.150837:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b8179c lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826413.151014:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+55:55475:x1874670563823616:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 1002us (1437us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826413.151024:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3665 00000100:00100000:0.0:1787826413.162232:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826413.162310:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563823872 00000100:00100000:3.0:1787826413.162319:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563823872 00000100:00100000:3.0:1787826413.162377:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1083 00000100:00100000:3.0:1787826413.162388:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049b92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+55:55475:x1874670563823872:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:3.0:1787826413.162639:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049b92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+56:55475:x1874670563823872:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 253us (425us total) trans 8589934809 rc 0/0 00000100:00100000:3.0:1787826413.162648:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1083 00000100:00100000:1.0:1787826413.186126:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826413.186238:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563824128 00000100:00100000:2.0:1787826413.186248:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563824128 00000100:00100000:2.0:1787826413.186314:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3666 00000100:00100000:2.0:1787826413.186325:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136ccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+56:55477:x1874670563824128:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826413.186349:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826413.186380:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b817a3 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0b9e expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.186531:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b817aa lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.186546:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b817aa lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.186558:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b817aa lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826413.186569:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:2.0:1787826413.186683:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b817a3 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b9e expref: 59 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.186703:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b817aa lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b9e expref: 58 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.186712:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826413.186715:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787826413.186719:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834a00, rc 0) 00000100:00100000:2.0:1787826413.186783:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136ccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:55477:x1874670563824128:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 460us (665us total) trans 8589934810 rc 0/0 00000100:00100000:2.0:1787826413.186791:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3666 00000100:00100000:2.0:1787826413.194760:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826413.194858:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563824256 00000100:00100000:1.0:1787826413.194868:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563824256 00000100:00100000:1.0:1787826413.194926:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2020 00000100:00100000:1.0:1787826413.194936:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2402:x1874670563824256:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826413.194954:0:30398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826413.194971:0:30398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000381c17db/0x22153cd396b817b8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0ba5 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826413.195027:0:30398:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce04f061c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:30398:1874670585231616:192.168.203.39@tcp:106: 00000100:00100000:1.0:1787826413.195742:0:30398:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf1850cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826413.201965:0:30398:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce04f061c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:30398:1874670585231616:192.168.203.39@tcp:106: 00010000:00010000:1.0:1787826413.202003:0:30398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000381c17db/0x22153cd396b817b8 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ba5 expref: 12 pid: 30398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.202026:0:30398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000381c17db/0x22153cd396b817b8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ba5 expref: 12 pid: 30398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.202039:0:30398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46a400, rc 0) 00000100:00100000:1.0:1787826413.202100:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2402:x1874670563824256:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 7164us (7348us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826413.202108:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2020 00000100:00100000:2.0:1787826413.216565:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826413.216686:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563824512 00000100:00100000:3.0:1787826413.216696:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563824512 00000100:00100000:3.0:1787826413.216754:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3667 00000100:00100000:3.0:1787826413.216775:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:55477:x1874670563824512:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826413.216800:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826413.216822:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b817bf lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0bac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.216925:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b817c6 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.216941:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81772 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b89 expref: 59 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.216950:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b817c6 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.216981:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81772 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b89 expref: 59 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.216995:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81772 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b89 expref: 59 pid: 9966 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826413.217008:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3abc3840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1874670585231744:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826413.217089:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10aba6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826413.224217:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826413.224309:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563824640 00000100:00100000:1.0:1787826413.224317:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563824640 00010000:00010000:1.0:1787826413.224358:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81772 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b89 expref: 60 pid: 9966 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826413.224407:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1083 00000100:00100000:1.0:1787826413.224417:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:2403:x1874670563824640:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826413.224432:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826413.224439:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81772 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b89 expref: 60 pid: 9966 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.224451:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81772 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b89 expref: 60 pid: 9966 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.224502:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826413.224508:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b817c6 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.224518:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b817c6 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.224525:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b817c6 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.224545:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826413.224604:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:2403:x1874670563824640:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 189us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826413.224611:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1083 00010000:00010000:3.0:1787826413.225413:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81772 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b89 expref: 59 pid: 9966 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826413.225433:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3abc3840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1874670585231744:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826413.225455:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b817c6 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.225465:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b817c6 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.225622:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b817c6 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826413.225646:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:2.0:1787826413.225852:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b817bf lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0bac expref: 60 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.225868:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b817c6 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0bac expref: 59 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.225876:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826413.225879:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787826413.225882:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400800, rc 0) 00000100:00100000:2.0:1787826413.225934:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55477:x1874670563824512:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 9159us (9375us total) trans 8589934811 rc 0/0 00000100:00100000:2.0:1787826413.225942:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3667 00000100:00100000:2.0:1787826413.230326:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826413.230428:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563824896 00000100:00100000:1.0:1787826413.230438:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563824896 00000100:00100000:1.0:1787826413.230534:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3668 00000100:00100000:1.0:1787826413.230543:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55477:x1874670563824896:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826413.230567:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826413.230591:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b817d4 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0bb3 expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.231008:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b817db lrc: 3/1,0 mode: --/PR res: [0x200000405:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.231022:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b817db lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.231033:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b817db lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826413.231042:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x22:0x0]: returning size 0 00010000:00010000:1.0:1787826413.231085:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b817d4 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0bb3 expref: 62 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.231107:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b817db lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0bb3 expref: 61 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.231115:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x22:0x0].0x0 (ffff90cf04f8bb00) 00010000:00010000:1.0:1787826413.231118:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826413.231121:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46b000, rc 0) 00000100:00100000:1.0:1787826413.231177:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+61:55477:x1874670563824896:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 635us (862us total) trans 8589934812 rc 0/0 00000100:00100000:1.0:1787826413.231185:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3668 00000100:00100000:0.0:1787826413.247082:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826413.247211:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563825152 00000100:00100000:3.0:1787826413.247223:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563825152 00000100:00100000:3.0:1787826413.247289:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3669 00000100:00100000:3.0:1787826413.247299:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049b9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+61:55477:x1874670563825152:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826413.247323:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826413.247345:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b817e9 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0bba expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.247509:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b817f0 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.247524:0:32404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b817db lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0bb3 expref: 62 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.247534:0:32404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b817f0 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.247569:0:32404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b817db lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0bb3 expref: 62 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.247581:0:32404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b817db lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0bb3 expref: 62 pid: 8247 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826413.247595:0:32404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3abc3840 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:32404:1874670585231872:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826413.247673:0:32404:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10aba6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826413.250245:0:32404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3abc3840 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:32404:1874670585231872:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826413.250279:0:32404:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b817f0 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826413.252995:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826413.253316:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563825280 00000100:00100000:3.0:1787826413.253325:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563825280 00010000:00010000:3.0:1787826413.253376:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b817db lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0bb3 expref: 63 pid: 8247 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826413.253425:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1084 00000100:00100000:3.0:1787826413.253435:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049bbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+63:2404:x1874670563825280:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826413.253450:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826413.253456:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b817db lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0bb3 expref: 63 pid: 8247 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.253500:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b817db lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0bb3 expref: 63 pid: 8247 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.253525:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b817db lrc: 0/0,0 mode: --/PR res: [0x200000405:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0bb3 expref: 63 pid: 8247 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.253542:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x22:0x0].0x0 (ffff90cf04f8bb00) 00010000:00010000:3.0:1787826413.253548:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b817f0 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.253558:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b817f0 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.253566:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b817f0 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.253599:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826413.253648:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049bbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+62:2404:x1874670563825280:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 214us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826413.253656:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1084 00010000:00010000:1.0:1787826413.253807:0:32404:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b817f0 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.253816:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b817f0 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826413.253835:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x22:0x0]: returning size 0 00000004:00080000:1.0:1787826413.253991:0:32404:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x106:0x0], index 0: 0 00010000:00010000:1.0:1787826413.254093:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b817f0 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.254101:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b817f0 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.254107:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b817f0 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.254112:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826413.254116:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b817f0 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.254124:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b817f0 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.254135:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x22:0x0].0x0 (ffff90cf04f8bb00) 00010000:00010000:1.0:1787826413.254138:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826413.254142:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b817f0 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.254147:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b817f0 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.254192:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b817e9 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x22:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0bba expref: 62 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.254215:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x22:0x0].0x0 (ffff90cf04f8bb00) 00010000:00010000:1.0:1787826413.254218:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787826413.254221:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b817e9 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x22:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0bba expref: 62 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.254236:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400200, rc 0) 00000100:00100000:1.0:1787826413.254282:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049b9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+61:55477:x1874670563825152:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 6984us (7211us total) trans 8589934813 rc 301/301 00000100:00100000:1.0:1787826413.254289:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3669 00000100:00100000:0.0:1787826413.262073:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826413.262166:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563825536 00000100:00100000:1.0:1787826413.262177:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563825536 00000100:00100000:1.0:1787826413.262352:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1084 00000100:00100000:1.0:1787826413.262363:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce039770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+61:55477:x1874670563825536:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:1.0:1787826413.262707:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce039770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+62:55477:x1874670563825536:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 345us (649us total) trans 8589934814 rc 0/0 00000100:00100000:1.0:1787826413.262716:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1084 00000100:00100000:3.0:1787826413.266489:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826413.266591:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563825664 00000100:00100000:0.0:1787826413.266600:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563825664 00000100:00100000:0.0:1787826413.266657:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3670 00000100:00100000:0.0:1787826413.266667:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+62:55477:x1874670563825664:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826413.266691:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826413.266712:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b817fe lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0bc1 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.266810:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b81805 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.266825:0:16564:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b817c6 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0bac expref: 63 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.266834:0:16564:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b81805 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.266866:0:16564:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b817c6 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0bac expref: 63 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.266879:0:16564:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b817c6 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0bac expref: 63 pid: 6518 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826413.266891:0:16564:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03977c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:16564:1874670585232000:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826413.266959:0:16564:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3300 going to sleep for 11 seconds 00000100:00100000:3.0:1787826413.273265:0:16564:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03977c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:16564:1874670585232000:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826413.273293:0:16564:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b81805 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826413.275520:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826413.275617:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563825792 00000100:00100000:2.0:1787826413.275626:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563825792 00010000:00010000:2.0:1787826413.275674:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b817c6 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0bac expref: 64 pid: 6518 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826413.275714:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1085 00000100:00100000:2.0:1787826413.275727:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+64:2403:x1874670563825792:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826413.275740:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826413.275749:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b817c6 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0bac expref: 64 pid: 6518 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.275774:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b817c6 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0bac expref: 64 pid: 6518 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.275798:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b817c6 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0bac expref: 64 pid: 6518 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.275816:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826413.275821:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b81805 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.275830:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b81805 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.275836:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b81805 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.275866:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826413.275911:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+63:2403:x1874670563825792:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 188us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826413.275919:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1085 00010000:00010000:3.0:1787826413.276118:0:16564:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b81805 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.276126:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b81805 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826413.276179:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:3.0:1787826413.276184:0:16564:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826413.276215:0:16564:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b81805 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.276245:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b817fe lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0bc1 expref: 63 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.276261:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b81805 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0bc1 expref: 62 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.276268:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826413.276270:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826413.276272:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165e000, rc 0) 00000100:00100000:3.0:1787826413.276299:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+62:55477:x1874670563825664:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 9635us (9839us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826413.276306:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3670 00000100:00100000:3.0:1787826413.285003:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826413.285104:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563825920 00000100:00100000:2.0:1787826413.285114:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563825920 00000100:00100000:2.0:1787826413.285214:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2021 00000100:00100000:2.0:1787826413.285225:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2404:x1874670563825920:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826413.285242:0:14864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826413.285259:0:14864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002904bac2/0x22153cd396b8180c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0bc8 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826413.285316:0:14864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce044d0780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14864:1874670585232128:192.168.203.39@tcp:106: 00000100:00100000:2.0:1787826413.285403:0:14864:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf078fef00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826413.287969:0:14864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce044d0780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14864:1874670585232128:192.168.203.39@tcp:106: 00010000:00010000:2.0:1787826413.288010:0:14864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002904bac2/0x22153cd396b8180c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0bc8 expref: 12 pid: 14864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.288032:0:14864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002904bac2/0x22153cd396b8180c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0bc8 expref: 12 pid: 14864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.288044:0:14864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835a00, rc 0) 00000100:00100000:2.0:1787826413.288096:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2404:x1874670563825920:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 2873us (3102us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826413.288105:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2021 00000100:00100000:3.0:1787826413.293572:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826413.293686:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563826048 00000100:00100000:2.0:1787826413.293695:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563826048 00000100:00100000:2.0:1787826413.293764:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3671 00000100:00100000:2.0:1787826413.293775:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+62:55477:x1874670563826048:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826413.293795:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826413.293820:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81813 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0bcf expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.293887:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b8181a lrc: 3/1,0 mode: --/PR res: [0x200000405:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.293900:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b8181a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x22:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.293911:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b8181a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x22:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826413.293952:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x22:0x0]: returning size 0 00000004:00200000:2.0:1787826413.293956:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826413.293973:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b8181a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x22:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.293998:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81813 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0bcf expref: 64 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.294017:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b8181a lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x22:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0bcf expref: 63 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.294024:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x22:0x0].0x0 (ffff90cf39e67f00) 00010000:00010000:2.0:1787826413.294027:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787826413.294030:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835800, rc 0) 00000100:00100000:2.0:1787826413.294081:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+63:55477:x1874670563826048:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 309us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826413.294088:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3671 00000100:00100000:3.0:1787826413.297722:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826413.298227:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563826176 00000100:00100000:1.0:1787826413.298237:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563826176 00000100:00100000:0.0:1787826413.298430:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2022 00000100:00100000:0.0:1787826413.298441:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670563826176:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826413.298458:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826413.298649:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac666fdd/0x22153cd396b81821 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x106:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0bd6 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826413.298677:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x106:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826413.298696:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x106:0x0].0x0 since=1359s v=(0 0) 00010000:00010000:0.0:1787826413.298700:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x106:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826413.298710:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac666fdd/0x22153cd396b81821 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x106:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0bd6 expref: 10 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.298728:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ac666fdd/0x22153cd396b81821 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x106:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0bd6 expref: 10 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.298746:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165fe00, rc 0) 00000100:00100000:0.0:1787826413.298796:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670563826176:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 357us (1085us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826413.298802:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2022 00000100:00080000:1.0:1787826413.300240:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826413.302158:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826413.302260:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563826432 00000100:00100000:3.0:1787826413.302270:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563826432 00000100:00100000:3.0:1787826413.302330:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3672 00000100:00100000:3.0:1787826413.302341:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03976d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+63:55477:x1874670563826432:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826413.302361:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826413.302397:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b81828 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0bdd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.302538:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b8182f lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.302554:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b8182f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.302566:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b8182f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826413.302579:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:3.0:1787826413.302680:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b81828 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0bdd expref: 66 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.302699:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b8182f lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0bdd expref: 65 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.302709:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826413.302712:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787826413.302715:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401800, rc 0) 00000100:00100000:3.0:1787826413.302766:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03976d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+65:55477:x1874670563826432:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 428us (616us total) trans 8589934815 rc 0/0 00000100:00100000:3.0:1787826413.302774:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3672 00000100:00100000:3.0:1787826413.307260:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826413.307367:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563826560 00000100:00100000:0.0:1787826413.307387:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563826560 00000100:00100000:0.0:1787826413.307445:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2023 00000100:00100000:0.0:1787826413.307454:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab143c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2404:x1874670563826560:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826413.307510:0:30696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826413.307539:0:30696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b8183d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0be4 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826413.307595:0:30696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03975e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:30696:1874670585232256:192.168.203.39@tcp:106: 00000100:00100000:0.0:1787826413.307672:0:30696:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3300 going to sleep for 11 seconds 00000100:00100000:0.0:1787826413.310746:0:30696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03975e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:30696:1874670585232256:192.168.203.39@tcp:106: 00010000:00010000:0.0:1787826413.310787:0:30696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b8183d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0be4 expref: 12 pid: 30696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.310811:0:30696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b8183d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0be4 expref: 12 pid: 30696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.310824:0:30696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165e400, rc 0) 00000100:00100000:0.0:1787826413.310883:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab143c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2404:x1874670563826560:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 3430us (3633us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826413.310892:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2023 00000100:00100000:1.0:1787826413.314356:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826413.314958:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563826688 00000100:00100000:2.0:1787826413.314969:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563826688 00000100:00100000:3.0:1787826413.315148:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2024 00000100:00100000:3.0:1787826413.315159:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2403:x1874670563826688:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826413.315176:0:8545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826413.315194:0:8545:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9767cf8/0x22153cd396b81844 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0beb expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826413.315262:0:8545:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab17840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8545:1874670585232384:192.168.203.39@tcp:106: 00000100:00100000:3.0:1787826413.315344:0:8545:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10aba000 going to sleep for 11 seconds 00000100:00100000:1.0:1787826413.317958:0:8545:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab17840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8545:1874670585232384:192.168.203.39@tcp:106: 00010000:00010000:1.0:1787826413.318000:0:8545:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e9767cf8/0x22153cd396b81844 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0beb expref: 12 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.318023:0:8545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9767cf8/0x22153cd396b81844 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0beb expref: 12 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.318036:0:8545:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401e00, rc 0) 00000100:00100000:1.0:1787826413.318098:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2403:x1874670563826688:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 2940us (3751us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826413.318107:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2024 00000100:00100000:3.0:1787826413.318866:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787826413.318884:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585232512:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787826413.318930:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826413.320924:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585232512 00000100:00100000:0.0:1787826413.320938:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585232512 00000100:00100000:0.0:1787826413.320997:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 778 00000100:00100000:0.0:1787826413.321007:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab14b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3644:x1874670585232512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787826413.321038:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 160009024 pending 0 free 3920248832 avail 3688726528 00000100:00100000:0.0:1787826413.321106:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab14b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3644:x1874670585232512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (2175us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826413.321113:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 778 00000100:00100000:2.0:1787826413.321237:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585232512:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826413.323176:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787826413.323206:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce04f04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585232640:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826413.323266:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826413.323314:0:12021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585232640 00000100:00100000:1.0:1787826413.323321:0:12021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585232640 00000100:00100000:1.0:1787826413.323367:0:12021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 779 00000100:00100000:3.0:1787826413.323559:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab15a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585232768:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787826413.323588:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826413.323617:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585232768 00000100:00100000:3.0:1787826413.323620:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585232768 00000100:00100000:0.0:1787826413.323713:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03975e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585232896:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787826413.323742:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826413.323852:0:12021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f06940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874670585232640:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787826413.323881:0:12021:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 186235712 pending 0 free 3919187968 avail 3687665664 00000100:00100000:1.0:1787826413.323925:0:12021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f06940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874670585232640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826413.323986:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce04f04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585232640:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826413.324329:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826413.324495:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563826816 00000100:00100000:0.0:1787826413.324501:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563826816 00000100:00100000:0.0:1787826413.324542:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2025 00000100:00100000:0.0:1787826413.324550:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2404:x1874670563826816:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:0.0:1787826413.324580:0:30695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b8184b lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.324597:0:30695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009a27ec96/0x22153cd396b8165a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b35 expref: 11 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.324606:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x106:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787826413.324610:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x106:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826413.324615:0:30695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b8184b lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.324642:0:30695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009a27ec96/0x22153cd396b8165a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b35 expref: 11 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.324654:0:30695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009a27ec96/0x22153cd396b8165a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b35 expref: 11 pid: 8436 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826413.324664:0:30695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03976580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:30695:1874670585233024:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826413.324723:0:30695:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3300 going to sleep for 11 seconds 00000100:00100000:0.0:1787826413.324927:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585232896 00000100:00100000:0.0:1787826413.324931:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585232896 00000100:00100000:3.0:1787826413.325042:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 780 00000100:00100000:3.0:1787826413.325051:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab16d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874670585232768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787826413.325064:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 160009024 pending 0 free 3920248832 avail 3688726528 00000100:00100000:3.0:1787826413.325107:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab16d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874670585232768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (1519us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826413.325114:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 780 00000100:00100000:3.0:1787826413.325154:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab15a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585232768:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826413.327805:0:12021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 779 00000100:00080000:1.0:1787826413.327846:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826413.328136:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826413.328213:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563826944 00000100:00100000:3.0:1787826413.328220:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563826944 00010000:00010000:3.0:1787826413.328255:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009a27ec96/0x22153cd396b8165a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b35 expref: 12 pid: 8436 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826413.328294:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1086 00000100:00100000:3.0:1787826413.328303:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563826944:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826413.328318:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826413.328340:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009a27ec96/0x22153cd396b8165a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x106:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b35 expref: 12 pid: 8436 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.328355:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009a27ec96/0x22153cd396b8165a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x106:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b35 expref: 12 pid: 8436 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.328401:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x106:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826413.328407:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x106:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826413.328413:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b8184b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x106:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.328424:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b8184b lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x106:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.328447:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826413.328513:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563826944:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 210us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826413.328521:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1086 00010000:00010000:1.0:1787826413.328914:0:30695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a27ec96/0x22153cd396b8165a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b35 expref: 11 pid: 8436 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826413.328931:0:30695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03976580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:30695:1874670585233024:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826413.328951:0:30695:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b8184b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x106:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.328963:0:30695:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b8184b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x106:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.328971:0:30695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b8184b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x106:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.328992:0:30695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b8184b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x106:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.329001:0:30695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b8184b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x106:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.329009:0:30695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b8184b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x106:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.329024:0:30695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165e400 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:1.0:1787826413.329028:0:30695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b8184b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x106:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.329038:0:30695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b8184b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x106:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.329052:0:30695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b8184b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x106:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.329061:0:30695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b8184b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x106:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826413.329120:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563826816:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 4570us (4792us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826413.329128:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2025 00000100:00100000:2.0:1787826413.333450:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826413.333586:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563827072 00000100:00100000:1.0:1787826413.333595:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563827072 00000100:00100000:1.0:1787826413.333648:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2026 00000100:00100000:1.0:1787826413.333658:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06306580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670563827072:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826413.333675:0:28853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826413.333695:0:28853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000816b8b1f/0x22153cd396b81852 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x106:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0bf2 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826413.333720:0:28853:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x106:0x0] initial LVB size: 0, mtime: 0x6a9010ec, atime: 0x6a9010ec, ctime: 0x6a9010ed, blocks: 0x0 00010000:00010000:1.0:1787826413.333740:0:28853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x106:0x0].0x0 since=1359s v=(0 0) 00010000:00010000:1.0:1787826413.333745:0:28853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x106:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826413.333754:0:28853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000816b8b1f/0x22153cd396b81852 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x106:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0bf2 expref: 11 pid: 28853 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.333772:0:28853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000816b8b1f/0x22153cd396b81852 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x106:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0bf2 expref: 11 pid: 28853 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.333786:0:28853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46ae00, rc 0) 00000100:00100000:1.0:1787826413.333842:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06306580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2403:x1874670563827072:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 185us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826413.333850:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2026 00000100:00100000:0.0:1787826413.339778:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 781 00000100:00100000:0.0:1787826413.339804:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03974f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1874670585232896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787826413.339833:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 186235712 pending 0 free 3919187968 avail 3687665664 00000100:00100000:0.0:1787826413.339933:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03974f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1874670585232896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 141us (16188us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826413.339940:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 781 00000100:00100000:1.0:1787826413.340038:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03975e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585232896:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787826413.386228:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826413.386331:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563827200 00000100:00100000:1.0:1787826413.386341:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563827200 00000100:00100000:1.0:1787826413.386406:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3673 00000100:00100000:1.0:1787826413.386416:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab15a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+65:55477:x1874670563827200:12345-192.168.203.39@tcp:44:lfs.0 00000001:00080000:0.0:1787826413.388029:0:34481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934815 is committed 00000004:00080000:0.0:1787826413.388067:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 25 committed 00000020:00080000:0.0:1787826413.388111:0:34481:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969329 batchid updated 00000020:00080000:0.0:1787826413.388136:0:34481:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90cf1850c000 refcount 2 committed 0 result 0 batchid 4294969330 00000020:00080000:0.0:1787826413.388142:0:34481:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cf39e98d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90cf1850c840 00000020:00080000:0.0:1787826413.388146:0:34481:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cf39e98900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90ce05b83600 00000020:00080000:2.0:1787826413.388219:0:34512:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969330 committed batchid 4294969329 00000004:00080000:2.0:1787826413.388334:0:34512:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff90cf078fef00 with version 10 00000020:00080000:2.0:1787826413.388350:0:34512:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 4294969328 cancel update log [0x240000405:0x2:0x0].2: rc = 0 00000020:00080000:2.0:1787826413.388398:0:34512:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 4294969328 cancel update log [0x200000bd0:0x2:0x0].3: rc = 0 00000020:00080000:2.0:1787826413.388426:0:34512:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 4294969329 cancel update log [0x200000bd0:0x2:0x0].4: rc = 0 00000020:00080000:2.0:1787826413.388434:0:34512:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969329 00000100:00100000:1.0:1787826413.388679:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787826413.388698:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce04f052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585233152:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787826413.388762:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826413.388809:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585233152 00000100:00100000:1.0:1787826413.388815:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585233152 00000100:00100000:1.0:1787826413.388856:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2027 00000100:00100000:1.0:1787826413.388864:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f05680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3644:x1874670585233152:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787826413.388888:0:30694:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:261 count 1 00010000:00010000:1.0:1787826413.388911:0:30694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8fb1ffc/0x22153cd396b81859 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x105:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.388933:0:30694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000382351a4/0x22153cd396b81668 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b3c expref: 9 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.388942:0:30694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x105:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787826413.388947:0:30694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x105:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826413.388951:0:30694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8fb1ffc/0x22153cd396b81859 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.388978:0:30694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000382351a4/0x22153cd396b81668 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b3c expref: 9 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.388991:0:30694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000382351a4/0x22153cd396b81668 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b3c expref: 9 pid: 30695 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826413.389003:0:30694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce04f06d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:30694:1874670585233280:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826413.389061:0:30694:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf1850c300 going to sleep for 11 seconds 00000100:00100000:1.0:1787826413.389139:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab15a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:55477:x1874670563827200:12345-192.168.203.39@tcp:44:lfs.0 Request processed in 2724us (2921us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826413.389148:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3673 00000004:00080000:0.0:1787826413.389392:0:34498:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff90cf39def9c0 version 10 rpc_version 10 00000020:00100000:0.0:1787826413.389415:0:34498:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787826413.389424:0:34498:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff90ce03977840 x1874670585233536/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787826413.389440:0:34498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03977840 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:34498:1874670585233536:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787826413.389501:0:34498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826413.389526:0:34498:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3540 going to sleep for 11 seconds 00000100:00100000:2.0:1787826413.389578:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585233536 00000100:00100000:2.0:1787826413.389582:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585233536 00000100:00100000:2.0:1787826413.389617:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1428 00000100:00100000:2.0:1787826413.389624:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:34498:x1874670585233536:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787826413.389760:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:34498:x1874670585233536:12345-0@lo:1000:osp_up1-0.0 Request processed in 136us (258us total) trans 4294967718 rc 0/0 00000100:00100000:2.0:1787826413.389767:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1428 00000100:00100000:1.0:1787826413.390612:0:34498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03977840 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:34498:1874670585233536:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1787826413.394213:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066a00/0x22153cd396b8164c lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.394230:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066a00/0x22153cd396b8164c lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.394236:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066a00/0x22153cd396b8164c lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.394242:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90ce0a066a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826413.394247:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066a00/0x22153cd396b8164c lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.394254:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066a00/0x22153cd396b8164c lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.394271:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x20:0x0].0x0 (ffff90cf04f8b100) 00010000:00010000:3.0:1787826413.394274:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826413.394279:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066a00/0x22153cd396b8164c lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.394285:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a066a00/0x22153cd396b8164c lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.394314:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b81661 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.394320:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b81661 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.394325:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b81661 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.394330:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826413.394332:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b81661 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.394338:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b81661 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.394345:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826413.394347:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826413.394350:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b81661 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.394355:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b81661 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826413.394718:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826413.394883:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826413.395163:0:30694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce04f06d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:30694:1874670585233280:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826413.395189:0:30694:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a8fb1ffc/0x22153cd396b81859 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826413.395269:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563827456 00000100:00100000:0.0:1787826413.395276:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563827456 00010000:00010000:0.0:1787826413.395313:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000382351a4/0x22153cd396b81668 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b3c expref: 10 pid: 30695 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826413.395353:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1087 00000100:00100000:0.0:1787826413.395363:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06307c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563827456:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826413.395391:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826413.395397:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000382351a4/0x22153cd396b81668 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x105:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b3c expref: 10 pid: 30695 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.395409:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000382351a4/0x22153cd396b81668 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x105:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b3c expref: 10 pid: 30695 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.395429:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000382351a4/0x22153cd396b81668 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x105:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b3c expref: 10 pid: 30695 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.395443:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x105:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826413.395447:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x105:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826413.395453:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a8fb1ffc/0x22153cd396b81859 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.395464:0:10340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8fb1ffc/0x22153cd396b81859 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.395513:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826413.395560:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06307c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563827456:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 199us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826413.395568:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1087 00010000:00010000:1.0:1787826413.395629:0:30694:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a8fb1ffc/0x22153cd396b81859 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x105:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.395637:0:30694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8fb1ffc/0x22153cd396b81859 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x105:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.395647:0:30694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8fb1ffc/0x22153cd396b81859 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x105:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.395654:0:30694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8fb1ffc/0x22153cd396b81859 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x105:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.395676:0:30694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787826413.395851:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f05680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:3644:x1874670585233152:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6987us (7087us total) trans 21474836995 rc 0/0 00000100:00100000:1.0:1787826413.395859:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2027 00000100:00100000:1.0:1787826413.395873:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563827328 00000100:00100000:1.0:1787826413.395876:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563827328 00010000:00010000:0.0:1787826413.395919:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826413.395926:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8fb1ffc/0x22153cd396b81859 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x105:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.395935:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46ac00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826413.395939:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8fb1ffc/0x22153cd396b81859 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x105:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.395948:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8fb1ffc/0x22153cd396b81859 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x105:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.395960:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8fb1ffc/0x22153cd396b81859 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x105:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.395967:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8fb1ffc/0x22153cd396b81859 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x105:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.395985:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826413.395987:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826413.395989:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826413.396825:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2028 00000100:00100000:3.0:1787826413.396841:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce063061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563827328:12345-192.168.203.39@tcp:16:lfs.0 00000100:00100000:3.0:1787826413.396919:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce063061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563827328:12345-192.168.203.39@tcp:16:lfs.0 Request processed in 83us (2206us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826413.396926:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2028 00000004:00080000:1.0:1787826413.403745:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce04f052c0/2, rc 0, transno 21474836995 00000100:00100000:1.0:1787826413.403761:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce04f052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585233152:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787826413.412413:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826413.412552:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563827584 00000100:00100000:0.0:1787826413.412563:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563827584 00000100:00100000:0.0:1787826413.412624:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2029 00000100:00100000:0.0:1787826413.412636:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06307840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2401:x1874670563827584:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:0.0:1787826413.412678:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000091cba634/0x22153cd396b81860 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.412696:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x106:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826413.412700:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x106:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826413.412707:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091cba634/0x22153cd396b81860 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.412722:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091cba634/0x22153cd396b81860 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.412753:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000091cba634/0x22153cd396b81860 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.412775:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091cba634/0x22153cd396b81860 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.412784:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091cba634/0x22153cd396b81860 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.412792:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165f400 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826413.412796:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091cba634/0x22153cd396b81860 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.412806:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091cba634/0x22153cd396b81860 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.412824:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091cba634/0x22153cd396b81860 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.412832:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091cba634/0x22153cd396b81860 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826413.412913:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06307840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2401:x1874670563827584:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 279us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826413.412921:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2029 00000100:00100000:3.0:1787826413.416964:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826413.417179:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563827840 00000100:00100000:0.0:1787826413.417188:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563827840 00000100:00100000:0.0:1787826413.417266:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3674 00000100:00100000:0.0:1787826413.417276:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+32:55477:x1874670563827840:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:0.0:1787826413.417331:0:16564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826413.417359:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b8181a lrc: 0/0,0 mode: --/PR res: [0x200000405:0x22:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0bcf expref: 32 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.417392:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x22:0x0].0x0 (ffff90cf39e67f00) 00010000:00010000:0.0:1787826413.417404:0:16564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826413.417436:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b81867 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.417453:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b81867 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.417462:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b81867 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826413.417629:0:16564:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ecd84918 reply state 00000000426b26f0 transno 8589934816 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b81867 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.417642:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b81867 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.417649:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x22:0x0].0x0 (ffff90ce01f45600) 00010000:00010000:0.0:1787826413.417652:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826413.417654:0:16564:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787826413.417752:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:55477:x1874670563827840:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 477us (796us total) trans 8589934816 rc 0/0 00000100:00100000:0.0:1787826413.417759:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3674 00000100:00100000:2.0:1787826413.422324:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826413.422629:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563827968 00000100:00100000:1.0:1787826413.422640:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563827968 00000100:00100000:1.0:1787826413.422703:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3675 00000100:00100000:1.0:1787826413.422712:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06305a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:55477:x1874670563827968:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826413.422738:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826413.422761:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a000/0x22153cd396b8186e lrc: 2/0,0 mode: --/CR res: [0x200000405:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0bf9 expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.423002:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a000/0x22153cd396b8186e lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0bf9 expref: 34 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.423018:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a000/0x22153cd396b8186e lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0bf9 expref: 34 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.423038:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x22:0x0].0x0 (ffff90ce01f45600) 00010000:00010000:1.0:1787826413.423041:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826413.423045:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46a000, rc 0) 00000100:00100000:1.0:1787826413.423107:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06305a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:55477:x1874670563827968:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 396us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826413.423113:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3675 00000100:00100000:3.0:1787826413.429114:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826413.429223:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563828096 00000100:00100000:2.0:1787826413.429232:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563828096 00000100:00100000:2.0:1787826413.429297:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2030 00000100:00100000:2.0:1787826413.429307:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab14f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:55477:x1874670563828096:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826413.429328:0:30398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826413.429345:0:30398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000159f1fa4/0x22153cd396b81875 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0c00 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.429533:0:30398:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ac666fdd/0x22153cd396b81821 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0bd6 expref: 10 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.429544:0:30398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x106:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826413.429548:0:30398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x106:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826413.429553:0:30398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000159f1fa4/0x22153cd396b81875 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c00 expref: 10 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.429589:0:30398:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ac666fdd/0x22153cd396b81821 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0bd6 expref: 10 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.429603:0:30398:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ac666fdd/0x22153cd396b81821 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0bd6 expref: 10 pid: 8437 timeout: 1459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826413.429616:0:30398:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce06304000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:30398:1874670585233664:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826413.429698:0:30398:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce010f59c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826413.433097:0:30398:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce06304000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:30398:1874670585233664:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826413.433132:0:30398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000159f1fa4/0x22153cd396b81875 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c00 expref: 10 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.433154:0:30398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835800, rc 0) 00000100:00100000:1.0:1787826413.433224:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab14f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:55477:x1874670563828096:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 3918us (4120us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826413.433233:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2030 00000100:00100000:3.0:1787826413.436229:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826413.436334:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563828224 00000100:00100000:1.0:1787826413.436342:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563828224 00010000:00010000:1.0:1787826413.436399:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ac666fdd/0x22153cd396b81821 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0bd6 expref: 10 pid: 8437 timeout: 1459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826413.436449:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1088 00000100:00100000:1.0:1787826413.436460:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf185dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670563828224:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826413.437129:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826413.437157:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ac666fdd/0x22153cd396b81821 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x106:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0bd6 expref: 10 pid: 8437 timeout: 1459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.437174:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ac666fdd/0x22153cd396b81821 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x106:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0bd6 expref: 10 pid: 8437 timeout: 1459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.437210:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac666fdd/0x22153cd396b81821 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x106:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0bd6 expref: 10 pid: 8437 timeout: 1459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.437234:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x106:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826413.437239:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x106:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826413.437245:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000159f1fa4/0x22153cd396b81875 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c00 expref: 9 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.437255:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000159f1fa4/0x22153cd396b81875 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c00 expref: 9 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.437297:0:6503:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000159f1fa4/0x22153cd396b81875 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c00 expref: 9 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826413.437311:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03976940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6503:1874670585233792:192.168.203.39@tcp:105: 00000100:00100000:0.0:1787826413.438819:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3000 going to sleep for 11 seconds 00000100:00100000:2.0:1787826413.445744:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826413.445854:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03976940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6503:1874670585233792:192.168.203.39@tcp:105: 00010000:00010000:0.0:1787826413.445883:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826413.445949:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf185dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670563828224:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 9490us (9728us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826413.445960:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1088 00000100:00100000:1.0:1787826413.446341:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563828352 00000100:00100000:1.0:1787826413.446348:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563828352 00000100:00100000:1.0:1787826413.446544:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2031 00000100:00100000:1.0:1787826413.446554:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06305e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670563828352:12345-192.168.203.39@tcp:2:lfs.0 00002000:00010000:1.0:1787826413.446709:0:28853:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x106:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787826413.446713:0:28853:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x106:0x0] updating lvb mtime from disk: 0 -> 1787826412 00002000:00010000:1.0:1787826413.446715:0:28853:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x106:0x0] updating lvb atime from disk: 0 -> 1787826412 00002000:00010000:1.0:1787826413.446718:0:28853:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x106:0x0] updating lvb ctime from disk: 0 -> 1787826414 00002000:00010000:1.0:1787826413.446720:0:28853:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x106:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1787826413.446752:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06305e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670563828352:12345-192.168.203.39@tcp:2:lfs.0 Request processed in 200us (1019us total) trans 21474836996 rc 0/0 00000100:00100000:1.0:1787826413.446761:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2031 00000100:00100000:3.0:1787826413.459614:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826413.459692:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563828608 00000100:00100000:0.0:1787826413.459703:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563828608 00000100:00100000:0.0:1787826413.459773:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3676 00000100:00100000:0.0:1787826413.459783:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab17c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:55477:x1874670563828608:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:0.0:1787826413.459838:0:9966:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826413.459866:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b81805 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0bc1 expref: 34 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.459886:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826413.459891:0:9966:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826413.459938:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8187c lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.459952:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8187c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.459962:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8187c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826413.460061:0:9966:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f880b31b reply state 0000000002dade33 transno 8589934817 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8187c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.460075:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8187c lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.460083:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826413.460085:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826413.460088:0:9966:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787826413.460176:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab17c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:55477:x1874670563828608:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 393us (570us total) trans 8589934817 rc 0/0 00000100:00100000:0.0:1787826413.460184:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3676 00000100:00100000:2.0:1787826413.469420:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826413.469564:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563828736 00000100:00100000:1.0:1787826413.469574:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563828736 00000100:00100000:1.0:1787826413.469642:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2032 00000100:00100000:1.0:1787826413.469653:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06304b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:55477:x1874670563828736:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826413.469669:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826413.469687:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000421aa0a2/0x22153cd396b81883 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0c07 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.469716:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000816b8b1f/0x22153cd396b81852 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0bf2 expref: 12 pid: 28853 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.469730:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x106:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826413.469735:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x106:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826413.469740:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000421aa0a2/0x22153cd396b81883 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c07 expref: 12 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.469772:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000816b8b1f/0x22153cd396b81852 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0bf2 expref: 12 pid: 28853 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.469786:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000816b8b1f/0x22153cd396b81852 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0bf2 expref: 12 pid: 28853 timeout: 1459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826413.469800:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce04f06d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1874670585233920:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826413.469882:0:8437:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf1850c300 going to sleep for 11 seconds 00000100:00100000:2.0:1787826413.472708:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826413.472796:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563828864 00000100:00100000:3.0:1787826413.472805:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563828864 00010000:00010000:3.0:1787826413.472845:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000816b8b1f/0x22153cd396b81852 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0bf2 expref: 13 pid: 28853 timeout: 1459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826413.472887:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1089 00000100:00100000:3.0:1787826413.472897:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06305680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2404:x1874670563828864:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826413.472912:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826413.472933:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000816b8b1f/0x22153cd396b81852 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x106:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0bf2 expref: 13 pid: 28853 timeout: 1459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.472946:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000816b8b1f/0x22153cd396b81852 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x106:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0bf2 expref: 13 pid: 28853 timeout: 1459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.472970:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x106:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826413.472975:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x106:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826413.472982:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000421aa0a2/0x22153cd396b81883 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x106:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c07 expref: 13 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.472998:0:10341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000421aa0a2/0x22153cd396b81883 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x106:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c07 expref: 13 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.473033:0:10341:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000421aa0a2/0x22153cd396b81883 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x106:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c07 expref: 13 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826413.473048:0:10341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab14000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10341:1874670585234048:192.168.203.39@tcp:105: 00000100:00100000:3.0:1787826413.473133:0:10341:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10aba840 going to sleep for 11 seconds 00010000:00010000:1.0:1787826413.474051:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000816b8b1f/0x22153cd396b81852 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x106:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0bf2 expref: 13 pid: 28853 timeout: 1459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826413.474068:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce04f06d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1874670585233920:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826413.474090:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000421aa0a2/0x22153cd396b81883 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c07 expref: 12 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.474112:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46bc00, rc 0) 00000100:00100000:1.0:1787826413.474163:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06304b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:55477:x1874670563828736:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 4512us (4751us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826413.474175:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2032 00000100:00100000:0.0:1787826413.491757:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826413.491847:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563828992 00000100:00100000:1.0:1787826413.491855:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563828992 00000100:00100000:1.0:1787826413.491911:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2033 00000100:00100000:1.0:1787826413.491921:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03976940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563828992:12345-192.168.203.39@tcp:2:lfs.0 00002000:00010000:1.0:1787826413.492062:0:30696:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x106:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787826413.492067:0:30696:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x106:0x0] updating lvb mtime from disk: 1787826412 -> 1787826412 00002000:00010000:1.0:1787826413.492069:0:30696:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x106:0x0] updating lvb atime from disk: 1787826412 -> 1787826412 00002000:00010000:1.0:1787826413.492071:0:30696:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x106:0x0] updating lvb ctime from disk: 1787826413 -> 1787826414 00002000:00010000:1.0:1787826413.492073:0:30696:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x106:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1787826413.492139:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03976940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2403:x1874670563828992:12345-192.168.203.39@tcp:2:lfs.0 Request processed in 219us (391us total) trans 17179869655 rc 0/0 00000100:00100000:1.0:1787826413.492147:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2033 00000100:00100000:3.0:1787826413.492301:0:10341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab14000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10341:1874670585234048:192.168.203.39@tcp:105: 00010000:00010000:3.0:1787826413.492323:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826413.492358:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06305680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563828864:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 19463us (19658us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826413.492366:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1089 00000100:00100000:2.0:1787826413.497958:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826413.499123:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563829248 00000100:00100000:3.0:1787826413.499140:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563829248 00000100:00100000:2.0:1787826413.499713:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1085 00000100:00100000:2.0:1787826413.499730:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf39579450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:55477:x1874670563829248:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:2.0:1787826413.499851:0:6521:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000405:0x1d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b8182f lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0bdd expref: 35 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.499902:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b8188a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.499917:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b8174f lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b82 expref: 35 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.499925:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b817aa lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b9e expref: 35 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.499933:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b8188a lrc: 5/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.499979:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b817aa lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b9e expref: 35 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.499997:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b817aa lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b9e expref: 35 pid: 16564 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826413.500014:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce063052c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1874670585234176:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826413.500153:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b8174f lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b82 expref: 35 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.500163:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b8174f lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b82 expref: 35 pid: 32404 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826413.500176:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce06306d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1874670585234304:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826413.500214:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce010f5e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787826413.505966:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826413.506116:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce063052c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1874670585234176:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826413.506130:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce06306d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1874670585234304:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826413.506169:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b8188a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826413.506331:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826413.506828:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563829504 00000100:00100000:3.0:1787826413.506840:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563829504 00010000:00010000:3.0:1787826413.506888:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b8174f lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b82 expref: 36 pid: 32404 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826413.506935:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1090 00000100:00100000:3.0:1787826413.506947:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06304000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:2403:x1874670563829504:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826413.506966:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826413.506974:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b8174f lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b82 expref: 36 pid: 32404 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.506987:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b8174f lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b82 expref: 36 pid: 32404 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.507017:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b8174f lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b82 expref: 36 pid: 32404 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.507044:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826413.507051:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b8188a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.507061:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b8188a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.507068:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826413.507143:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06304000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:2403:x1874670563829504:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 199us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826413.507152:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1090 00000100:00100000:1.0:1787826413.507853:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563829632 00000100:00100000:1.0:1787826413.507865:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563829632 00000100:00100000:1.0:1787826413.507912:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1086 00000100:00100000:1.0:1787826413.507925:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06307c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:42220:x1874670563829632:12345-192.168.203.39@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787826413.508316:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06307c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:42220:x1874670563829632:12345-192.168.203.39@tcp:35:ldlm_bl.0 Request processed in 394us (2364us total) trans 8589934818 rc 0/0 00000100:00100000:1.0:1787826413.508325:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1086 00000100:00100000:2.0:1787826413.513433:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826413.517240:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563829760 00000100:00100000:0.0:1787826413.517263:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563829760 00010000:00010000:0.0:1787826413.517339:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b817aa lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b9e expref: 36 pid: 16564 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826413.518111:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1091 00000100:00100000:0.0:1787826413.518130:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06306d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:2404:x1874670563829760:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826413.518156:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826413.518166:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b817aa lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b9e expref: 36 pid: 16564 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.518182:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b817aa lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b9e expref: 36 pid: 16564 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.518226:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b817aa lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0b9e expref: 36 pid: 16564 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.518251:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826413.518257:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b8188a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.518269:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b8188a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.518278:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b8188a lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.518307:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826413.518411:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06306d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:2404:x1874670563829760:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 289us (4993us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826413.518420:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1091 00010000:00010000:2.0:1787826413.518534:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b8188a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.518545:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b8188a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.518574:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81891 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.518587:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a000/0x22153cd396b8186e lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0bf9 expref: 34 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.518596:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81891 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x22:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.518632:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a000/0x22153cd396b8186e lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0bf9 expref: 34 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.518646:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a000/0x22153cd396b8186e lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0bf9 expref: 34 pid: 8247 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826413.518661:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce063052c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1874670585234432:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826413.518730:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce010f50c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826413.522227:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826413.522264:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563829888 00000100:00100000:0.0:1787826413.522276:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563829888 00010000:00010000:0.0:1787826413.522331:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a000/0x22153cd396b8186e lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0bf9 expref: 35 pid: 8247 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826413.522362:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce063052c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1874670585234432:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826413.522392:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1092 00010000:00010000:1.0:1787826413.522404:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81891 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x22:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826413.522405:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf07967840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:2403:x1874670563829888:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826413.522429:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826413.522440:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a000/0x22153cd396b8186e lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x22:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0bf9 expref: 35 pid: 8247 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.522455:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a000/0x22153cd396b8186e lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x22:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0bf9 expref: 35 pid: 8247 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.522505:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a000/0x22153cd396b8186e lrc: 0/0,0 mode: --/CR res: [0x200000405:0x22:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0bf9 expref: 35 pid: 8247 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.522524:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x22:0x0].0x0 (ffff90ce01f45600) 00010000:00010000:0.0:1787826413.522530:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81891 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x22:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.522544:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81891 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x22:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.522554:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81891 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x22:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.522577:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826413.522609:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81891 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x22:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.522619:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81891 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x22:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826413.522644:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf07967840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:2403:x1874670563829888:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 241us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826413.522653:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1092 00000100:00100000:1.0:1787826413.523464:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce04f06d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6521:1874670585234560:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787826413.523747:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826413.523882:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf1850c900 going to sleep for 11 seconds 00000100:00100000:2.0:1787826413.526281:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585234560 00000100:00100000:2.0:1787826413.526299:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585234560 00000100:00100000:2.0:1787826413.526386:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1429 00000100:00100000:2.0:1787826413.526398:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f06580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6521:x1874670585234560:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787826413.526594:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f06580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6521:x1874670585234560:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 198us (2846us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826413.526603:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1429 00000100:00100000:1.0:1787826413.526681:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce04f06d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6521:1874670585234560:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787826413.526776:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce04f06d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6521:1874670585234688:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787826413.526822:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826413.526856:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3f7d8000 going to sleep for 11 seconds 00000100:00100000:0.0:1787826413.526912:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585234688 00000100:00100000:0.0:1787826413.526917:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585234688 00000100:00100000:0.0:1787826413.526958:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1430 00000100:00100000:0.0:1787826413.526966:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6521:x1874670585234688:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787826413.527043:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6521:x1874670585234688:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 79us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826413.527050:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1430 00000100:00100000:2.0:1787826413.527225:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce04f06d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6521:1874670585234688:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787826413.527392:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934819 00000100:00100000:2.0:1787826413.527494:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf07965a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6521:1874670585234816:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787826413.527532:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826413.527553:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce010f50c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826413.528203:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585234816 00000100:00100000:0.0:1787826413.528213:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585234816 00000100:00100000:0.0:1787826413.528270:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1431 00000100:00100000:0.0:1787826413.528279:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf079661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6521:x1874670585234816:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787826413.528455:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf079661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6521:x1874670585234816:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 177us (921us total) trans 21474836997 rc 0/0 00000100:00100000:0.0:1787826413.528490:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1431 00000100:00100000:1.0:1787826413.528738:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf07965a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6521:1874670585234816:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787826413.528832:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934820 00010000:00010000:1.0:1787826413.528863:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81891 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x22:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.528875:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81891 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x22:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.528884:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81891 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x22:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.528890:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826413.528896:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81891 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x22:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.528905:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81891 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x22:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.528931:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x22:0x0].0x0 (ffff90ce01f45600) 00010000:00010000:1.0:1787826413.528934:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787826413.528939:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81891 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x22:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.528946:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81891 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x22:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.528962:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b8188a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.528968:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b8188a lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.528974:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b8188a lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.528979:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826413.528981:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b8188a lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.528987:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b8188a lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.528994:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826413.528996:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787826413.528999:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b8188a lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.529005:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b8188a lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.529022:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826413.529025:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787826413.529032:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b8182f lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0bdd expref: 36 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826413.529143:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf39579450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:55477:x1874670563829248:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 29418us (31198us total) trans 8589934821 rc 0/0 00000100:00100000:1.0:1787826413.529153:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1085 00000020:00080000:1.0:1787826413.529157:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1787826413.535928:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826413.539631:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563830016 00000100:00100000:1.0:1787826413.539652:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563830016 00000100:00100000:1.0:1787826413.539745:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3677 00000100:00100000:1.0:1787826413.539758:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf07966d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:55477:x1874670563830016:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826413.539794:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826413.539822:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b81898 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0c0e expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.539911:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b81898 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c0e expref: 36 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.539932:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b81898 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c0e expref: 36 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.539955:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826413.539959:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826413.539964:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46ba00, rc 0) 00000100:00100000:1.0:1787826413.540060:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf07966d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55477:x1874670563830016:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 304us (4147us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826413.540068:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3677 00000100:00100000:0.0:1787826413.548761:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826413.548869:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563830272 00000100:00100000:2.0:1787826413.548882:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563830272 00000100:00100000:2.0:1787826413.548957:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1087 00000100:00100000:2.0:1787826413.548969:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce039770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55477:x1874670563830272:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:2.0:1787826413.549722:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce039770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:55477:x1874670563830272:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 751us (972us total) trans 8589934822 rc 0/0 00000100:00100000:2.0:1787826413.549733:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1087 00000100:00100000:2.0:1787826413.555946:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826413.558277:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563830528 00000100:00100000:1.0:1787826413.558300:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563830528 00000100:00100000:1.0:1787826413.558590:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1088 00000100:00100000:1.0:1787826413.558604:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf07966940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:55477:x1874670563830528:12345-192.168.203.39@tcp:35:lfs.0 00000004:00080000:1.0:1787826413.558860:0:6521:0:(mdd_object.c:4014:mdd_close()) Object [0x200000405:0x22:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:1.0:1787826413.558970:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b8189f lrc: 3/0,1 mode: --/PW res: [0x200000405:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.558992:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b8189f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.559007:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b8189f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.559018:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b8189f lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.559025:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b8189f lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.559033:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b8189f lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.559062:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787826413.559202:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf07966940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:55477:x1874670563830528:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 591us (3262us total) trans 8589934823 rc 0/0 00000100:00100000:1.0:1787826413.559213:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1088 00010000:00010000:0.0:1787826413.559724:0:7460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826413.559735:0:7460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b8189f lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.559744:0:7460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46b200 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826413.559749:0:7460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b8189f lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.559763:0:7460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b8189f lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.559780:0:7460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x22:0x0].0x0 (ffff90ce01f45600) 00010000:00010000:0.0:1787826413.559784:0:7460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787826413.559788:0:7460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b8189f lrc: 1/0,0 mode: --/PW res: [0x200000405:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.559795:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b8189f lrc: 0/0,0 mode: --/PW res: [0x200000405:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.559812:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826413.559814:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826413.559816:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826413.582562:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826413.582682:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563830656 00000100:00100000:2.0:1787826413.582694:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563830656 00000100:00100000:2.0:1787826413.582766:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3678 00000100:00100000:2.0:1787826413.582778:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:55479:x1874670563830656:12345-192.168.203.39@tcp:101:getfattr.0 00010000:00010000:2.0:1787826413.582812:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826413.582840:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b818a6 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0c15 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.582937:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b818ad lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.582954:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b818ad lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.582967:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b818ad lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.582982:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b818b4 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.582990:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b818b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.583008:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b818b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.583106:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b818bb lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.583116:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b818bb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.583124:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b818bb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826413.583178:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:2.0:1787826413.583183:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826413.583220:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b818bb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.583236:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b818bb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.583245:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b818ad lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.583251:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b818ad lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.583259:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b818ad lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.583266:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826413.583271:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b818ad lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.583280:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b818ad lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.583296:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf39e67800) 00010000:00010000:2.0:1787826413.583300:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826413.583305:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b818ad lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.583312:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b818ad lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.583331:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b818b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.583337:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b818b4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.583342:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b818b4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.583347:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826413.583350:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b818b4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.583356:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b818b4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.583363:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf39e67600) 00010000:00010000:2.0:1787826413.583365:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826413.583368:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b818b4 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.583374:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b818b4 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.583409:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b818a6 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c15 expref: 40 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.583426:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b818bb lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c15 expref: 39 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.583438:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826413.583440:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826413.583443:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835000, rc 0) 00000100:00100000:2.0:1787826413.583560:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+39:55479:x1874670563830656:12345-192.168.203.39@tcp:101:getfattr.0 Request processed in 783us (1012us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826413.583568:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3678 00000100:00100000:3.0:1787826413.614886:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826413.616841:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563830912 00000100:00100000:1.0:1787826413.616861:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563830912 00000100:00100000:1.0:1787826413.616952:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3679 00000100:00100000:1.0:1787826413.616964:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab17840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+39:55483:x1874670563830912:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826413.616993:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826413.617022:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b818c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0c1c expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.617237:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a000/0x22153cd396b818c9 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.617254:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a000/0x22153cd396b818c9 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1c:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.617266:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a000/0x22153cd396b818c9 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1c:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826413.617278:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1c:0x0]: returning size 4096 00010000:00010000:1.0:1787826413.617405:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b818c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c1c expref: 42 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.617428:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a000/0x22153cd396b818c9 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1c:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c1c expref: 41 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.617438:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c:0x0].0x0 (ffff90cf39656800) 00010000:00010000:1.0:1787826413.617441:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787826413.617444:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46a000, rc 0) 00000100:00100000:0.0:1787826413.618705:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab17840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+41:55483:x1874670563830912:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1730us (3822us total) trans 8589934824 rc 0/0 00000100:00100000:0.0:1787826413.618719:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3679 00000100:00100000:0.0:1787826413.623304:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826413.623397:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563831040 00000100:00100000:3.0:1787826413.623411:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563831040 00000100:00100000:3.0:1787826413.623694:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3680 00000100:00100000:3.0:1787826413.623709:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03975e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+41:55483:x1874670563831040:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:3.0:1787826413.623815:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b818d7 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.623836:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b818d7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.623852:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b818d7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.623868:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b818de lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.623875:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b818de lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.623883:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b818de lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.623982:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b818e5 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.623992:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b818e5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.623999:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b818e5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826413.624049:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:3.0:1787826413.624055:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826413.624070:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b818e5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.624086:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b818d7 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.624094:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b818d7 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.624105:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b818d7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.624112:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b818d7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.624119:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826413.624124:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b818d7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.624133:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b818d7 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.624148:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf39656000) 00010000:00010000:3.0:1787826413.624151:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826413.624157:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b818d7 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.624164:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b818d7 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.624190:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b818de lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.624208:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b818de lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.624218:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b818de lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.624223:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826413.624227:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b818de lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.624232:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b818de lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.624240:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf39656100) 00010000:00010000:3.0:1787826413.624242:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826413.624245:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b818de lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.624251:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b818de lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.624263:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b818e5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.624268:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b818e5 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.624274:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b818e5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.624279:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826413.624282:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b818e5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.624288:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b818e5 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.624294:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826413.624297:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826413.624301:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b818e5 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.624308:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b818e5 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826413.624596:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03975e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+41:55483:x1874670563831040:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 888us (1303us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826413.624606:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3680 00000100:00100000:2.0:1787826413.644727:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826413.644910:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563831296 00000100:00100000:0.0:1787826413.644924:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563831296 00000100:00100000:0.0:1787826413.645010:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3681 00000100:00100000:0.0:1787826413.645022:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf07964780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+41:55485:x1874670563831296:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826413.645050:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826413.645079:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b818ec lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0c23 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.645247:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b818f3 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.645271:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b818f3 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.645285:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b818f3 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826413.645303:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:0.0:1787826413.645455:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b818ec lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c23 expref: 44 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.645540:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b818f3 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c23 expref: 43 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.645551:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826413.645553:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787826413.645557:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165ec00, rc 0) 00000100:00100000:0.0:1787826413.645642:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf07964780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55485:x1874670563831296:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 624us (930us total) trans 8589934825 rc 0/0 00000100:00100000:0.0:1787826413.645650:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3681 00000100:00100000:0.0:1787826413.653807:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826413.653982:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563831552 00000100:00100000:3.0:1787826413.654005:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563831552 00000100:00100000:3.0:1787826413.654084:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3682 00000100:00100000:3.0:1787826413.654095:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03976580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55485:x1874670563831552:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826413.654128:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826413.654158:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b81901 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0c2a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.654331:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b81908 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.654349:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b818bb lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c15 expref: 44 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.654359:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b81908 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.654663:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b818bb lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c15 expref: 44 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.654681:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b818bb lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c15 expref: 44 pid: 6518 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826413.654702:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f8092c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1874670585234944:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826413.654944:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10aba840 going to sleep for 11 seconds 00000100:00100000:1.0:1787826413.662431:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826413.662699:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563831680 00000100:00100000:2.0:1787826413.662712:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563831680 00010000:00010000:2.0:1787826413.662776:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b818bb lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c15 expref: 45 pid: 6518 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826413.662861:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1093 00000100:00100000:2.0:1787826413.662872:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f06d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+45:2403:x1874670563831680:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826413.662892:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826413.662910:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b818bb lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c15 expref: 45 pid: 6518 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.662925:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b818bb lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c15 expref: 45 pid: 6518 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.662956:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826413.662962:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b81908 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.662974:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b81908 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.662984:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b81908 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.663010:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826413.663088:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f06d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+45:2403:x1874670563831680:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 216us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826413.663097:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1093 00010000:00010000:3.0:1787826413.664486:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b818bb lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c15 expref: 44 pid: 6518 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826413.664518:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f8092c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1874670585234944:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826413.664555:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b81908 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.664567:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b81908 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.664573:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b81908 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826413.664604:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:3.0:1787826413.664918:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b81901 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c2a expref: 45 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.664936:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b81908 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c2a expref: 44 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.664947:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826413.664950:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787826413.664954:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401600, rc 0) 00000100:00100000:3.0:1787826413.665042:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03976580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55485:x1874670563831552:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 10948us (11249us total) trans 8589934826 rc 0/0 00000100:00100000:3.0:1787826413.665052:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3682 00000100:00100000:1.0:1787826413.668665:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826413.668763:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563831808 00000100:00100000:3.0:1787826413.668777:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563831808 00000100:00100000:3.0:1787826413.668847:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1089 00000100:00100000:3.0:1787826413.668860:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce063052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55485:x1874670563831808:12345-192.168.203.39@tcp:33:lfs.0 00000100:00100000:3.0:1787826413.669079:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce063052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55485:x1874670563831808:12345-192.168.203.39@tcp:33:lfs.0 Request processed in 221us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826413.669087:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1089 00000100:00100000:3.0:1787826413.671263:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826413.671335:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563832064 00000100:00100000:2.0:1787826413.671347:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563832064 00000100:00100000:2.0:1787826413.671427:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1090 00000100:00100000:2.0:1787826413.671438:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55485:x1874670563832064:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:2.0:1787826413.672111:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+45:55485:x1874670563832064:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 669us (855us total) trans 8589934827 rc 0/0 00000100:00100000:2.0:1787826413.672122:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1090 00000100:00100000:3.0:1787826413.674565:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826413.675122:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563832320 00000100:00100000:1.0:1787826413.675136:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563832320 00000100:00100000:1.0:1787826413.675233:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3683 00000100:00100000:1.0:1787826413.675245:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f80b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+45:55485:x1874670563832320:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826413.675281:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826413.675285:0:8247:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:1.0:1787826413.675322:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b81908 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c2a expref: 45 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.675350:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b818f3 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c23 expref: 44 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.675361:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826413.675381:0:8247:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826413.675399:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b81916 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0c31 expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.675718:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b8191d lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.675737:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b8191d lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.675748:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b8191d lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826413.675775:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:1.0:1787826413.675910:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b81916 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c31 expref: 46 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.675933:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b8191d lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c31 expref: 45 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.675942:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826413.675945:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787826413.675948:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46a400, rc 0) 00000100:00100000:1.0:1787826413.676026:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f80b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+45:55485:x1874670563832320:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 783us (1474us total) trans 8589934828 rc 0/0 00000100:00100000:1.0:1787826413.676035:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3683 00000100:00100000:1.0:1787826413.682304:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826413.686623:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563832576 00000100:00100000:2.0:1787826413.686645:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563832576 00000100:00100000:2.0:1787826413.686736:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1091 00000100:00100000:2.0:1787826413.686748:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3957bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+45:55485:x1874670563832576:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:2.0:1787826413.686859:0:6522:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000405:0x1d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b8191d lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c31 expref: 45 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.688034:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8192b lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.688060:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b81898 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c0e expref: 45 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.688077:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8192b lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.688636:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b81898 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c0e expref: 45 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.688662:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b81898 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c0e expref: 45 pid: 32404 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826413.688684:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf079643c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585235072:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826413.688814:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce010f59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826413.698629:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826413.698745:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf079643c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585235072:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826413.698784:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8192b lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826413.698982:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563832704 00000100:00100000:3.0:1787826413.698991:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563832704 00010000:00010000:3.0:1787826413.699034:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b81898 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c0e expref: 46 pid: 32404 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826413.699076:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1094 00000100:00100000:3.0:1787826413.699095:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03977c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+46:2404:x1874670563832704:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826413.699113:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826413.699121:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b81898 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c0e expref: 46 pid: 32404 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.699134:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b81898 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c0e expref: 46 pid: 32404 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.699162:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b81898 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c0e expref: 46 pid: 32404 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.699187:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826413.699202:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8192b lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.699213:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8192b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.699223:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8192b lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.699253:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826413.699310:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03977c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+45:2404:x1874670563832704:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 226us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826413.699318:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1094 00010000:00010000:2.0:1787826413.700110:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8192b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.700123:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8192b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.700344:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8192b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.700352:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8192b lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.700359:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8192b lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.700376:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826413.700381:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8192b lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.700390:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8192b lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.700406:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826413.700409:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787826413.700568:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8192b lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.700575:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8192b lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.700591:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826413.700594:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787826413.700600:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b8191d lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c31 expref: 44 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826413.700808:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3957bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55485:x1874670563832576:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 14059us (18517us total) trans 8589934829 rc -22/-22 00000100:00100000:2.0:1787826413.700819:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1091 00000100:00100000:0.0:1787826413.705599:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826413.705694:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563832832 00000100:00100000:3.0:1787826413.705706:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563832832 00000100:00100000:3.0:1787826413.705811:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3684 00000100:00100000:3.0:1787826413.705825:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce039770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55485:x1874670563832832:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826413.705856:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826413.705883:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b81932 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0c38 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.705967:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b81932 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c38 expref: 45 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.705984:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b81932 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c38 expref: 45 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.706011:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826413.706015:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826413.706019:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400c00, rc 0) 00000100:00100000:3.0:1787826413.706100:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce039770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+45:55485:x1874670563832832:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 278us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826413.706109:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3684 00000100:00100000:0.0:1787826413.713616:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826413.718815:0:34487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563832960 00000100:00100000:2.0:1787826413.718837:0:34487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563832960 00000100:00100000:3.0:1787826413.719306:0:34487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 100 00000100:00100000:3.0:1787826413.719337:0:34487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1099c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:307626ff-a376-4faf-93e0-9f55b723d964+10:2402:x1874670563832960:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1787826413.720040:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826413.720060:0:34487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1099c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:307626ff-a376-4faf-93e0-9f55b723d964+10:2402:x1874670563832960:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 727us (6457us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826413.720072:0:34487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 100 00000100:00100000:1.0:1787826413.720279:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826413.720931:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563833344 00000100:00100000:2.0:1787826413.720941:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563833344 00000100:00100000:2.0:1787826413.720988:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563833088 00000100:00100000:2.0:1787826413.720992:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563833088 00000100:00100000:3.0:1787826413.721005:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3685 00000100:00100000:3.0:1787826413.721015:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06307c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+45:55485:x1874670563833344:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826413.721038:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826413.721068:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b81939 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0c3f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826413.721427:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1582 00000100:00100000:2.0:1787826413.721436:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce063052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:2402:x1874670563833088:12345-192.168.203.39@tcp:400:kworker.0 00000100:00080000:0.0:1787826413.721520:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787826413.721553:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce063052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:2402:x1874670563833088:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 117us (1272us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826413.721561:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1582 00010000:00010000:3.0:1787826413.723306:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b81940 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.723337:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b81940 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.723353:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b81940 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826413.723371:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x23:0x0]: returning size 0 00010000:00010000:3.0:1787826413.724705:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b81939 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c3f expref: 48 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.724752:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b81940 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c3f expref: 47 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.724764:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x23:0x0].0x0 (ffff90cf39656000) 00010000:00010000:3.0:1787826413.724767:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826413.724771:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400400, rc 0) 00000100:00100000:3.0:1787826413.725064:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06307c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+47:55485:x1874670563833344:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 4047us (5025us total) trans 8589934830 rc 0/0 00000100:00100000:3.0:1787826413.725075:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3685 00000100:00100000:1.0:1787826413.733266:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826413.739764:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563833600 00000100:00100000:2.0:1787826413.739784:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563833600 00000100:00100000:0.0:1787826413.740460:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3686 00000100:00100000:0.0:1787826413.740493:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+47:55485:x1874670563833600:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826413.740530:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826413.740558:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b8194e lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0c46 expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.740689:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81955 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.740706:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81955 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.740720:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81955 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826413.740735:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:0.0:1787826413.740863:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b8194e lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c46 expref: 50 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.740883:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81955 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c46 expref: 49 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.740904:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826413.740908:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787826413.740911:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165e200, rc 0) 00000100:00100000:0.0:1787826413.741005:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:55485:x1874670563833600:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 534us (7754us total) trans 8589934831 rc 0/0 00000100:00100000:0.0:1787826413.741013:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3686 00000100:00100000:2.0:1787826413.749375:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826413.749516:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563833856 00000100:00100000:1.0:1787826413.749530:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563833856 00000100:00100000:1.0:1787826413.749600:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1092 00000100:00100000:1.0:1787826413.749610:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf07966940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:55485:x1874670563833856:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:1.0:1787826413.749711:0:6521:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000405:0x1d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81955 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c46 expref: 49 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.749761:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b81963 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.749776:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b81932 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c38 expref: 49 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.749792:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b81963 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.749832:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b81932 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c38 expref: 49 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.749846:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b81932 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c38 expref: 49 pid: 6519 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826413.749863:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fdda40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1874670585235200:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826413.749957:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3f7d8780 going to sleep for 11 seconds 00000100:00100000:1.0:1787826413.753301:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826413.753394:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563833984 00000100:00100000:3.0:1787826413.753406:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563833984 00010000:00010000:3.0:1787826413.753458:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b81932 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c38 expref: 50 pid: 6519 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826413.753536:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1095 00000100:00100000:3.0:1787826413.753548:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf185de050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+50:2403:x1874670563833984:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826413.753569:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826413.753576:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b81932 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c38 expref: 50 pid: 6519 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.753592:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b81932 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c38 expref: 50 pid: 6519 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.753628:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826413.753635:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b81963 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.753647:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b81963 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.753657:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b81963 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.753681:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826413.753742:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf185de050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+50:2403:x1874670563833984:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 196us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826413.753749:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1095 00010000:00010000:2.0:1787826413.754005:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b81932 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c38 expref: 49 pid: 6519 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826413.754027:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fdda40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1874670585235200:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826413.754054:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b81963 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.754065:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b81963 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.754071:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b81963 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.754220:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b8196a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x23:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.754234:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b81940 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c3f expref: 48 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.754244:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b8196a lrc: 4/0,1 mode: --/EX res: [0x200000405:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.754286:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b81940 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c3f expref: 48 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.754302:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b81940 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c3f expref: 48 pid: 6520 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826413.754319:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf079643c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1874670585235328:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826413.754377:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce010f5e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787826413.762008:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826413.762094:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563834112 00000100:00100000:3.0:1787826413.762107:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563834112 00010000:00010000:3.0:1787826413.762175:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b81940 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c3f expref: 49 pid: 6520 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826413.762235:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1096 00000100:00100000:1.0:1787826413.762246:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf079643c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1874670585235328:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826413.762249:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf07967840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:2404:x1874670563834112:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826413.762277:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826413.762286:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b81940 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c3f expref: 49 pid: 6520 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.762294:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b8196a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x23:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.762304:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b81940 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c3f expref: 49 pid: 6520 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.764596:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b81940 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c3f expref: 49 pid: 6520 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.764631:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x23:0x0].0x0 (ffff90cf39656000) 00010000:00010000:3.0:1787826413.764638:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b8196a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.764649:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b8196a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.764660:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b8196a lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.764698:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826413.764797:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf07967840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:2404:x1874670563834112:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 2549us (2800us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826413.764810:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1096 00010000:00010000:1.0:1787826413.770161:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b8196a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x23:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.770183:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b8196a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x23:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826413.770642:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fdc000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6521:1874670585235456:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787826413.770734:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826413.770784:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3f7d8b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787826413.770873:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585235456 00000100:00100000:2.0:1787826413.770893:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585235456 00000100:00100000:2.0:1787826413.770946:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1432 00000100:00100000:2.0:1787826413.770956:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6521:x1874670585235456:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787826413.771070:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6521:x1874670585235456:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 115us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826413.771080:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1432 00000100:00100000:1.0:1787826413.771177:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fdc000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6521:1874670585235456:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787826413.771248:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934832 00000001:00080000:1.0:1787826413.771301:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934833 00010000:00010000:1.0:1787826413.771320:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b8196a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x23:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.771330:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b8196a lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x23:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.771339:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b8196a lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x23:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.771347:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826413.771353:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b8196a lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x23:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.771364:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b8196a lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x23:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.771396:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x23:0x0].0x0 (ffff90cf39656000) 00010000:00010000:1.0:1787826413.771400:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787826413.771406:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b8196a lrc: 2/0,0 mode: --/EX res: [0x200000405:0x23:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.771413:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b8196a lrc: 0/0,0 mode: --/EX res: [0x200000405:0x23:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.771439:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b81963 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.771446:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b81963 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.771452:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b81963 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.771458:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46aa00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826413.771462:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b81963 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.771468:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b81963 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.771623:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826413.771626:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787826413.771630:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b81963 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.771638:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b81963 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.771653:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826413.771656:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787826413.771664:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81955 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c46 expref: 50 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826413.771782:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf07966940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:55485:x1874670563833856:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 22172us (22420us total) trans 8589934834 rc 0/0 00000100:00100000:1.0:1787826413.771792:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1092 00000020:00080000:1.0:1787826413.771796:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1787826413.776392:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826413.776944:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563834240 00000100:00100000:3.0:1787826413.776959:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563834240 00000100:00100000:3.0:1787826413.777031:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3687 00000100:00100000:3.0:1787826413.777043:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf079643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:55485:x1874670563834240:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826413.777074:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826413.777100:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b81971 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0c4d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.777172:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b81971 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c4d expref: 50 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.777204:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b81971 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c4d expref: 50 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.777226:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826413.777230:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826413.777234:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400600, rc 0) 00000100:00100000:3.0:1787826413.777319:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf079643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+50:55485:x1874670563834240:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 277us (957us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826413.777327:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3687 00000100:00100000:3.0:1787826413.783115:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826413.783883:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563834496 00000100:00100000:2.0:1787826413.783896:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563834496 00000100:00100000:2.0:1787826413.784015:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1093 00000100:00100000:2.0:1787826413.784028:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f80b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+50:55485:x1874670563834496:12345-192.168.203.39@tcp:35:lfs.0 00000004:00080000:2.0:1787826413.784432:0:6522:0:(mdd_object.c:4014:mdd_close()) Object [0x200000405:0x23:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787826413.784687:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].25, 64 off10272 00000004:00080000:2.0:1787826413.784702:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1359796229645ns, next at 1360796226307ns, rc = 0 00000001:00080000:2.0:1787826413.784710:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934835 00010000:00010000:2.0:1787826413.784873:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b81978 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.784893:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b81978 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.784907:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b81978 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.784917:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b81978 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.784924:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b81978 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.784931:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b81978 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.784957:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787826413.785039:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826413.785049:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b81978 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.785058:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834400 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:1.0:1787826413.785063:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b81978 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.785073:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b81978 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826413.785082:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f80b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+52:55485:x1874670563834496:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 1054us (1979us total) trans 8589934836 rc 0/0 00000100:00100000:2.0:1787826413.785094:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1093 00000020:00080000:2.0:1787826413.785100:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787826413.785104:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x23:0x0].0x0 (ffff90cf39e67800) 00010000:00010000:1.0:1787826413.785110:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787826413.785116:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b81978 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.785123:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b81978 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.785145:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826413.785148:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826413.785150:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826413.787997:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826413.788067:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563834752 00000100:00100000:2.0:1787826413.788080:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563834752 00000100:00100000:2.0:1787826413.788149:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1094 00000100:00100000:2.0:1787826413.788161:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+52:55485:x1874670563834752:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:2.0:1787826413.788706:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55485:x1874670563834752:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 545us (730us total) trans 8589934837 rc 0/0 00000100:00100000:2.0:1787826413.788717:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1094 00000100:00100000:0.0:1787826413.805299:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826413.805389:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563834880 00000100:00100000:2.0:1787826413.805402:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563834880 00000100:00100000:2.0:1787826413.805504:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3688 00000100:00100000:2.0:1787826413.805516:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03977c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55487:x1874670563834880:12345-192.168.203.39@tcp:101:getfattr.0 00010000:00010000:2.0:1787826413.805552:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826413.805582:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8197f lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0c54 expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.805675:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81986 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.805691:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81986 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.805704:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81986 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.805720:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8198d lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.805728:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8198d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.805735:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8198d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.805845:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81994 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.805855:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81994 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.805862:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81994 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826413.805913:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:2.0:1787826413.805918:0:9966:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826413.805941:0:9966:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81994 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.805955:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81994 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.805966:0:9966:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81986 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.805973:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81986 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.805980:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81986 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.805987:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81986 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.805993:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826413.805998:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81986 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.806006:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81986 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.806019:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf39e67600) 00010000:00010000:2.0:1787826413.806022:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826413.806028:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81986 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.806039:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81986 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.806054:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8198d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.806060:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8198d lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.806067:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8198d lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.806072:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826413.806074:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8198d lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.806080:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8198d lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.806087:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf39e67100) 00010000:00010000:2.0:1787826413.806089:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826413.806092:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8198d lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.806098:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8198d lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.806131:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8197f lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c54 expref: 55 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.806149:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81994 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c54 expref: 54 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.806157:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826413.806160:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826413.806163:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834600, rc 0) 00000100:00100000:2.0:1787826413.806255:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03977c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+54:55487:x1874670563834880:12345-192.168.203.39@tcp:101:getfattr.0 Request processed in 741us (971us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826413.806264:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3688 00000100:00100000:1.0:1787826413.811684:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826413.811831:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563835008 00000100:00100000:0.0:1787826413.811843:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563835008 00000100:00100000:0.0:1787826413.811915:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2034 00000100:00100000:0.0:1787826413.811927:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2401:x1874670563835008:12345-192.168.203.39@tcp:101:getfattr.0 00010000:00010000:0.0:1787826413.811952:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826413.811975:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b49a3b43/0x22153cd396b8199b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0c5b expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826413.812059:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf136ce1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1874670585235584:192.168.203.39@tcp:106: 00000100:00100000:0.0:1787826413.812170:0:8435:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3540 going to sleep for 11 seconds 00000100:00100000:0.0:1787826413.816683:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf136ce1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1874670585235584:192.168.203.39@tcp:106: 00010000:00010000:0.0:1787826413.816745:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b49a3b43/0x22153cd396b8199b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c5b expref: 11 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.816873:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b49a3b43/0x22153cd396b8199b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c5b expref: 11 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.816892:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165fa00, rc 0) 00000100:00100000:0.0:1787826413.816982:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2401:x1874670563835008:12345-192.168.203.39@tcp:101:getfattr.0 Request processed in 5057us (5313us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826413.816993:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2034 00000100:00100000:2.0:1787826413.847040:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826413.847217:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563835136 00000100:00100000:3.0:1787826413.847230:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563835136 00000100:00100000:3.0:1787826413.847310:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3689 00000100:00100000:3.0:1787826413.847323:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+54:55491:x1874670563835136:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:3.0:1787826413.847438:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b819a2 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.847459:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b819a2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.847527:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b819a2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.847543:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b819a9 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.847550:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b819a9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.847558:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b819a9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.847654:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b819b0 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.847924:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b819b0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.847936:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b819b0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826413.847992:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:3.0:1787826413.847997:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826413.848014:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b819b0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.848031:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b819a2 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.848038:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b819a2 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.848045:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b819a2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.848053:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b819a2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.848059:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826413.848063:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b819a2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.848073:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b819a2 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.848088:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf39656100) 00010000:00010000:3.0:1787826413.848091:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826413.848095:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b819a2 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.848103:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b819a2 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.848132:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b819a9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.848137:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b819a9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.848143:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b819a9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.848147:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826413.848150:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b819a9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.848155:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b819a9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.848161:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf39656700) 00010000:00010000:3.0:1787826413.848164:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826413.848166:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b819a9 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.848176:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b819a9 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.848188:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b819b0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.848203:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b819b0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.848209:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b819b0 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.848214:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826413.848218:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b819b0 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.848224:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b819b0 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.848231:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826413.848233:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826413.848236:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b819b0 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.848242:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b819b0 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826413.848345:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+54:55491:x1874670563835136:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 1021us (1318us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826413.848354:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3689 00000100:00100000:1.0:1787826413.879571:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826413.879720:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563835392 00000100:00100000:0.0:1787826413.879733:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563835392 00000100:00100000:0.0:1787826413.879805:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3690 00000100:00100000:0.0:1787826413.879816:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+54:55493:x1874670563835392:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826413.879845:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826413.879873:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b819b7 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0c62 expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.880022:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b819be lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.880041:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b819be lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.880055:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b819be lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826413.880069:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:0.0:1787826413.880216:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b819b7 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c62 expref: 57 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.880240:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b819be lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c62 expref: 56 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.880251:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826413.880254:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787826413.880258:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165ea00, rc 0) 00000100:00100000:0.0:1787826413.880340:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+56:55493:x1874670563835392:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 525us (790us total) trans 8589934838 rc 0/0 00000100:00100000:0.0:1787826413.880348:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3690 00000100:00100000:1.0:1787826413.885127:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826413.885264:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563835520 00000100:00100000:0.0:1787826413.885276:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563835520 00000100:00100000:0.0:1787826413.885355:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2035 00000100:00100000:0.0:1787826413.885385:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670563835520:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826413.885409:0:30695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826413.885434:0:30695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091cba634/0x22153cd396b819cc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0c69 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826413.885552:0:30695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf136ce1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:30695:1874670585235712:192.168.203.39@tcp:106: 00000100:00100000:0.0:1787826413.885945:0:30695:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3780 going to sleep for 11 seconds 00010000:00010000:2.0:1787826413.891788:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826413.897722:0:30695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf136ce1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:30695:1874670585235712:192.168.203.39@tcp:106: 00010000:00010000:0.0:1787826413.897790:0:30695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000091cba634/0x22153cd396b819cc lrc: 1/0,0 mode: --/PR res: [0x280000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c69 expref: 11 pid: 30695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.897892:0:30695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091cba634/0x22153cd396b819cc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c69 expref: 11 pid: 30695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.897919:0:30695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165f400, rc 0) 00000100:00100000:0.0:1787826413.898154:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670563835520:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 12788us (13041us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826413.898163:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2035 00000100:00100000:2.0:1787826413.903305:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826413.903419:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563835776 00000100:00100000:0.0:1787826413.903432:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563835776 00000100:00100000:0.0:1787826413.903551:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3691 00000100:00100000:0.0:1787826413.903564:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+56:55493:x1874670563835776:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826413.903598:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826413.903626:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b819d3 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0c70 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.903793:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b819da lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.903817:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81994 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c54 expref: 57 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.903826:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b819da lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.903867:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81994 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c54 expref: 57 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.903883:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81994 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c54 expref: 57 pid: 9966 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826413.903900:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf136ce1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1874670585235840:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826413.904002:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3780 going to sleep for 11 seconds 00000100:00100000:2.0:1787826413.913727:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf136ce1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1874670585235840:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826413.913772:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b819da lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826413.916183:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826413.916340:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563835904 00000100:00100000:0.0:1787826413.916354:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563835904 00010000:00010000:0.0:1787826413.916407:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81994 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c54 expref: 58 pid: 9966 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826413.916542:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1097 00000100:00100000:0.0:1787826413.916554:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa852c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:2404:x1874670563835904:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826413.916574:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826413.916582:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81994 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c54 expref: 58 pid: 9966 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.916596:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81994 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c54 expref: 58 pid: 9966 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.916624:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81994 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c54 expref: 58 pid: 9966 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.916645:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826413.916651:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b819da lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.916672:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b819da lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.916681:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b819da lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.916715:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826413.916791:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa852c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+57:2404:x1874670563835904:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 239us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826413.916801:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1097 00010000:00010000:2.0:1787826413.919203:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b819da lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.919227:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b819da lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826413.919263:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:2.0:1787826413.919467:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b819d3 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c70 expref: 58 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.921502:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b819da lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c70 expref: 57 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826413.921532:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826413.921537:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787826413.921542:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165e000, rc 0) 00000100:00100000:2.0:1787826413.921643:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+57:55493:x1874670563835776:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 18080us (18351us total) trans 8589934839 rc 0/0 00000100:00100000:2.0:1787826413.921653:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3691 00000100:00100000:2.0:1787826413.927279:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826413.927545:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563836160 00000100:00100000:0.0:1787826413.927559:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563836160 00000100:00100000:0.0:1787826413.927629:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3692 00000100:00100000:0.0:1787826413.927642:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+57:55493:x1874670563836160:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826413.927690:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826413.928158:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b819e8 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0c77 expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.929749:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b819ef lrc: 3/1,0 mode: --/PR res: [0x200000405:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.929778:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b819ef lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.929792:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b819ef lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826413.929806:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x24:0x0]: returning size 0 00010000:00010000:0.0:1787826413.929874:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b819e8 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c77 expref: 60 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.929909:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b819ef lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c77 expref: 59 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.929919:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x24:0x0].0x0 (ffff90cf0c7dac00) 00010000:00010000:0.0:1787826413.929922:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826413.929926:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165e400, rc 0) 00000100:00100000:0.0:1787826413.930017:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55493:x1874670563836160:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 2378us (2755us total) trans 8589934840 rc 0/0 00000100:00100000:0.0:1787826413.930606:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3692 00000100:00100000:1.0:1787826413.936736:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826413.937152:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563836416 00000100:00100000:0.0:1787826413.937165:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563836416 00000100:00100000:0.0:1787826413.937258:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3693 00000100:00100000:0.0:1787826413.937270:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55493:x1874670563836416:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826413.937302:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826413.937328:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b819fd lrc: 2/0,0 mode: --/CR res: [0x200000405:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0c7e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.937503:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b81a04 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.937521:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b819ef lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c77 expref: 60 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.937535:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b81a04 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.937580:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b819ef lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c77 expref: 60 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.937594:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b819ef lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c77 expref: 60 pid: 9966 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826413.937610:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf136ce1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1874670585235968:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826413.938827:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3780 going to sleep for 11 seconds 00000100:00100000:0.0:1787826413.946289:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf136ce1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1874670585235968:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826413.946336:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b81a04 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826413.946919:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826413.949921:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563836544 00000100:00100000:3.0:1787826413.949943:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563836544 00010000:00010000:3.0:1787826413.950015:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b819ef lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c77 expref: 61 pid: 9966 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826413.950075:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1098 00000100:00100000:3.0:1787826413.950086:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fde580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+61:2403:x1874670563836544:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826413.950169:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826413.950179:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b819ef lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c77 expref: 61 pid: 9966 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.950206:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b819ef lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c77 expref: 61 pid: 9966 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.950235:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b819ef lrc: 0/0,0 mode: --/PR res: [0x200000405:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c77 expref: 61 pid: 9966 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.950258:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x24:0x0].0x0 (ffff90cf0c7dac00) 00010000:00010000:3.0:1787826413.950265:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b81a04 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.950276:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b81a04 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.950284:0:10340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b81a04 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.950328:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826413.950589:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b81a04 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.950601:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b81a04 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826413.950630:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x24:0x0]: returning size 0 00000004:00080000:1.0:1787826413.952436:0:6520:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x107:0x0], index 1: 0 00010000:00010000:1.0:1787826413.952943:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b81a04 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.952958:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b81a04 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.952966:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b81a04 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.952975:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165f600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826413.952981:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b81a04 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.953001:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b81a04 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.953022:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x24:0x0].0x0 (ffff90cf0c7dac00) 00010000:00010000:1.0:1787826413.953033:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826413.953039:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b81a04 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.953046:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b81a04 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.953117:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b819fd lrc: 1/0,0 mode: --/CR res: [0x200000405:0x24:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c7e expref: 61 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.953130:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x24:0x0].0x0 (ffff90cf0c7dac00) 00010000:00010000:1.0:1787826413.953132:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787826413.953137:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b819fd lrc: 0/0,0 mode: --/CR res: [0x200000405:0x24:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c7e expref: 61 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.953156:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165f400, rc 0) 00000100:00100000:3.0:1787826413.953301:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fde580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:2403:x1874670563836544:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3212us (6381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826413.953317:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1098 00000100:00100000:1.0:1787826413.955819:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55493:x1874670563836416:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 18530us (21421us total) trans 8589934841 rc 301/301 00000100:00100000:1.0:1787826413.955838:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3693 00000100:00100000:1.0:1787826413.962027:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826413.962183:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563836800 00000100:00100000:3.0:1787826413.962204:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563836800 00000100:00100000:1.0:1787826413.962361:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1095 00000100:00100000:1.0:1787826413.962385:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fde1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55493:x1874670563836800:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:1.0:1787826413.962779:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fde1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:55493:x1874670563836800:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 397us (767us total) trans 8589934842 rc 0/0 00000100:00100000:1.0:1787826413.962788:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1095 00000100:00100000:2.0:1787826413.970640:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826413.970943:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563836928 00000100:00100000:0.0:1787826413.970957:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563836928 00000100:00100000:0.0:1787826413.971054:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3694 00000100:00100000:0.0:1787826413.971066:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa87840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:55493:x1874670563836928:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826413.971102:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826413.971130:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81a12 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0c85 expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.971270:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b81a19 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.971287:0:32404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b819da lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c70 expref: 61 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.971298:0:32404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b81a19 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.971343:0:32404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b819da lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c70 expref: 61 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826413.971359:0:32404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b819da lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c70 expref: 61 pid: 6518 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826413.972109:0:32404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf136ce1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:32404:1874670585236096:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826413.972241:0:32404:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3780 going to sleep for 11 seconds 00000100:00100000:0.0:1787826413.977121:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826413.977401:0:32404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf136ce1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:32404:1874670585236096:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826413.977449:0:32404:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b81a19 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826413.977811:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563837056 00000100:00100000:3.0:1787826413.977820:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563837056 00010000:00010000:3.0:1787826413.977874:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b819da lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c70 expref: 62 pid: 6518 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826413.978039:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1099 00000100:00100000:3.0:1787826413.978052:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049bad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+62:2404:x1874670563837056:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826413.978073:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826413.978082:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b819da lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c70 expref: 62 pid: 6518 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.978097:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b819da lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c70 expref: 62 pid: 6518 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.978125:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b819da lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c70 expref: 62 pid: 6518 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.978146:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826413.978151:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b81a19 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.978161:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b81a19 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.978171:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b81a19 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826413.978216:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826413.978290:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049bad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+61:2404:x1874670563837056:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 240us (1184us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826413.978299:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1099 00010000:00010000:1.0:1787826413.979182:0:32404:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b81a19 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.979204:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b81a19 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826413.979281:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:1.0:1787826413.979287:0:32404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826413.979316:0:32404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b81a19 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.980304:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81a12 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c85 expref: 61 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.980332:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b81a19 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c85 expref: 60 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.980344:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826413.980348:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826413.980353:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165fc00, rc 0) 00000100:00100000:1.0:1787826413.980464:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa87840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:55493:x1874670563836928:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 9399us (9839us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826413.980505:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3694 00000100:00100000:0.0:1787826413.993118:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826413.993929:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563837184 00000100:00100000:1.0:1787826413.993946:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563837184 00000100:00100000:1.0:1787826413.994089:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2036 00000100:00100000:1.0:1787826413.994113:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049b92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563837184:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826413.994140:0:28853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826413.994174:0:28853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000816b8b1f/0x22153cd396b81a20 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0c8c expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826413.994266:0:28853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fdc3c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28853:1874670585236224:192.168.203.39@tcp:106: 00000100:00100000:1.0:1787826413.994392:0:28853:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf1850cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826413.998616:0:28853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fdc3c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28853:1874670585236224:192.168.203.39@tcp:106: 00010000:00010000:1.0:1787826413.998674:0:28853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000816b8b1f/0x22153cd396b81a20 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c8c expref: 11 pid: 28853 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.998705:0:28853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000816b8b1f/0x22153cd396b81a20 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c8c expref: 11 pid: 28853 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826413.998720:0:28853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46ae00, rc 0) 00000100:00100000:1.0:1787826413.998955:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049b92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563837184:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 4854us (5860us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826413.998966:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2036 00000100:00100000:2.0:1787826414.002126:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826414.002240:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563837312 00000100:00100000:0.0:1787826414.002253:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563837312 00000100:00100000:0.0:1787826414.002396:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3695 00000100:00100000:0.0:1787826414.002408:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa85e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:55493:x1874670563837312:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826414.002434:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826414.002463:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b81a27 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0c93 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.002595:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b81a2e lrc: 3/1,0 mode: --/PR res: [0x200000405:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.002613:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b81a2e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x24:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.002629:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b81a2e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x24:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826414.002688:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x24:0x0]: returning size 0 00000004:00200000:0.0:1787826414.002693:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826414.002714:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b81a2e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x24:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.002744:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b81a27 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x24:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c93 expref: 62 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.002778:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b81a2e lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x24:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c93 expref: 61 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.002788:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x24:0x0].0x0 (ffff90cf0c7da900) 00010000:00010000:0.0:1787826414.002791:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787826414.002795:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165e000, rc 0) 00000100:00100000:0.0:1787826414.002871:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa85e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+61:55493:x1874670563837312:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 465us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826414.003269:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3695 00000100:00100000:1.0:1787826414.006851:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826414.008994:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563837440 00000100:00100000:3.0:1787826414.009013:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563837440 00000100:00100000:2.0:1787826414.009182:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2037 00000100:00100000:2.0:1787826414.009204:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563837440:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826414.009229:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826414.009257:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b81a35 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x107:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0c9a expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787826414.009291:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x107:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826414.009317:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x107:0x0].0x0 since=1360s v=(0 0) 00010000:00010000:2.0:1787826414.009322:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x107:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826414.009333:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b81a35 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x107:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c9a expref: 13 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.009356:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b81a35 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x107:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c9a expref: 13 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.009739:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834a00, rc 0) 00000100:00100000:2.0:1787826414.009839:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2403:x1874670563837440:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 646us (3079us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826414.009848:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2037 00000100:00100000:2.0:1787826414.013372:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826414.013464:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563837696 00000100:00100000:0.0:1787826414.013504:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563837696 00000100:00100000:0.0:1787826414.013578:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3696 00000100:00100000:0.0:1787826414.013590:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+61:55493:x1874670563837696:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826414.013619:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826414.013648:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81a3c lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0ca1 expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.013794:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b81a43 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.013822:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b81a43 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.013837:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b81a43 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826414.013853:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:0.0:1787826414.013989:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81a3c lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ca1 expref: 64 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.014011:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b81a43 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ca1 expref: 63 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.014021:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826414.014024:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787826414.014028:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165ee00, rc 0) 00000100:00100000:0.0:1787826414.014103:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+63:55493:x1874670563837696:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 514us (749us total) trans 8589934843 rc 0/0 00000100:00100000:0.0:1787826414.014111:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3696 00000100:00100000:3.0:1787826414.021557:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826414.021695:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563837824 00000100:00100000:1.0:1787826414.021707:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563837824 00000100:00100000:1.0:1787826414.021782:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2038 00000100:00100000:1.0:1787826414.021794:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f808f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670563837824:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826414.021817:0:30696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826414.021839:0:30696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8fb1ffc/0x22153cd396b81a51 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0ca8 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826414.022028:0:30696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fdcf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:30696:1874670585236352:192.168.203.39@tcp:106: 00000100:00100000:1.0:1787826414.022432:0:30696:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf1850cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826414.027606:0:30696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fdcf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:30696:1874670585236352:192.168.203.39@tcp:106: 00010000:00010000:0.0:1787826414.027660:0:30696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a8fb1ffc/0x22153cd396b81a51 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ca8 expref: 11 pid: 30696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.027693:0:30696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8fb1ffc/0x22153cd396b81a51 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ca8 expref: 11 pid: 30696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.027709:0:30696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46ac00, rc 0) 00000100:00100000:0.0:1787826414.027791:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f808f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670563837824:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 5995us (6244us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826414.027801:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2038 00000100:00100000:2.0:1787826414.034658:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826414.034763:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563837952 00000100:00100000:3.0:1787826414.034778:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563837952 00000100:00100000:3.0:1787826414.034857:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2039 00000100:00100000:3.0:1787826414.034870:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670563837952:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826414.034894:0:8545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826414.034916:0:8545:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b81a58 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0caf expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826414.035005:0:8545:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f808b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8545:1874670585236480:192.168.203.39@tcp:106: 00000100:00100000:2.0:1787826414.035187:0:8545:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10aba180 going to sleep for 11 seconds 00000100:00100000:1.0:1787826414.041865:0:8545:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f808b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8545:1874670585236480:192.168.203.39@tcp:106: 00010000:00010000:1.0:1787826414.041926:0:8545:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b81a58 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0caf expref: 11 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.041958:0:8545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b81a58 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0caf expref: 11 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.041978:0:8545:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400c00, rc 0) 00000100:00100000:1.0:1787826414.042050:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670563837952:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 7182us (7408us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826414.042061:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2039 00000100:00100000:1.0:1787826414.053317:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826414.053455:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563838080 00000100:00100000:2.0:1787826414.053514:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563838080 00000100:00100000:2.0:1787826414.053584:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2040 00000100:00100000:2.0:1787826414.053596:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563838080:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:2.0:1787826414.053656:0:30398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b81a5f lrc: 3/1,0 mode: --/PR res: [0x280000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.053680:0:30398:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000159f1fa4/0x22153cd396b81875 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c00 expref: 10 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.053691:0:30398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x106:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787826414.053696:0:30398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x106:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826414.053701:0:30398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b81a5f lrc: 4/1,0 mode: --/PR res: [0x280000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.053748:0:30398:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000159f1fa4/0x22153cd396b81875 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c00 expref: 10 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.053771:0:30398:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000159f1fa4/0x22153cd396b81875 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c00 expref: 10 pid: 30398 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826414.053789:0:30398:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aa84000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:30398:1874670585236608:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826414.053906:0:30398:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce010f5e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826414.056835:0:30398:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aa84000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:30398:1874670585236608:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826414.056878:0:30398:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b81a5f lrc: 3/1,0 mode: --/PR res: [0x280000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826414.058061:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826414.062681:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563838208 00000100:00100000:0.0:1787826414.062702:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563838208 00010000:00010000:0.0:1787826414.062787:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000159f1fa4/0x22153cd396b81875 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c00 expref: 11 pid: 30398 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826414.062845:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1100 00000100:00100000:0.0:1787826414.062856:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2404:x1874670563838208:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826414.062875:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826414.062903:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000159f1fa4/0x22153cd396b81875 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x106:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c00 expref: 11 pid: 30398 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.062925:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000159f1fa4/0x22153cd396b81875 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x106:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c00 expref: 11 pid: 30398 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.062956:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000159f1fa4/0x22153cd396b81875 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x106:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c00 expref: 11 pid: 30398 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.062978:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x106:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826414.062982:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x106:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826414.062989:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b81a5f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.063001:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b81a5f lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.063029:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826414.063128:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563838208:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 273us (5075us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826414.063137:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1100 00010000:00010000:1.0:1787826414.064135:0:30398:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b81a5f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x106:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.064158:0:30398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b81a5f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x106:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.064206:0:30398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b81a5f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x106:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.064215:0:30398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b81a5f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x106:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.064224:0:30398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b81a5f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x106:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.064232:0:30398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835c00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:1.0:1787826414.064238:0:30398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b81a5f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x106:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.064249:0:30398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b81a5f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x106:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.064273:0:30398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b81a5f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x106:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.064288:0:30398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b81a5f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x106:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826414.064708:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563838080:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 11108us (11405us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826414.064720:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2040 00000100:00100000:1.0:1787826414.068232:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826414.068329:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563838336 00000100:00100000:3.0:1787826414.068342:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563838336 00000100:00100000:3.0:1787826414.068688:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2041 00000100:00100000:3.0:1787826414.068703:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670563838336:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826414.068728:0:14864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826414.068752:0:14864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021c90a82/0x22153cd396b81a66 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x106:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0cb6 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826414.069006:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x106:0x0] initial LVB size: 0, mtime: 0x6a9010ec, atime: 0x6a9010ec, ctime: 0x6a9010ee, blocks: 0x0 00010000:00010000:3.0:1787826414.069032:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x106:0x0].0x0 since=1360s v=(0 0) 00010000:00010000:3.0:1787826414.069039:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x106:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826414.069051:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021c90a82/0x22153cd396b81a66 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x106:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cb6 expref: 10 pid: 14864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.069073:0:14864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000021c90a82/0x22153cd396b81a66 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x106:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cb6 expref: 10 pid: 14864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.069089:0:14864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400400, rc 0) 00000100:00100000:3.0:1787826414.069736:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670563838336:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1032us (1514us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826414.069748:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2041 00000100:00100000:3.0:1787826414.119788:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826414.119918:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563838464 00000100:00100000:1.0:1787826414.119932:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563838464 00000100:00100000:1.0:1787826414.120020:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3697 00000100:00100000:1.0:1787826414.120033:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f80b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+63:55493:x1874670563838464:12345-192.168.203.39@tcp:44:lfs.0 00000001:00080000:2.0:1787826414.122175:0:34481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934843 is committed 00000004:00080000:2.0:1787826414.122222:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 25 committed 00010000:00010000:1.0:1787826414.122321:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b81867 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.122335:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b81867 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.122344:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b81867 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.122352:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165e600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826414.122358:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b81867 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.122382:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b81867 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.122404:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x22:0x0].0x0 (ffff90ce01f45600) 00010000:00010000:1.0:1787826414.122409:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826414.122414:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b81867 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.122421:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b81867 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.122454:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8187c lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.122461:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8187c lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.122467:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8187c lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.122517:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165fe00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826414.122520:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8187c lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.122526:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8187c lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.122535:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826414.122537:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826414.122541:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8187c lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.122547:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8187c lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826414.122993:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f80ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585236736:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787826414.123093:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826414.123233:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585236736 00000100:00100000:1.0:1787826414.123244:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585236736 00000100:00100000:1.0:1787826414.123311:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2042 00000100:00100000:1.0:1787826414.123322:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049bbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3646:x1874670585236736:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787826414.123357:0:8437:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:262 count 1 00010000:00010000:1.0:1787826414.123403:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065f23c08/0x22153cd396b81a6d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.123427:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000421aa0a2/0x22153cd396b81883 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c07 expref: 12 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.123437:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x106:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787826414.123443:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x106:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826414.123448:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065f23c08/0x22153cd396b81a6d lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.123509:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000421aa0a2/0x22153cd396b81883 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c07 expref: 12 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.123525:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000421aa0a2/0x22153cd396b81883 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c07 expref: 12 pid: 8437 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826414.123537:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fdda40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1874670585236864:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826414.123621:0:8437:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf1850c900 going to sleep for 11 seconds 00000100:00100000:1.0:1787826414.126710:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826414.127225:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fdda40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1874670585236864:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826414.127267:0:8437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000065f23c08/0x22153cd396b81a6d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787826414.127433:0:34481:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90ce010f5840 refcount 2 committed 0 result 0 batchid 4294969331 00000020:00080000:2.0:1787826414.127440:0:34481:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cf1f111700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90ce010f5480 00000020:00080000:2.0:1787826414.127444:0:34481:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cf1f111100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90cf09da5c00 00000020:00080000:2.0:1787826414.127490:0:34481:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969330 batchid updated 00000100:00100000:2.0:1787826414.127526:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563838592 00000100:00100000:2.0:1787826414.127534:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563838592 00010000:00010000:2.0:1787826414.127582:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000421aa0a2/0x22153cd396b81883 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c07 expref: 13 pid: 8437 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826414.127632:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1101 00000100:00100000:2.0:1787826414.127643:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2404:x1874670563838592:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826414.127662:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826414.127669:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000421aa0a2/0x22153cd396b81883 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x106:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c07 expref: 13 pid: 8437 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.127683:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000421aa0a2/0x22153cd396b81883 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x106:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c07 expref: 13 pid: 8437 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.127712:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000421aa0a2/0x22153cd396b81883 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x106:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c07 expref: 13 pid: 8437 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.127731:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x106:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826414.127736:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x106:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826414.127742:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000065f23c08/0x22153cd396b81a6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.127753:0:10340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065f23c08/0x22153cd396b81a6d lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787826414.127899:0:34512:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969331 committed batchid 4294969330 00000020:00080000:1.0:1787826414.127992:0:34512:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969330 00000100:00100000:1.0:1787826414.128140:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f80b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:55493:x1874670563838464:12345-192.168.203.39@tcp:44:lfs.0 Request processed in 8109us (8368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826414.128150:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3697 00010000:00010000:2.0:1787826414.128290:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826414.128313:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563838592:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 672us (1618us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826414.128320:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1101 00000100:00100000:3.0:1787826414.130716:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00010000:00010000:1.0:1787826414.130935:0:8437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000065f23c08/0x22153cd396b81a6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x106:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.130954:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065f23c08/0x22153cd396b81a6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x106:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.130969:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065f23c08/0x22153cd396b81a6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x106:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.130977:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065f23c08/0x22153cd396b81a6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x106:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.131004:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787826414.131285:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563838720 00000100:00100000:2.0:1787826414.131296:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563838720 00000100:00100000:2.0:1787826414.131356:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2043 00000100:00100000:2.0:1787826414.131368:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f809e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2402:x1874670563838720:12345-192.168.203.39@tcp:16:lfs.0 00000100:00100000:2.0:1787826414.131490:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f809e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2402:x1874670563838720:12345-192.168.203.39@tcp:16:lfs.0 Request processed in 123us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826414.131499:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2043 00000100:00100000:1.0:1787826414.131993:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049bbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3646:x1874670585236736:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8670us (8897us total) trans 17179869656 rc 0/0 00000100:00100000:1.0:1787826414.132002:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2042 00010000:00010000:1.0:1787826414.132027:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826414.132035:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065f23c08/0x22153cd396b81a6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x106:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.132045:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46a800 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:1.0:1787826414.132050:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065f23c08/0x22153cd396b81a6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x106:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.132060:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065f23c08/0x22153cd396b81a6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x106:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.132084:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065f23c08/0x22153cd396b81a6d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x106:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.132092:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065f23c08/0x22153cd396b81a6d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x106:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.132114:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826414.132116:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826414.132117:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787826414.133212:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3f80ad00/2, rc 0, transno 17179869656 00000100:00100000:0.0:1787826414.133229:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f80ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585236736:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787826414.142383:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826414.142576:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563838848 00000100:00100000:0.0:1787826414.142589:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563838848 00000100:00100000:0.0:1787826414.142664:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2044 00000100:00100000:0.0:1787826414.142677:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f80a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563838848:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:0.0:1787826414.142737:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000952ff42d/0x22153cd396b81a74 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.142760:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x106:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826414.142766:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x106:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826414.142773:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000952ff42d/0x22153cd396b81a74 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.142789:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000952ff42d/0x22153cd396b81a74 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.142823:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000952ff42d/0x22153cd396b81a74 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.142831:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000952ff42d/0x22153cd396b81a74 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.142840:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000952ff42d/0x22153cd396b81a74 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.142847:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165e200 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826414.142852:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000952ff42d/0x22153cd396b81a74 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.142861:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000952ff42d/0x22153cd396b81a74 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.142879:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000952ff42d/0x22153cd396b81a74 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.142888:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000952ff42d/0x22153cd396b81a74 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826414.142976:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f80a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563838848:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 302us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826414.142985:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2044 00000100:00100000:1.0:1787826414.146438:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826414.146671:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563839104 00000100:00100000:0.0:1787826414.146686:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563839104 00000100:00100000:0.0:1787826414.146775:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3698 00000100:00100000:0.0:1787826414.146788:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:55493:x1874670563839104:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:0.0:1787826414.146865:0:32404:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826414.146902:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b81a2e lrc: 0/0,0 mode: --/PR res: [0x200000405:0x24:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c93 expref: 33 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.146925:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x24:0x0].0x0 (ffff90cf0c7da900) 00010000:00010000:0.0:1787826414.146939:0:32404:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826414.146987:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b81a7b lrc: 3/0,1 mode: --/PW res: [0x200000405:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.147004:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b81a7b lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x24:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.147018:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b81a7b lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x24:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826414.147184:0:32404:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007fd5cfd9 reply state 00000000fb9d8f12 transno 8589934844 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b81a7b lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x24:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.149076:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b81a7b lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x24:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.149089:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x24:0x0].0x0 (ffff90cf0c7daf00) 00010000:00010000:0.0:1787826414.149094:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826414.149100:0:32404:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787826414.149973:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:55493:x1874670563839104:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 3173us (3536us total) trans 8589934844 rc 0/0 00000100:00100000:0.0:1787826414.149988:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3698 00000100:00100000:3.0:1787826414.157055:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826414.157179:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563839232 00000100:00100000:0.0:1787826414.157203:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563839232 00000100:00100000:2.0:1787826414.157526:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3699 00000100:00100000:2.0:1787826414.157542:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f809a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:55493:x1874670563839232:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826414.157584:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826414.157613:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b81a82 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0cbd expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.157721:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b81a82 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cbd expref: 35 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.157741:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b81a82 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cbd expref: 35 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.157766:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x24:0x0].0x0 (ffff90cf0c7daf00) 00010000:00010000:2.0:1787826414.157770:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826414.157775:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835a00, rc 0) 00000100:00100000:2.0:1787826414.157844:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f809a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:55493:x1874670563839232:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 306us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826414.157852:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3699 00000100:00100000:2.0:1787826414.162787:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826414.162999:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563839360 00000100:00100000:0.0:1787826414.163015:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563839360 00000100:00100000:0.0:1787826414.163220:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2045 00000100:00100000:0.0:1787826414.163246:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa85a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:55493:x1874670563839360:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826414.163312:0:30695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826414.163351:0:30695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e32bc9b1/0x22153cd396b81a89 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0cc4 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.163440:0:30695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b81a35 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c9a expref: 13 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.163452:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x107:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826414.163458:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x107:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826414.163465:0:30695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e32bc9b1/0x22153cd396b81a89 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cc4 expref: 13 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.163555:0:30695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b81a35 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c9a expref: 13 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.163572:0:30695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b81a35 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c9a expref: 13 pid: 8436 timeout: 1460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826414.163601:0:30695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3abc03c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:30695:1874670585236992:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826414.163722:0:30695:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787826414.167833:0:30695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3abc03c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:30695:1874670585236992:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826414.168081:0:30695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e32bc9b1/0x22153cd396b81a89 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cc4 expref: 13 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.168110:0:30695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165e000, rc 0) 00000100:00100000:0.0:1787826414.168451:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa85a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:55493:x1874670563839360:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 5207us (5679us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826414.168463:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2045 00000100:00100000:2.0:1787826414.171876:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826414.173110:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563839488 00000100:00100000:0.0:1787826414.173128:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563839488 00010000:00010000:0.0:1787826414.173202:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b81a35 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c9a expref: 13 pid: 8436 timeout: 1460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826414.173323:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1102 00000100:00100000:0.0:1787826414.173337:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf185dd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2404:x1874670563839488:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826414.173362:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826414.173418:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b81a35 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x107:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c9a expref: 13 pid: 8436 timeout: 1460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.173433:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b81a35 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x107:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c9a expref: 13 pid: 8436 timeout: 1460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.173466:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b81a35 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x107:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c9a expref: 13 pid: 8436 timeout: 1460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.173513:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x107:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826414.173520:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x107:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826414.173530:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e32bc9b1/0x22153cd396b81a89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cc4 expref: 12 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.173545:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e32bc9b1/0x22153cd396b81a89 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cc4 expref: 12 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.174053:0:6504:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e32bc9b1/0x22153cd396b81a89 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cc4 expref: 12 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826414.174076:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3abc03c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6504:1874670585237120:192.168.203.39@tcp:105: 00000100:00100000:0.0:1787826414.174213:0:6504:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787826414.178257:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3abc03c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6504:1874670585237120:192.168.203.39@tcp:105: 00010000:00010000:0.0:1787826414.178302:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826414.178368:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf185dd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563839488:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5034us (6506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826414.178382:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1102 00000100:00100000:2.0:1787826414.180095:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826414.180179:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563839616 00000100:00100000:3.0:1787826414.180198:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563839616 00000100:00100000:3.0:1787826414.180313:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2046 00000100:00100000:3.0:1787826414.180326:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563839616:12345-192.168.203.39@tcp:2:lfs.0 00002000:00010000:3.0:1787826414.180947:0:28853:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x107:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787826414.180952:0:28853:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x107:0x0] updating lvb mtime from disk: 0 -> 1787826412 00002000:00010000:3.0:1787826414.180955:0:28853:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x107:0x0] updating lvb atime from disk: 0 -> 1787826412 00002000:00010000:3.0:1787826414.180958:0:28853:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x107:0x0] updating lvb ctime from disk: 0 -> 1787826414 00002000:00010000:3.0:1787826414.180961:0:28853:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x107:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1787826414.181022:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2403:x1874670563839616:12345-192.168.203.39@tcp:2:lfs.0 Request processed in 699us (937us total) trans 17179869657 rc 0/0 00000100:00100000:3.0:1787826414.181031:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2046 00000100:00100000:2.0:1787826414.186731:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826414.186964:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563839872 00000100:00100000:3.0:1787826414.186978:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563839872 00000100:00100000:3.0:1787826414.187098:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3700 00000100:00100000:3.0:1787826414.187111:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa86580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:55493:x1874670563839872:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:3.0:1787826414.187187:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826414.187233:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b81a19 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c85 expref: 35 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.187258:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826414.187264:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826414.187347:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81a90 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.187373:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81a90 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.187387:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81a90 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826414.187615:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004fcd1d04 reply state 00000000a7a42599 transno 8589934845 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81a90 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.187629:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81a90 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.187641:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826414.187643:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826414.187647:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826414.187775:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa86580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55493:x1874670563839872:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 666us (1058us total) trans 8589934845 rc 0/0 00000100:00100000:3.0:1787826414.187784:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3700 00000100:00100000:0.0:1787826414.192216:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826414.192758:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563840000 00000100:00100000:3.0:1787826414.192773:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563840000 00000100:00100000:2.0:1787826414.193136:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2047 00000100:00100000:2.0:1787826414.193149:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:55493:x1874670563840000:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826414.193175:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826414.193213:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000382351a4/0x22153cd396b81a97 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0ccb expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.193255:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000021c90a82/0x22153cd396b81a66 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cb6 expref: 11 pid: 14864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.193266:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x106:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826414.193271:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x106:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826414.193286:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000382351a4/0x22153cd396b81a97 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ccb expref: 11 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.193342:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000021c90a82/0x22153cd396b81a66 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cb6 expref: 11 pid: 14864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.193370:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000021c90a82/0x22153cd396b81a66 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cb6 expref: 11 pid: 14864 timeout: 1460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826414.193402:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aa86940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1874670585237248:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826414.193538:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce010f5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826414.197241:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aa86940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1874670585237248:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826414.197421:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000382351a4/0x22153cd396b81a97 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ccb expref: 11 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.197453:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834c00, rc 0) 00000100:00100000:3.0:1787826414.198113:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826414.198305:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563840128 00000100:00100000:2.0:1787826414.198314:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563840128 00010000:00010000:2.0:1787826414.198721:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000021c90a82/0x22153cd396b81a66 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cb6 expref: 12 pid: 14864 timeout: 1460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826414.198833:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:55493:x1874670563840000:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 5363us (6323us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826414.198846:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2047 00000100:00100000:2.0:1787826414.198916:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1103 00000100:00100000:2.0:1787826414.198928:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f809680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2404:x1874670563840128:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826414.198947:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826414.198975:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000021c90a82/0x22153cd396b81a66 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x106:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cb6 expref: 11 pid: 14864 timeout: 1460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.198998:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000021c90a82/0x22153cd396b81a66 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x106:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cb6 expref: 11 pid: 14864 timeout: 1460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.199028:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021c90a82/0x22153cd396b81a66 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x106:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cb6 expref: 11 pid: 14864 timeout: 1460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.199048:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x106:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826414.199052:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x106:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826414.199060:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000382351a4/0x22153cd396b81a97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ccb expref: 10 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.199072:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000382351a4/0x22153cd396b81a97 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ccb expref: 10 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.199114:0:6505:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000382351a4/0x22153cd396b81a97 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ccb expref: 10 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826414.199131:0:6505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aa86940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1874670585237376:192.168.203.39@tcp:105: 00000100:00100000:2.0:1787826414.199258:0:6505:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce010f50c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826414.203280:0:6505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aa86940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1874670585237376:192.168.203.39@tcp:105: 00000100:00100000:3.0:1787826414.203305:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00010000:00010000:2.0:1787826414.203318:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826414.203402:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f809680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563840128:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4468us (5283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826414.203420:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1103 00000100:00100000:0.0:1787826414.203569:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563840256 00000100:00100000:0.0:1787826414.203577:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563840256 00000100:00100000:0.0:1787826414.203647:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2048 00000100:00100000:0.0:1787826414.203658:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f80a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563840256:12345-192.168.203.39@tcp:2:lfs.0 00002000:00010000:0.0:1787826414.203869:0:30696:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x106:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787826414.203873:0:30696:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x106:0x0] updating lvb mtime from disk: 1787826412 -> 1787826412 00002000:00010000:0.0:1787826414.203876:0:30696:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x106:0x0] updating lvb atime from disk: 1787826412 -> 1787826412 00002000:00010000:0.0:1787826414.203878:0:30696:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x106:0x0] updating lvb ctime from disk: 1787826414 -> 1787826414 00002000:00010000:0.0:1787826414.203881:0:30696:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x106:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1787826414.203910:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f80a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2404:x1874670563840256:12345-192.168.203.39@tcp:2:lfs.0 Request processed in 254us (674us total) trans 21474836998 rc 0/0 00000100:00100000:0.0:1787826414.203917:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2048 00000100:00100000:1.0:1787826414.207282:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826414.207721:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563840512 00000100:00100000:3.0:1787826414.207734:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563840512 00000100:00100000:0.0:1787826414.208291:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1096 00000100:00100000:0.0:1787826414.208308:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3957a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55493:x1874670563840512:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:0.0:1787826414.208448:0:14257:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000405:0x1d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b81a43 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ca1 expref: 36 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.209034:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b81a9e lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.209052:0:14257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b81971 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c4d expref: 36 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.209062:0:14257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b819be lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c62 expref: 36 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.209072:0:14257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b81a9e lrc: 5/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.209116:0:14257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b819be lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c62 expref: 36 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.209130:0:14257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b819be lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c62 expref: 36 pid: 32404 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826414.209144:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf07967840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585237504:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826414.209314:0:14257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b81971 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c4d expref: 36 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.209321:0:14257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b81971 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c4d expref: 36 pid: 6519 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826414.209328:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce049bad00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585237632:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826414.209348:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826414.212725:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826414.212969:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563840768 00000100:00100000:3.0:1787826414.212981:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563840768 00000100:00100000:3.0:1787826414.213054:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1097 00000100:00100000:3.0:1787826414.213066:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:42221:x1874670563840768:12345-192.168.203.39@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787826414.213488:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf07967840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585237504:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826414.213514:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce049bad00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585237632:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826414.213547:0:14257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b81a9e lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826414.213560:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:42221:x1874670563840768:12345-192.168.203.39@tcp:35:ldlm_bl.0 Request processed in 496us (849us total) trans 8589934846 rc 0/0 00000100:00100000:3.0:1787826414.213569:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1097 00000100:00100000:1.0:1787826414.213713:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826414.213869:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563840896 00000100:00100000:0.0:1787826414.213875:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563840896 00010000:00010000:0.0:1787826414.213908:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b81971 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c4d expref: 38 pid: 6519 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826414.213941:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1104 00000100:00100000:0.0:1787826414.213949:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:2403:x1874670563840896:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826414.213964:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826414.213973:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b81971 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c4d expref: 38 pid: 6519 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.213985:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b81971 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c4d expref: 38 pid: 6519 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.214014:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b81971 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c4d expref: 38 pid: 6519 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.214031:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826414.214037:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b81a9e lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.214047:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b81a9e lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.214053:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826414.214089:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:2403:x1874670563840896:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 140us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826414.214096:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1104 00000100:00100000:1.0:1787826414.216388:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826414.216520:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563841024 00000100:00100000:0.0:1787826414.216531:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563841024 00010000:00010000:0.0:1787826414.216591:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b819be lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c62 expref: 37 pid: 32404 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826414.216637:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1105 00000100:00100000:0.0:1787826414.216648:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:2404:x1874670563841024:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826414.217035:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826414.217044:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b819be lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c62 expref: 37 pid: 32404 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.217056:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b819be lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c62 expref: 37 pid: 32404 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.217079:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b819be lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0c62 expref: 37 pid: 32404 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.217093:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826414.217098:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b81a9e lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.217106:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b81a9e lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.217113:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b81a9e lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.217144:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826414.217188:0:14257:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b81a9e lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.217208:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b81a9e lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826414.217221:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:2404:x1874670563841024:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 575us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826414.217228:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1105 00010000:00010000:2.0:1787826414.217236:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b81aa5 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.217249:0:14257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b81a82 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cbd expref: 36 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.217258:0:14257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b81aa5 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x24:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.217298:0:14257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b81a82 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cbd expref: 36 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.217313:0:14257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b81a82 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cbd expref: 36 pid: 9966 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826414.217332:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aa86940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585237760:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826414.217448:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce010f50c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826414.220140:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aa86940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585237760:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826414.220182:0:14257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b81aa5 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x24:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826414.220635:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826414.220956:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563841152 00000100:00100000:2.0:1787826414.220964:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563841152 00010000:00010000:2.0:1787826414.221012:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b81a82 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cbd expref: 36 pid: 9966 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826414.221051:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1106 00000100:00100000:2.0:1787826414.221062:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:2404:x1874670563841152:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826414.221080:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826414.221088:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b81a82 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x24:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cbd expref: 36 pid: 9966 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.221101:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b81a82 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x24:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cbd expref: 36 pid: 9966 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.221129:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b81a82 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x24:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cbd expref: 36 pid: 9966 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.221147:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x24:0x0].0x0 (ffff90cf0c7daf00) 00010000:00010000:2.0:1787826414.221153:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b81aa5 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x24:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.221165:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b81aa5 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x24:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.221174:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b81aa5 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x24:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.221215:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826414.221301:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:2404:x1874670563841152:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 239us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826414.221309:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1106 00010000:00010000:0.0:1787826414.221674:0:14257:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b81aa5 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x24:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.221684:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b81aa5 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x24:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826414.222062:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce049bad00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585237888:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1787826414.222129:0:14257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826414.222159:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e36c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826414.222693:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585237888 00000100:00100000:2.0:1787826414.222702:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585237888 00000100:00100000:2.0:1787826414.222814:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1433 00000100:00100000:2.0:1787826414.222826:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf07967840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:14257:x1874670585237888:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1787826414.223030:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf07967840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:14257:x1874670585237888:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 206us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826414.223038:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1433 00000100:00100000:3.0:1787826414.223129:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce049bad00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585237888:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1787826414.223221:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f808b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585238016:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1787826414.223264:0:14257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826414.223323:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce02725000 going to sleep for 11 seconds 00000100:00100000:2.0:1787826414.223361:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585238016 00000100:00100000:2.0:1787826414.223732:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585238016 00000100:00100000:2.0:1787826414.223770:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1434 00000100:00100000:2.0:1787826414.223778:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:14257:x1874670585238016:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1787826414.223867:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:14257:x1874670585238016:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 89us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826414.223874:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1434 00000100:00100000:3.0:1787826414.223982:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f808b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585238016:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:3.0:1787826414.224119:0:14257:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934847 00000100:00100000:3.0:1787826414.224177:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f808b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585238144:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1787826414.224215:0:14257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826414.224233:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce02742540 going to sleep for 11 seconds 00000100:00100000:0.0:1787826414.224292:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585238144 00000100:00100000:0.0:1787826414.224298:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585238144 00000100:00100000:0.0:1787826414.224336:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1435 00000100:00100000:0.0:1787826414.224343:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049bad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:14257:x1874670585238144:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1787826414.224723:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049bad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+10:14257:x1874670585238144:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 379us (505us total) trans 17179869658 rc 0/0 00000100:00100000:0.0:1787826414.224731:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1435 00000100:00100000:3.0:1787826414.224964:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f808b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585238144:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:3.0:1787826414.225042:0:14257:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934848 00010000:00010000:3.0:1787826414.225082:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b81aa5 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x24:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.225094:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b81aa5 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x24:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.225102:0:14257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b81aa5 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x24:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.225109:0:14257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826414.225114:0:14257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b81aa5 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x24:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.225124:0:14257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b81aa5 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x24:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.225143:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x24:0x0].0x0 (ffff90cf0c7daf00) 00010000:00010000:3.0:1787826414.225147:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787826414.225153:0:14257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b81aa5 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x24:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.225159:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b81aa5 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x24:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.225177:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b81a9e lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.225188:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b81a9e lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.225208:0:14257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b81a9e lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.225213:0:14257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165f400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826414.225216:0:14257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b81a9e lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.225221:0:14257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b81a9e lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.225230:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826414.225232:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787826414.225235:0:14257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b81a9e lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.225240:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b81a9e lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.225254:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826414.225257:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787826414.225264:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b81a43 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ca1 expref: 37 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826414.225884:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3957a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55493:x1874670563840512:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 17579us (18617us total) trans 8589934849 rc 0/0 00000100:00100000:3.0:1787826414.225896:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1096 00000020:00080000:3.0:1787826414.225901:0:14257:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1787826414.228807:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826414.228995:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563841280 00000100:00100000:2.0:1787826414.229008:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563841280 00000100:00100000:2.0:1787826414.229114:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3701 00000100:00100000:2.0:1787826414.229125:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55493:x1874670563841280:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826414.229168:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826414.229205:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81aac lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0cd2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.229282:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81aac lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cd2 expref: 37 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.229304:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81aac lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cd2 expref: 37 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.229326:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826414.229329:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826414.229333:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834a00, rc 0) 00000100:00100000:2.0:1787826414.229825:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:55493:x1874670563841280:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 699us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826414.229834:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3701 00000100:00100000:1.0:1787826414.233217:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826414.233345:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563841536 00000100:00100000:2.0:1787826414.233357:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563841536 00000100:00100000:2.0:1787826414.234265:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1098 00000100:00100000:2.0:1787826414.234283:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:55493:x1874670563841536:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:2.0:1787826414.234714:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:55493:x1874670563841536:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 436us (1509us total) trans 8589934850 rc 0/0 00000100:00100000:2.0:1787826414.234724:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1098 00000100:00100000:3.0:1787826414.238805:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826414.238923:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563841792 00000100:00100000:0.0:1787826414.238936:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563841792 00000100:00100000:0.0:1787826414.238995:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1099 00000100:00100000:0.0:1787826414.239004:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f80b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:55493:x1874670563841792:12345-192.168.203.39@tcp:35:lfs.0 00000004:00080000:0.0:1787826414.239263:0:14257:0:(mdd_object.c:4014:mdd_close()) Object [0x200000405:0x24:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:0.0:1787826414.239373:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81ab3 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.239403:0:14257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81ab3 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.239419:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81ab3 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.239428:0:14257:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81ab3 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.239435:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81ab3 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.239442:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81ab3 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.239495:0:14257:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787826414.239616:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f80b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+39:55493:x1874670563841792:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 611us (824us total) trans 8589934851 rc 0/0 00000100:00100000:0.0:1787826414.239625:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1099 00010000:00010000:1.0:1787826414.239788:0:7460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826414.239798:0:7460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81ab3 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.239805:0:7460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165ea00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:1.0:1787826414.239809:0:7460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81ab3 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.239818:0:7460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81ab3 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.239843:0:7460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x24:0x0].0x0 (ffff90cf0c7daf00) 00010000:00010000:1.0:1787826414.239846:0:7460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787826414.239852:0:7460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81ab3 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.239857:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81ab3 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.239871:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826414.239873:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826414.239874:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826414.260933:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826414.261035:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563841920 00000100:00100000:0.0:1787826414.261047:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563841920 00000100:00100000:0.0:1787826414.261129:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3702 00000100:00100000:0.0:1787826414.261141:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+39:55495:x1874670563841920:12345-192.168.203.39@tcp:101:getfattr.0 00010000:00010000:0.0:1787826414.261173:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826414.261212:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b81aba lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0cd9 expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.261296:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b81ac1 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.261320:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b81ac1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.261334:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b81ac1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.261350:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81ac8 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.261358:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.261365:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.261466:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81acf lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.261517:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81acf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.261525:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81acf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826414.261577:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:0.0:1787826414.261583:0:32404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826414.261609:0:32404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81acf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.261623:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81acf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.261635:0:32404:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b81ac1 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.261642:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b81ac1 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.261648:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b81ac1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.261654:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b81ac1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.261661:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165e400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826414.261666:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b81ac1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.261675:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b81ac1 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.261690:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf0c7da900) 00010000:00010000:0.0:1787826414.261693:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826414.261698:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b81ac1 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.261706:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b81ac1 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.261724:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.261731:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81ac8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.261737:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81ac8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.261743:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165fa00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826414.261745:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81ac8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.261752:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81ac8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.261760:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf0c7da800) 00010000:00010000:0.0:1787826414.261762:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826414.261766:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81ac8 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.261772:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81ac8 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.261810:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b81aba lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cd9 expref: 41 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.261827:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81acf lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cd9 expref: 40 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.261839:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826414.261842:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826414.261845:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165ea00, rc 0) 00000100:00100000:0.0:1787826414.261931:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55495:x1874670563841920:12345-192.168.203.39@tcp:101:getfattr.0 Request processed in 791us (1010us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826414.261940:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3702 00000100:00100000:3.0:1787826414.325657:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826414.327748:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563842048 00000100:00100000:2.0:1787826414.327768:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563842048 00000100:00100000:2.0:1787826414.327870:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3703 00000100:00100000:2.0:1787826414.327883:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55499:x1874670563842048:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:2.0:1787826414.327996:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b81ad6 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.328015:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b81ad6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.328032:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b81ad6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.328048:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81add lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.328055:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81add lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.328061:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81add lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.328153:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81ae4 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.328163:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.328170:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826414.328228:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:2.0:1787826414.328241:0:9966:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826414.328258:0:9966:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.328273:0:9966:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b81ad6 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.328281:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b81ad6 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.328292:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b81ad6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.328299:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b81ad6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.328306:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826414.328312:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b81ad6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.328320:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b81ad6 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.328334:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf1859ad00) 00010000:00010000:2.0:1787826414.328338:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826414.328343:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b81ad6 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.328350:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b81ad6 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.328373:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81add lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.328380:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81add lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.328386:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81add lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.328391:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826414.328394:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81add lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.328400:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81add lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.328407:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf1859a000) 00010000:00010000:2.0:1787826414.328410:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826414.328412:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81add lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.328418:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81add lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.328430:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.328436:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81ae4 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.328442:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81ae4 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.328447:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826414.328450:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81ae4 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.328455:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81ae4 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.328462:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826414.328464:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826414.328468:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81ae4 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.328558:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81ae4 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826414.328677:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55499:x1874670563842048:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 794us (3032us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826414.328687:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3703 00000100:00100000:3.0:1787826414.352948:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826414.353270:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563842304 00000100:00100000:2.0:1787826414.353284:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563842304 00000100:00100000:2.0:1787826414.353360:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3704 00000100:00100000:2.0:1787826414.353372:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fde1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55501:x1874670563842304:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826414.353402:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826414.353435:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81aeb lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0ce0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.353753:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81af2 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.353774:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81af2 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.353789:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81af2 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826414.353804:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:2.0:1787826414.353946:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81aeb lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ce0 expref: 43 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.353970:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81af2 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ce0 expref: 42 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.353981:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826414.353984:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787826414.353989:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835000, rc 0) 00000100:00100000:2.0:1787826414.354069:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fde1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+42:55501:x1874670563842304:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 698us (1135us total) trans 8589934852 rc 0/0 00000100:00100000:2.0:1787826414.354077:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3704 00000100:00100000:3.0:1787826414.359411:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826414.359730:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563842560 00000100:00100000:2.0:1787826414.359743:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563842560 00000100:00100000:2.0:1787826414.359816:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3705 00000100:00100000:2.0:1787826414.359827:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fde580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+42:55501:x1874670563842560:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826414.359860:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826414.359886:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b81b00 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0ce7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.360034:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b81b07 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.360052:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81acf lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cd9 expref: 43 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.360063:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b81b07 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.360105:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81acf lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cd9 expref: 43 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.360120:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81acf lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cd9 expref: 43 pid: 32404 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826414.360137:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aa86940 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1874670585238272:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826414.360260:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce010f5cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826414.365709:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aa86940 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1874670585238272:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826414.365757:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b81b07 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826414.366045:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826414.366138:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563842688 00000100:00100000:0.0:1787826414.366146:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563842688 00010000:00010000:0.0:1787826414.366210:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81acf lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cd9 expref: 44 pid: 32404 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826414.366266:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1107 00000100:00100000:0.0:1787826414.366278:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:2403:x1874670563842688:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826414.366299:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826414.366308:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81acf lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cd9 expref: 44 pid: 32404 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.366323:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81acf lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cd9 expref: 44 pid: 32404 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.366355:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81acf lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cd9 expref: 44 pid: 32404 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.366375:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826414.366381:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b81b07 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.366394:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b81b07 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.366403:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b81b07 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.366435:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826414.366776:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b81b07 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.366786:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b81b07 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826414.366816:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:2.0:1787826414.367001:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b81b00 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ce7 expref: 45 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.367021:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b81b07 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ce7 expref: 44 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.367030:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826414.367032:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787826414.367035:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834400, rc 0) 00000100:00100000:2.0:1787826414.367095:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fde580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55501:x1874670563842560:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 7269us (7711us total) trans 8589934853 rc 0/0 00000100:00100000:2.0:1787826414.367104:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3705 00000100:00100000:0.0:1787826414.367468:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:2403:x1874670563842688:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 1190us (1423us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826414.367688:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1107 00000100:00100000:1.0:1787826414.371020:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826414.371142:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563842816 00000100:00100000:3.0:1787826414.371156:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563842816 00000100:00100000:3.0:1787826414.371273:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1100 00000100:00100000:3.0:1787826414.371285:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55501:x1874670563842816:12345-192.168.203.39@tcp:33:lfs.0 00000100:00100000:3.0:1787826414.371565:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55501:x1874670563842816:12345-192.168.203.39@tcp:33:lfs.0 Request processed in 282us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826414.371574:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1100 00000100:00100000:2.0:1787826414.386333:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826414.386517:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563843072 00000100:00100000:0.0:1787826414.386530:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563843072 00000100:00100000:0.0:1787826414.386597:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1101 00000100:00100000:0.0:1787826414.386610:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55501:x1874670563843072:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:0.0:1787826414.386904:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55501:x1874670563843072:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 295us (585us total) trans 8589934854 rc 0/0 00000100:00100000:0.0:1787826414.386914:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1101 00000100:00100000:2.0:1787826414.390302:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826414.390897:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563843328 00000100:00100000:0.0:1787826414.390912:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563843328 00000100:00100000:0.0:1787826414.391033:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3706 00000100:00100000:0.0:1787826414.391045:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55501:x1874670563843328:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826414.391079:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826414.391083:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:0.0:1787826414.391118:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b81b07 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ce7 expref: 44 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.391144:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81af2 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ce0 expref: 43 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.391158:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826414.391164:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826414.391181:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81b15 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0cee expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.391346:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81b1c lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.391379:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81b1c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.391392:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81b1c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826414.391414:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:0.0:1787826414.391692:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81b15 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cee expref: 45 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.391712:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81b1c lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cee expref: 44 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.391721:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826414.391725:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787826414.391728:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165fa00, rc 0) 00000100:00100000:0.0:1787826414.391830:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55501:x1874670563843328:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 787us (1543us total) trans 8589934855 rc 0/0 00000100:00100000:0.0:1787826414.391911:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3706 00000100:00100000:3.0:1787826414.395099:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826414.395326:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563843584 00000100:00100000:1.0:1787826414.395339:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563843584 00000100:00100000:1.0:1787826414.395452:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1102 00000100:00100000:1.0:1787826414.395464:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf39579050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55501:x1874670563843584:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:1.0:1787826414.395607:0:14257:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000405:0x1d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81b1c lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cee expref: 44 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.395658:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b81b2a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.395675:0:14257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81aac lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cd2 expref: 44 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.395685:0:14257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b81b2a lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.395727:0:14257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81aac lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cd2 expref: 44 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.395739:0:14257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81aac lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cd2 expref: 44 pid: 6520 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826414.395753:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf41c84b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585238400:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826414.395865:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf1850c000 going to sleep for 11 seconds 00000100:00100000:3.0:1787826414.401962:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826414.402076:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563843712 00000100:00100000:0.0:1787826414.402086:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563843712 00000100:00100000:1.0:1787826414.402098:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf41c84b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585238400:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826414.402132:0:14257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b81b2a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.402134:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81aac lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cd2 expref: 45 pid: 6520 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826414.402186:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1108 00000100:00100000:0.0:1787826414.402206:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+45:2403:x1874670563843712:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826414.402227:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826414.402238:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81aac lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cd2 expref: 45 pid: 6520 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.402253:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81aac lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cd2 expref: 45 pid: 6520 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.402289:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81aac lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cd2 expref: 45 pid: 6520 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.402310:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826414.402317:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b81b2a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.402327:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b81b2a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.402336:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b81b2a lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.402377:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826414.402405:0:14257:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b81b2a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.402413:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b81b2a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826414.402448:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:2403:x1874670563843712:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 244us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826414.402457:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1108 00010000:00010000:1.0:1787826414.402660:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b81b2a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.402670:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b81b2a lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.402678:0:14257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b81b2a lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.402690:0:14257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46bc00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826414.402697:0:14257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b81b2a lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.402706:0:14257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b81b2a lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.402716:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826414.402719:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787826414.402723:0:14257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b81b2a lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.402729:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b81b2a lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.402742:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826414.402744:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787826414.402749:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81b1c lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cee expref: 43 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826414.402895:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf39579050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55501:x1874670563843584:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 7432us (7809us total) trans 8589934856 rc -22/-22 00000100:00100000:1.0:1787826414.402905:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1102 00000100:00100000:3.0:1787826414.412400:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826414.412545:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563843840 00000100:00100000:0.0:1787826414.412558:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563843840 00000100:00100000:0.0:1787826414.412642:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3707 00000100:00100000:0.0:1787826414.412654:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55501:x1874670563843840:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826414.412688:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826414.412716:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b81b31 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0cf5 expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.412794:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b81b31 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cf5 expref: 44 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.412812:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b81b31 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cf5 expref: 44 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.412835:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826414.412850:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826414.412855:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165e400, rc 0) 00000100:00100000:1.0:1787826414.412999:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55501:x1874670563843840:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 345us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826414.413008:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3707 00000100:00100000:3.0:1787826414.417221:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826414.417919:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563844096 00000100:00100000:2.0:1787826414.417936:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563844096 00000100:00100000:2.0:1787826414.418076:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3708 00000100:00100000:2.0:1787826414.418090:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06305680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55501:x1874670563844096:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826414.418120:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826414.418160:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b81b38 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0cfc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.420288:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b81b3f lrc: 3/1,0 mode: --/PR res: [0x200000405:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.420319:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b81b3f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.420335:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b81b3f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826414.420349:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x25:0x0]: returning size 0 00010000:00010000:2.0:1787826414.420423:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b81b38 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cfc expref: 47 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.420452:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b81b3f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cfc expref: 46 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.420463:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x25:0x0].0x0 (ffff90cf1859ad00) 00010000:00010000:2.0:1787826414.420466:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826414.420541:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835c00, rc 0) 00000100:00100000:2.0:1787826414.420647:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06305680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+46:55501:x1874670563844096:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 2559us (3441us total) trans 8589934857 rc 0/0 00000100:00100000:2.0:1787826414.420658:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3708 00000100:00100000:0.0:1787826414.427003:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826414.431577:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563844352 00000100:00100000:2.0:1787826414.431599:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563844352 00000100:00100000:3.0:1787826414.432078:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3709 00000100:00100000:3.0:1787826414.432093:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf07966940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+46:55501:x1874670563844352:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826414.432128:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826414.432156:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b81b4d lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0d03 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.432308:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b81b54 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.432327:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b81b54 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.432345:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b81b54 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826414.432359:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:3.0:1787826414.433055:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b81b4d lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d03 expref: 49 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.433079:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b81b54 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d03 expref: 48 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.433090:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826414.433093:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787826414.433098:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401e00, rc 0) 00000100:00100000:3.0:1787826414.433886:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf07966940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55501:x1874670563844352:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1791us (6891us total) trans 8589934858 rc 0/0 00000100:00100000:3.0:1787826414.433901:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3709 00000100:00100000:3.0:1787826414.457025:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826414.457280:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563844608 00000100:00100000:2.0:1787826414.457293:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563844608 00000100:00100000:2.0:1787826414.457373:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1103 00000100:00100000:2.0:1787826414.457386:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55501:x1874670563844608:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:2.0:1787826414.458005:0:6521:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000405:0x1d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b81b54 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d03 expref: 48 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.458068:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b81b62 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.458086:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b81b31 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cf5 expref: 48 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.458096:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b81b62 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.458147:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b81b31 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cf5 expref: 48 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.458317:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b81b31 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cf5 expref: 48 pid: 8247 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826414.458339:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aa84000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1874670585238528:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826414.458911:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce010f5cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826414.472337:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aa84000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1874670585238528:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826414.472387:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b81b62 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826414.474874:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826414.475290:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563844736 00000100:00100000:1.0:1787826414.475305:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563844736 00010000:00010000:1.0:1787826414.475365:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b81b31 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cf5 expref: 49 pid: 8247 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826414.475427:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1109 00000100:00100000:1.0:1787826414.475438:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf185dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:2404:x1874670563844736:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826414.475456:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826414.475465:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b81b31 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cf5 expref: 49 pid: 8247 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.475516:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b81b31 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cf5 expref: 49 pid: 8247 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.475547:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b81b31 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cf5 expref: 49 pid: 8247 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.475569:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826414.475576:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b81b62 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.475586:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b81b62 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.475603:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b81b62 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.475651:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826414.475879:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b81b62 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.475889:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b81b62 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.475917:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81b69 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.475930:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b81b3f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cfc expref: 48 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.475939:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81b69 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x25:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.475982:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b81b3f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cfc expref: 48 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.475996:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b81b3f lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cfc expref: 48 pid: 6519 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826414.476012:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aa84000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1874670585238656:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826414.476109:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce010f5cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826414.476941:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf185dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:2404:x1874670563844736:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 1495us (2071us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826414.476956:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1109 00000100:00100000:2.0:1787826414.480835:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aa84000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1874670585238656:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826414.480882:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81b69 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x25:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826414.485303:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826414.485816:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563844864 00000100:00100000:2.0:1787826414.485829:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563844864 00010000:00010000:2.0:1787826414.485886:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b81b3f lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cfc expref: 48 pid: 6519 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826414.485934:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1110 00000100:00100000:2.0:1787826414.485946:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:2403:x1874670563844864:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826414.485965:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826414.485973:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b81b3f lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cfc expref: 48 pid: 6519 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.485989:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b81b3f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cfc expref: 48 pid: 6519 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.486018:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b81b3f lrc: 0/0,0 mode: --/PR res: [0x200000405:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cfc expref: 48 pid: 6519 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.486038:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x25:0x0].0x0 (ffff90cf1859ad00) 00010000:00010000:2.0:1787826414.486043:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81b69 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x25:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.486055:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81b69 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x25:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.486063:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81b69 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x25:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.486095:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826414.486351:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+47:2403:x1874670563844864:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 405us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826414.486361:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1110 00010000:00010000:3.0:1787826414.486556:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81b69 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x25:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.486568:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81b69 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x25:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826414.487012:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce06306d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6521:1874670585238784:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787826414.487090:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826414.487134:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3ab4c600 going to sleep for 11 seconds 00000100:00100000:2.0:1787826414.487332:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585238784 00000100:00100000:2.0:1787826414.487340:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585238784 00000100:00100000:2.0:1787826414.487401:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1436 00000100:00100000:2.0:1787826414.487420:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f06d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:6521:x1874670585238784:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787826414.487543:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f06d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:6521:x1874670585238784:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 125us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826414.487551:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1436 00000100:00100000:3.0:1787826414.488900:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce06306d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6521:1874670585238784:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787826414.489005:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934859 00000001:00080000:3.0:1787826414.489118:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934860 00010000:00010000:3.0:1787826414.489144:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81b69 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x25:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.489169:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81b69 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x25:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.489177:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81b69 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x25:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.489183:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826414.489196:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81b69 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x25:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.489205:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81b69 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x25:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.489226:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x25:0x0].0x0 (ffff90cf1859ad00) 00010000:00010000:3.0:1787826414.489230:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787826414.489236:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81b69 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x25:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.489243:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81b69 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x25:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.489270:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b81b62 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.489277:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b81b62 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.489288:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b81b62 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.489293:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826414.489295:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b81b62 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.489301:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b81b62 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.489310:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826414.489312:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787826414.489316:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b81b62 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.489321:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b81b62 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.489334:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826414.489337:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787826414.489344:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b81b54 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d03 expref: 49 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826414.489495:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55501:x1874670563844608:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 32089us (32463us total) trans 8589934861 rc 0/0 00000100:00100000:3.0:1787826414.489507:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1103 00000020:00080000:3.0:1787826414.489514:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1787826414.494046:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826414.494285:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563844992 00000100:00100000:0.0:1787826414.494298:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563844992 00000100:00100000:0.0:1787826414.494391:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3710 00000100:00100000:0.0:1787826414.494403:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06306d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55501:x1874670563844992:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826414.494440:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826414.494514:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b81b70 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0d0a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.494594:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b81b70 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d0a expref: 49 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.494612:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b81b70 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d0a expref: 49 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.494636:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826414.494640:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826414.494645:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165fc00, rc 0) 00000100:00100000:0.0:1787826414.494731:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06306d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:55501:x1874670563844992:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 330us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826414.494740:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3710 00000100:00100000:1.0:1787826414.499444:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826414.499649:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563845248 00000100:00100000:0.0:1787826414.499662:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563845248 00000100:00100000:0.0:1787826414.499730:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1104 00000100:00100000:0.0:1787826414.499742:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:55501:x1874670563845248:12345-192.168.203.39@tcp:35:lfs.0 00000004:00080000:0.0:1787826414.500694:0:14257:0:(mdd_object.c:4014:mdd_close()) Object [0x200000405:0x25:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787826414.500846:0:14257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].25, 64 off10248 00000004:00080000:0.0:1787826414.500862:0:14257:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1360512390460ns, next at 1361512387198ns, rc = 0 00000001:00080000:0.0:1787826414.500871:0:14257:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934862 00010000:00010000:0.0:1787826414.501116:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81b77 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.501137:0:14257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81b77 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.501233:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81b77 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.501244:0:14257:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81b77 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.501251:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81b77 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.501257:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81b77 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.501277:0:14257:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787826414.501891:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826414.501900:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81b77 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.501909:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165e200 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:1.0:1787826414.501913:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81b77 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.501921:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81b77 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.501937:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x25:0x0].0x0 (ffff90cf0c7da900) 00010000:00010000:1.0:1787826414.501940:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787826414.501945:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81b77 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.501951:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81b77 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.501975:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826414.501977:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826414.501979:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826414.502447:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+51:55501:x1874670563845248:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 2410us (2719us total) trans 8589934863 rc 0/0 00000100:00100000:0.0:1787826414.502461:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1104 00000020:00080000:0.0:1787826414.502497:0:14257:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787826414.513514:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826414.513668:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563845504 00000100:00100000:3.0:1787826414.513683:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563845504 00000100:00100000:3.0:1787826414.513755:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1105 00000100:00100000:3.0:1787826414.513766:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+51:55501:x1874670563845504:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:3.0:1787826414.514008:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+52:55501:x1874670563845504:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 245us (552us total) trans 8589934864 rc 0/0 00000100:00100000:3.0:1787826414.514017:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1105 00000100:00100000:3.0:1787826414.546597:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826414.546934:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563845632 00000100:00100000:0.0:1787826414.546943:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563845632 00000100:00100000:0.0:1787826414.547013:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3711 00000100:00100000:0.0:1787826414.547023:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab90780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+52:55503:x1874670563845632:12345-192.168.203.39@tcp:101:getfattr.0 00010000:00010000:0.0:1787826414.547046:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826414.547070:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b81b7e lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0d11 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.547132:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b81b85 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.547146:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b81b85 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.547157:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b81b85 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.547172:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81b8c lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.547199:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81b8c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.547208:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81b8c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.547409:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b81b93 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.547420:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b81b93 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.547427:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b81b93 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826414.547813:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:0.0:1787826414.547818:0:16564:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826414.549303:0:16564:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b81b93 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.549324:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b81b93 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.549335:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b81b85 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.549340:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b81b85 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.549346:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b81b85 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.549352:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165e600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826414.549356:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b81b85 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.549364:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b81b85 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.549378:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf0c7da800) 00010000:00010000:2.0:1787826414.549381:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826414.549386:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b81b85 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.549392:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b81b85 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.549407:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81b8c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.549412:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81b8c lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.549418:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81b8c lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.549423:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165e200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826414.549425:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81b8c lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.549431:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81b8c lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.549439:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf0c7da900) 00010000:00010000:2.0:1787826414.549441:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826414.549444:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81b8c lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.549449:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81b8c lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.549686:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b81b7e lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d11 expref: 54 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.549705:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b81b93 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d11 expref: 53 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.549714:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826414.549716:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826414.549719:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165e400, rc 0) 00000100:00100000:2.0:1787826414.549799:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab90780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55503:x1874670563845632:12345-192.168.203.39@tcp:101:getfattr.0 Request processed in 2776us (3210us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826414.549808:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3711 00000100:00100000:1.0:1787826414.558238:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826414.558321:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563845760 00000100:00100000:0.0:1787826414.558330:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563845760 00000100:00100000:0.0:1787826414.558391:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2049 00000100:00100000:0.0:1787826414.558401:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c87c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2403:x1874670563845760:12345-192.168.203.39@tcp:101:getfattr.0 00010000:00010000:0.0:1787826414.558419:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826414.558434:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091cba634/0x22153cd396b81b9a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0d18 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826414.558526:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce044d0f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1874670585238912:192.168.203.39@tcp:106: 00000100:00100000:0.0:1787826414.558606:0:8435:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3300 going to sleep for 11 seconds 00000100:00100000:0.0:1787826414.561066:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce044d0f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1874670585238912:192.168.203.39@tcp:106: 00010000:00010000:0.0:1787826414.561110:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000091cba634/0x22153cd396b81b9a lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d18 expref: 14 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.561135:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091cba634/0x22153cd396b81b9a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d18 expref: 14 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.561150:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165f400, rc 0) 00000100:00100000:0.0:1787826414.561235:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c87c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2403:x1874670563845760:12345-192.168.203.39@tcp:101:getfattr.0 Request processed in 2835us (3005us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826414.561245:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2049 00000100:00100000:3.0:1787826414.608859:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826414.608971:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563845888 00000100:00100000:2.0:1787826414.608984:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563845888 00000100:00100000:2.0:1787826414.609060:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3712 00000100:00100000:2.0:1787826414.609069:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab92d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55507:x1874670563845888:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:2.0:1787826414.609135:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81ba1 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.609150:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81ba1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.609161:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81ba1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.609172:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b81ba8 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.609182:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b81ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.609199:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b81ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.609268:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81baf lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.609278:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81baf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.609284:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81baf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826414.609332:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:2.0:1787826414.609336:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826414.609349:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81baf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.609362:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81ba1 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.609368:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81ba1 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.609375:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81ba1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.609380:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81ba1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.609401:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826414.609405:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81ba1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.609413:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81ba1 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.609424:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf1859a000) 00010000:00010000:2.0:1787826414.609427:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826414.609431:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81ba1 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.609436:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81ba1 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.609453:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b81ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.609458:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b81ba8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.609464:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b81ba8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.609468:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826414.609527:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b81ba8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.609534:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b81ba8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.609545:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf1859af00) 00010000:00010000:2.0:1787826414.609547:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826414.609550:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b81ba8 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.609556:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b81ba8 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.609567:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81baf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.609572:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81baf lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.609578:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81baf lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.609582:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826414.609584:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81baf lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.609590:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81baf lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.609598:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826414.609600:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826414.609603:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81baf lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.609609:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81baf lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826414.609702:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab92d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55507:x1874670563845888:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 633us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826414.609710:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3712 00000100:00100000:1.0:1787826414.636689:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826414.637726:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563846144 00000100:00100000:3.0:1787826414.637746:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563846144 00000100:00100000:3.0:1787826414.637850:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3713 00000100:00100000:3.0:1787826414.637862:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c87840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55509:x1874670563846144:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826414.637888:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826414.637917:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b81bb6 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0d1f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.638059:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b81bbd lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.638078:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b81bbd lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.638092:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b81bbd lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826414.638106:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:3.0:1787826414.638273:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b81bb6 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d1f expref: 56 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.638303:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b81bbd lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d1f expref: 55 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.638314:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826414.638317:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787826414.638321:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401800, rc 0) 00000100:00100000:3.0:1787826414.638747:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c87840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+55:55509:x1874670563846144:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 885us (2064us total) trans 8589934865 rc 0/0 00000100:00100000:3.0:1787826414.638827:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3713 00000100:00100000:3.0:1787826414.642060:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826414.642241:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563846272 00000100:00100000:1.0:1787826414.642257:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563846272 00000100:00100000:1.0:1787826414.642400:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2050 00000100:00100000:1.0:1787826414.642412:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2404:x1874670563846272:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826414.642430:0:30398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826414.642449:0:30398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bacf1a1a/0x22153cd396b81bcb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0d26 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826414.642778:0:30398:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf41c84780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:30398:1874670585239040:192.168.203.39@tcp:106: 00000100:00100000:1.0:1787826414.642875:0:30398:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf1850cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826414.650624:0:30398:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf41c84780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:30398:1874670585239040:192.168.203.39@tcp:106: 00010000:00010000:1.0:1787826414.650676:0:30398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bacf1a1a/0x22153cd396b81bcb lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d26 expref: 14 pid: 30398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.650710:0:30398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bacf1a1a/0x22153cd396b81bcb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d26 expref: 14 pid: 30398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.650726:0:30398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46b200, rc 0) 00000100:00100000:1.0:1787826414.650820:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2404:x1874670563846272:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 8410us (8775us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826414.650830:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2050 00000100:00100000:3.0:1787826414.664320:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826414.664572:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563846528 00000100:00100000:1.0:1787826414.664585:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563846528 00000100:00100000:1.0:1787826414.664670:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3714 00000100:00100000:1.0:1787826414.664681:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+55:55509:x1874670563846528:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826414.664716:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826414.664746:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b81bd2 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0d2d expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.664907:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b81bd9 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.664929:0:8247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b81b93 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d11 expref: 56 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.664939:0:8247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b81bd9 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.664981:0:8247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b81b93 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d11 expref: 56 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.664996:0:8247:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b81b93 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d11 expref: 56 pid: 16564 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826414.665012:0:8247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf41c84780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8247:1874670585239168:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826414.665121:0:8247:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf1850cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787826414.669206:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826414.669316:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563846656 00000100:00100000:2.0:1787826414.669329:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563846656 00010000:00010000:2.0:1787826414.669395:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b81b93 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d11 expref: 57 pid: 16564 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826414.669446:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1111 00000100:00100000:2.0:1787826414.669457:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab92580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+57:2403:x1874670563846656:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826414.669515:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826414.669525:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b81b93 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d11 expref: 57 pid: 16564 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.669541:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b81b93 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d11 expref: 57 pid: 16564 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.669570:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826414.669577:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b81bd9 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.669587:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b81bd9 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.669596:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b81bd9 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.669622:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826414.669701:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab92580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+57:2403:x1874670563846656:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 245us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826414.669709:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1111 00010000:00010000:1.0:1787826414.670367:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b81b93 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d11 expref: 56 pid: 16564 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826414.670400:0:8247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf41c84780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8247:1874670585239168:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826414.670426:0:8247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b81bd9 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.670436:0:8247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b81bd9 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.670442:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b81bd9 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826414.670519:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:1.0:1787826414.670702:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b81bd2 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d2d expref: 57 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.670723:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b81bd9 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d2d expref: 56 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.670731:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826414.670735:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787826414.670737:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46ae00, rc 0) 00000100:00100000:0.0:1787826414.671265:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+56:55509:x1874670563846528:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 6582us (6956us total) trans 8589934866 rc 0/0 00000100:00100000:0.0:1787826414.671275:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3714 00000100:00100000:3.0:1787826414.674219:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826414.674656:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563846912 00000100:00100000:2.0:1787826414.674669:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563846912 00000100:00100000:2.0:1787826414.674749:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3715 00000100:00100000:2.0:1787826414.674762:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab91a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+56:55509:x1874670563846912:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826414.674800:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826414.674834:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81be7 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0d34 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.678914:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81bee lrc: 3/1,0 mode: --/PR res: [0x200000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.678946:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81bee lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.678963:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81bee lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826414.678980:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x26:0x0]: returning size 0 00010000:00010000:2.0:1787826414.679075:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81be7 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d34 expref: 59 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.679109:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81bee lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d34 expref: 58 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.679119:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x26:0x0].0x0 (ffff90cf1859a000) 00010000:00010000:2.0:1787826414.679123:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826414.679128:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834600, rc 0) 00000100:00100000:2.0:1787826414.679237:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab91a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:55509:x1874670563846912:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 4478us (5032us total) trans 8589934867 rc 0/0 00000100:00100000:2.0:1787826414.679248:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3715 00000100:00100000:3.0:1787826414.683048:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826414.683165:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563847168 00000100:00100000:0.0:1787826414.683178:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563847168 00000100:00100000:0.0:1787826414.683271:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3716 00000100:00100000:0.0:1787826414.683282:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:55509:x1874670563847168:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826414.683314:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826414.683343:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b81bfc lrc: 2/0,0 mode: --/CR res: [0x200000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0d3b expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.683782:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81c03 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.683804:0:9966:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81bee lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d34 expref: 59 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.683813:0:9966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81c03 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x26:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.683857:0:9966:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81bee lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d34 expref: 59 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.683873:0:9966:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81bee lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d34 expref: 59 pid: 16564 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826414.683888:0:9966:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce044d0f00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9966:1874670585239296:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826414.683996:0:9966:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3300 going to sleep for 11 seconds 00000100:00100000:0.0:1787826414.688132:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826414.688307:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563847296 00000100:00100000:1.0:1787826414.688319:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563847296 00010000:00010000:1.0:1787826414.688392:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81bee lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d34 expref: 60 pid: 16564 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826414.688443:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1112 00000100:00100000:1.0:1787826414.688455:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:2403:x1874670563847296:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826414.688500:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826414.688509:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81bee lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d34 expref: 60 pid: 16564 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.688534:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81bee lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d34 expref: 60 pid: 16564 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.688562:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x26:0x0].0x0 (ffff90cf1859a000) 00010000:00010000:1.0:1787826414.688569:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81c03 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x26:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.688580:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81c03 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x26:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.688590:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81c03 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x26:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.688614:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826414.688676:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:2403:x1874670563847296:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 223us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826414.688684:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1112 00010000:00010000:2.0:1787826414.690287:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81bee lrc: 0/0,0 mode: --/PR res: [0x200000405:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d34 expref: 59 pid: 16564 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826414.690313:0:9966:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce044d0f00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9966:1874670585239296:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826414.690353:0:9966:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81c03 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x26:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.690659:0:9966:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81c03 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x26:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.690665:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81c03 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x26:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826414.690695:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x26:0x0]: returning size 0 00000004:00080000:2.0:1787826414.690935:0:9966:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x107:0x0], index 0: 0 00010000:00010000:2.0:1787826414.691072:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81c03 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x26:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.691080:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81c03 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x26:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.691088:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81c03 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x26:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.691094:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165fa00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826414.691099:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81c03 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x26:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.691109:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81c03 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x26:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.691128:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x26:0x0].0x0 (ffff90cf1859a000) 00010000:00010000:2.0:1787826414.691132:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826414.691137:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81c03 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x26:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.691142:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81c03 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x26:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.691210:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b81bfc lrc: 1/0,0 mode: --/CR res: [0x200000405:0x26:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d3b expref: 59 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.691223:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x26:0x0].0x0 (ffff90cf1859a000) 00010000:00010000:2.0:1787826414.691225:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787826414.691229:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b81bfc lrc: 0/0,0 mode: --/CR res: [0x200000405:0x26:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d3b expref: 59 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.691245:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165ee00, rc 0) 00000100:00100000:2.0:1787826414.691328:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:55509:x1874670563847168:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 8046us (8294us total) trans 8589934868 rc 301/301 00000100:00100000:2.0:1787826414.691338:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3716 00000100:00100000:0.0:1787826414.694284:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826414.694995:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563847552 00000100:00100000:3.0:1787826414.695008:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563847552 00000100:00100000:3.0:1787826414.695080:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1106 00000100:00100000:3.0:1787826414.695092:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:55509:x1874670563847552:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:3.0:1787826414.695853:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55509:x1874670563847552:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 760us (1581us total) trans 8589934869 rc 0/0 00000100:00100000:3.0:1787826414.695865:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1106 00000100:00100000:3.0:1787826414.699287:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826414.699428:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563847680 00000100:00100000:2.0:1787826414.699440:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563847680 00000100:00100000:2.0:1787826414.699686:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3717 00000100:00100000:2.0:1787826414.699699:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab91e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55509:x1874670563847680:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826414.699733:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826414.699764:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b81c11 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0d42 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.699892:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81c18 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.699910:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b81bd9 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d2d expref: 60 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.699920:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81c18 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.699965:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b81bd9 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d2d expref: 60 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.699979:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b81bd9 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d2d expref: 60 pid: 8247 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826414.699996:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aa86940 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1874670585239424:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826414.700101:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce010f5e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787826414.702607:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aa86940 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1874670585239424:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826414.702647:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81c18 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826414.704306:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826414.704814:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563847808 00000100:00100000:0.0:1787826414.704825:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563847808 00010000:00010000:0.0:1787826414.704883:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b81bd9 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d2d expref: 61 pid: 8247 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826414.704934:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1113 00000100:00100000:0.0:1787826414.704945:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab93c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+61:2404:x1874670563847808:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826414.704964:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826414.704972:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b81bd9 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d2d expref: 61 pid: 8247 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.704991:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b81bd9 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d2d expref: 61 pid: 8247 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.705021:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b81bd9 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d2d expref: 61 pid: 8247 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.705043:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826414.705050:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81c18 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.705061:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81c18 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.705070:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81c18 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.705102:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826414.705174:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab93c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:2404:x1874670563847808:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 229us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826414.705183:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1113 00010000:00010000:1.0:1787826414.705832:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81c18 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.705845:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81c18 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826414.705914:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:1.0:1787826414.705920:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826414.705945:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81c18 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.705986:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b81c11 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d42 expref: 60 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.706005:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81c18 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d42 expref: 59 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.706014:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826414.706017:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826414.706020:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835000, rc 0) 00000100:00100000:1.0:1787826414.706077:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab91e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55509:x1874670563847680:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 6381us (6804us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826414.706089:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3717 00000100:00100000:3.0:1787826414.709619:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826414.709736:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563847936 00000100:00100000:2.0:1787826414.709749:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563847936 00000100:00100000:2.0:1787826414.709827:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2051 00000100:00100000:2.0:1787826414.709841:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2402:x1874670563847936:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826414.709865:0:14864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826414.709891:0:14864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9e5b8b8/0x22153cd396b81c1f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0d49 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826414.709972:0:14864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aa86940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14864:1874670585239552:192.168.203.39@tcp:106: 00000100:00100000:2.0:1787826414.710079:0:14864:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce010f5e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787826414.713182:0:14864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aa86940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14864:1874670585239552:192.168.203.39@tcp:106: 00010000:00010000:3.0:1787826414.713249:0:14864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d9e5b8b8/0x22153cd396b81c1f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d49 expref: 14 pid: 14864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.713282:0:14864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9e5b8b8/0x22153cd396b81c1f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d49 expref: 14 pid: 14864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.713298:0:14864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834400, rc 0) 00000100:00100000:3.0:1787826414.713384:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2402:x1874670563847936:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 3545us (3778us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826414.713394:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2051 00000100:00100000:0.0:1787826414.716155:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826414.716286:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563848064 00000100:00100000:1.0:1787826414.716299:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563848064 00000100:00100000:1.0:1787826414.716462:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3718 00000100:00100000:1.0:1787826414.716515:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55509:x1874670563848064:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826414.716541:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826414.716571:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b81c26 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0d50 expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.716666:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b81c2d lrc: 3/1,0 mode: --/PR res: [0x200000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.716683:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b81c2d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x26:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.716697:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b81c2d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x26:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826414.716772:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x26:0x0]: returning size 0 00000004:00200000:1.0:1787826414.716777:0:8247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826414.716802:0:8247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b81c2d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x26:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.716835:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b81c26 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d50 expref: 61 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.716855:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b81c2d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x26:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d50 expref: 60 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.716870:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x26:0x0].0x0 (ffff90cf04f8bb00) 00010000:00010000:1.0:1787826414.716873:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787826414.716878:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46ac00, rc 0) 00000100:00100000:1.0:1787826414.716949:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:55509:x1874670563848064:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 478us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826414.716958:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3718 00000100:00100000:2.0:1787826414.720301:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826414.720406:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563848192 00000100:00100000:0.0:1787826414.720419:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563848192 00000100:00100000:0.0:1787826414.720511:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2052 00000100:00100000:0.0:1787826414.720524:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa86940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2404:x1874670563848192:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826414.720547:0:30694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826414.720577:0:30694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004185bcb5/0x22153cd396b81c34 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x107:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0d57 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826414.720613:0:30694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x107:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826414.720640:0:30694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x107:0x0].0x0 since=1360s v=(0 0) 00010000:00010000:0.0:1787826414.720646:0:30694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x107:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826414.720658:0:30694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004185bcb5/0x22153cd396b81c34 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x107:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d57 expref: 12 pid: 30694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.720679:0:30694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004185bcb5/0x22153cd396b81c34 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x107:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d57 expref: 12 pid: 30694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.720695:0:30694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165ee00, rc 0) 00000100:00100000:0.0:1787826414.720767:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa86940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563848192:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 245us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826414.720774:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2052 00000100:00100000:3.0:1787826414.723135:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826414.724017:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563848448 00000100:00100000:0.0:1787826414.724033:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563848448 00000100:00100000:0.0:1787826414.724111:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3719 00000100:00100000:0.0:1787826414.724123:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab92940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:55509:x1874670563848448:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826414.724150:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826414.724178:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81c3b lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0d5e expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.724329:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81c42 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.724348:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81c42 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.724362:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81c42 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826414.724452:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:0.0:1787826414.724635:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81c3b lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d5e expref: 63 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.724658:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81c42 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d5e expref: 62 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.724668:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826414.724671:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787826414.724675:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165ea00, rc 0) 00000100:00100000:0.0:1787826414.724752:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab92940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+62:55509:x1874670563848448:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 630us (1630us total) trans 8589934870 rc 0/0 00000100:00100000:0.0:1787826414.724761:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3719 00000100:00100000:3.0:1787826414.729676:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826414.729959:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563848576 00000100:00100000:1.0:1787826414.729972:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563848576 00000100:00100000:1.0:1787826414.730050:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2053 00000100:00100000:1.0:1787826414.730062:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf2f794c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2403:x1874670563848576:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826414.730087:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826414.730111:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000951304c9/0x22153cd396b81c50 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0d65 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826414.730205:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf41c84780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1874670585239680:192.168.203.39@tcp:106: 00000100:00100000:1.0:1787826414.730324:0:8437:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf1850cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826414.752025:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf41c84780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1874670585239680:192.168.203.39@tcp:106: 00010000:00010000:1.0:1787826414.752083:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000951304c9/0x22153cd396b81c50 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d65 expref: 14 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.752114:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000951304c9/0x22153cd396b81c50 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d65 expref: 14 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.752131:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46b400, rc 0) 00000100:00100000:1.0:1787826414.752225:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf2f794c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2403:x1874670563848576:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 22165us (22561us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826414.752237:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2053 00000100:00100000:2.0:1787826414.759201:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826414.759300:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563848704 00000100:00100000:1.0:1787826414.759314:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563848704 00000100:00100000:1.0:1787826414.759690:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2054 00000100:00100000:1.0:1787826414.759705:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2403:x1874670563848704:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826414.759730:0:8545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826414.759753:0:8545:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000951304c9/0x22153cd396b81c57 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0d6c expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826414.759832:0:8545:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf41c87c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8545:1874670585239808:192.168.203.39@tcp:106: 00000100:00100000:1.0:1787826414.760756:0:8545:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf1850cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826414.777782:0:8545:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf41c87c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8545:1874670585239808:192.168.203.39@tcp:106: 00010000:00010000:1.0:1787826414.777840:0:8545:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000951304c9/0x22153cd396b81c57 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d6c expref: 14 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.777874:0:8545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000951304c9/0x22153cd396b81c57 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d6c expref: 14 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.777891:0:8545:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46b400, rc 0) 00000100:00100000:1.0:1787826414.778025:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2403:x1874670563848704:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 18322us (18850us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826414.778036:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2054 00000100:00100000:3.0:1787826414.793932:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826414.794199:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563848832 00000100:00100000:0.0:1787826414.794212:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563848832 00000100:00100000:0.0:1787826414.794505:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2055 00000100:00100000:0.0:1787826414.794519:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab930c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2401:x1874670563848832:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:0.0:1787826414.794579:0:30695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b49a3b43/0x22153cd396b81c5e lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.794605:0:30695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e32bc9b1/0x22153cd396b81a89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cc4 expref: 13 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.794622:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x107:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826414.794628:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x107:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826414.794634:0:30695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b49a3b43/0x22153cd396b81c5e lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.800386:0:30695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e32bc9b1/0x22153cd396b81a89 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cc4 expref: 13 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.800420:0:30695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e32bc9b1/0x22153cd396b81a89 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cc4 expref: 13 pid: 30695 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826414.800441:0:30695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce044d12c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:30695:1874670585239936:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826414.800889:0:30695:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e36c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826414.812877:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826414.812910:0:30695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce044d12c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:30695:1874670585239936:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826414.812951:0:30695:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b49a3b43/0x22153cd396b81c5e lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826414.813038:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563848960 00000100:00100000:3.0:1787826414.813047:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563848960 00010000:00010000:3.0:1787826414.813094:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e32bc9b1/0x22153cd396b81a89 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cc4 expref: 14 pid: 30695 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826414.813137:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1114 00000100:00100000:3.0:1787826414.813148:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa85a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563848960:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826414.813166:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826414.813204:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e32bc9b1/0x22153cd396b81a89 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x107:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cc4 expref: 14 pid: 30695 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.813218:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e32bc9b1/0x22153cd396b81a89 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x107:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cc4 expref: 14 pid: 30695 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.813247:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e32bc9b1/0x22153cd396b81a89 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x107:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0cc4 expref: 14 pid: 30695 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.813268:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x107:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826414.813274:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x107:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826414.813281:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b49a3b43/0x22153cd396b81c5e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.813300:0:10340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b49a3b43/0x22153cd396b81c5e lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.813333:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826414.813404:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa85a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2404:x1874670563848960:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 257us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826414.813413:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1114 00010000:00010000:0.0:1787826414.813586:0:30695:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b49a3b43/0x22153cd396b81c5e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x107:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.813596:0:30695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b49a3b43/0x22153cd396b81c5e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x107:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.813626:0:30695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b49a3b43/0x22153cd396b81c5e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x107:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.813633:0:30695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b49a3b43/0x22153cd396b81c5e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x107:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.813641:0:30695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b49a3b43/0x22153cd396b81c5e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x107:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.813650:0:30695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165fa00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826414.813654:0:30695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b49a3b43/0x22153cd396b81c5e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x107:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.813664:0:30695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b49a3b43/0x22153cd396b81c5e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x107:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.813676:0:30695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b49a3b43/0x22153cd396b81c5e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x107:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.813683:0:30695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b49a3b43/0x22153cd396b81c5e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x107:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826414.813733:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab930c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2401:x1874670563848832:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 19219us (19818us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826414.813746:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2055 00000100:00100000:3.0:1787826414.818225:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826414.818332:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563849088 00000100:00100000:1.0:1787826414.818345:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563849088 00000100:00100000:1.0:1787826414.818416:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2056 00000100:00100000:1.0:1787826414.818427:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab93840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2401:x1874670563849088:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826414.818449:0:28853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826414.818515:0:28853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000951304c9/0x22153cd396b81c65 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x107:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0d73 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826414.818548:0:28853:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x107:0x0] initial LVB size: 0, mtime: 0x6a9010ec, atime: 0x6a9010ec, ctime: 0x6a9010ee, blocks: 0x0 00010000:00010000:1.0:1787826414.818576:0:28853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x107:0x0].0x0 since=1360s v=(0 0) 00010000:00010000:1.0:1787826414.818582:0:28853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x107:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826414.818594:0:28853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000951304c9/0x22153cd396b81c65 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x107:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d73 expref: 13 pid: 28853 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.818615:0:28853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000951304c9/0x22153cd396b81c65 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x107:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d73 expref: 13 pid: 28853 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.818631:0:28853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46b400, rc 0) 00000100:00100000:2.0:1787826414.819078:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab93840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2401:x1874670563849088:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 650us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826414.819088:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2056 00000100:00100000:2.0:1787826414.884614:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826414.885209:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563849216 00000100:00100000:0.0:1787826414.885220:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563849216 00000100:00100000:0.0:1787826414.885293:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3720 00000100:00100000:0.0:1787826414.885305:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+62:55509:x1874670563849216:12345-192.168.203.39@tcp:44:lfs.0 00000001:00080000:2.0:1787826414.887647:0:34481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934870 is committed 00000004:00080000:2.0:1787826414.887677:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 26 committed 00000020:00080000:2.0:1787826414.887719:0:34481:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90ce02725f00 refcount 2 committed 0 result 0 batchid 4294969332 00000020:00080000:2.0:1787826414.887725:0:34481:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cf092f4600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90ce02725000 00000020:00080000:2.0:1787826414.887729:0:34481:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cf092f4900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90cf26c05a00 00000020:00080000:2.0:1787826414.887754:0:34481:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969331 batchid updated 00000020:00080000:0.0:1787826414.887946:0:34512:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969332 committed batchid 4294969331 00000020:00080000:0.0:1787826414.888005:0:34512:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969331 00000100:00100000:0.0:1787826414.888136:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:55509:x1874670563849216:12345-192.168.203.39@tcp:44:lfs.0 Request processed in 2829us (3526us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826414.888147:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3720 00000100:00100000:0.0:1787826414.888179:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787826414.888204:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf41c87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585240064:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787826414.888256:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826414.888300:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585240064 00000100:00100000:0.0:1787826414.888307:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585240064 00000100:00100000:0.0:1787826414.888342:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2057 00000100:00100000:0.0:1787826414.888350:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+8:3646:x1874670585240064:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787826414.888735:0:30694:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:262 count 1 00010000:00010000:0.0:1787826414.888760:0:30694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b49a3b43/0x22153cd396b81c6c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.888782:0:30694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000382351a4/0x22153cd396b81a97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ccb expref: 11 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.888792:0:30694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x106:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826414.888797:0:30694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x106:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826414.888802:0:30694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b49a3b43/0x22153cd396b81c6c lrc: 4/0,1 mode: --/PW res: [0x280000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.888830:0:30694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000382351a4/0x22153cd396b81a97 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ccb expref: 11 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.888843:0:30694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000382351a4/0x22153cd396b81a97 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ccb expref: 11 pid: 8436 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826414.888855:0:30694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce044d0b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:30694:1874670585240192:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826414.888915:0:30694:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e36c0 going to sleep for 11 seconds 00010000:00010000:3.0:1787826414.889261:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b81a7b lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x24:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.889271:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b81a7b lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x24:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.889282:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b81a7b lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x24:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.889289:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165ec00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826414.889293:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b81a7b lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x24:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.889309:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b81a7b lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x24:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.889326:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x24:0x0].0x0 (ffff90cf0c7daf00) 00010000:00010000:3.0:1787826414.889329:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826414.889333:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b81a7b lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x24:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.889340:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b81a7b lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x24:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.889367:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81a90 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.889373:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81a90 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.889379:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81a90 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.889383:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826414.889386:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81a90 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.889394:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81a90 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.889401:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826414.889403:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826414.889406:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81a90 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.889411:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81a90 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826414.891092:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826414.891251:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563849344 00000100:00100000:0.0:1787826414.891268:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563849344 00000100:00100000:0.0:1787826414.891331:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2058 00000100:00100000:0.0:1787826414.891341:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa86940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563849344:12345-192.168.203.39@tcp:16:lfs.0 00000100:00100000:0.0:1787826414.891450:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa86940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563849344:12345-192.168.203.39@tcp:16:lfs.0 Request processed in 109us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826414.891458:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2058 00000100:00100000:0.0:1787826414.892255:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826414.892371:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563849472 00000100:00100000:1.0:1787826414.892377:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563849472 00010000:00010000:1.0:1787826414.892405:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000382351a4/0x22153cd396b81a97 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ccb expref: 12 pid: 8436 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826414.892439:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1115 00000100:00100000:1.0:1787826414.892446:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563849472:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826414.892459:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826414.892465:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000382351a4/0x22153cd396b81a97 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x106:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ccb expref: 12 pid: 8436 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.892509:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000382351a4/0x22153cd396b81a97 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x106:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ccb expref: 12 pid: 8436 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.892534:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x106:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826414.892539:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x106:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826414.892546:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b49a3b43/0x22153cd396b81c6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x106:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.892557:0:10341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b49a3b43/0x22153cd396b81c6c lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x106:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.892577:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826414.892614:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563849472:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 168us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826414.892622:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1115 00010000:00010000:2.0:1787826414.893097:0:30694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000382351a4/0x22153cd396b81a97 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ccb expref: 11 pid: 8436 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826414.893114:0:30694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce044d0b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:30694:1874670585240192:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826414.893142:0:30694:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b49a3b43/0x22153cd396b81c6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x106:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.893153:0:30694:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b49a3b43/0x22153cd396b81c6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x106:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.893166:0:30694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b49a3b43/0x22153cd396b81c6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x106:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.893176:0:30694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b49a3b43/0x22153cd396b81c6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x106:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.893194:0:30694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b49a3b43/0x22153cd396b81c6c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x106:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.893221:0:30694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787826414.893412:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+9:3646:x1874670585240064:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5062us (5155us total) trans 21474836999 rc 0/0 00000100:00100000:2.0:1787826414.893420:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2057 00010000:00010000:0.0:1787826414.893691:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826414.893699:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b49a3b43/0x22153cd396b81c6c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x106:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.893708:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165fa00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826414.893712:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b49a3b43/0x22153cd396b81c6c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x106:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.893722:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b49a3b43/0x22153cd396b81c6c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x106:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.893738:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b49a3b43/0x22153cd396b81c6c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x106:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.893747:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b49a3b43/0x22153cd396b81c6c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x106:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.893768:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826414.893770:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826414.893772:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787826414.893888:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf41c87c00/2, rc 0, transno 21474836999 00000100:00100000:1.0:1787826414.893894:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf41c87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585240064:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1787826414.917785:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826414.919350:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826414.923252:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563849600 00000100:00100000:0.0:1787826414.923277:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563849600 00000100:00100000:0.0:1787826414.923345:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2059 00000100:00100000:0.0:1787826414.923356:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2403:x1874670563849600:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:0.0:1787826414.923822:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b49a3b43/0x22153cd396b81c73 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.923838:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x107:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826414.923843:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x107:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826414.923848:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b49a3b43/0x22153cd396b81c73 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.923862:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b49a3b43/0x22153cd396b81c73 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.923889:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b49a3b43/0x22153cd396b81c73 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.923897:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b49a3b43/0x22153cd396b81c73 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.923905:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b49a3b43/0x22153cd396b81c73 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.923913:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165fa00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826414.923917:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b49a3b43/0x22153cd396b81c73 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.923925:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b49a3b43/0x22153cd396b81c73 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.923939:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b49a3b43/0x22153cd396b81c73 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.923948:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b49a3b43/0x22153cd396b81c73 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826414.924025:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2403:x1874670563849600:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 670us (4684us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826414.924033:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2059 00000100:00100000:3.0:1787826414.926761:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826414.926915:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563849856 00000100:00100000:1.0:1787826414.926927:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563849856 00000100:00100000:1.0:1787826414.926983:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3721 00000100:00100000:1.0:1787826414.926993:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab90f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:55509:x1874670563849856:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:1.0:1787826414.927046:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826414.927073:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b81c2d lrc: 0/0,0 mode: --/PR res: [0x200000405:0x26:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d50 expref: 33 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.927093:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x26:0x0].0x0 (ffff90cf04f8bb00) 00010000:00010000:1.0:1787826414.927102:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826414.927134:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b81c7a lrc: 3/0,1 mode: --/PW res: [0x200000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.927148:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b81c7a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.927158:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b81c7a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826414.927304:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a212cf10 reply state 0000000091b51185 transno 8589934871 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b81c7a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.927317:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b81c7a lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826414.927323:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x26:0x0].0x0 (ffff90cf3ab61400) 00010000:00010000:1.0:1787826414.927325:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826414.927328:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826414.927509:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab90f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:55509:x1874670563849856:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 516us (756us total) trans 8589934871 rc 0/0 00000100:00100000:1.0:1787826414.927516:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3721 00000100:00100000:1.0:1787826414.932102:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826414.932194:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563849984 00000100:00100000:0.0:1787826414.932204:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563849984 00000100:00100000:0.0:1787826414.932271:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3722 00000100:00100000:0.0:1787826414.932281:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:55509:x1874670563849984:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826414.932305:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826414.932326:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81c81 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0d7a expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.932391:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81c81 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x26:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d7a expref: 35 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.932406:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81c81 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x26:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d7a expref: 35 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.932423:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x26:0x0].0x0 (ffff90cf3ab61400) 00010000:00010000:0.0:1787826414.932426:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826414.932429:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165fa00, rc 0) 00000100:00100000:0.0:1787826414.932507:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:55509:x1874670563849984:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 227us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826414.932514:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3722 00000100:00100000:1.0:1787826414.939663:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826414.939834:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563850112 00000100:00100000:2.0:1787826414.939844:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563850112 00000100:00100000:2.0:1787826414.939909:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2060 00000100:00100000:2.0:1787826414.939918:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c86d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:55509:x1874670563850112:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826414.939935:0:30398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826414.939953:0:30398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000382351a4/0x22153cd396b81c88 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0d81 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.939986:0:30398:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004185bcb5/0x22153cd396b81c34 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d57 expref: 12 pid: 30694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.939996:0:30398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x107:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826414.940001:0:30398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x107:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826414.940005:0:30398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000382351a4/0x22153cd396b81c88 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d81 expref: 12 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.940041:0:30398:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004185bcb5/0x22153cd396b81c34 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d57 expref: 12 pid: 30694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.940055:0:30398:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004185bcb5/0x22153cd396b81c34 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d57 expref: 12 pid: 30694 timeout: 1460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826414.940068:0:30398:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0300e580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:30398:1874670585240320:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826414.940147:0:30398:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce010f50c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826414.948180:0:30398:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0300e580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:30398:1874670585240320:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826414.948234:0:30398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000382351a4/0x22153cd396b81c88 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d81 expref: 12 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.948257:0:30398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834c00, rc 0) 00000100:00100000:2.0:1787826414.948334:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c86d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:55509:x1874670563850112:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 8416us (8678us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826414.948343:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2060 00000100:00100000:1.0:1787826414.948954:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826414.949024:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563850240 00000100:00100000:3.0:1787826414.949033:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563850240 00010000:00010000:3.0:1787826414.949069:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004185bcb5/0x22153cd396b81c34 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d57 expref: 12 pid: 30694 timeout: 1460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826414.949108:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1116 00000100:00100000:3.0:1787826414.949116:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf185df450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563850240:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826414.949130:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826414.949151:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004185bcb5/0x22153cd396b81c34 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x107:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d57 expref: 12 pid: 30694 timeout: 1460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.949164:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004185bcb5/0x22153cd396b81c34 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x107:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d57 expref: 12 pid: 30694 timeout: 1460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.949202:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004185bcb5/0x22153cd396b81c34 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x107:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d57 expref: 12 pid: 30694 timeout: 1460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.949219:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x107:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826414.949223:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x107:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826414.949229:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000382351a4/0x22153cd396b81c88 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d81 expref: 11 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.949240:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000382351a4/0x22153cd396b81c88 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d81 expref: 11 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826414.949286:0:6505:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000382351a4/0x22153cd396b81c88 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d81 expref: 11 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826414.949301:0:6505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab91680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1874670585240448:192.168.203.39@tcp:105: 00000100:00100000:3.0:1787826414.949373:0:6505:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3ab4cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787826414.954668:0:6505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab91680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1874670585240448:192.168.203.39@tcp:105: 00010000:00010000:3.0:1787826414.954694:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826414.954757:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf185df450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2404:x1874670563850240:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5639us (5803us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826414.954767:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1116 00000100:00100000:0.0:1787826414.956545:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826414.956747:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563850368 00000100:00100000:2.0:1787826414.956756:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563850368 00000100:00100000:2.0:1787826414.956811:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2061 00000100:00100000:2.0:1787826414.956820:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2403:x1874670563850368:12345-192.168.203.39@tcp:2:lfs.0 00002000:00010000:2.0:1787826414.956981:0:28853:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x107:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787826414.956986:0:28853:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x107:0x0] updating lvb mtime from disk: 0 -> 1787826412 00002000:00010000:2.0:1787826414.956988:0:28853:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x107:0x0] updating lvb atime from disk: 0 -> 1787826412 00002000:00010000:2.0:1787826414.956990:0:28853:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x107:0x0] updating lvb ctime from disk: 0 -> 1787826415 00002000:00010000:2.0:1787826414.956993:0:28853:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x107:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1787826414.957048:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563850368:12345-192.168.203.39@tcp:2:lfs.0 Request processed in 229us (508us total) trans 21474837000 rc 0/0 00000100:00100000:2.0:1787826414.957056:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2061 00000100:00100000:1.0:1787826414.964039:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826414.966029:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563850624 00000100:00100000:0.0:1787826414.966043:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563850624 00000100:00100000:0.0:1787826414.966120:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3723 00000100:00100000:0.0:1787826414.966130:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:55509:x1874670563850624:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:0.0:1787826414.966196:0:8247:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826414.966226:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81c18 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d42 expref: 35 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.966248:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826414.966253:0:8247:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826414.966316:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81c8f lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.966331:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81c8f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.966341:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81c8f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826414.966445:0:8247:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ad494c25 reply state 00000000de943ec2 transno 8589934872 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81c8f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.966458:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81c8f lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.966464:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826414.966467:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826414.966518:0:8247:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787826414.966628:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55509:x1874670563850624:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 499us (2597us total) trans 8589934872 rc 0/0 00000100:00100000:0.0:1787826414.966635:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3723 00000100:00100000:0.0:1787826414.970115:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826414.970219:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563850752 00000100:00100000:2.0:1787826414.970229:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563850752 00000100:00100000:2.0:1787826414.970296:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2062 00000100:00100000:2.0:1787826414.970307:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:55509:x1874670563850752:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826414.970325:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826414.970344:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b81c96 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0d88 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.970377:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000951304c9/0x22153cd396b81c65 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d73 expref: 14 pid: 28853 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.970387:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x107:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826414.970392:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x107:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826414.970398:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b81c96 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d88 expref: 14 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.970433:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000951304c9/0x22153cd396b81c65 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d73 expref: 14 pid: 28853 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.970447:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000951304c9/0x22153cd396b81c65 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d73 expref: 14 pid: 28853 timeout: 1460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826414.970463:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0300e580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1874670585240576:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826414.970576:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce010f50c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826414.973367:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0300e580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1874670585240576:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826414.973404:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b81c96 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d88 expref: 14 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.973426:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834a00, rc 0) 00000100:00100000:2.0:1787826414.973798:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:55509:x1874670563850752:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 3491us (3691us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826414.973807:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2062 00000100:00100000:1.0:1787826414.984922:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826414.985033:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563850880 00000100:00100000:0.0:1787826414.985042:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563850880 00010000:00010000:0.0:1787826414.985083:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000951304c9/0x22153cd396b81c65 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d73 expref: 14 pid: 28853 timeout: 1460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826414.985134:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1117 00000100:00100000:0.0:1787826414.985145:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f07840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2403:x1874670563850880:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826414.985161:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826414.985182:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000951304c9/0x22153cd396b81c65 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x107:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d73 expref: 14 pid: 28853 timeout: 1460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.985207:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000951304c9/0x22153cd396b81c65 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x107:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d73 expref: 14 pid: 28853 timeout: 1460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.985232:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000951304c9/0x22153cd396b81c65 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x107:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d73 expref: 14 pid: 28853 timeout: 1460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.985251:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x107:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826414.985255:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x107:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826414.985262:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b81c96 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d88 expref: 13 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.985272:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b81c96 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d88 expref: 13 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826414.985321:0:6503:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b81c96 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d88 expref: 13 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826414.985339:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce044d0b40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6503:1874670585240704:192.168.203.39@tcp:105: 00000100:00100000:0.0:1787826414.985423:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826414.987992:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce044d0b40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6503:1874670585240704:192.168.203.39@tcp:105: 00010000:00010000:1.0:1787826414.988022:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826414.988076:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f07840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2403:x1874670563850880:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 2932us (3163us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826414.988087:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1117 00000100:00100000:3.0:1787826414.988805:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826414.988881:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563851008 00000100:00100000:1.0:1787826414.988889:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563851008 00000100:00100000:1.0:1787826414.988940:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2063 00000100:00100000:1.0:1787826414.988949:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab92580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2404:x1874670563851008:12345-192.168.203.39@tcp:2:lfs.0 00002000:00010000:1.0:1787826414.989092:0:8437:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x107:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787826414.989096:0:8437:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x107:0x0] updating lvb mtime from disk: 1787826412 -> 1787826412 00002000:00010000:1.0:1787826414.989098:0:8437:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x107:0x0] updating lvb atime from disk: 1787826412 -> 1787826412 00002000:00010000:1.0:1787826414.989101:0:8437:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x107:0x0] updating lvb ctime from disk: 1787826414 -> 1787826415 00002000:00010000:1.0:1787826414.989103:0:8437:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x107:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1787826414.989178:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab92580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563851008:12345-192.168.203.39@tcp:2:lfs.0 Request processed in 229us (375us total) trans 17179869659 rc 0/0 00000100:00100000:1.0:1787826414.989196:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2063 00000100:00100000:1.0:1787826414.997983:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826414.998058:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563851264 00000100:00100000:2.0:1787826414.998067:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563851264 00000100:00100000:2.0:1787826414.998126:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1107 00000100:00100000:2.0:1787826414.998136:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf39578c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55509:x1874670563851264:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:2.0:1787826414.998223:0:6522:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000405:0x1d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81c42 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d5e expref: 36 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.998267:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b81c9d lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.998277:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b81b70 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d0a expref: 36 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.998286:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b81bbd lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d1f expref: 36 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.998294:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b81c9d lrc: 5/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.998339:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b81bbd lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d1f expref: 36 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.998353:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b81bbd lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d1f expref: 36 pid: 6520 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826414.998366:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0300e580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585240832:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826414.998454:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b81b70 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d0a expref: 36 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826414.998463:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b81b70 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d0a expref: 36 pid: 6518 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826414.998505:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0300d680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585240960:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826414.998532:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce010f50c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826415.002572:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826415.002607:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826415.002770:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563851648 00000100:00100000:1.0:1787826415.002779:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563851648 00000100:00100000:1.0:1787826415.002842:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1108 00000100:00100000:1.0:1787826415.002853:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:49796:x1874670563851648:12345-192.168.203.39@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787826415.003064:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:49796:x1874670563851648:12345-192.168.203.39@tcp:35:ldlm_bl.0 Request processed in 212us (455us total) trans 8589934873 rc 0/0 00000100:00100000:1.0:1787826415.003072:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1108 00000100:00080000:0.0:1787826415.003156:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787826415.003249:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0300e580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585240832:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826415.003261:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0300d680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585240960:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826415.003289:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b81c9d lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826415.003694:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563851392 00000100:00100000:3.0:1787826415.003700:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563851392 00010000:00010000:3.0:1787826415.003726:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b81b70 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d0a expref: 38 pid: 6518 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826415.003756:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1118 00000100:00100000:3.0:1787826415.003763:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:2404:x1874670563851392:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826415.003774:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826415.003780:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b81b70 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d0a expref: 38 pid: 6518 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.003792:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b81b70 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d0a expref: 38 pid: 6518 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.003813:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b81b70 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d0a expref: 38 pid: 6518 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.003828:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826415.003833:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b81c9d lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.003842:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b81c9d lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.003848:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826415.003871:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:2404:x1874670563851392:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 109us (1309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826415.003877:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1118 00000100:00100000:0.0:1787826415.010073:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826415.010727:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563851776 00000100:00100000:3.0:1787826415.010739:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563851776 00010000:00010000:3.0:1787826415.010785:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b81bbd lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d1f expref: 37 pid: 6520 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826415.010831:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1119 00000100:00100000:3.0:1787826415.010841:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:2404:x1874670563851776:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826415.010856:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826415.010863:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b81bbd lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d1f expref: 37 pid: 6520 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.010876:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b81bbd lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d1f expref: 37 pid: 6520 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.010910:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b81bbd lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d1f expref: 37 pid: 6520 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.010927:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826415.010933:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b81c9d lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.010942:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b81c9d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.010950:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b81c9d lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.010977:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826415.011034:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:2404:x1874670563851776:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 194us (972us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826415.011045:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1119 00010000:00010000:0.0:1787826415.011121:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b81c9d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.011129:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b81c9d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.011150:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b81ca4 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.011161:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81c81 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x26:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d7a expref: 35 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.011168:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b81ca4 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x26:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.011209:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81c81 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x26:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d7a expref: 35 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.011221:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81c81 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x26:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d7a expref: 35 pid: 16564 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826415.011235:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf361e6d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585241088:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826415.011289:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3540 going to sleep for 11 seconds 00000100:00100000:0.0:1787826415.023936:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf361e6d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585241088:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826415.023966:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b81ca4 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x26:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826415.026261:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826415.026617:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563851904 00000100:00100000:0.0:1787826415.026627:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563851904 00010000:00010000:0.0:1787826415.026669:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81c81 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x26:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d7a expref: 36 pid: 16564 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826415.026715:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1120 00000100:00100000:0.0:1787826415.026724:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f05e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:2404:x1874670563851904:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826415.026738:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826415.026744:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81c81 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x26:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d7a expref: 36 pid: 16564 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.026756:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81c81 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x26:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d7a expref: 36 pid: 16564 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.026778:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81c81 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x26:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d7a expref: 36 pid: 16564 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.026793:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x26:0x0].0x0 (ffff90cf3ab61400) 00010000:00010000:0.0:1787826415.026798:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b81ca4 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x26:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.026808:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b81ca4 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x26:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.026816:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b81ca4 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x26:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.026841:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826415.026896:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f05e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:2404:x1874670563851904:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 172us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826415.026916:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1120 00010000:00010000:0.0:1787826415.026943:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b81ca4 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x26:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.026951:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b81ca4 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x26:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826415.027244:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf361e6d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1874670585241216:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787826415.027291:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826415.027321:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3780 going to sleep for 11 seconds 00000100:00100000:0.0:1787826415.027341:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585241216 00000100:00100000:0.0:1787826415.027344:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585241216 00000100:00100000:0.0:1787826415.027599:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1437 00000100:00100000:0.0:1787826415.027607:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+10:6522:x1874670585241216:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787826415.027683:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+10:6522:x1874670585241216:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 77us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826415.027691:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1437 00000100:00100000:0.0:1787826415.027725:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf361e6d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1874670585241216:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787826415.027764:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf361e6d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1874670585241344:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787826415.027788:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826415.027805:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3540 going to sleep for 11 seconds 00000100:00100000:2.0:1787826415.027916:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585241344 00000100:00100000:2.0:1787826415.027920:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585241344 00000100:00080000:1.0:1787826415.028182:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787826415.028196:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826415.032546:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1438 00000100:00100000:2.0:1787826415.032561:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:6522:x1874670585241344:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787826415.032687:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:6522:x1874670585241344:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 130us (4898us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826415.032696:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1438 00000100:00100000:0.0:1787826415.032868:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf361e6d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1874670585241344:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787826415.033008:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934874 00000100:00100000:0.0:1787826415.033077:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf361e6d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1874670585241472:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787826415.033115:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826415.033138:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826415.033314:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585241472 00000100:00100000:2.0:1787826415.033321:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585241472 00000100:00100000:2.0:1787826415.033367:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1439 00000100:00100000:2.0:1787826415.033375:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:6522:x1874670585241472:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787826415.033610:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+10:6522:x1874670585241472:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 235us (494us total) trans 21474837001 rc 0/0 00000100:00100000:2.0:1787826415.033618:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1439 00000100:00100000:1.0:1787826415.033683:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf361e6d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1874670585241472:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787826415.033741:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934875 00010000:00010000:1.0:1787826415.033766:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b81ca4 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x26:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.033776:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b81ca4 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x26:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.033783:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b81ca4 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x26:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.033789:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165ee00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826415.033794:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b81ca4 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x26:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.033802:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b81ca4 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x26:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.033819:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x26:0x0].0x0 (ffff90cf3ab61400) 00010000:00010000:1.0:1787826415.033822:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787826415.033827:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b81ca4 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x26:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.033833:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b81ca4 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x26:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.033847:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b81c9d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.033853:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b81c9d lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.033865:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b81c9d lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.033870:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826415.033873:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b81c9d lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.033879:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b81c9d lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.033887:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826415.033889:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787826415.033892:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b81c9d lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.033898:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b81c9d lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.033909:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826415.033911:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787826415.033918:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81c42 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d5e expref: 37 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826415.033999:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf39578c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55509:x1874670563851264:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 35864us (36024us total) trans 8589934876 rc 0/0 00000100:00100000:1.0:1787826415.034008:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1107 00000020:00080000:1.0:1787826415.034011:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1787826415.041656:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826415.041766:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563852032 00000100:00100000:0.0:1787826415.041776:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563852032 00000100:00100000:0.0:1787826415.041835:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3724 00000100:00100000:0.0:1787826415.041844:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55509:x1874670563852032:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826415.041868:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826415.041889:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b81cab lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0d8f expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.041942:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b81cab lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d8f expref: 37 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.041958:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b81cab lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d8f expref: 37 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.041975:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826415.041978:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826415.041982:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165e400, rc 0) 00000100:00100000:0.0:1787826415.042032:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:55509:x1874670563852032:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 189us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826415.042039:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3724 00000100:00100000:2.0:1787826415.050618:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826415.050772:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563852288 00000100:00100000:1.0:1787826415.050782:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563852288 00000100:00100000:1.0:1787826415.050844:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1109 00000100:00100000:1.0:1787826415.050854:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:55509:x1874670563852288:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:1.0:1787826415.051067:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:55509:x1874670563852288:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 214us (457us total) trans 8589934877 rc 0/0 00000100:00100000:1.0:1787826415.051076:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1109 00000100:00100000:2.0:1787826415.055902:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826415.055973:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563852544 00000100:00100000:1.0:1787826415.055983:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563852544 00000100:00100000:1.0:1787826415.056041:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1110 00000100:00100000:1.0:1787826415.056051:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:55509:x1874670563852544:12345-192.168.203.39@tcp:35:lfs.0 00000004:00080000:1.0:1787826415.056250:0:6522:0:(mdd_object.c:4014:mdd_close()) Object [0x200000405:0x26:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:1.0:1787826415.056329:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b81cb2 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.056345:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b81cb2 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.056357:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b81cb2 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.056366:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b81cb2 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.056372:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b81cb2 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.056378:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b81cb2 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.056403:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787826415.056522:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+39:55509:x1874670563852544:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 471us (626us total) trans 8589934878 rc 0/0 00000100:00100000:1.0:1787826415.056530:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1110 00010000:00010000:0.0:1787826415.056773:0:7460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826415.056780:0:7460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b81cb2 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.056787:0:7460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46b000 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826415.056791:0:7460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b81cb2 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.056798:0:7460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b81cb2 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.056810:0:7460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x26:0x0].0x0 (ffff90cf3ab61400) 00010000:00010000:0.0:1787826415.056813:0:7460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787826415.056817:0:7460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b81cb2 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.056822:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b81cb2 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.056834:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826415.056835:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826415.056836:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826415.105526:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826415.105613:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563852672 00000100:00100000:3.0:1787826415.105623:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563852672 00000100:00100000:3.0:1787826415.105670:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3725 00000100:00100000:3.0:1787826415.105679:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+39:55511:x1874670563852672:12345-192.168.203.39@tcp:101:getfattr.0 00010000:00010000:3.0:1787826415.105700:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826415.105721:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b81cb9 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0d96 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.105776:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b81cc0 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.105789:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b81cc0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.105799:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b81cc0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.105813:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b81cc7 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.105820:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b81cc7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.105827:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b81cc7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.105896:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81cce lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.105910:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81cce lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.105917:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81cce lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826415.105953:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:3.0:1787826415.105957:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826415.105973:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81cce lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.105983:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81cce lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.105991:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b81cc0 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.105997:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b81cc0 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.106003:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b81cc0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.106008:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b81cc0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.106013:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401e00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826415.106017:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b81cc0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.106024:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b81cc0 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.106039:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf39656600) 00010000:00010000:3.0:1787826415.106042:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826415.106047:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b81cc0 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.106053:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b81cc0 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.106068:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b81cc7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.106074:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b81cc7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.106080:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b81cc7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.106085:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826415.106088:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b81cc7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.106094:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b81cc7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.106101:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf39656200) 00010000:00010000:3.0:1787826415.106103:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826415.106105:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b81cc7 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.106111:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b81cc7 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.106144:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b81cb9 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d96 expref: 41 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.106158:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81cce lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d96 expref: 40 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.106165:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826415.106167:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826415.106169:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401a00, rc 0) 00000100:00100000:3.0:1787826415.106238:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55511:x1874670563852672:12345-192.168.203.39@tcp:101:getfattr.0 Request processed in 559us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826415.106244:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3725 00000100:00100000:1.0:1787826415.179989:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826415.180393:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563852800 00000100:00100000:2.0:1787826415.180406:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563852800 00000100:00100000:2.0:1787826415.180536:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3726 00000100:00100000:2.0:1787826415.180548:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f05680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55515:x1874670563852800:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:2.0:1787826415.180649:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81cd5 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.180670:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81cd5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.180685:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81cd5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.180706:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b81cdc lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.180714:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b81cdc lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.180721:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b81cdc lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.181629:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81ce3 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.181651:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81ce3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.181662:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81ce3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826415.181718:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:2.0:1787826415.181724:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826415.181740:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81ce3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.181844:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81cd5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.181853:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81cd5 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.181861:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81cd5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.181872:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826415.181876:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81cd5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.181885:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81cd5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.181901:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf39e67400) 00010000:00010000:2.0:1787826415.181904:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826415.181909:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81cd5 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.181915:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81cd5 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.181939:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b81cdc lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.181945:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b81cdc lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.181950:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b81cdc lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.181955:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826415.181958:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b81cdc lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.181963:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b81cdc lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.181974:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf39e67800) 00010000:00010000:2.0:1787826415.181976:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826415.181979:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b81cdc lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.181984:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b81cdc lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.181995:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81ce3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.182000:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81ce3 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.182005:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81ce3 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.182011:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826415.182014:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81ce3 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.182020:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81ce3 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.182026:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826415.182029:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826415.182032:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81ce3 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.182037:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81ce3 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826415.182645:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f05680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55515:x1874670563852800:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 2091us (2664us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826415.182657:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3726 00000100:00100000:2.0:1787826415.203785:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826415.204549:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563853056 00000100:00100000:1.0:1787826415.204563:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563853056 00000100:00100000:1.0:1787826415.204653:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3727 00000100:00100000:1.0:1787826415.204665:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55517:x1874670563853056:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826415.204694:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826415.204720:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b81cea lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0d9d expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.204868:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b81cf1 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.204887:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b81cf1 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.204902:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b81cf1 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826415.204917:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:1.0:1787826415.206661:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b81cea lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d9d expref: 43 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.206701:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b81cf1 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d9d expref: 42 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.206713:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826415.206717:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787826415.206722:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46bc00, rc 0) 00000100:00100000:1.0:1787826415.206903:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+42:55517:x1874670563853056:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 2238us (3133us total) trans 8589934879 rc 0/0 00000100:00100000:1.0:1787826415.206914:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3727 00000100:00100000:1.0:1787826415.223015:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826415.223378:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563853312 00000100:00100000:3.0:1787826415.223392:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563853312 00000100:00100000:3.0:1787826415.223468:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3728 00000100:00100000:3.0:1787826415.223509:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+42:55517:x1874670563853312:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826415.223543:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826415.223572:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b81cff lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0da4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.223719:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b81d06 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.223738:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81cce lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d96 expref: 43 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.223748:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b81d06 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.223995:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81cce lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d96 expref: 43 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.224013:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81cce lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d96 expref: 43 pid: 6519 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826415.224029:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab93c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1874670585241600:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826415.224330:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3ab4c300 going to sleep for 11 seconds 00000100:00100000:2.0:1787826415.230742:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826415.230844:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563853440 00000100:00100000:0.0:1787826415.230855:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563853440 00010000:00010000:0.0:1787826415.230922:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81cce lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d96 expref: 44 pid: 6519 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826415.230979:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1121 00000100:00100000:0.0:1787826415.230992:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:2404:x1874670563853440:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826415.231017:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826415.231026:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81cce lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d96 expref: 44 pid: 6519 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.231048:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81cce lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d96 expref: 44 pid: 6519 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.231081:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826415.231088:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b81d06 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.231101:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b81d06 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.231111:0:10340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b81d06 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.231138:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826415.231230:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:2404:x1874670563853440:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 241us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826415.231240:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1121 00010000:00010000:3.0:1787826415.233641:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81cce lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d96 expref: 43 pid: 6519 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826415.233672:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab93c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1874670585241600:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826415.233702:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b81d06 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.233715:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b81d06 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.233722:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b81d06 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826415.233755:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:3.0:1787826415.234140:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b81cff lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0da4 expref: 44 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.234234:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b81d06 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0da4 expref: 43 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.234251:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826415.234255:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787826415.234259:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401600, rc 0) 00000100:00100000:3.0:1787826415.234603:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55517:x1874670563853312:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 11093us (11600us total) trans 8589934880 rc 0/0 00000100:00100000:3.0:1787826415.234612:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3728 00000100:00100000:2.0:1787826415.238315:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826415.238744:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563853568 00000100:00100000:3.0:1787826415.238759:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563853568 00000100:00100000:3.0:1787826415.239703:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1111 00000100:00100000:3.0:1787826415.239723:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55517:x1874670563853568:12345-192.168.203.39@tcp:33:lfs.0 00000100:00100000:3.0:1787826415.239950:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55517:x1874670563853568:12345-192.168.203.39@tcp:33:lfs.0 Request processed in 235us (1650us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826415.239959:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1111 00000100:00100000:1.0:1787826415.243697:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826415.243779:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563853824 00000100:00100000:3.0:1787826415.243792:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563853824 00000100:00100000:3.0:1787826415.243859:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1112 00000100:00100000:3.0:1787826415.243872:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55517:x1874670563853824:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:3.0:1787826415.244233:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55517:x1874670563853824:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 362us (549us total) trans 8589934881 rc 0/0 00000100:00100000:3.0:1787826415.244243:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1112 00000100:00100000:2.0:1787826415.248294:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826415.248606:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563854080 00000100:00100000:0.0:1787826415.248622:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563854080 00000100:00100000:0.0:1787826415.248710:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3729 00000100:00100000:0.0:1787826415.248722:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55517:x1874670563854080:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826415.248755:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826415.248759:0:16564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:0.0:1787826415.248795:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b81d06 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0da4 expref: 44 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.248820:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b81cf1 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d9d expref: 43 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.248834:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826415.248841:0:16564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826415.248858:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81d14 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0dab expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.249027:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b81d1b lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.249043:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b81d1b lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.249054:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b81d1b lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826415.249068:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:0.0:1787826415.249216:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81d14 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0dab expref: 45 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.249233:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b81d1b lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0dab expref: 44 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.249241:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826415.249245:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787826415.249247:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165e000, rc 0) 00000100:00100000:0.0:1787826415.249938:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55517:x1874670563854080:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1213us (1653us total) trans 8589934882 rc 0/0 00000100:00100000:0.0:1787826415.249950:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3729 00000100:00100000:2.0:1787826415.259491:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826415.259791:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563854336 00000100:00100000:3.0:1787826415.259805:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563854336 00000100:00100000:3.0:1787826415.259886:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1113 00000100:00100000:3.0:1787826415.259898:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3957b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55517:x1874670563854336:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:3.0:1787826415.260002:0:6521:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000405:0x1d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b81d1b lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0dab expref: 44 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.260054:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b81d29 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.260069:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b81cab lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d8f expref: 44 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.260079:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b81d29 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.260121:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b81cab lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d8f expref: 44 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.260138:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b81cab lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d8f expref: 44 pid: 9966 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826415.260156:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab93c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1874670585241728:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826415.260277:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3ab4c840 going to sleep for 11 seconds 00000100:00100000:1.0:1787826415.265614:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826415.266331:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab93c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1874670585241728:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826415.266386:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b81d29 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826415.266597:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563854464 00000100:00100000:0.0:1787826415.266607:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563854464 00010000:00010000:0.0:1787826415.266663:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b81cab lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d8f expref: 45 pid: 9966 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826415.266715:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1122 00000100:00100000:0.0:1787826415.266726:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab16940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+45:2403:x1874670563854464:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826415.266746:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826415.266765:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b81cab lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d8f expref: 45 pid: 9966 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.266780:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b81cab lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d8f expref: 45 pid: 9966 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.266809:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b81cab lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d8f expref: 45 pid: 9966 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.266828:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826415.266834:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b81d29 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.266846:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b81d29 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.266854:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b81d29 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.266882:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826415.266954:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab16940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:2403:x1874670563854464:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 229us (1359us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826415.266963:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1122 00010000:00010000:3.0:1787826415.267288:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b81d29 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.267297:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b81d29 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.267583:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b81d29 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.267593:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b81d29 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.267600:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b81d29 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.267607:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826415.267612:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b81d29 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.267620:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b81d29 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.267633:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826415.267636:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787826415.267641:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b81d29 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.267647:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b81d29 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.267659:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826415.267661:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787826415.267667:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b81d1b lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0dab expref: 43 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826415.268221:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3957b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55517:x1874670563854336:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 8320us (8764us total) trans 8589934883 rc -22/-22 00000100:00100000:3.0:1787826415.268236:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1113 00000100:00100000:2.0:1787826415.271284:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826415.271460:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563854592 00000100:00100000:0.0:1787826415.271507:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563854592 00000100:00100000:0.0:1787826415.271580:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3730 00000100:00100000:0.0:1787826415.271592:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55517:x1874670563854592:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826415.271624:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826415.271651:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81d30 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0db2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.271730:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81d30 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0db2 expref: 44 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.271749:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81d30 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0db2 expref: 44 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.271771:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826415.271774:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826415.271779:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165fa00, rc 0) 00000100:00100000:0.0:1787826415.271850:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55517:x1874670563854592:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 260us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826415.271859:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3730 00000100:00100000:2.0:1787826415.279386:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826415.280981:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563854848 00000100:00100000:1.0:1787826415.281002:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563854848 00000100:00100000:1.0:1787826415.281101:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3731 00000100:00100000:1.0:1787826415.281114:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55517:x1874670563854848:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826415.281141:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826415.281175:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b81d37 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0db9 expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.281903:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b81d3e lrc: 3/1,0 mode: --/PR res: [0x200000405:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.281922:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b81d3e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.281935:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b81d3e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826415.281947:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x27:0x0]: returning size 0 00010000:00010000:1.0:1787826415.282005:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b81d37 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0db9 expref: 47 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.282040:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b81d3e lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0db9 expref: 46 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.282051:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x27:0x0].0x0 (ffff90cf3ab61f00) 00010000:00010000:1.0:1787826415.282054:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826415.282058:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46b200, rc 0) 00000100:00100000:1.0:1787826415.282322:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+46:55517:x1874670563854848:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1208us (2965us total) trans 8589934884 rc 0/0 00000100:00100000:1.0:1787826415.282332:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3731 00000100:00100000:1.0:1787826415.290704:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826415.291340:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563855104 00000100:00100000:3.0:1787826415.291363:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563855104 00000100:00100000:3.0:1787826415.291634:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3732 00000100:00100000:3.0:1787826415.291649:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+46:55517:x1874670563855104:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826415.291687:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826415.291718:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b81d4c lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0dc0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.292227:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b81d53 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.292249:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b81d53 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.292263:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b81d53 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826415.292277:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:2.0:1787826415.292452:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b81d4c lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0dc0 expref: 49 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.292516:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b81d53 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0dc0 expref: 48 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.292526:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826415.292530:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787826415.292535:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834400, rc 0) 00000100:00100000:2.0:1787826415.292738:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55517:x1874670563855104:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1091us (2048us total) trans 8589934885 rc 0/0 00000100:00100000:2.0:1787826415.292747:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3732 00000100:00100000:0.0:1787826415.297048:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826415.297157:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563855360 00000100:00100000:1.0:1787826415.297172:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563855360 00000100:00100000:1.0:1787826415.297261:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1114 00000100:00100000:1.0:1787826415.297273:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55517:x1874670563855360:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:1.0:1787826415.297400:0:6522:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000405:0x1d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b81d53 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0dc0 expref: 48 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.297451:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b81d61 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.297465:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81d30 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0db2 expref: 48 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.297720:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b81d61 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.297780:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81d30 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0db2 expref: 48 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.297797:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81d30 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0db2 expref: 48 pid: 6518 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826415.297815:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab16580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585241856:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826415.297924:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3300 going to sleep for 11 seconds 00000100:00100000:0.0:1787826415.301405:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826415.301753:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563855488 00000100:00100000:3.0:1787826415.301775:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563855488 00010000:00010000:3.0:1787826415.301836:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81d30 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0db2 expref: 49 pid: 6518 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826415.301878:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1123 00000100:00100000:3.0:1787826415.301889:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf185dec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:2403:x1874670563855488:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826415.301909:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826415.301916:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81d30 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0db2 expref: 49 pid: 6518 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.301931:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81d30 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0db2 expref: 49 pid: 6518 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.301961:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826415.301968:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b81d61 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.301985:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b81d61 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.301993:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b81d61 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.302015:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826415.302088:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf185dec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:2403:x1874670563855488:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 200us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826415.302096:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1123 00010000:00010000:1.0:1787826415.303832:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81d30 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0db2 expref: 48 pid: 6518 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826415.303864:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab16580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585241856:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826415.303902:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b81d61 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.303914:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b81d61 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.303919:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b81d61 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.303952:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b81d68 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.303968:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b81d3e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0db9 expref: 47 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.303978:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b81d68 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x27:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.304024:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b81d3e lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0db9 expref: 47 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.304043:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b81d3e lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0db9 expref: 47 pid: 32404 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826415.304060:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab16580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585241984:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826415.304413:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3300 going to sleep for 11 seconds 00000100:00100000:0.0:1787826415.308955:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826415.309095:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab16580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585241984:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826415.309138:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b81d68 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x27:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826415.309243:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563855616 00000100:00100000:2.0:1787826415.309252:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563855616 00010000:00010000:2.0:1787826415.309302:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b81d3e lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0db9 expref: 48 pid: 32404 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826415.309346:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1124 00000100:00100000:2.0:1787826415.309365:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:2403:x1874670563855616:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826415.309390:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826415.309399:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b81d3e lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0db9 expref: 48 pid: 32404 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.309412:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b81d3e lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0db9 expref: 48 pid: 32404 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.309439:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b81d3e lrc: 0/0,0 mode: --/PR res: [0x200000405:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0db9 expref: 48 pid: 32404 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.309457:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x27:0x0].0x0 (ffff90cf3ab61f00) 00010000:00010000:2.0:1787826415.309462:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b81d68 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x27:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.309777:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b81d68 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x27:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.309788:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b81d68 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x27:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.309818:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826415.309892:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+47:2403:x1874670563855616:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 535us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826415.309900:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1124 00010000:00010000:1.0:1787826415.310010:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b81d68 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x27:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.310018:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b81d68 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x27:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826415.310817:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab16580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1874670585242112:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787826415.310889:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826415.310934:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3f7d8000 going to sleep for 11 seconds 00000100:00100000:3.0:1787826415.311785:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585242112 00000100:00100000:3.0:1787826415.311797:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585242112 00000100:00100000:3.0:1787826415.311857:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1440 00000100:00100000:3.0:1787826415.311868:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+10:6522:x1874670585242112:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787826415.312010:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+10:6522:x1874670585242112:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 143us (1119us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826415.312018:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1440 00000100:00100000:1.0:1787826415.313024:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab16580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1874670585242112:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787826415.313133:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934886 00000001:00080000:1.0:1787826415.313265:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934887 00010000:00010000:1.0:1787826415.313293:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b81d68 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x27:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.313310:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b81d68 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x27:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.313331:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b81d68 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x27:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.313338:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46ba00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826415.313343:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b81d68 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x27:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.313352:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b81d68 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x27:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.314668:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x27:0x0].0x0 (ffff90cf3ab61f00) 00010000:00010000:1.0:1787826415.314680:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787826415.314689:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b81d68 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x27:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.314698:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b81d68 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x27:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.314730:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b81d61 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.314736:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b81d61 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.314743:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b81d61 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.314748:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46ae00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826415.314754:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b81d61 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.314772:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b81d61 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.314782:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826415.314785:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787826415.314788:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b81d61 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.314793:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b81d61 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.314810:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826415.314812:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787826415.314821:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b81d53 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0dc0 expref: 49 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826415.314984:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55517:x1874670563855360:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 17712us (17950us total) trans 8589934888 rc 0/0 00000100:00100000:1.0:1787826415.314996:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1114 00000020:00080000:1.0:1787826415.315004:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1787826415.319442:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826415.319730:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563855744 00000100:00100000:2.0:1787826415.319742:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563855744 00000100:00100000:2.0:1787826415.319825:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3733 00000100:00100000:2.0:1787826415.319854:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55517:x1874670563855744:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826415.319889:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826415.319914:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b81d6f lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0dc7 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.319990:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b81d6f lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0dc7 expref: 49 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.320008:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b81d6f lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0dc7 expref: 49 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.320031:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826415.320034:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826415.320038:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835c00, rc 0) 00000100:00100000:2.0:1787826415.321280:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:55517:x1874670563855744:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1417us (1842us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826415.321294:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3733 00000100:00100000:3.0:1787826415.325008:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826415.325758:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563856000 00000100:00100000:0.0:1787826415.325774:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563856000 00000100:00100000:0.0:1787826415.325868:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1115 00000100:00100000:0.0:1787826415.325880:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab93c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:55517:x1874670563856000:12345-192.168.203.39@tcp:35:lfs.0 00000004:00080000:0.0:1787826415.327278:0:6521:0:(mdd_object.c:4014:mdd_close()) Object [0x200000405:0x27:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787826415.327431:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].26, 64 off10336 00000004:00080000:0.0:1787826415.327447:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1361338974702ns, next at 1362338971706ns, rc = 0 00000001:00080000:0.0:1787826415.327455:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934889 00010000:00010000:0.0:1787826415.327713:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81d76 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.327736:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81d76 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.327751:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81d76 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.327772:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81d76 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.327780:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81d76 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.327786:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81d76 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.327813:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787826415.327851:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826415.327860:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81d76 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.327869:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165fa00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:1.0:1787826415.327873:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81d76 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.327888:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81d76 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.327904:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x27:0x0].0x0 (ffff90cf0c7da900) 00010000:00010000:1.0:1787826415.327907:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787826415.327912:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81d76 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.327918:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81d76 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.327941:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826415.327943:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826415.327945:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826415.328364:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab93c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+51:55517:x1874670563856000:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 2479us (3364us total) trans 8589934890 rc 0/0 00000100:00100000:0.0:1787826415.328377:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1115 00000020:00080000:0.0:1787826415.328384:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787826415.331026:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826415.331276:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563856256 00000100:00100000:1.0:1787826415.331289:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563856256 00000100:00100000:1.0:1787826415.331580:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1116 00000100:00100000:1.0:1787826415.331592:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab91680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+51:55517:x1874670563856256:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:1.0:1787826415.331894:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab91680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+52:55517:x1874670563856256:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 303us (884us total) trans 8589934891 rc 0/0 00000100:00100000:1.0:1787826415.331903:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1116 00000100:00100000:2.0:1787826415.357242:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826415.357377:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563856384 00000100:00100000:0.0:1787826415.357392:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563856384 00000100:00100000:0.0:1787826415.357526:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3734 00000100:00100000:0.0:1787826415.357539:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+52:55519:x1874670563856384:12345-192.168.203.39@tcp:101:getfattr.0 00010000:00010000:0.0:1787826415.357574:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826415.357605:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b81d7d lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0dce expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.357693:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b81d84 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.357710:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b81d84 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.357724:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b81d84 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.357739:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81d8b lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.357747:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81d8b lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.357753:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81d8b lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.357857:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b81d92 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.357867:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b81d92 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.357873:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b81d92 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826415.357931:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:0.0:1787826415.357936:0:9966:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826415.357962:0:9966:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b81d92 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.357976:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b81d92 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.357986:0:9966:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b81d84 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.357993:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b81d84 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.357999:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b81d84 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.358005:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b81d84 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.358011:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165e000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826415.358016:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b81d84 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.358024:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b81d84 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.358038:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf0c7da900) 00010000:00010000:0.0:1787826415.358042:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826415.358047:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b81d84 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.358058:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b81d84 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.358074:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81d8b lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.358079:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81d8b lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.358085:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81d8b lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.358091:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165ea00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826415.358094:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81d8b lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.358099:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81d8b lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.358107:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf0c7daf00) 00010000:00010000:0.0:1787826415.358110:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826415.358112:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81d8b lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.358118:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81d8b lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.358154:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b81d7d lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0dce expref: 54 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.358172:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b81d92 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0dce expref: 53 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.358180:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826415.358193:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826415.358196:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165ee00, rc 0) 00000100:00100000:0.0:1787826415.358274:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55519:x1874670563856384:12345-192.168.203.39@tcp:101:getfattr.0 Request processed in 737us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826415.358281:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3734 00000100:00100000:0.0:1787826415.367328:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826415.368269:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563856512 00000100:00100000:1.0:1787826415.368287:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563856512 00000100:00080000:0.0:1787826415.368466:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826415.368772:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2064 00000100:00100000:1.0:1787826415.368787:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2401:x1874670563856512:12345-192.168.203.39@tcp:101:getfattr.0 00010000:00010000:1.0:1787826415.368811:0:8545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826415.368837:0:8545:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000816b8b1f/0x22153cd396b81d99 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0dd5 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826415.368923:0:8545:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab16580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8545:1874670585242240:192.168.203.39@tcp:106: 00000100:00100000:1.0:1787826415.369047:0:8545:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3f7d8780 going to sleep for 11 seconds 00000100:00100000:1.0:1787826415.374091:0:8545:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab16580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8545:1874670585242240:192.168.203.39@tcp:106: 00010000:00010000:1.0:1787826415.374150:0:8545:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000816b8b1f/0x22153cd396b81d99 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0dd5 expref: 13 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.374209:0:8545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000816b8b1f/0x22153cd396b81d99 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0dd5 expref: 13 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.374227:0:8545:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46ae00, rc 0) 00000100:00100000:1.0:1787826415.374301:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2401:x1874670563856512:12345-192.168.203.39@tcp:101:getfattr.0 Request processed in 5518us (6989us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826415.374310:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2064 00000100:00100000:0.0:1787826415.422151:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826415.422274:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563856640 00000100:00100000:2.0:1787826415.422289:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563856640 00000100:00100000:1.0:1787826415.422570:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3735 00000100:00100000:1.0:1787826415.422586:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55523:x1874670563856640:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:1.0:1787826415.422700:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b81da0 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.422724:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b81da0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.422739:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b81da0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.422754:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b81da7 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.422774:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b81da7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.422780:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b81da7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.422893:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b81dae lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.422902:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b81dae lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.422908:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b81dae lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826415.422958:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:1.0:1787826415.422964:0:8247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826415.422978:0:8247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b81dae lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.422993:0:8247:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b81da0 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.423001:0:8247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b81da0 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.423007:0:8247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b81da0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.423014:0:8247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b81da0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.423024:0:8247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46ae00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826415.423028:0:8247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b81da0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.423036:0:8247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b81da0 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.423051:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf3ab61f00) 00010000:00010000:1.0:1787826415.423054:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826415.423060:0:8247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b81da0 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.423068:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b81da0 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.423092:0:8247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b81da7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.423099:0:8247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b81da7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.423106:0:8247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b81da7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.423112:0:8247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46ba00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826415.423115:0:8247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b81da7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.423122:0:8247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b81da7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.423134:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf3ab61000) 00010000:00010000:1.0:1787826415.423137:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826415.423140:0:8247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b81da7 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.423146:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b81da7 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.423158:0:8247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b81dae lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.423164:0:8247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b81dae lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.423170:0:8247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b81dae lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.423175:0:8247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46a800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826415.423178:0:8247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b81dae lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.423195:0:8247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b81dae lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.423203:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826415.423206:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826415.423209:0:8247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b81dae lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.423215:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b81dae lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826415.423626:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55523:x1874670563856640:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 1041us (1490us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826415.423635:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3735 00000100:00100000:0.0:1787826415.452978:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826415.453142:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563856896 00000100:00100000:2.0:1787826415.453155:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563856896 00000100:00100000:2.0:1787826415.453249:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3736 00000100:00100000:2.0:1787826415.453264:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55525:x1874670563856896:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826415.453293:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826415.453321:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b81db5 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0ddc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.453570:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81dbc lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.453589:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81dbc lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.453603:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81dbc lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826415.453617:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:2.0:1787826415.453768:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b81db5 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ddc expref: 56 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.453793:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81dbc lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ddc expref: 55 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.453804:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826415.453807:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787826415.453812:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835800, rc 0) 00000100:00100000:2.0:1787826415.453894:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+55:55525:x1874670563856896:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 634us (931us total) trans 8589934892 rc 0/0 00000100:00100000:2.0:1787826415.453905:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3736 00000100:00100000:2.0:1787826415.459982:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826415.460843:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563857024 00000100:00100000:0.0:1787826415.460858:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563857024 00000100:00100000:0.0:1787826415.460933:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2065 00000100:00100000:0.0:1787826415.460947:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563857024:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826415.460974:0:30695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826415.461003:0:30695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003bd432a2/0x22153cd396b81dca lrc: 2/0,0 mode: --/PR res: [0x280000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0de3 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826415.461383:0:30695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf361e7840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:30695:1874670585242368:192.168.203.39@tcp:106: 00000100:00100000:0.0:1787826415.461720:0:30695:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce04aa5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826415.472558:0:30695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf361e7840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:30695:1874670585242368:192.168.203.39@tcp:106: 00010000:00010000:1.0:1787826415.472623:0:30695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003bd432a2/0x22153cd396b81dca lrc: 1/0,0 mode: --/PR res: [0x280000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0de3 expref: 13 pid: 30695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.472667:0:30695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003bd432a2/0x22153cd396b81dca lrc: 0/0,0 mode: --/PR res: [0x280000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0de3 expref: 13 pid: 30695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.472695:0:30695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165ec00, rc 0) 00000100:00100000:1.0:1787826415.472793:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563857024:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 11849us (12827us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826415.472806:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2065 00000100:00100000:3.0:1787826415.476341:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826415.477081:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563857280 00000100:00100000:2.0:1787826415.477099:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563857280 00000100:00100000:2.0:1787826415.477239:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3737 00000100:00100000:2.0:1787826415.477253:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+55:55525:x1874670563857280:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826415.477288:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826415.477318:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b81dd1 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0dea expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.477679:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81dd8 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.477699:0:16564:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b81d92 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0dce expref: 56 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.477709:0:16564:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81dd8 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.477770:0:16564:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b81d92 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0dce expref: 56 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.477788:0:16564:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b81d92 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0dce expref: 56 pid: 9966 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826415.477806:0:16564:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0300e1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:16564:1874670585242496:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826415.477925:0:16564:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce010f5840 going to sleep for 11 seconds 00000100:00100000:2.0:1787826415.481898:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826415.482256:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563857408 00000100:00100000:3.0:1787826415.482268:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563857408 00010000:00010000:3.0:1787826415.482325:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b81d92 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0dce expref: 57 pid: 9966 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826415.482380:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1125 00000100:00100000:3.0:1787826415.482391:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+57:2403:x1874670563857408:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826415.482414:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826415.482423:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b81d92 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0dce expref: 57 pid: 9966 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.482438:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b81d92 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0dce expref: 57 pid: 9966 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.482468:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826415.482514:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81dd8 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.482526:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81dd8 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.482536:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81dd8 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.482560:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826415.482626:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+57:2403:x1874670563857408:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 236us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826415.482635:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1125 00010000:00010000:0.0:1787826415.484614:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b81d92 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0dce expref: 56 pid: 9966 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826415.484649:0:16564:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0300e1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:16564:1874670585242496:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826415.484683:0:16564:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81dd8 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.485077:0:16564:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81dd8 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.485086:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81dd8 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826415.485122:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:1.0:1787826415.485331:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b81dd1 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0dea expref: 57 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.485353:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81dd8 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0dea expref: 56 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.485860:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826415.485864:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787826415.485869:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834600, rc 0) 00000100:00100000:1.0:1787826415.485995:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+56:55525:x1874670563857280:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 8744us (9668us total) trans 8589934893 rc 0/0 00000100:00100000:1.0:1787826415.486006:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3737 00000100:00100000:2.0:1787826415.489950:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826415.490039:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563857664 00000100:00100000:0.0:1787826415.490053:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563857664 00000100:00100000:0.0:1787826415.490137:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3738 00000100:00100000:0.0:1787826415.490150:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+56:55525:x1874670563857664:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826415.490190:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826415.490220:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b81de6 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0df1 expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.491062:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b81ded lrc: 3/1,0 mode: --/PR res: [0x200000405:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.491084:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b81ded lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.491100:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b81ded lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826415.491114:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x28:0x0]: returning size 0 00010000:00010000:0.0:1787826415.491176:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b81de6 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0df1 expref: 59 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.491217:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b81ded lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0df1 expref: 58 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.491229:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x28:0x0].0x0 (ffff90cf0c7daf00) 00010000:00010000:0.0:1787826415.491232:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826415.491236:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165e600, rc 0) 00000100:00100000:0.0:1787826415.491322:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:55525:x1874670563857664:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1173us (1386us total) trans 8589934894 rc 0/0 00000100:00100000:0.0:1787826415.491331:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3738 00000100:00100000:0.0:1787826415.495797:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826415.495986:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563857920 00000100:00100000:2.0:1787826415.495998:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563857920 00000100:00100000:2.0:1787826415.496079:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3739 00000100:00100000:2.0:1787826415.496092:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:55525:x1874670563857920:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826415.496125:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826415.496163:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b81dfb lrc: 2/0,0 mode: --/CR res: [0x200000405:0x28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0df8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.496322:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b81e02 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.496340:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b81ded lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0df1 expref: 59 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.496350:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b81e02 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.496406:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b81ded lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0df1 expref: 59 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.496420:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b81ded lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0df1 expref: 59 pid: 9966 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826415.496436:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0300e1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1874670585242624:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826415.496586:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce010f5e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787826415.500926:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826415.501014:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563858048 00000100:00100000:0.0:1787826415.501027:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563858048 00010000:00010000:0.0:1787826415.501092:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b81ded lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0df1 expref: 60 pid: 9966 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826415.501145:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1126 00000100:00100000:0.0:1787826415.501157:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:2403:x1874670563858048:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826415.501177:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826415.501194:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b81ded lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0df1 expref: 60 pid: 9966 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.501210:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b81ded lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0df1 expref: 60 pid: 9966 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.501241:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x28:0x0].0x0 (ffff90cf0c7daf00) 00010000:00010000:0.0:1787826415.501248:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b81e02 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x28:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.501258:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b81e02 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x28:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.501267:0:10340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b81e02 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x28:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.501293:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826415.501376:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:2403:x1874670563858048:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 220us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826415.501387:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1126 00010000:00010000:3.0:1787826415.501734:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b81ded lrc: 0/0,0 mode: --/PR res: [0x200000405:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0df1 expref: 59 pid: 9966 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826415.501756:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0300e1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1874670585242624:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826415.501786:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b81e02 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x28:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.501797:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b81e02 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x28:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.501804:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b81e02 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x28:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826415.501828:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x28:0x0]: returning size 0 00000004:00080000:3.0:1787826415.502045:0:6519:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x108:0x0], index 1: 0 00010000:00010000:3.0:1787826415.502204:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b81e02 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x28:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.502213:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b81e02 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x28:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.502221:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b81e02 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x28:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.502228:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826415.502233:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b81e02 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x28:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.502242:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b81e02 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x28:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.502255:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x28:0x0].0x0 (ffff90cf0c7daf00) 00010000:00010000:3.0:1787826415.502258:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826415.502263:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b81e02 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x28:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.502269:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b81e02 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x28:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.502327:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b81dfb lrc: 1/0,0 mode: --/CR res: [0x200000405:0x28:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0df8 expref: 59 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.502343:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x28:0x0].0x0 (ffff90cf0c7daf00) 00010000:00010000:3.0:1787826415.502345:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787826415.502349:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b81dfb lrc: 0/0,0 mode: --/CR res: [0x200000405:0x28:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0df8 expref: 59 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.502367:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835a00, rc 0) 00000100:00100000:3.0:1787826415.502423:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:55525:x1874670563857920:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 6333us (6640us total) trans 8589934895 rc 301/301 00000100:00100000:3.0:1787826415.502432:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3739 00000100:00100000:2.0:1787826415.505774:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826415.505869:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563858304 00000100:00100000:0.0:1787826415.505885:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563858304 00000100:00100000:0.0:1787826415.505959:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1117 00000100:00100000:0.0:1787826415.505972:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:55525:x1874670563858304:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:2.0:1787826415.506862:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55525:x1874670563858304:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 885us (1105us total) trans 8589934896 rc 0/0 00000100:00100000:2.0:1787826415.506875:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1117 00000100:00100000:0.0:1787826415.509465:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826415.509669:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563858432 00000100:00100000:1.0:1787826415.509682:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563858432 00000100:00100000:1.0:1787826415.509860:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3740 00000100:00100000:1.0:1787826415.509873:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55525:x1874670563858432:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826415.509905:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826415.509933:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b81e10 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0dff expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.510066:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b81e17 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.510085:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81dd8 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0dea expref: 60 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.510096:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b81e17 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.510139:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81dd8 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0dea expref: 60 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.510155:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81dd8 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0dea expref: 60 pid: 16564 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826415.510172:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab16580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1874670585242752:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826415.510297:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3f7d8000 going to sleep for 11 seconds 00000100:00100000:1.0:1787826415.513527:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826415.513660:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab16580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1874670585242752:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826415.513697:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b81e17 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826415.513795:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563858560 00000100:00100000:2.0:1787826415.513804:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563858560 00010000:00010000:2.0:1787826415.513858:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81dd8 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0dea expref: 61 pid: 16564 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826415.513904:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1127 00000100:00100000:2.0:1787826415.513916:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab14f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+61:2404:x1874670563858560:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826415.513934:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826415.513942:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81dd8 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0dea expref: 61 pid: 16564 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.513955:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81dd8 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0dea expref: 61 pid: 16564 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.513984:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81dd8 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0dea expref: 61 pid: 16564 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.514004:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826415.514009:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b81e17 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.514021:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b81e17 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.514032:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b81e17 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.514070:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826415.514147:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab14f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:2404:x1874670563858560:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 233us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826415.514156:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1127 00010000:00010000:0.0:1787826415.514288:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b81e17 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.514296:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b81e17 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826415.514367:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:0.0:1787826415.514373:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826415.514402:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b81e17 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.514442:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b81e10 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0dff expref: 60 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.514461:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b81e17 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0dff expref: 59 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.514509:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826415.514514:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826415.514517:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46ac00, rc 0) 00000100:00100000:0.0:1787826415.514546:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55525:x1874670563858432:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 4677us (5208us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826415.514554:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3740 00000100:00100000:2.0:1787826415.520077:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826415.520201:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563858688 00000100:00100000:0.0:1787826415.520215:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563858688 00000100:00100000:0.0:1787826415.520300:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2066 00000100:00100000:0.0:1787826415.520313:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2401:x1874670563858688:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826415.520337:0:28853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826415.520370:0:28853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac666fdd/0x22153cd396b81e1e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0e06 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826415.520451:0:28853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf361e4b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28853:1874670585242880:192.168.203.39@tcp:106: 00000100:00100000:0.0:1787826415.520580:0:28853:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf100e1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826415.523310:0:28853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf361e4b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28853:1874670585242880:192.168.203.39@tcp:106: 00010000:00010000:0.0:1787826415.523384:0:28853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ac666fdd/0x22153cd396b81e1e lrc: 1/0,0 mode: --/PR res: [0x280000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e06 expref: 13 pid: 28853 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.523417:0:28853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac666fdd/0x22153cd396b81e1e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e06 expref: 13 pid: 28853 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.523433:0:28853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165fe00, rc 0) 00000100:00100000:1.0:1787826415.524114:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2401:x1874670563858688:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 3798us (4047us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826415.524128:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2066 00000100:00100000:1.0:1787826415.527160:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826415.527270:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563858816 00000100:00100000:2.0:1787826415.527284:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563858816 00000100:00100000:2.0:1787826415.527665:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3741 00000100:00100000:2.0:1787826415.527679:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab16580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55525:x1874670563858816:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826415.527705:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826415.527734:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81e25 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0e0d expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.528020:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81e2c lrc: 3/1,0 mode: --/PR res: [0x200000405:0x28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.528038:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81e2c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x28:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.528052:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81e2c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x28:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826415.528111:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x28:0x0]: returning size 0 00000004:00200000:2.0:1787826415.528115:0:16564:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826415.528140:0:16564:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81e2c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x28:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.528171:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b81e25 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e0d expref: 61 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.528206:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81e2c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x28:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e0d expref: 60 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.528216:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x28:0x0].0x0 (ffff90cf39e67800) 00010000:00010000:2.0:1787826415.528220:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787826415.528225:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835000, rc 0) 00000100:00100000:2.0:1787826415.528497:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab16580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:55525:x1874670563858816:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 680us (1209us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826415.528508:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3741 00000100:00100000:1.0:1787826415.531525:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826415.531616:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563858944 00000100:00100000:0.0:1787826415.531628:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563858944 00000100:00100000:0.0:1787826415.531710:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2067 00000100:00100000:0.0:1787826415.531722:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab16940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563858944:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826415.531747:0:30696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826415.531787:0:30696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004185bcb5/0x22153cd396b81e33 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x108:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0e14 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826415.531823:0:30696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x108:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826415.531851:0:30696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x108:0x0].0x0 since=1361s v=(0 0) 00010000:00010000:0.0:1787826415.531856:0:30696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x108:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826415.531868:0:30696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004185bcb5/0x22153cd396b81e33 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x108:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e14 expref: 15 pid: 30696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.531892:0:30696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004185bcb5/0x22153cd396b81e33 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x108:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e14 expref: 15 pid: 30696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.531909:0:30696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165ee00, rc 0) 00000100:00080000:3.0:1787826415.532018:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826415.532605:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab16940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2404:x1874670563858944:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 881us (1089us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826415.532614:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2067 00000100:00100000:1.0:1787826415.535944:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826415.536045:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563859200 00000100:00100000:0.0:1787826415.536058:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563859200 00000100:00100000:0.0:1787826415.536168:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3742 00000100:00100000:0.0:1787826415.536189:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:55525:x1874670563859200:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826415.536218:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826415.536247:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b81e3a lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0e1b expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.536537:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b81e41 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.536556:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b81e41 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.536568:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b81e41 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826415.536585:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:0.0:1787826415.536719:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b81e3a lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e1b expref: 63 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.536742:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b81e41 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e1b expref: 62 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.536753:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826415.536756:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787826415.536760:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165fc00, rc 0) 00000100:00100000:0.0:1787826415.536846:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+62:55525:x1874670563859200:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 668us (917us total) trans 8589934897 rc 0/0 00000100:00100000:0.0:1787826415.536854:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3742 00000100:00100000:2.0:1787826415.539922:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826415.540015:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563859328 00000100:00100000:3.0:1787826415.540027:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563859328 00000100:00100000:3.0:1787826415.540100:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2068 00000100:00100000:3.0:1787826415.540113:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563859328:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826415.540136:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826415.540159:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b81e4f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0e22 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826415.540251:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab93480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1874670585243008:192.168.203.39@tcp:106: 00000100:00100000:3.0:1787826415.540548:0:8437:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3ab4c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826415.542863:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab93480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1874670585243008:192.168.203.39@tcp:106: 00010000:00010000:3.0:1787826415.542919:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b81e4f lrc: 1/0,0 mode: --/PR res: [0x280000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e22 expref: 13 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.542958:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b81e4f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e22 expref: 13 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.542973:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401e00, rc 0) 00000100:00100000:3.0:1787826415.543076:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563859328:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 2965us (3169us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826415.543087:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2068 00000100:00100000:1.0:1787826415.545850:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826415.545937:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563859456 00000100:00100000:2.0:1787826415.545949:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563859456 00000100:00100000:2.0:1787826415.546048:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2069 00000100:00100000:2.0:1787826415.546061:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06306580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563859456:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826415.546083:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826415.546106:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c6f0c33/0x22153cd396b81e56 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0e29 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826415.546191:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0300e1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1874670585243136:192.168.203.39@tcp:106: 00000100:00100000:2.0:1787826415.546291:0:8435:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce010f5e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787826415.549278:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0300e1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1874670585243136:192.168.203.39@tcp:106: 00010000:00010000:0.0:1787826415.549337:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005c6f0c33/0x22153cd396b81e56 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e29 expref: 13 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.549369:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c6f0c33/0x22153cd396b81e56 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e29 expref: 13 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.549395:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834600, rc 0) 00000100:00100000:0.0:1787826415.549929:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06306580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563859456:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 3867us (4087us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826415.549941:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2069 00000100:00100000:0.0:1787826415.552221:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826415.552372:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563859584 00000100:00100000:1.0:1787826415.552384:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563859584 00000100:00100000:1.0:1787826415.552459:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2070 00000100:00100000:1.0:1787826415.552505:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563859584:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:1.0:1787826415.552559:0:30398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000951304c9/0x22153cd396b81e5d lrc: 3/1,0 mode: --/PR res: [0x280000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.552583:0:30398:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000382351a4/0x22153cd396b81c88 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d81 expref: 12 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.552834:0:30398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x107:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787826415.552840:0:30398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x107:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826415.552846:0:30398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000951304c9/0x22153cd396b81e5d lrc: 4/1,0 mode: --/PR res: [0x280000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.552901:0:30398:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000382351a4/0x22153cd396b81c88 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d81 expref: 12 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.552919:0:30398:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000382351a4/0x22153cd396b81c88 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d81 expref: 12 pid: 30398 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826415.552938:0:30398:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce063061c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:30398:1874670585243264:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826415.553156:0:30398:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3f7d8b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787826415.559075:0:30398:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce063061c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:30398:1874670585243264:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826415.559124:0:30398:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000951304c9/0x22153cd396b81e5d lrc: 3/1,0 mode: --/PR res: [0x280000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826415.559224:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826415.559674:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563859712 00000100:00100000:3.0:1787826415.559684:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563859712 00010000:00010000:3.0:1787826415.559733:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000382351a4/0x22153cd396b81c88 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d81 expref: 13 pid: 30398 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826415.559803:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1128 00000100:00100000:3.0:1787826415.559815:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06307840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2403:x1874670563859712:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826415.559833:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826415.559860:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000382351a4/0x22153cd396b81c88 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x107:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d81 expref: 13 pid: 30398 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.559876:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000382351a4/0x22153cd396b81c88 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x107:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d81 expref: 13 pid: 30398 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.559909:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000382351a4/0x22153cd396b81c88 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x107:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d81 expref: 13 pid: 30398 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.559927:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x107:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826415.559932:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x107:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826415.559939:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000951304c9/0x22153cd396b81e5d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.559951:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000951304c9/0x22153cd396b81e5d lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.559984:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826415.560060:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06307840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563859712:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 247us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826415.560071:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1128 00010000:00010000:1.0:1787826415.560362:0:30398:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000951304c9/0x22153cd396b81e5d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x107:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.560374:0:30398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000951304c9/0x22153cd396b81e5d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x107:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.560401:0:30398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000951304c9/0x22153cd396b81e5d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x107:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.560411:0:30398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000951304c9/0x22153cd396b81e5d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x107:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.560421:0:30398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000951304c9/0x22153cd396b81e5d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x107:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.560437:0:30398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46b400 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:1.0:1787826415.560441:0:30398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000951304c9/0x22153cd396b81e5d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x107:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.560450:0:30398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000951304c9/0x22153cd396b81e5d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x107:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.560463:0:30398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000951304c9/0x22153cd396b81e5d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x107:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.560948:0:30398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000951304c9/0x22153cd396b81e5d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x107:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826415.562036:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2404:x1874670563859584:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 9557us (9817us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826415.562049:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2070 00000100:00100000:1.0:1787826415.568585:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826415.568794:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563859840 00000100:00100000:2.0:1787826415.568807:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563859840 00000100:00100000:2.0:1787826415.568898:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2071 00000100:00100000:2.0:1787826415.568910:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06305e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2403:x1874670563859840:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826415.568936:0:14864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826415.568969:0:14864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002904bac2/0x22153cd396b81e64 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x107:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0e30 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787826415.569005:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x107:0x0] initial LVB size: 0, mtime: 0x6a9010ec, atime: 0x6a9010ec, ctime: 0x6a9010ef, blocks: 0x0 00010000:00010000:2.0:1787826415.569033:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x107:0x0].0x0 since=1361s v=(0 0) 00010000:00010000:2.0:1787826415.569039:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x107:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826415.569051:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002904bac2/0x22153cd396b81e64 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x107:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e30 expref: 12 pid: 14864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.569072:0:14864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002904bac2/0x22153cd396b81e64 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x107:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e30 expref: 12 pid: 14864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.569088:0:14864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835a00, rc 0) 00000100:00100000:2.0:1787826415.569168:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06305e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563859840:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 259us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826415.569175:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2071 00000100:00100000:2.0:1787826415.615794:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826415.615910:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563859968 00000100:00100000:3.0:1787826415.615922:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563859968 00000100:00100000:3.0:1787826415.616002:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3743 00000100:00100000:3.0:1787826415.616014:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+62:55525:x1874670563859968:12345-192.168.203.39@tcp:44:lfs.0 00000001:00080000:2.0:1787826415.620543:0:34481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934897 is committed 00000004:00080000:2.0:1787826415.620595:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 26 committed 00010000:00010000:1.0:1787826415.620619:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b81c7a lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.620639:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b81c7a lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.620648:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b81c7a lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.620655:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46a400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826415.620661:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b81c7a lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.620671:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b81c7a lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.620693:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x26:0x0].0x0 (ffff90cf3ab61400) 00010000:00010000:1.0:1787826415.620696:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826415.620703:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b81c7a lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.620711:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b81c7a lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.620749:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81c8f lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.620756:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81c8f lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.620769:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81c8f lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.620776:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165e200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826415.620780:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81c8f lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787826415.620784:0:34481:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90cf068e3780 refcount 2 committed 0 result 0 batchid 4294969333 00010000:00010000:1.0:1787826415.620788:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81c8f lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787826415.620795:0:34481:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cf39612e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90cf068e3540 00000020:00080000:2.0:1787826415.620801:0:34481:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cf39612900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90cf09db1e00 00010000:00010000:1.0:1787826415.620803:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826415.620808:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826415.620812:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81c8f lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.620819:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81c8f lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787826415.620824:0:34481:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969332 batchid updated 00000020:00080000:0.0:1787826415.621296:0:34512:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969333 committed batchid 4294969332 00000020:00080000:0.0:1787826415.621406:0:34512:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969332 00000100:00100000:3.0:1787826415.621595:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:55525:x1874670563859968:12345-192.168.203.39@tcp:44:lfs.0 Request processed in 5577us (5812us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826415.621607:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3743 00000100:00100000:2.0:1787826415.621953:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787826415.621969:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585243392:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787826415.622028:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826415.622134:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585243392 00000100:00100000:3.0:1787826415.622142:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585243392 00000100:00100000:3.0:1787826415.622405:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2072 00000100:00100000:3.0:1787826415.622416:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:3645:x1874670585243392:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787826415.622443:0:30696:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:263 count 1 00010000:00010000:3.0:1787826415.622464:0:30696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9767cf8/0x22153cd396b81e6b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.622504:0:30696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b81c96 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d88 expref: 14 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.622514:0:30696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x107:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787826415.622517:0:30696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x107:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826415.622522:0:30696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9767cf8/0x22153cd396b81e6b lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.622551:0:30696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b81c96 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d88 expref: 14 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.622566:0:30696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b81c96 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d88 expref: 14 pid: 8436 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826415.622578:0:30696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce04f07840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:30696:1874670585243520:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826415.622636:0:30696:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3ab4c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826415.634686:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826415.634749:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826415.634838:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563860224 00000100:00100000:1.0:1787826415.634850:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563860224 00000100:00100000:1.0:1787826415.634928:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2073 00000100:00100000:1.0:1787826415.634940:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2404:x1874670563860224:12345-192.168.203.39@tcp:16:lfs.0 00000100:00100000:2.0:1787826415.635081:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563860096 00000100:00100000:2.0:1787826415.635099:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563860096 00000100:00100000:1.0:1787826415.635125:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2404:x1874670563860224:12345-192.168.203.39@tcp:16:lfs.0 Request processed in 183us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826415.635132:0:30696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce04f07840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:30696:1874670585243520:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826415.635141:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2073 00010000:00010000:2.0:1787826415.635159:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b81c96 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d88 expref: 16 pid: 8436 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.635171:0:30696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e9767cf8/0x22153cd396b81e6b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x107:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826415.635235:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1129 00000100:00100000:2.0:1787826415.635248:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136d6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2403:x1874670563860096:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826415.635375:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826415.635384:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b81c96 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x107:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d88 expref: 15 pid: 8436 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.635469:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b81c96 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x107:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d88 expref: 15 pid: 8436 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.635614:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b81c96 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x107:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0d88 expref: 15 pid: 8436 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.635762:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x107:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826415.635768:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x107:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826415.635774:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e9767cf8/0x22153cd396b81e6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.635784:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9767cf8/0x22153cd396b81e6b lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.635885:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826415.635958:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136d6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2403:x1874670563860096:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 712us (1286us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826415.635968:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1129 00010000:00010000:3.0:1787826415.636368:0:30696:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e9767cf8/0x22153cd396b81e6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x107:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.636378:0:30696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9767cf8/0x22153cd396b81e6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x107:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.636388:0:30696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9767cf8/0x22153cd396b81e6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x107:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.636966:0:30696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9767cf8/0x22153cd396b81e6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x107:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.637052:0:30696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787826415.637263:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:3645:x1874670585243392:12345-0@lo:6:osp-syn-1-0.0 Request processed in 14847us (15232us total) trans 17179869660 rc 0/0 00000100:00100000:3.0:1787826415.637280:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2072 00000004:00080000:2.0:1787826415.637817:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3ab93480/2, rc 0, transno 17179869660 00000100:00100000:2.0:1787826415.637826:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585243392:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1787826415.638028:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826415.638036:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9767cf8/0x22153cd396b81e6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x107:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.638045:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401e00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826415.638049:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9767cf8/0x22153cd396b81e6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x107:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.638059:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9767cf8/0x22153cd396b81e6b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x107:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.638078:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9767cf8/0x22153cd396b81e6b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x107:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.638086:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9767cf8/0x22153cd396b81e6b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x107:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.638111:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826415.638114:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826415.638116:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826415.658167:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826415.658292:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563860352 00000100:00100000:1.0:1787826415.658304:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563860352 00000100:00100000:1.0:1787826415.658602:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2074 00000100:00100000:1.0:1787826415.658618:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136d4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2402:x1874670563860352:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:1.0:1787826415.658682:0:8545:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001a5fe178/0x22153cd396b81e72 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.658705:0:8545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x107:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826415.658710:0:8545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x107:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826415.658719:0:8545:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a5fe178/0x22153cd396b81e72 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.659125:0:8545:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a5fe178/0x22153cd396b81e72 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.659175:0:8545:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001a5fe178/0x22153cd396b81e72 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.659195:0:8545:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a5fe178/0x22153cd396b81e72 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.659203:0:8545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a5fe178/0x22153cd396b81e72 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.659211:0:8545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46a600 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:1.0:1787826415.659215:0:8545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a5fe178/0x22153cd396b81e72 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.659225:0:8545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a5fe178/0x22153cd396b81e72 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.659246:0:8545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a5fe178/0x22153cd396b81e72 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.659254:0:8545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a5fe178/0x22153cd396b81e72 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826415.659759:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136d4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2402:x1874670563860352:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 1141us (1604us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826415.659771:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2074 00000100:00100000:1.0:1787826415.665302:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826415.665417:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563860608 00000100:00100000:0.0:1787826415.665431:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563860608 00000100:00100000:0.0:1787826415.665621:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3744 00000100:00100000:0.0:1787826415.665634:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06304b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:55525:x1874670563860608:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:0.0:1787826415.665709:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826415.668297:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81e2c lrc: 0/0,0 mode: --/PR res: [0x200000405:0x28:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e0d expref: 33 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.668332:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x28:0x0].0x0 (ffff90cf39e67800) 00010000:00010000:0.0:1787826415.668347:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826415.668403:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b81e79 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.668419:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b81e79 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.668431:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b81e79 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826415.668638:0:6518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000070d1221a reply state 00000000ebff61db transno 8589934898 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b81e79 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.668653:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b81e79 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.668664:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x28:0x0].0x0 (ffff90cf0c7dac00) 00010000:00010000:0.0:1787826415.668667:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826415.668670:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787826415.668842:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06304b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:55525:x1874670563860608:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 3209us (3553us total) trans 8589934898 rc 0/0 00000100:00100000:0.0:1787826415.668853:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3744 00000100:00100000:2.0:1787826415.678932:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826415.681467:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563860736 00000100:00100000:1.0:1787826415.681509:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563860736 00000100:00100000:1.0:1787826415.681612:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3745 00000100:00100000:1.0:1787826415.681625:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:55525:x1874670563860736:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826415.681659:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826415.681688:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b81e80 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0e37 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.681780:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b81e80 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x28:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e37 expref: 35 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.681799:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b81e80 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x28:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e37 expref: 35 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.681821:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x28:0x0].0x0 (ffff90cf0c7dac00) 00010000:00010000:1.0:1787826415.681825:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826415.681829:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46a600, rc 0) 00000100:00100000:1.0:1787826415.681911:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:55525:x1874670563860736:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 288us (2992us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826415.681918:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3745 00000100:00100000:2.0:1787826415.686963:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826415.687198:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563860864 00000100:00100000:0.0:1787826415.687211:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563860864 00000100:00100000:0.0:1787826415.687301:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2075 00000100:00100000:0.0:1787826415.687314:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:55525:x1874670563860864:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826415.687348:0:30695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826415.687384:0:30695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b81e87 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0e3e expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.687426:0:30695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004185bcb5/0x22153cd396b81e33 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e14 expref: 15 pid: 30696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.687436:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x108:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826415.687441:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x108:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826415.687447:0:30695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b81e87 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e3e expref: 15 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.687531:0:30695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004185bcb5/0x22153cd396b81e33 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e14 expref: 15 pid: 30696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.687548:0:30695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004185bcb5/0x22153cd396b81e33 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e14 expref: 15 pid: 30696 timeout: 1461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826415.687566:0:30695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf136d4780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:30695:1874670585243648:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826415.687671:0:30695:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a139c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826415.696564:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826415.696742:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563860992 00000100:00100000:3.0:1787826415.696764:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563860992 00010000:00010000:3.0:1787826415.696822:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004185bcb5/0x22153cd396b81e33 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e14 expref: 16 pid: 30696 timeout: 1461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826415.696873:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1130 00000100:00100000:3.0:1787826415.696886:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf185df050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2403:x1874670563860992:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826415.696906:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826415.696936:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004185bcb5/0x22153cd396b81e33 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x108:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e14 expref: 16 pid: 30696 timeout: 1461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.696953:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004185bcb5/0x22153cd396b81e33 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x108:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e14 expref: 16 pid: 30696 timeout: 1461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.696988:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x108:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826415.696994:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x108:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826415.697004:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b81e87 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x108:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e3e expref: 16 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.697017:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b81e87 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x108:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e3e expref: 16 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.697066:0:6503:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b81e87 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x108:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e3e expref: 16 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826415.697085:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce04f07840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6503:1874670585243776:192.168.203.39@tcp:105: 00000100:00100000:3.0:1787826415.697204:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3ab4c3c0 going to sleep for 11 seconds 00010000:00010000:1.0:1787826415.700464:0:30695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004185bcb5/0x22153cd396b81e33 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x108:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e14 expref: 16 pid: 30696 timeout: 1461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826415.700518:0:30695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf136d4780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:30695:1874670585243648:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826415.700831:0:30695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b81e87 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e3e expref: 15 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.700857:0:30695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165e400, rc 0) 00000100:00100000:1.0:1787826415.701318:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:55525:x1874670563860864:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 14003us (14367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826415.701331:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2075 00000100:00100000:2.0:1787826415.702973:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce04f07840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6503:1874670585243776:192.168.203.39@tcp:105: 00010000:00010000:2.0:1787826415.703002:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826415.703062:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf185df050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2403:x1874670563860992:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6178us (6514us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826415.703075:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1130 00000100:00100000:2.0:1787826415.715849:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826415.716152:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563861120 00000100:00100000:3.0:1787826415.716169:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563861120 00000100:00100000:3.0:1787826415.716262:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2076 00000100:00100000:3.0:1787826415.716273:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2403:x1874670563861120:12345-192.168.203.39@tcp:2:lfs.0 00002000:00010000:3.0:1787826415.716572:0:14864:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x108:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787826415.716577:0:14864:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x108:0x0] updating lvb mtime from disk: 0 -> 1787826412 00002000:00010000:3.0:1787826415.716580:0:14864:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x108:0x0] updating lvb atime from disk: 0 -> 1787826412 00002000:00010000:3.0:1787826415.716582:0:14864:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x108:0x0] updating lvb ctime from disk: 0 -> 1787826416 00002000:00010000:3.0:1787826415.716585:0:14864:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x108:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1787826415.716660:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2403:x1874670563861120:12345-192.168.203.39@tcp:2:lfs.0 Request processed in 389us (820us total) trans 17179869661 rc 0/0 00000100:00100000:3.0:1787826415.716669:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2076 00000100:00100000:0.0:1787826415.719522:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826415.719803:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563861376 00000100:00100000:2.0:1787826415.719812:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563861376 00000100:00100000:2.0:1787826415.719878:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3746 00000100:00100000:2.0:1787826415.719889:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:55525:x1874670563861376:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:2.0:1787826415.719941:0:9966:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826415.719969:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b81e17 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0dff expref: 35 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.719990:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826415.719995:0:9966:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826415.720054:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b81e8e lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.720067:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b81e8e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.720077:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b81e8e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826415.720265:0:9966:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000050fc945d reply state 00000000175407b6 transno 8589934899 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b81e8e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.720278:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b81e8e lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.720284:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826415.720287:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826415.720289:0:9966:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826415.720849:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55525:x1874670563861376:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 959us (1383us total) trans 8589934899 rc 0/0 00000100:00100000:2.0:1787826415.720858:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3746 00000100:00100000:0.0:1787826415.727670:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826415.727738:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563861504 00000100:00100000:2.0:1787826415.727747:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563861504 00000100:00100000:2.0:1787826415.727800:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2077 00000100:00100000:2.0:1787826415.727810:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136d43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:55525:x1874670563861504:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826415.727828:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826415.727847:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c800962/0x22153cd396b81e95 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0e45 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.727878:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002904bac2/0x22153cd396b81e64 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e30 expref: 13 pid: 14864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.727887:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x107:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826415.727892:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x107:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826415.727897:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c800962/0x22153cd396b81e95 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e45 expref: 13 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.727930:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002904bac2/0x22153cd396b81e64 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e30 expref: 13 pid: 14864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.727943:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002904bac2/0x22153cd396b81e64 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e30 expref: 13 pid: 14864 timeout: 1461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826415.727957:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f82de00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1874670585243904:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826415.728034:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce010f5cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826415.732889:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f82de00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1874670585243904:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826415.732925:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008c800962/0x22153cd396b81e95 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e45 expref: 13 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.732946:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834800, rc 0) 00000100:00100000:2.0:1787826415.732996:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136d43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:55525:x1874670563861504:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 5187us (5334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826415.733006:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2077 00000100:00100000:0.0:1787826415.742443:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826415.742715:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563861632 00000100:00100000:3.0:1787826415.742726:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563861632 00010000:00010000:3.0:1787826415.742768:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002904bac2/0x22153cd396b81e64 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e30 expref: 13 pid: 14864 timeout: 1461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826415.742813:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1131 00000100:00100000:3.0:1787826415.742823:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136d7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2404:x1874670563861632:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826415.742838:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826415.742871:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002904bac2/0x22153cd396b81e64 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x107:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e30 expref: 13 pid: 14864 timeout: 1461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.742886:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002904bac2/0x22153cd396b81e64 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x107:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e30 expref: 13 pid: 14864 timeout: 1461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.742911:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002904bac2/0x22153cd396b81e64 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x107:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e30 expref: 13 pid: 14864 timeout: 1461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.742929:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x107:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826415.742934:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x107:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826415.742941:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008c800962/0x22153cd396b81e95 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e45 expref: 12 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.742958:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c800962/0x22153cd396b81e95 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e45 expref: 12 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.742997:0:6504:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008c800962/0x22153cd396b81e95 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e45 expref: 12 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826415.743011:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce04f05e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6504:1874670585244032:192.168.203.39@tcp:105: 00000100:00100000:3.0:1787826415.743094:0:6504:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3ab4c000 going to sleep for 11 seconds 00000100:00100000:3.0:1787826415.745974:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce04f05e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6504:1874670585244032:192.168.203.39@tcp:105: 00010000:00010000:3.0:1787826415.746000:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826415.746058:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136d7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563861632:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3236us (3623us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826415.746070:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1131 00000100:00100000:1.0:1787826415.759965:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826415.760131:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563861760 00000100:00100000:0.0:1787826415.760141:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563861760 00000100:00100000:0.0:1787826415.760208:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2078 00000100:00100000:0.0:1787826415.760220:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06307840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563861760:12345-192.168.203.39@tcp:2:lfs.0 00002000:00010000:0.0:1787826415.760530:0:8437:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x107:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787826415.760534:0:8437:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x107:0x0] updating lvb mtime from disk: 1787826412 -> 1787826412 00002000:00010000:0.0:1787826415.760537:0:8437:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x107:0x0] updating lvb atime from disk: 1787826412 -> 1787826412 00002000:00010000:0.0:1787826415.760539:0:8437:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x107:0x0] updating lvb ctime from disk: 1787826415 -> 1787826416 00002000:00010000:0.0:1787826415.760542:0:8437:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x107:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1787826415.760960:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06307840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2403:x1874670563861760:12345-192.168.203.39@tcp:2:lfs.0 Request processed in 740us (1002us total) trans 21474837002 rc 0/0 00000100:00100000:0.0:1787826415.760969:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2078 00000100:00100000:0.0:1787826415.776786:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826415.778676:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563862016 00000100:00100000:1.0:1787826415.778691:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563862016 00000100:00100000:1.0:1787826415.778775:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1118 00000100:00100000:1.0:1787826415.778787:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eea7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55525:x1874670563862016:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:1.0:1787826415.778885:0:6522:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000405:0x1d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b81e41 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e1b expref: 36 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.778932:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b81e9c lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.778945:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b81d6f lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0dc7 expref: 36 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.778953:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81dbc lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ddc expref: 36 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.778961:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b81e9c lrc: 5/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.779000:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81dbc lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ddc expref: 36 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.779020:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81dbc lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ddc expref: 36 pid: 6520 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826415.779036:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce063061c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585244160:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826415.779139:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b81d6f lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0dc7 expref: 36 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.779148:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b81d6f lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0dc7 expref: 36 pid: 16564 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826415.779156:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03976940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585244288:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826415.779191:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3f7d8b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826415.787169:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826415.787215:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826415.787990:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563862272 00000100:00100000:2.0:1787826415.788001:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563862272 00000100:00100000:2.0:1787826415.788067:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1119 00000100:00100000:2.0:1787826415.788079:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049b8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:49796:x1874670563862272:12345-192.168.203.39@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787826415.788327:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049b8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:49796:x1874670563862272:12345-192.168.203.39@tcp:35:ldlm_bl.0 Request processed in 249us (1167us total) trans 8589934900 rc 0/0 00000100:00100000:2.0:1787826415.788336:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1119 00000100:00100000:3.0:1787826415.788761:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563862400 00000100:00100000:3.0:1787826415.788767:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563862400 00010000:00010000:3.0:1787826415.788796:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b81d6f lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0dc7 expref: 38 pid: 16564 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826415.788833:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1132 00000100:00100000:3.0:1787826415.788841:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049b92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:2403:x1874670563862400:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826415.788863:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826415.788870:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b81d6f lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0dc7 expref: 38 pid: 16564 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.788885:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b81d6f lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0dc7 expref: 38 pid: 16564 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.788918:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826415.788924:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b81e9c lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.788934:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b81e9c lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.788941:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826415.788978:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049b92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:2403:x1874670563862400:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 139us (1762us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826415.788985:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1132 00000100:00100000:1.0:1787826415.791117:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826415.791504:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563862528 00000100:00100000:2.0:1787826415.791513:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563862528 00010000:00010000:2.0:1787826415.791561:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81dbc lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ddc expref: 38 pid: 6520 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826415.791602:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1133 00000100:00100000:2.0:1787826415.791611:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049bbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:2403:x1874670563862528:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826415.791624:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826415.791630:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81dbc lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ddc expref: 38 pid: 6520 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.791643:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81dbc lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ddc expref: 38 pid: 6520 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.791665:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826415.791670:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b81e9c lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.791680:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b81e9c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.791689:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b81e9c lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.791707:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826415.791750:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049bbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:2403:x1874670563862528:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 141us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826415.791762:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1133 00010000:00010000:0.0:1787826415.792429:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81dbc lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ddc expref: 37 pid: 6520 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826415.792449:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce063061c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585244160:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826415.792463:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b81d6f lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0dc7 expref: 36 pid: 16564 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826415.792521:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03976940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585244288:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826415.792546:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b81e9c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.792556:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b81e9c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.792562:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b81e9c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.792595:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b81ea3 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.792605:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b81e80 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e37 expref: 35 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.792613:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b81ea3 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x28:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.792644:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b81e80 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e37 expref: 35 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.792658:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b81e80 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e37 expref: 35 pid: 16564 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826415.792672:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf136d5a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585244416:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826415.792749:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a13f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826415.800912:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826415.800974:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563862656 00000100:00100000:3.0:1787826415.800984:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563862656 00000100:00100000:2.0:1787826415.801008:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf136d5a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585244416:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826415.801025:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b81e80 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e37 expref: 36 pid: 16564 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.801036:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b81ea3 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x28:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826415.801073:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1134 00000100:00100000:3.0:1787826415.801093:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:2403:x1874670563862656:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826415.801108:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826415.801116:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b81e80 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x28:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e37 expref: 36 pid: 16564 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.801129:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b81e80 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x28:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e37 expref: 36 pid: 16564 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.801150:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b81e80 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x28:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e37 expref: 36 pid: 16564 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.801168:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x28:0x0].0x0 (ffff90cf0c7dac00) 00010000:00010000:3.0:1787826415.801173:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b81ea3 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x28:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.801192:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b81ea3 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x28:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.801201:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b81ea3 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x28:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826415.801228:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826415.801282:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:2403:x1874670563862656:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 191us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826415.801290:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1134 00010000:00010000:2.0:1787826415.801432:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b81ea3 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.801442:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b81ea3 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826415.801736:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f82de00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1874670585244544:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787826415.801789:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826415.801820:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10aba180 going to sleep for 11 seconds 00000100:00100000:0.0:1787826415.802001:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585244544 00000100:00100000:0.0:1787826415.802007:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585244544 00000100:00100000:0.0:1787826415.802034:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1441 00000100:00100000:0.0:1787826415.802040:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:6522:x1874670585244544:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787826415.802122:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:6522:x1874670585244544:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 82us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826415.802129:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1441 00000100:00100000:2.0:1787826415.802170:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f82de00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1874670585244544:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787826415.802223:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f82de00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1874670585244672:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787826415.802248:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826415.802276:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10aba480 going to sleep for 11 seconds 00000100:00100000:0.0:1787826415.802335:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585244672 00000100:00100000:0.0:1787826415.802339:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585244672 00000100:00100000:0.0:1787826415.802370:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1442 00000100:00100000:0.0:1787826415.802377:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:6522:x1874670585244672:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787826415.802461:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:6522:x1874670585244672:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 83us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826415.802467:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1442 00000100:00100000:2.0:1787826415.802563:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f82de00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1874670585244672:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787826415.802663:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934901 00000100:00100000:2.0:1787826415.802710:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f82de00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1874670585244800:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787826415.802737:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826415.802773:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585244800 00000100:00100000:1.0:1787826415.802779:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585244800 00000100:00100000:1.0:1787826415.802882:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1443 00000100:00100000:2.0:1787826415.802882:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce04d24240 going to sleep for 11 seconds 00000100:00100000:1.0:1787826415.802894:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:6522:x1874670585244800:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787826415.802996:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+12:6522:x1874670585244800:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 105us (258us total) trans 17179869662 rc 0/0 00000100:00100000:1.0:1787826415.803002:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1443 00000100:00100000:2.0:1787826415.803053:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f82de00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1874670585244800:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787826415.803100:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934902 00010000:00010000:2.0:1787826415.803121:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b81ea3 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.803131:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b81ea3 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.803137:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b81ea3 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.803143:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165f400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826415.803146:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b81ea3 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.803154:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b81ea3 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.803168:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x28:0x0].0x0 (ffff90cf0c7dac00) 00010000:00010000:2.0:1787826415.803171:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787826415.803175:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b81ea3 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.803190:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b81ea3 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.803203:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b81e9c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.803209:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b81e9c lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.803215:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b81e9c lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.803220:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46ba00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826415.803224:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b81e9c lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.803230:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b81e9c lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.803237:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826415.803240:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787826415.803242:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b81e9c lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.803248:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b81e9c lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.803259:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826415.803261:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787826415.803267:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b81e41 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e1b expref: 37 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826415.803342:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eea7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55525:x1874670563862016:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 24557us (26577us total) trans 8589934903 rc 0/0 00000100:00100000:2.0:1787826415.803350:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1118 00000020:00080000:2.0:1787826415.803353:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1787826415.808751:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826415.809309:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563862784 00000100:00100000:3.0:1787826415.809321:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563862784 00000100:00100000:2.0:1787826415.811141:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3747 00000100:00100000:2.0:1787826415.811155:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55525:x1874670563862784:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826415.811193:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826415.811217:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81eaa lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0e4c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.811272:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81eaa lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e4c expref: 37 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.811287:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81eaa lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e4c expref: 37 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.811304:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826415.811307:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826415.811311:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834a00, rc 0) 00000100:00100000:2.0:1787826415.811367:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:55525:x1874670563862784:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 216us (2628us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826415.811374:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3747 00000100:00100000:1.0:1787826415.816654:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826415.816748:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563863040 00000100:00100000:2.0:1787826415.816758:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563863040 00000100:00100000:2.0:1787826415.816869:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1120 00000100:00100000:2.0:1787826415.816880:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:55525:x1874670563863040:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:2.0:1787826415.817124:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:55525:x1874670563863040:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 245us (478us total) trans 8589934904 rc 0/0 00000100:00100000:2.0:1787826415.817132:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1120 00000100:00100000:0.0:1787826415.822019:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826415.823530:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563863296 00000100:00100000:2.0:1787826415.823543:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563863296 00000100:00100000:2.0:1787826415.823609:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1121 00000100:00100000:2.0:1787826415.823619:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136d70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:55525:x1874670563863296:12345-192.168.203.39@tcp:35:lfs.0 00000004:00080000:2.0:1787826415.824051:0:6522:0:(mdd_object.c:4014:mdd_close()) Object [0x200000405:0x28:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:2.0:1787826415.824132:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b81eb1 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.824149:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b81eb1 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.824161:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b81eb1 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.824170:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b81eb1 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.824177:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b81eb1 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.824192:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b81eb1 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.824215:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787826415.824318:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136d70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+39:55525:x1874670563863296:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 700us (2307us total) trans 8589934905 rc 0/0 00000100:00100000:2.0:1787826415.824327:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1121 00010000:00010000:1.0:1787826415.825128:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826415.825137:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b81eb1 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.825145:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834c00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:1.0:1787826415.825149:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b81eb1 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.825158:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b81eb1 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.825175:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x28:0x0].0x0 (ffff90cf0c7dac00) 00010000:00010000:1.0:1787826415.825187:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787826415.825193:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b81eb1 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.825199:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b81eb1 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.825215:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826415.825217:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826415.825219:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826415.857194:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826415.857301:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563863424 00000100:00100000:1.0:1787826415.857310:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563863424 00000100:00100000:1.0:1787826415.857383:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3748 00000100:00100000:1.0:1787826415.857393:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+39:55527:x1874670563863424:12345-192.168.203.39@tcp:101:getfattr.0 00010000:00010000:1.0:1787826415.857416:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826415.857442:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b81eb8 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0e53 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.857559:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b81ebf lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.857576:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b81ebf lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.857587:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b81ebf lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.857603:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b81ec6 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.857611:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b81ec6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.857618:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b81ec6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.857690:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b81ecd lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.857698:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b81ecd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.857704:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b81ecd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826415.857742:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:1.0:1787826415.857747:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826415.857782:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b81ecd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.857793:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b81ecd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.857803:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b81ebf lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.857810:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b81ebf lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.857816:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b81ebf lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.857823:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46a600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826415.857827:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b81ebf lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.857835:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b81ebf lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.857847:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf3ab61400) 00010000:00010000:1.0:1787826415.857850:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826415.857855:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b81ebf lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.857862:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b81ebf lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.857875:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b81ec6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.857880:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b81ec6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.857885:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b81ec6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.857891:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46bc00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826415.857893:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b81ec6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.857899:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b81ec6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.857906:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf3ab61000) 00010000:00010000:1.0:1787826415.857908:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826415.857911:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b81ec6 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.857916:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b81ec6 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.857946:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b81eb8 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e53 expref: 41 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.857961:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b81ecd lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e53 expref: 40 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826415.857968:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826415.857971:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826415.857973:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46b200, rc 0) 00000100:00100000:1.0:1787826415.858029:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55527:x1874670563863424:12345-192.168.203.39@tcp:101:getfattr.0 Request processed in 637us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826415.858035:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3748 00010000:00010000:1.0:1787826415.940260:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826415.946402:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826415.947016:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563863552 00000100:00100000:2.0:1787826415.947029:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563863552 00000100:00100000:2.0:1787826415.947096:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3749 00000100:00100000:2.0:1787826415.947106:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f05e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55531:x1874670563863552:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:2.0:1787826415.947199:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b81ed4 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.947214:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b81ed4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.947226:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b81ed4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.947240:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b81edb lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.947248:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b81edb lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.947254:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b81edb lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.947328:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81ee2 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.947337:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81ee2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.947343:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81ee2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826415.947667:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:2.0:1787826415.947671:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826415.947685:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81ee2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.947700:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b81ed4 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.947707:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b81ed4 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.947713:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b81ed4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.947720:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b81ed4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.947729:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826415.947734:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b81ed4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.947741:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b81ed4 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.947753:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf1859a900) 00010000:00010000:2.0:1787826415.947756:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826415.947761:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b81ed4 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.947775:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b81ed4 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.947795:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b81edb lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.947802:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b81edb lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.947807:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b81edb lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.947812:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826415.947814:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b81edb lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.947820:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b81edb lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.947832:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf1859a300) 00010000:00010000:2.0:1787826415.947835:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826415.947837:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b81edb lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.947843:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b81edb lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.947853:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81ee2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.947858:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81ee2 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.947864:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81ee2 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.947869:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826415.947871:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81ee2 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.947877:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81ee2 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.947885:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826415.947887:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826415.947890:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81ee2 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.948127:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81ee2 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826415.948311:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f05e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55531:x1874670563863552:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 1203us (1915us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826415.948320:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3749 00000100:00100000:0.0:1787826415.984884:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826415.985046:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563863808 00000100:00100000:2.0:1787826415.985055:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563863808 00000100:00100000:2.0:1787826415.985120:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3750 00000100:00100000:2.0:1787826415.985130:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55533:x1874670563863808:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826415.985149:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826415.985171:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81ee9 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0e5a expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.985307:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b81ef0 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.985322:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b81ef0 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.985333:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b81ef0 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826415.985343:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:2.0:1787826415.985446:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81ee9 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e5a expref: 43 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.985465:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b81ef0 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e5a expref: 42 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826415.985523:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826415.985537:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787826415.985541:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835c00, rc 0) 00000100:00100000:2.0:1787826415.985603:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+42:55533:x1874670563863808:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 474us (729us total) trans 8589934906 rc 0/0 00000100:00100000:2.0:1787826415.985611:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3750 00000100:00100000:1.0:1787826415.990417:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826415.994683:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563864064 00000100:00100000:0.0:1787826415.994699:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563864064 00000100:00100000:0.0:1787826415.995105:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3751 00000100:00100000:0.0:1787826415.995118:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+42:55533:x1874670563864064:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826415.995141:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826415.995166:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b81efe lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0e61 expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.995279:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b81f05 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.995699:0:8247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b81ecd lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e53 expref: 43 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.995711:0:8247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b81f05 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.995940:0:8247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b81ecd lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e53 expref: 43 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826415.995956:0:8247:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b81ecd lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e53 expref: 43 pid: 6518 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826415.995970:0:8247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf136d5a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8247:1874670585244928:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826415.996065:0:8247:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a13f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826416.000460:0:8247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf136d5a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8247:1874670585244928:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826416.000529:0:8247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b81f05 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826416.001324:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826416.001417:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563864192 00000100:00100000:2.0:1787826416.001425:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563864192 00010000:00010000:2.0:1787826416.001464:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b81ecd lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e53 expref: 44 pid: 6518 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826416.001539:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1135 00000100:00100000:2.0:1787826416.001548:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:2404:x1874670563864192:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826416.001565:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826416.001572:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b81ecd lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e53 expref: 44 pid: 6518 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.001583:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b81ecd lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e53 expref: 44 pid: 6518 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.001606:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b81ecd lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e53 expref: 44 pid: 6518 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.001621:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826416.001627:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b81f05 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.001637:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b81f05 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.001653:0:10340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b81f05 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.001732:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826416.001787:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:2404:x1874670563864192:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 240us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826416.001794:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1135 00010000:00010000:0.0:1787826416.006983:0:8247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b81f05 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.007002:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b81f05 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826416.007030:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:0.0:1787826416.007174:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b81efe lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e61 expref: 44 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.007213:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b81f05 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e61 expref: 43 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.007223:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826416.007226:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787826416.007229:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165fe00, rc 0) 00000100:00100000:0.0:1787826416.007374:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55533:x1874670563864064:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 12258us (16966us total) trans 8589934907 rc 0/0 00000100:00100000:0.0:1787826416.007384:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3751 00000100:00100000:1.0:1787826416.024787:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826416.029215:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563864320 00000100:00100000:2.0:1787826416.029230:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563864320 00000100:00100000:2.0:1787826416.029367:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1122 00000100:00100000:2.0:1787826416.029379:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55533:x1874670563864320:12345-192.168.203.39@tcp:33:lfs.0 00000100:00100000:2.0:1787826416.029574:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55533:x1874670563864320:12345-192.168.203.39@tcp:33:lfs.0 Request processed in 196us (4797us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826416.029582:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1122 00000100:00100000:3.0:1787826416.037400:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826416.037584:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563864576 00000100:00100000:2.0:1787826416.037593:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563864576 00000100:00100000:2.0:1787826416.037648:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1123 00000100:00100000:2.0:1787826416.037657:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f07840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55533:x1874670563864576:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:2.0:1787826416.038064:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f07840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55533:x1874670563864576:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 406us (673us total) trans 8589934908 rc 0/0 00000100:00100000:2.0:1787826416.038072:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1123 00000100:00100000:0.0:1787826416.048368:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826416.048506:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563864832 00000100:00100000:2.0:1787826416.048515:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563864832 00000100:00100000:2.0:1787826416.048581:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3752 00000100:00100000:2.0:1787826416.048591:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55533:x1874670563864832:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826416.048618:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826416.048621:0:16564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:2.0:1787826416.048647:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b81f05 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e61 expref: 44 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.048669:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b81ef0 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e5a expref: 43 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.048680:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826416.048685:0:16564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826416.048698:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81f13 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0e68 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.048793:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b81f1a lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.048871:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b81f1a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.048881:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b81f1a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826416.048952:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:2.0:1787826416.049048:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81f13 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e68 expref: 45 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.049061:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b81f1a lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e68 expref: 44 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.049075:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826416.049078:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787826416.049080:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834c00, rc 0) 00000100:00100000:2.0:1787826416.049576:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55533:x1874670563864832:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 984us (1225us total) trans 8589934909 rc 0/0 00000100:00100000:2.0:1787826416.049584:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3752 00000100:00100000:0.0:1787826416.060013:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826416.060145:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563865088 00000100:00100000:2.0:1787826416.060153:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563865088 00000100:00100000:2.0:1787826416.060216:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1124 00000100:00100000:2.0:1787826416.060226:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eea4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55533:x1874670563865088:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:2.0:1787826416.060298:0:6521:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000405:0x1d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b81f1a lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e68 expref: 44 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.060338:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81f28 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.060360:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81eaa lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e4c expref: 44 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.060369:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81f28 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.060401:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81eaa lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e4c expref: 44 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.060413:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81eaa lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e4c expref: 44 pid: 6519 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826416.060427:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f82da40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1874670585245056:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826416.060535:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce04d24e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826416.066822:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826416.066917:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f82da40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1874670585245056:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826416.066941:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81f28 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826416.067421:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563865216 00000100:00100000:3.0:1787826416.067427:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563865216 00010000:00010000:3.0:1787826416.067462:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81eaa lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e4c expref: 45 pid: 6519 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826416.067855:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1136 00000100:00100000:3.0:1787826416.067865:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+45:2403:x1874670563865216:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826416.067880:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826416.067887:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81eaa lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e4c expref: 45 pid: 6519 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.067900:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81eaa lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e4c expref: 45 pid: 6519 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.067922:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b81eaa lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e4c expref: 45 pid: 6519 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.067938:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826416.067943:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81f28 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.067952:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81f28 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.067959:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81f28 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.067983:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826416.068031:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:2403:x1874670563865216:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 167us (1217us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826416.068038:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1136 00010000:00010000:2.0:1787826416.068822:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81f28 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.068832:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81f28 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.068992:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81f28 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.068999:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81f28 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.069006:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81f28 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.069011:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826416.069015:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81f28 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.069022:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81f28 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.069032:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826416.069036:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787826416.069040:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81f28 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.069046:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81f28 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.069057:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826416.069059:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787826416.069064:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b81f1a lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e68 expref: 43 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826416.069194:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eea4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55533:x1874670563865088:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 8969us (9190us total) trans 8589934910 rc -22/-22 00000100:00100000:2.0:1787826416.069203:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1124 00000100:00100000:1.0:1787826416.082312:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826416.082459:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563865344 00000100:00100000:0.0:1787826416.082508:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563865344 00000100:00100000:0.0:1787826416.082711:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3753 00000100:00100000:0.0:1787826416.082723:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55533:x1874670563865344:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826416.082747:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826416.082769:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81f2f lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0e6f expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.082826:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81f2f lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e6f expref: 44 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.082840:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81f2f lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e6f expref: 44 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.082859:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826416.082863:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826416.082867:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165e200, rc 0) 00000100:00100000:0.0:1787826416.082930:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55533:x1874670563865344:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 209us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826416.082939:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3753 00000100:00100000:0.0:1787826416.093226:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826416.093308:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563865600 00000100:00100000:3.0:1787826416.093318:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563865600 00000100:00100000:3.0:1787826416.093391:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3754 00000100:00100000:3.0:1787826416.093410:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55533:x1874670563865600:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826416.093442:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826416.093465:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81f36 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0e76 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.094280:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b81f3d lrc: 3/1,0 mode: --/PR res: [0x200000405:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.094296:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b81f3d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.094307:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b81f3d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826416.094316:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x29:0x0]: returning size 0 00010000:00010000:3.0:1787826416.094359:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81f36 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e76 expref: 47 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.094383:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b81f3d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e76 expref: 46 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.094464:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x29:0x0].0x0 (ffff90cf39656200) 00010000:00010000:3.0:1787826416.094468:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826416.094492:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400800, rc 0) 00000100:00100000:3.0:1787826416.094682:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+46:55533:x1874670563865600:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1272us (1464us total) trans 8589934911 rc 0/0 00000100:00100000:3.0:1787826416.094690:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3754 00000100:00100000:1.0:1787826416.098997:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826416.099091:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563865856 00000100:00100000:0.0:1787826416.099100:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563865856 00000100:00100000:0.0:1787826416.099160:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3755 00000100:00100000:0.0:1787826416.099169:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+46:55533:x1874670563865856:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826416.099201:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826416.099221:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81f4b lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0e7d expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.099323:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b81f52 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.099337:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b81f52 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.099353:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b81f52 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826416.099365:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:0.0:1787826416.099521:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b81f4b lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e7d expref: 49 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.099678:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b81f52 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e7d expref: 48 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.099691:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826416.099694:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787826416.099697:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165f600, rc 0) 00000100:00100000:0.0:1787826416.099774:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55533:x1874670563865856:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 605us (789us total) trans 8589934912 rc 0/0 00000100:00100000:0.0:1787826416.099782:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3755 00000100:00100000:1.0:1787826416.109253:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826416.109646:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563866112 00000100:00100000:3.0:1787826416.109655:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563866112 00000100:00100000:3.0:1787826416.109788:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1125 00000100:00100000:3.0:1787826416.109798:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55533:x1874670563866112:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:3.0:1787826416.109875:0:14257:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000405:0x1d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b81f52 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e7d expref: 48 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.109917:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81f60 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.109930:0:14257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81f2f lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e6f expref: 48 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.109939:0:14257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81f60 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.109981:0:14257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81f2f lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e6f expref: 48 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.109995:0:14257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81f2f lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e6f expref: 48 pid: 32404 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826416.110010:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce04f07840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585245184:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826416.110098:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3ab4cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787826416.113223:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce04f07840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585245184:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826416.113252:0:14257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81f60 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826416.114808:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826416.114891:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563866240 00000100:00100000:3.0:1787826416.114899:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563866240 00010000:00010000:3.0:1787826416.114940:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81f2f lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e6f expref: 49 pid: 32404 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826416.114983:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1137 00000100:00100000:3.0:1787826416.114992:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf185d8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:2404:x1874670563866240:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826416.115006:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826416.115013:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81f2f lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e6f expref: 49 pid: 32404 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.115025:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81f2f lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e6f expref: 49 pid: 32404 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.115046:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81f2f lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e6f expref: 49 pid: 32404 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.115062:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826416.115068:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81f60 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.115078:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81f60 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.115086:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81f60 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.115115:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826416.115173:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf185d8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:2404:x1874670563866240:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 181us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826416.115192:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1137 00010000:00010000:1.0:1787826416.115545:0:14257:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81f60 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.115553:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81f60 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.115576:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b81f67 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.115588:0:14257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b81f3d lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e76 expref: 47 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.115594:0:14257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b81f67 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x29:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.115618:0:14257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b81f3d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e76 expref: 47 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.115626:0:14257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b81f3d lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e76 expref: 47 pid: 6519 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826416.115636:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fdde00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585245312:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826416.115674:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3f7d8000 going to sleep for 11 seconds 00000100:00100000:1.0:1787826416.118833:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fdde00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585245312:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826416.118863:0:14257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b81f67 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x29:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826416.119311:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826416.119579:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563866368 00000100:00100000:2.0:1787826416.119586:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563866368 00010000:00010000:2.0:1787826416.119621:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b81f3d lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e76 expref: 48 pid: 6519 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826416.119657:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1138 00000100:00100000:2.0:1787826416.119667:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:2403:x1874670563866368:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826416.119682:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826416.119688:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b81f3d lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e76 expref: 48 pid: 6519 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.119701:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b81f3d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e76 expref: 48 pid: 6519 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.119728:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b81f3d lrc: 0/0,0 mode: --/PR res: [0x200000405:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e76 expref: 48 pid: 6519 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.119744:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x29:0x0].0x0 (ffff90cf39656200) 00010000:00010000:2.0:1787826416.119749:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b81f67 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x29:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.119757:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b81f67 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x29:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.119766:0:10340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b81f67 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x29:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.119793:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826416.119845:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+47:2403:x1874670563866368:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 180us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826416.119853:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1138 00010000:00010000:3.0:1787826416.119903:0:14257:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b81f67 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x29:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.119911:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b81f67 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x29:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826416.120216:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce04f07840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585245440:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1787826416.120281:0:14257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826416.120321:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3ab4c600 going to sleep for 11 seconds 00000100:00100000:2.0:1787826416.120821:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585245440 00000100:00100000:2.0:1787826416.120827:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585245440 00000100:00100000:2.0:1787826416.120866:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1444 00000100:00100000:2.0:1787826416.120873:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+12:14257:x1874670585245440:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1787826416.120958:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+12:14257:x1874670585245440:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 85us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826416.120964:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1444 00000100:00100000:3.0:1787826416.121026:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce04f07840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585245440:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:3.0:1787826416.121073:0:14257:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934913 00000001:00080000:3.0:1787826416.121126:0:14257:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934914 00010000:00010000:3.0:1787826416.121144:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b81f67 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x29:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.121151:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b81f67 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x29:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.121158:0:14257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b81f67 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x29:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.121165:0:14257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46a400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826416.121169:0:14257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b81f67 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x29:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.121198:0:14257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b81f67 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x29:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.121214:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x29:0x0].0x0 (ffff90cf39656200) 00010000:00010000:3.0:1787826416.121217:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787826416.121222:0:14257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b81f67 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x29:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.121232:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b81f67 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x29:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.121254:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81f60 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.121259:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81f60 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.121264:0:14257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81f60 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.121268:0:14257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826416.121270:0:14257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81f60 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.121276:0:14257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81f60 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.121282:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826416.121284:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787826416.121286:0:14257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81f60 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.121291:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81f60 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.121300:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826416.121302:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787826416.121307:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b81f52 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e7d expref: 49 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826416.121532:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55533:x1874670563866112:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 11734us (12289us total) trans 8589934915 rc 0/0 00000100:00100000:3.0:1787826416.121540:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1125 00000020:00080000:3.0:1787826416.121544:0:14257:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1787826416.125114:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826416.125194:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563866496 00000100:00100000:2.0:1787826416.125203:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563866496 00000100:00100000:2.0:1787826416.125269:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3756 00000100:00100000:2.0:1787826416.125278:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55533:x1874670563866496:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826416.125302:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826416.125324:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b81f6e lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0e84 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.125391:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b81f6e lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e84 expref: 49 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.125406:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b81f6e lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e84 expref: 49 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.125424:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826416.125426:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826416.125430:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835c00, rc 0) 00000100:00100000:2.0:1787826416.125515:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:55533:x1874670563866496:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 237us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826416.125523:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3756 00000100:00100000:2.0:1787826416.130817:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826416.130899:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563866752 00000100:00100000:3.0:1787826416.130910:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563866752 00000100:00100000:3.0:1787826416.130966:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1126 00000100:00100000:3.0:1787826416.130976:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:55533:x1874670563866752:12345-192.168.203.39@tcp:35:lfs.0 00000004:00080000:3.0:1787826416.131266:0:6521:0:(mdd_object.c:4014:mdd_close()) Object [0x200000405:0x29:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787826416.131325:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].26, 64 off10312 00000004:00080000:3.0:1787826416.131335:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1362142863449ns, next at 1363142861472ns, rc = 0 00000001:00080000:3.0:1787826416.131341:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934916 00010000:00010000:3.0:1787826416.131396:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81f75 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.131414:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81f75 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.131424:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81f75 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.131432:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81f75 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.131438:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81f75 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.131444:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81f75 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.131508:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787826416.131593:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+51:55533:x1874670563866752:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 617us (784us total) trans 8589934917 rc 0/0 00000100:00100000:3.0:1787826416.131601:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1126 00000020:00080000:3.0:1787826416.131605:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787826416.131745:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826416.131753:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81f75 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.131759:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401a00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:1.0:1787826416.131764:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81f75 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.131771:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81f75 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.131784:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x29:0x0].0x0 (ffff90cf39656200) 00010000:00010000:1.0:1787826416.131787:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787826416.131792:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81f75 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.131799:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b81f75 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.131816:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826416.131818:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826416.131820:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826416.137582:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826416.137679:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563867008 00000100:00100000:3.0:1787826416.137688:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563867008 00000100:00100000:3.0:1787826416.137742:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1127 00000100:00100000:3.0:1787826416.137751:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+51:55533:x1874670563867008:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:3.0:1787826416.137964:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+52:55533:x1874670563867008:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 213us (389us total) trans 8589934918 rc 0/0 00000100:00100000:3.0:1787826416.137973:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1127 00000100:00100000:2.0:1787826416.175168:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826416.175276:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563867136 00000100:00100000:0.0:1787826416.175286:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563867136 00000100:00100000:0.0:1787826416.175346:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3757 00000100:00100000:0.0:1787826416.175372:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+52:55535:x1874670563867136:12345-192.168.203.39@tcp:101:getfattr.0 00010000:00010000:0.0:1787826416.175395:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826416.175418:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b81f7c lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0e8b expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.175531:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b81f83 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.175549:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b81f83 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.175560:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b81f83 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.175578:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81f8a lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.175585:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81f8a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.175591:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81f8a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.175677:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81f91 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.175686:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81f91 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.175693:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81f91 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826416.175736:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:0.0:1787826416.175741:0:32404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826416.175759:0:32404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81f91 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.175770:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81f91 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.175779:0:32404:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b81f83 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.175786:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b81f83 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.175792:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b81f83 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.175798:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b81f83 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.175809:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165f600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826416.175813:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b81f83 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.175819:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b81f83 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.175831:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf0c7da800) 00010000:00010000:0.0:1787826416.175835:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826416.175839:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b81f83 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.175845:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b81f83 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.175860:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81f8a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.175865:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81f8a lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.175871:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81f8a lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.175876:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165fa00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826416.175879:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81f8a lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.175885:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81f8a lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.175897:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90ce01f45600) 00010000:00010000:0.0:1787826416.175899:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826416.175902:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81f8a lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.175907:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81f8a lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.175935:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b81f7c lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e8b expref: 54 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.175952:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81f91 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e8b expref: 53 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.175960:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826416.175962:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826416.175964:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165e200, rc 0) 00000100:00100000:0.0:1787826416.176023:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55535:x1874670563867136:12345-192.168.203.39@tcp:101:getfattr.0 Request processed in 653us (864us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826416.176031:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3757 00000100:00100000:0.0:1787826416.194141:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826416.194253:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563867264 00000100:00100000:2.0:1787826416.194263:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563867264 00000100:00100000:2.0:1787826416.194324:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2079 00000100:00100000:2.0:1787826416.194334:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136d4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2404:x1874670563867264:12345-192.168.203.39@tcp:101:getfattr.0 00010000:00010000:2.0:1787826416.194365:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826416.194384:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002904bac2/0x22153cd396b81f98 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0e92 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826416.194443:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f82d680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1874670585245568:192.168.203.39@tcp:106: 00000100:00100000:2.0:1787826416.194569:0:8435:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce04d24c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826416.205222:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f82d680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1874670585245568:192.168.203.39@tcp:106: 00010000:00010000:0.0:1787826416.205263:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002904bac2/0x22153cd396b81f98 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e92 expref: 16 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.205286:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002904bac2/0x22153cd396b81f98 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e92 expref: 16 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.205300:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835a00, rc 0) 00000100:00100000:0.0:1787826416.205374:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136d4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2404:x1874670563867264:12345-192.168.203.39@tcp:101:getfattr.0 Request processed in 11033us (11236us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826416.205382:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2079 00000100:00100000:3.0:1787826416.244541:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826416.244714:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563867392 00000100:00100000:2.0:1787826416.244736:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563867392 00000100:00100000:2.0:1787826416.244802:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3758 00000100:00100000:2.0:1787826416.244813:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55539:x1874670563867392:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:2.0:1787826416.244888:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81f9f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.244905:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81f9f lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.244916:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81f9f lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.244929:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81fa6 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.244936:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81fa6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.244943:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81fa6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.245009:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b81fad lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.245018:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b81fad lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.245024:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b81fad lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826416.245067:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:2.0:1787826416.245071:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826416.245083:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b81fad lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.245095:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81f9f lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.245102:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81f9f lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.245107:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81f9f lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.245114:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81f9f lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.245119:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826416.245123:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81f9f lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.245129:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81f9f lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.245140:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf1859a300) 00010000:00010000:2.0:1787826416.245143:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826416.245147:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81f9f lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.245154:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b81f9f lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.245185:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81fa6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.245192:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81fa6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.245198:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81fa6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.245203:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826416.245206:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81fa6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.245213:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81fa6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.245220:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf1859a900) 00010000:00010000:2.0:1787826416.245222:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826416.245225:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81fa6 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.245231:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b81fa6 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.245243:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b81fad lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.245249:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b81fad lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.245255:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b81fad lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.245261:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826416.245264:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b81fad lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.245270:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b81fad lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.245277:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826416.245280:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826416.245283:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b81fad lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.245289:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b81fad lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826416.245530:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55539:x1874670563867392:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 717us (998us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826416.245539:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3758 00000100:00100000:2.0:1787826416.275691:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826416.275794:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563867648 00000100:00100000:1.0:1787826416.275803:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563867648 00000100:00100000:1.0:1787826416.275862:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3759 00000100:00100000:1.0:1787826416.275872:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55541:x1874670563867648:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826416.275891:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826416.275910:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b81fb4 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0e99 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.276008:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b81fbb lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.276023:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b81fbb lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.276034:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b81fbb lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826416.276046:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:1.0:1787826416.276141:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b81fb4 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e99 expref: 56 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.276159:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b81fbb lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e99 expref: 55 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.276168:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826416.276171:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787826416.276184:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46b000, rc 0) 00000100:00100000:1.0:1787826416.276245:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+55:55541:x1874670563867648:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 375us (562us total) trans 8589934919 rc 0/0 00000100:00100000:1.0:1787826416.276256:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3759 00000100:00100000:1.0:1787826416.281752:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826416.281847:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563867776 00000100:00100000:3.0:1787826416.281857:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563867776 00000100:00100000:3.0:1787826416.281915:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2080 00000100:00100000:3.0:1787826416.281925:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f808f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2402:x1874670563867776:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826416.281945:0:30398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826416.281963:0:30398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000482bb568/0x22153cd396b81fc9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0ea0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826416.282025:0:30398:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce04f07840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:30398:1874670585245696:192.168.203.39@tcp:106: 00000100:00100000:3.0:1787826416.282199:0:30398:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf1850cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826416.284896:0:30398:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce04f07840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:30398:1874670585245696:192.168.203.39@tcp:106: 00010000:00010000:1.0:1787826416.284936:0:30398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000482bb568/0x22153cd396b81fc9 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ea0 expref: 16 pid: 30398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.284960:0:30398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000482bb568/0x22153cd396b81fc9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ea0 expref: 16 pid: 30398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.284974:0:30398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400200, rc 0) 00000100:00100000:1.0:1787826416.285085:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f808f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2402:x1874670563867776:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 3160us (3343us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826416.285094:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2080 00000100:00100000:2.0:1787826416.290316:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826416.290415:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563868032 00000100:00100000:0.0:1787826416.290426:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563868032 00000100:00100000:0.0:1787826416.290507:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3760 00000100:00100000:0.0:1787826416.290517:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+55:55541:x1874670563868032:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826416.290539:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826416.290561:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b81fd0 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0ea7 expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.290659:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81fd7 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.290672:0:9966:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81f91 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e8b expref: 56 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.290680:0:9966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81fd7 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.290709:0:9966:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81f91 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e8b expref: 56 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.290722:0:9966:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81f91 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e8b expref: 56 pid: 32404 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826416.290740:0:9966:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf136d7840 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9966:1874670585245824:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826416.290827:0:9966:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a139c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826416.293374:0:9966:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf136d7840 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9966:1874670585245824:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826416.293405:0:9966:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81fd7 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826416.294908:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826416.294990:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563868160 00000100:00100000:3.0:1787826416.294998:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563868160 00010000:00010000:3.0:1787826416.295039:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81f91 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e8b expref: 57 pid: 32404 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826416.295085:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1139 00000100:00100000:3.0:1787826416.295095:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+57:2404:x1874670563868160:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826416.295109:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826416.295116:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81f91 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e8b expref: 57 pid: 32404 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.295129:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81f91 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e8b expref: 57 pid: 32404 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.295155:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b81f91 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e8b expref: 57 pid: 32404 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.295172:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826416.295188:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81fd7 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.295197:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81fd7 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.295205:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81fd7 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.295240:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826416.295300:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+56:2404:x1874670563868160:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 206us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826416.295309:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1139 00010000:00010000:0.0:1787826416.295441:0:9966:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81fd7 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.295449:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81fd7 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826416.295512:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:0.0:1787826416.295631:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b81fd0 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ea7 expref: 57 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.295646:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81fd7 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ea7 expref: 56 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.295654:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826416.295656:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787826416.295659:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165fa00, rc 0) 00000100:00100000:0.0:1787826416.295686:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+56:55541:x1874670563868032:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 5171us (5381us total) trans 8589934920 rc 0/0 00000100:00100000:0.0:1787826416.295693:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3760 00000100:00100000:2.0:1787826416.299784:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826416.299873:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563868416 00000100:00100000:1.0:1787826416.299882:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563868416 00000100:00100000:1.0:1787826416.299940:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3761 00000100:00100000:1.0:1787826416.299951:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+56:55541:x1874670563868416:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826416.299972:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826416.299995:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b81fe5 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0eae expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.300435:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b81fec lrc: 3/1,0 mode: --/PR res: [0x200000405:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.300448:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b81fec lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.300459:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b81fec lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826416.300515:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x2a:0x0]: returning size 0 00010000:00010000:1.0:1787826416.300559:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b81fe5 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0eae expref: 59 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.300581:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b81fec lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0eae expref: 58 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.300589:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2a:0x0].0x0 (ffff90cf3ab61000) 00010000:00010000:1.0:1787826416.300592:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826416.300595:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46aa00, rc 0) 00000100:00100000:1.0:1787826416.300644:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:55541:x1874670563868416:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 696us (886us total) trans 8589934921 rc 0/0 00000100:00100000:1.0:1787826416.300652:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3761 00000100:00100000:2.0:1787826416.306732:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826416.306834:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563868672 00000100:00100000:3.0:1787826416.306843:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563868672 00000100:00100000:3.0:1787826416.306906:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3762 00000100:00100000:3.0:1787826416.306915:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:55541:x1874670563868672:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826416.306937:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826416.306958:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b81ffa lrc: 2/0,0 mode: --/CR res: [0x200000405:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0eb5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.307060:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b82001 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.307086:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b81fec lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0eae expref: 59 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.307095:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b82001 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.307125:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b81fec lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0eae expref: 59 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.307139:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b81fec lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0eae expref: 59 pid: 6518 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826416.307151:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce04f07840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1874670585245952:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826416.307235:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf1850c300 going to sleep for 11 seconds 00000100:00100000:3.0:1787826416.311922:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce04f07840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1874670585245952:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826416.311953:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b82001 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826416.312036:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826416.312107:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563868800 00000100:00100000:3.0:1787826416.312113:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563868800 00010000:00010000:3.0:1787826416.312147:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b81fec lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0eae expref: 60 pid: 6518 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826416.312186:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1140 00000100:00100000:3.0:1787826416.312195:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049b92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:2403:x1874670563868800:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826416.312209:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826416.312215:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b81fec lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0eae expref: 60 pid: 6518 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.312225:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b81fec lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0eae expref: 60 pid: 6518 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.312246:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b81fec lrc: 0/0,0 mode: --/PR res: [0x200000405:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0eae expref: 60 pid: 6518 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.312261:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2a:0x0].0x0 (ffff90cf3ab61000) 00010000:00010000:3.0:1787826416.312266:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b82001 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.312274:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b82001 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.312282:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b82001 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.312314:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826416.312498:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b82001 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.312506:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b82001 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826416.312527:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x2a:0x0]: returning size 0 00000004:00080000:0.0:1787826416.312684:0:6519:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x108:0x0], index 0: 0 00010000:00010000:0.0:1787826416.312854:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b82001 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.312863:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b82001 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.312870:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b82001 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.312876:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826416.312880:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b82001 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.312888:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b82001 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.312898:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2a:0x0].0x0 (ffff90cf3ab61000) 00010000:00010000:0.0:1787826416.312901:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826416.312904:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b82001 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.312910:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b82001 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.312953:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b81ffa lrc: 1/0,0 mode: --/CR res: [0x200000405:0x2a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0eb5 expref: 60 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.312967:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2a:0x0].0x0 (ffff90cf3ab61000) 00010000:00010000:0.0:1787826416.312970:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787826416.312973:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b81ffa lrc: 0/0,0 mode: --/CR res: [0x200000405:0x2a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0eb5 expref: 60 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.312987:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401200, rc 0) 00000100:00100000:0.0:1787826416.313136:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55541:x1874670563868672:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 6221us (6412us total) trans 8589934922 rc 301/301 00000100:00100000:0.0:1787826416.313144:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3762 00000100:00100000:3.0:1787826416.313255:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049b92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:2403:x1874670563868800:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 1060us (1219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826416.313263:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1140 00000100:00100000:2.0:1787826416.316831:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826416.316895:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563869056 00000100:00100000:0.0:1787826416.316904:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563869056 00000100:00100000:0.0:1787826416.316956:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1128 00000100:00100000:0.0:1787826416.316966:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049bbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:55541:x1874670563869056:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:0.0:1787826416.317218:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049bbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55541:x1874670563869056:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 253us (396us total) trans 8589934923 rc 0/0 00000100:00100000:0.0:1787826416.317225:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1128 00000100:00100000:1.0:1787826416.319806:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826416.319985:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563869184 00000100:00100000:2.0:1787826416.319993:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563869184 00000100:00100000:2.0:1787826416.320046:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3763 00000100:00100000:2.0:1787826416.320056:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f809e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55541:x1874670563869184:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826416.320078:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826416.320098:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b8200f lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0ebc expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.320190:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82016 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.320205:0:16564:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81fd7 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ea7 expref: 60 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.320214:0:16564:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82016 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.320246:0:16564:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81fd7 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ea7 expref: 60 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.320259:0:16564:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81fd7 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ea7 expref: 60 pid: 9966 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826416.320272:0:16564:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce049b8f00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:16564:1874670585246080:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826416.320369:0:16564:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce04d24240 going to sleep for 11 seconds 00000100:00100000:2.0:1787826416.323615:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826416.323723:0:16564:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce049b8f00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:16564:1874670585246080:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826416.323750:0:16564:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82016 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826416.323912:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563869312 00000100:00100000:3.0:1787826416.323919:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563869312 00010000:00010000:3.0:1787826416.323955:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81fd7 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ea7 expref: 61 pid: 9966 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826416.323996:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1141 00000100:00100000:3.0:1787826416.324005:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+61:2403:x1874670563869312:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826416.324021:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826416.324027:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81fd7 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ea7 expref: 61 pid: 9966 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.324039:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81fd7 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ea7 expref: 61 pid: 9966 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.324061:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b81fd7 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ea7 expref: 61 pid: 9966 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.324076:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826416.324080:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82016 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.324089:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82016 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.324096:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82016 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.324123:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826416.324185:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:2403:x1874670563869312:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 171us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826416.324192:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1141 00010000:00010000:1.0:1787826416.324666:0:16564:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82016 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.324675:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82016 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826416.324724:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:1.0:1787826416.324728:0:16564:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826416.324746:0:16564:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82016 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.324788:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b8200f lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ebc expref: 60 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.324805:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82016 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ebc expref: 59 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.324813:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826416.324816:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826416.324819:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834600, rc 0) 00000100:00100000:1.0:1787826416.324855:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f809e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55541:x1874670563869184:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 4801us (5057us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826416.324862:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3763 00000100:00100000:2.0:1787826416.330692:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826416.330802:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563869440 00000100:00100000:1.0:1787826416.330812:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563869440 00000100:00100000:1.0:1787826416.330869:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2081 00000100:00100000:1.0:1787826416.330880:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2404:x1874670563869440:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826416.330898:0:28853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826416.330915:0:28853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bacf1a1a/0x22153cd396b8201d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0ec3 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826416.330974:0:28853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f80a1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28853:1874670585246208:192.168.203.39@tcp:106: 00000100:00100000:1.0:1787826416.331052:0:28853:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3f7d8900 going to sleep for 11 seconds 00000100:00100000:1.0:1787826416.334086:0:28853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f80a1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28853:1874670585246208:192.168.203.39@tcp:106: 00010000:00010000:1.0:1787826416.334125:0:28853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bacf1a1a/0x22153cd396b8201d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ec3 expref: 16 pid: 28853 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.334146:0:28853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bacf1a1a/0x22153cd396b8201d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ec3 expref: 16 pid: 28853 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.334158:0:28853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46b200, rc 0) 00000100:00100000:1.0:1787826416.334221:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2404:x1874670563869440:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 3342us (3539us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826416.334230:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2081 00000100:00100000:2.0:1787826416.337454:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826416.337954:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563869568 00000100:00100000:0.0:1787826416.337965:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563869568 00000100:00100000:0.0:1787826416.338058:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3764 00000100:00100000:0.0:1787826416.338068:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab93c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55541:x1874670563869568:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826416.338088:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826416.338111:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b82024 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0eca expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.338191:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b8202b lrc: 3/1,0 mode: --/PR res: [0x200000405:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.338205:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b8202b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x2a:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.338216:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b8202b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x2a:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826416.338258:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x2a:0x0]: returning size 0 00000004:00200000:0.0:1787826416.338263:0:9966:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826416.338277:0:9966:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b8202b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x2a:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.338312:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b82024 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0eca expref: 61 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.338328:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b8202b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x2a:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0eca expref: 60 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.338336:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2a:0x0].0x0 (ffff90ce01f45600) 00010000:00010000:0.0:1787826416.338339:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787826416.338342:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165f600, rc 0) 00000100:00100000:0.0:1787826416.338596:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab93c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:55541:x1874670563869568:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 529us (1150us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826416.338603:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3764 00000100:00100000:2.0:1787826416.341907:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826416.341990:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563869696 00000100:00100000:1.0:1787826416.341999:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563869696 00000100:00100000:1.0:1787826416.342088:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2082 00000100:00100000:1.0:1787826416.342099:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab91680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2403:x1874670563869696:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826416.342116:0:30694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826416.342136:0:30694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065f23c08/0x22153cd396b82032 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x108:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0ed1 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826416.342161:0:30694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x108:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826416.342193:0:30694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x108:0x0].0x0 since=1362s v=(0 0) 00010000:00010000:1.0:1787826416.342198:0:30694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x108:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826416.342207:0:30694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065f23c08/0x22153cd396b82032 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x108:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ed1 expref: 14 pid: 30694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.342226:0:30694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065f23c08/0x22153cd396b82032 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x108:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ed1 expref: 14 pid: 30694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.342243:0:30694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46a800, rc 0) 00000100:00100000:1.0:1787826416.342344:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab91680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2403:x1874670563869696:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 247us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826416.342499:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2082 00000100:00100000:0.0:1787826416.345755:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826416.345998:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563869952 00000100:00100000:1.0:1787826416.346008:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563869952 00000100:00100000:1.0:1787826416.346073:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3765 00000100:00100000:1.0:1787826416.346084:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:55541:x1874670563869952:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826416.346103:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826416.346121:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b82039 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0ed8 expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.346254:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82040 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.346270:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82040 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.346282:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82040 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826416.346295:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:1.0:1787826416.346411:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b82039 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ed8 expref: 63 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.346430:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82040 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ed8 expref: 62 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.346445:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826416.346448:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787826416.346452:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46a600, rc 0) 00000100:00100000:1.0:1787826416.346708:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+62:55541:x1874670563869952:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 624us (960us total) trans 8589934924 rc 0/0 00000100:00100000:1.0:1787826416.346717:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3765 00000100:00100000:3.0:1787826416.350804:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826416.350943:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563870080 00000100:00100000:0.0:1787826416.350952:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563870080 00000100:00100000:0.0:1787826416.351005:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2083 00000100:00100000:0.0:1787826416.351015:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f07840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2404:x1874670563870080:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826416.351035:0:30696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826416.351051:0:30696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091cba634/0x22153cd396b8204e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0edf expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826416.351108:0:30696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf136d70c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:30696:1874670585246336:192.168.203.39@tcp:106: 00000100:00100000:0.0:1787826416.351196:0:30696:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce02742d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787826416.354015:0:30696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf136d70c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:30696:1874670585246336:192.168.203.39@tcp:106: 00010000:00010000:3.0:1787826416.354054:0:30696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000091cba634/0x22153cd396b8204e lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0edf expref: 16 pid: 30696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.354078:0:30696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091cba634/0x22153cd396b8204e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0edf expref: 16 pid: 30696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.354092:0:30696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165f400, rc 0) 00000100:00100000:3.0:1787826416.354149:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f07840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2404:x1874670563870080:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 3135us (3355us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826416.354158:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2083 00000100:00100000:2.0:1787826416.357941:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826416.358031:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563870208 00000100:00100000:1.0:1787826416.358040:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563870208 00000100:00100000:1.0:1787826416.358100:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2084 00000100:00100000:1.0:1787826416.358110:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2403:x1874670563870208:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826416.358126:0:8545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826416.358144:0:8545:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bacf1a1a/0x22153cd396b82055 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0ee6 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826416.358209:0:8545:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f80a1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8545:1874670585246464:192.168.203.39@tcp:106: 00000100:00100000:1.0:1787826416.358299:0:8545:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3f7d8780 going to sleep for 11 seconds 00000100:00100000:1.0:1787826416.360704:0:8545:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f80a1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8545:1874670585246464:192.168.203.39@tcp:106: 00010000:00010000:1.0:1787826416.360743:0:8545:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bacf1a1a/0x22153cd396b82055 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ee6 expref: 16 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.360776:0:8545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bacf1a1a/0x22153cd396b82055 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ee6 expref: 16 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.360791:0:8545:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46b200, rc 0) 00000100:00100000:1.0:1787826416.360845:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2403:x1874670563870208:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 2736us (2915us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826416.360854:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2084 00000100:00100000:2.0:1787826416.363316:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826416.363503:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563870336 00000100:00100000:1.0:1787826416.363512:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563870336 00000100:00100000:1.0:1787826416.363572:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2085 00000100:00100000:1.0:1787826416.363582:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2404:x1874670563870336:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:1.0:1787826416.363626:0:30695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000421aa0a2/0x22153cd396b8205c lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.363646:0:30695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b81e87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e3e expref: 15 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.363655:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x108:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787826416.363660:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x108:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826416.363665:0:30695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000421aa0a2/0x22153cd396b8205c lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.363699:0:30695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b81e87 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e3e expref: 15 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.363713:0:30695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b81e87 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e3e expref: 15 pid: 30695 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826416.363726:0:30695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f80a1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:30695:1874670585246592:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826416.363803:0:30695:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3f7d8780 going to sleep for 11 seconds 00000100:00100000:1.0:1787826416.365807:0:30695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f80a1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:30695:1874670585246592:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826416.365836:0:30695:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000421aa0a2/0x22153cd396b8205c lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826416.367906:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826416.367980:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563870464 00000100:00100000:1.0:1787826416.367989:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563870464 00010000:00010000:1.0:1787826416.368027:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b81e87 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e3e expref: 16 pid: 30695 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826416.368068:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1142 00000100:00100000:1.0:1787826416.368078:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2403:x1874670563870464:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826416.368092:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826416.368113:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b81e87 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x108:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e3e expref: 16 pid: 30695 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.368126:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b81e87 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x108:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e3e expref: 16 pid: 30695 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.368151:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b81e87 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x108:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e3e expref: 16 pid: 30695 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.368167:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x108:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826416.368171:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x108:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826416.368187:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000421aa0a2/0x22153cd396b8205c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.368202:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000421aa0a2/0x22153cd396b8205c lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.368284:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826416.368338:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2403:x1874670563870464:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 261us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826416.368346:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1142 00010000:00010000:0.0:1787826416.370191:0:30695:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000421aa0a2/0x22153cd396b8205c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x108:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.370209:0:30695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000421aa0a2/0x22153cd396b8205c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x108:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.370236:0:30695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000421aa0a2/0x22153cd396b8205c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x108:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.370244:0:30695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000421aa0a2/0x22153cd396b8205c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x108:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.370252:0:30695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000421aa0a2/0x22153cd396b8205c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x108:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.370260:0:30695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46bc00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826416.370264:0:30695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000421aa0a2/0x22153cd396b8205c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x108:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.370272:0:30695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000421aa0a2/0x22153cd396b8205c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x108:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.370291:0:30695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000421aa0a2/0x22153cd396b8205c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x108:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.370300:0:30695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000421aa0a2/0x22153cd396b8205c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x108:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826416.370771:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563870336:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 7178us (7452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826416.370782:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2085 00000100:00100000:2.0:1787826416.373609:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826416.373721:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563870592 00000100:00100000:3.0:1787826416.373729:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563870592 00000100:00100000:3.0:1787826416.373792:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2086 00000100:00100000:3.0:1787826416.373802:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2401:x1874670563870592:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826416.373820:0:14864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826416.373841:0:14864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a816990/0x22153cd396b82063 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x108:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0eed expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826416.373866:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x108:0x0] initial LVB size: 0, mtime: 0x6a9010ec, atime: 0x6a9010ec, ctime: 0x6a9010f0, blocks: 0x0 00010000:00010000:3.0:1787826416.373887:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x108:0x0].0x0 since=1362s v=(0 0) 00010000:00010000:3.0:1787826416.373892:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x108:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826416.373901:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a816990/0x22153cd396b82063 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x108:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0eed expref: 15 pid: 14864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.373919:0:14864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003a816990/0x22153cd396b82063 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x108:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0eed expref: 15 pid: 14864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.373931:0:14864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401400, rc 0) 00000100:00100000:3.0:1787826416.373989:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2401:x1874670563870592:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 188us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826416.373996:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2086 00000100:00100000:2.0:1787826416.435637:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826416.435780:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563870720 00000100:00100000:0.0:1787826416.435790:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563870720 00000100:00100000:0.0:1787826416.435859:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3766 00000100:00100000:0.0:1787826416.435868:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+62:55541:x1874670563870720:12345-192.168.203.39@tcp:44:lfs.0 00000001:00080000:3.0:1787826416.441532:0:34481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934924 is committed 00000004:00080000:3.0:1787826416.441566:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 27 committed 00000020:00080000:3.0:1787826416.441617:0:34481:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90cf10aba180 refcount 2 committed 0 result 0 batchid 4294969334 00000020:00080000:3.0:1787826416.441622:0:34481:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cf1f111200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90cf10aba480 00000020:00080000:3.0:1787826416.441626:0:34481:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cf1f111e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90ce04881400 00000020:00080000:3.0:1787826416.441650:0:34481:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969333 batchid updated 00000020:00080000:2.0:1787826416.441721:0:34512:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969334 committed batchid 4294969333 00000020:00080000:2.0:1787826416.441789:0:34512:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969333 00000100:00100000:3.0:1787826416.442023:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787826416.442042:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f80a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585246720:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787826416.442106:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826416.442234:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585246720 00000100:00100000:1.0:1787826416.442242:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585246720 00000100:00100000:1.0:1787826416.442293:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2087 00000100:00100000:1.0:1787826416.442301:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:3644:x1874670585246720:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787826416.442326:0:8436:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:263 count 1 00010000:00010000:1.0:1787826416.442362:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bacf1a1a/0x22153cd396b8206a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.442385:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008c800962/0x22153cd396b81e95 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e45 expref: 13 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.442394:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x107:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787826416.442398:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x107:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826416.442403:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bacf1a1a/0x22153cd396b8206a lrc: 4/0,1 mode: --/PW res: [0x280000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.442430:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008c800962/0x22153cd396b81e95 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e45 expref: 13 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.442449:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008c800962/0x22153cd396b81e95 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e45 expref: 13 pid: 8436 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826416.442460:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f80a940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1874670585246848:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826416.442584:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3f7d8780 going to sleep for 11 seconds 00010000:00010000:0.0:1787826416.443019:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b81e79 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.443030:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b81e79 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.443037:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b81e79 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.443043:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165e000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826416.443048:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b81e79 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.443056:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b81e79 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.443073:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x28:0x0].0x0 (ffff90cf0c7dac00) 00010000:00010000:0.0:1787826416.443075:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826416.443080:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b81e79 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.443086:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b81e79 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.443109:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b81e8e lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.443117:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b81e8e lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.443122:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b81e8e lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.443128:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826416.443131:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b81e8e lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.443137:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b81e8e lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.443145:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826416.443147:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826416.443150:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b81e8e lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.443156:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b81e8e lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826416.443262:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:55541:x1874670563870720:12345-192.168.203.39@tcp:44:lfs.0 Request processed in 7395us (7635us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826416.443272:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3766 00000100:00100000:2.0:1787826416.458984:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826416.459205:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563870848 00000100:00100000:3.0:1787826416.459215:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563870848 00000100:00100000:3.0:1787826416.459278:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2088 00000100:00100000:3.0:1787826416.459287:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab14f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2403:x1874670563870848:12345-192.168.203.39@tcp:16:lfs.0 00000100:00100000:3.0:1787826416.459399:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab14f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2403:x1874670563870848:12345-192.168.203.39@tcp:16:lfs.0 Request processed in 112us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826416.459408:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2088 00000100:00100000:1.0:1787826416.460204:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f80a940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1874670585246848:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826416.460230:0:8436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bacf1a1a/0x22153cd396b8206a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826416.460551:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826416.461941:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563870976 00000100:00100000:2.0:1787826416.461952:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563870976 00010000:00010000:2.0:1787826416.461992:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008c800962/0x22153cd396b81e95 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e45 expref: 14 pid: 8436 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826416.462033:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1143 00000100:00100000:2.0:1787826416.462042:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2403:x1874670563870976:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826416.462056:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826416.462061:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008c800962/0x22153cd396b81e95 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x107:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e45 expref: 14 pid: 8436 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.462075:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008c800962/0x22153cd396b81e95 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x107:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e45 expref: 14 pid: 8436 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.462109:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c800962/0x22153cd396b81e95 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x107:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e45 expref: 14 pid: 8436 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.462126:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x107:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826416.462130:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x107:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826416.462135:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bacf1a1a/0x22153cd396b8206a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.462151:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bacf1a1a/0x22153cd396b8206a lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x107:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.462189:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826416.462312:0:8436:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bacf1a1a/0x22153cd396b8206a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x107:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.462321:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bacf1a1a/0x22153cd396b8206a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x107:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.462331:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bacf1a1a/0x22153cd396b8206a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x107:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.462339:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bacf1a1a/0x22153cd396b8206a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x107:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.462359:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787826416.462547:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3644:x1874670585246720:12345-0@lo:6:osp-syn-0-0.0 Request processed in 20246us (20440us total) trans 21474837003 rc 0/0 00000100:00100000:1.0:1787826416.462556:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2087 00010000:00010000:1.0:1787826416.462577:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826416.462584:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bacf1a1a/0x22153cd396b8206a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x107:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.462592:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46b200 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:1.0:1787826416.462597:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bacf1a1a/0x22153cd396b8206a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x107:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.462607:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bacf1a1a/0x22153cd396b8206a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x107:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.462619:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bacf1a1a/0x22153cd396b8206a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x107:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.462627:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bacf1a1a/0x22153cd396b8206a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x107:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.462645:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826416.462647:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826416.462648:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787826416.462678:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3f80a1c0/2, rc 0, transno 21474837003 00000100:00100000:1.0:1787826416.462684:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f80a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585246720:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787826416.463001:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2403:x1874670563870976:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 958us (2449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826416.463010:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1143 00000100:00100000:2.0:1787826416.505420:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826416.505551:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563871104 00000100:00100000:0.0:1787826416.505560:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563871104 00000100:00100000:0.0:1787826416.505618:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2089 00000100:00100000:0.0:1787826416.505628:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9acb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2403:x1874670563871104:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:0.0:1787826416.505670:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004185bcb5/0x22153cd396b82071 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.505686:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x108:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826416.505691:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x108:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826416.505696:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004185bcb5/0x22153cd396b82071 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.505709:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004185bcb5/0x22153cd396b82071 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.505733:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004185bcb5/0x22153cd396b82071 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.505742:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004185bcb5/0x22153cd396b82071 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.505751:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004185bcb5/0x22153cd396b82071 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.505759:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165ee00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826416.505763:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004185bcb5/0x22153cd396b82071 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.505774:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004185bcb5/0x22153cd396b82071 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.505789:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004185bcb5/0x22153cd396b82071 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.505798:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004185bcb5/0x22153cd396b82071 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826416.505881:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9acb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2403:x1874670563871104:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 253us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826416.505896:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2089 00000100:00100000:0.0:1787826416.510446:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826416.510610:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563871360 00000100:00100000:1.0:1787826416.510619:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563871360 00000100:00100000:1.0:1787826416.510682:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3767 00000100:00100000:1.0:1787826416.510693:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136d70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:55541:x1874670563871360:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:1.0:1787826416.510747:0:16564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826416.510775:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b8202b lrc: 0/0,0 mode: --/PR res: [0x200000405:0x2a:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0eca expref: 33 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.510796:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2a:0x0].0x0 (ffff90ce01f45600) 00010000:00010000:1.0:1787826416.510816:0:16564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826416.510849:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b82078 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.510862:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b82078 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.510872:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b82078 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826416.510992:0:16564:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ae9fb4f3 reply state 00000000c96a2961 transno 8589934925 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b82078 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.511004:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b82078 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.511009:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2a:0x0].0x0 (ffff90cf3ab61e00) 00010000:00010000:1.0:1787826416.511011:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826416.511014:0:16564:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826416.514000:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136d70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:55541:x1874670563871360:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 3298us (3552us total) trans 8589934925 rc 0/0 00000100:00100000:1.0:1787826416.514014:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3767 00000100:00100000:3.0:1787826416.517010:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826416.517262:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563871488 00000100:00100000:0.0:1787826416.517272:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563871488 00000100:00100000:0.0:1787826416.517330:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3768 00000100:00100000:0.0:1787826416.517339:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa85a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:55541:x1874670563871488:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826416.517372:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826416.517392:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b8207f lrc: 2/0,0 mode: --/CR res: [0x200000405:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0ef4 expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.517450:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b8207f lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ef4 expref: 35 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.517464:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b8207f lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ef4 expref: 35 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.517520:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2a:0x0].0x0 (ffff90cf3ab61e00) 00010000:00010000:0.0:1787826416.517523:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826416.517527:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165fc00, rc 0) 00000100:00100000:0.0:1787826416.517577:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa85a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:55541:x1874670563871488:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 239us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826416.517584:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3768 00000100:00100000:0.0:1787826416.529570:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826416.529661:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563871616 00000100:00100000:3.0:1787826416.529670:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563871616 00000100:00100000:3.0:1787826416.529727:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2090 00000100:00100000:3.0:1787826416.529737:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03976940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:55541:x1874670563871616:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826416.529755:0:30398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826416.529773:0:30398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d612c5b/0x22153cd396b82086 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0efb expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.529814:0:30398:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065f23c08/0x22153cd396b82032 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ed1 expref: 14 pid: 30694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.529824:0:30398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x108:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826416.529828:0:30398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x108:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826416.529833:0:30398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d612c5b/0x22153cd396b82086 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0efb expref: 14 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.529870:0:30398:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000065f23c08/0x22153cd396b82032 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ed1 expref: 14 pid: 30694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.529884:0:30398:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000065f23c08/0x22153cd396b82032 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ed1 expref: 14 pid: 30694 timeout: 1462 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826416.529904:0:30398:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3fb970c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:30398:1874670585246976:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826416.529989:0:30398:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf1850c300 going to sleep for 11 seconds 00000100:00100000:2.0:1787826416.546228:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826416.546309:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563871744 00000100:00100000:0.0:1787826416.546318:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563871744 00010000:00010000:0.0:1787826416.546366:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000065f23c08/0x22153cd396b82032 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ed1 expref: 15 pid: 30694 timeout: 1462 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826416.546409:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1144 00000100:00100000:0.0:1787826416.546419:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf185db850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2404:x1874670563871744:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826416.546435:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826416.546456:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000065f23c08/0x22153cd396b82032 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x108:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ed1 expref: 15 pid: 30694 timeout: 1462 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.546499:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000065f23c08/0x22153cd396b82032 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x108:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ed1 expref: 15 pid: 30694 timeout: 1462 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.546526:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x108:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826416.546530:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x108:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826416.546537:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006d612c5b/0x22153cd396b82086 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x108:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0efb expref: 15 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.546548:0:10341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d612c5b/0x22153cd396b82086 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x108:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0efb expref: 15 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.546583:0:10341:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006d612c5b/0x22153cd396b82086 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x108:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0efb expref: 15 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826416.546597:0:10341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce063061c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10341:1874670585247104:192.168.203.39@tcp:105: 00000100:00100000:0.0:1787826416.546676:0:10341:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce02742540 going to sleep for 11 seconds 00010000:00010000:3.0:1787826416.547722:0:30398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065f23c08/0x22153cd396b82032 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x108:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ed1 expref: 15 pid: 30694 timeout: 1462 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826416.547741:0:30398:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3fb970c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:30398:1874670585246976:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826416.547768:0:30398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006d612c5b/0x22153cd396b82086 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0efb expref: 14 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.547780:0:30398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400000, rc 0) 00000100:00100000:3.0:1787826416.548005:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03976940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:55541:x1874670563871616:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 18268us (18443us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826416.548013:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2090 00000100:00100000:3.0:1787826416.550196:0:10341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce063061c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10341:1874670585247104:192.168.203.39@tcp:105: 00010000:00010000:3.0:1787826416.550223:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826416.550278:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf185db850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2404:x1874670563871744:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3859us (4058us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826416.550288:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1144 00000100:00100000:2.0:1787826416.557625:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826416.558078:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563871872 00000100:00100000:3.0:1787826416.558089:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563871872 00000100:00100000:3.0:1787826416.558200:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2091 00000100:00100000:3.0:1787826416.558210:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9afc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2404:x1874670563871872:12345-192.168.203.39@tcp:2:lfs.0 00002000:00010000:3.0:1787826416.558385:0:14864:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x108:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787826416.558389:0:14864:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x108:0x0] updating lvb mtime from disk: 0 -> 1787826412 00002000:00010000:3.0:1787826416.558391:0:14864:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x108:0x0] updating lvb atime from disk: 0 -> 1787826412 00002000:00010000:3.0:1787826416.558393:0:14864:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x108:0x0] updating lvb ctime from disk: 0 -> 1787826417 00002000:00010000:3.0:1787826416.558395:0:14864:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x108:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1787826416.558460:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9afc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563871872:12345-192.168.203.39@tcp:2:lfs.0 Request processed in 251us (841us total) trans 21474837004 rc 0/0 00000100:00100000:3.0:1787826416.558467:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2091 00000100:00100000:2.0:1787826416.565016:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826416.565143:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563872128 00000100:00100000:1.0:1787826416.565153:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563872128 00000100:00100000:1.0:1787826416.565228:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3769 00000100:00100000:1.0:1787826416.565238:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9af840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:55541:x1874670563872128:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:1.0:1787826416.565290:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826416.565318:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82016 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ebc expref: 35 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.565338:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826416.565343:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826416.565604:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b8208d lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.565619:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b8208d lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.565630:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b8208d lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826416.565731:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009ccab1a1 reply state 0000000080854ff0 transno 8589934926 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b8208d lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.565744:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b8208d lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.565764:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826416.565767:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826416.565770:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826416.565858:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9af840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55541:x1874670563872128:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 621us (853us total) trans 8589934926 rc 0/0 00000100:00100000:1.0:1787826416.565866:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3769 00000100:00100000:0.0:1787826416.574394:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826416.574513:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563872256 00000100:00100000:2.0:1787826416.574521:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563872256 00000100:00100000:2.0:1787826416.574573:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2092 00000100:00100000:2.0:1787826416.574583:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce063061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:55541:x1874670563872256:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826416.574599:0:30694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826416.574615:0:30694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b82094 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0f02 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.574644:0:30694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003a816990/0x22153cd396b82063 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0eed expref: 16 pid: 14864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.574653:0:30694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x108:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826416.574657:0:30694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x108:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826416.574663:0:30694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b82094 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f02 expref: 16 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.574702:0:30694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003a816990/0x22153cd396b82063 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0eed expref: 16 pid: 14864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.574716:0:30694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003a816990/0x22153cd396b82063 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0eed expref: 16 pid: 14864 timeout: 1462 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826416.574729:0:30694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a9af0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:30694:1874670585247232:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826416.574802:0:30694:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce04d24240 going to sleep for 11 seconds 00000100:00100000:1.0:1787826416.577835:0:30694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a9af0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:30694:1874670585247232:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826416.577874:0:30694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b82094 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f02 expref: 16 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.577902:0:30694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834a00, rc 0) 00000100:00100000:1.0:1787826416.577960:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce063061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:55541:x1874670563872256:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 3377us (3573us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826416.577969:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2092 00000100:00100000:1.0:1787826416.582199:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826416.582288:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563872384 00000100:00100000:2.0:1787826416.582297:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563872384 00010000:00010000:2.0:1787826416.582337:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003a816990/0x22153cd396b82063 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0eed expref: 16 pid: 14864 timeout: 1462 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826416.582390:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1145 00000100:00100000:2.0:1787826416.582399:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f80a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2403:x1874670563872384:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826416.582415:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826416.582437:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003a816990/0x22153cd396b82063 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x108:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0eed expref: 16 pid: 14864 timeout: 1462 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.582450:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003a816990/0x22153cd396b82063 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x108:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0eed expref: 16 pid: 14864 timeout: 1462 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.582505:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a816990/0x22153cd396b82063 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x108:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0eed expref: 16 pid: 14864 timeout: 1462 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.582523:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x108:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826416.582527:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x108:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826416.582533:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b82094 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f02 expref: 15 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.582543:0:10340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b82094 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f02 expref: 15 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.582581:0:10340:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b82094 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f02 expref: 15 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826416.582594:0:10340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a9af480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10340:1874670585247360:192.168.203.39@tcp:105: 00000100:00100000:2.0:1787826416.582671:0:10340:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce04d24c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826416.591910:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826416.593111:0:10340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a9af480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10340:1874670585247360:192.168.203.39@tcp:105: 00010000:00010000:2.0:1787826416.593135:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826416.593207:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f80a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2403:x1874670563872384:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 10808us (11017us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826416.593218:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1145 00000100:00100000:3.0:1787826416.593328:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563872512 00000100:00100000:3.0:1787826416.593334:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563872512 00000100:00100000:3.0:1787826416.593383:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2093 00000100:00100000:3.0:1787826416.593391:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf2f791850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2403:x1874670563872512:12345-192.168.203.39@tcp:2:lfs.0 00002000:00010000:3.0:1787826416.593568:0:30696:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x108:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787826416.593571:0:30696:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x108:0x0] updating lvb mtime from disk: 1787826412 -> 1787826412 00002000:00010000:3.0:1787826416.593574:0:30696:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x108:0x0] updating lvb atime from disk: 1787826412 -> 1787826412 00002000:00010000:3.0:1787826416.593576:0:30696:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x108:0x0] updating lvb ctime from disk: 1787826416 -> 1787826417 00002000:00010000:3.0:1787826416.593578:0:30696:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x108:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1787826416.593788:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf2f791850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2403:x1874670563872512:12345-192.168.203.39@tcp:2:lfs.0 Request processed in 396us (1887us total) trans 17179869663 rc 0/0 00000100:00100000:0.0:1787826416.593796:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2093 00000100:00100000:0.0:1787826416.597303:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826416.597729:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563872768 00000100:00100000:2.0:1787826416.597740:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563872768 00000100:00100000:2.0:1787826416.597902:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1129 00000100:00100000:2.0:1787826416.597912:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eea6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55541:x1874670563872768:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:2.0:1787826416.597992:0:6521:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000405:0x1d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82040 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ed8 expref: 36 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.598032:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b8209b lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.598044:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b81f6e lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e84 expref: 36 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.598053:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b81fbb lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e99 expref: 36 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.598062:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b8209b lrc: 5/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.598095:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b81fbb lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e99 expref: 36 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.598108:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b81fbb lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e99 expref: 36 pid: 6520 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826416.598121:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a9af480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1874670585247488:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826416.598243:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b81f6e lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e84 expref: 36 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.598253:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b81f6e lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e84 expref: 36 pid: 16564 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826416.598262:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a9ac780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1874670585247616:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826416.598282:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce04d24c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826416.602084:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826416.602668:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a9af480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1874670585247488:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826416.602683:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a9ac780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1874670585247616:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826416.602709:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b8209b lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826416.602852:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563873024 00000100:00100000:1.0:1787826416.602859:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563873024 00000100:00100000:1.0:1787826416.602967:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1130 00000100:00100000:1.0:1787826416.602977:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:49796:x1874670563873024:12345-192.168.203.39@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787826416.603191:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:49796:x1874670563873024:12345-192.168.203.39@tcp:35:ldlm_bl.0 Request processed in 214us (1116us total) trans 8589934927 rc 0/0 00000100:00100000:1.0:1787826416.603199:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1130 00000100:00100000:3.0:1787826416.605634:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826416.605672:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826416.605775:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563873152 00000100:00100000:2.0:1787826416.605784:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563873152 00010000:00010000:2.0:1787826416.605824:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b81fbb lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e99 expref: 38 pid: 6520 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826416.605861:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563873280 00000100:00100000:2.0:1787826416.605864:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563873280 00010000:00010000:2.0:1787826416.605876:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b81f6e lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e84 expref: 39 pid: 16564 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826416.605899:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1146 00000100:00100000:2.0:1787826416.605908:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb970c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+39:2403:x1874670563873152:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826416.605924:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826416.605930:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b81fbb lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e99 expref: 39 pid: 6520 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.605942:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b81fbb lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e99 expref: 39 pid: 6520 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.605964:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b81fbb lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e99 expref: 39 pid: 6520 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.605982:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826416.605987:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b8209b lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.605999:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b8209b lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.606005:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826416.606051:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb970c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:2403:x1874670563873152:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 143us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826416.606058:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1146 00000100:00100000:2.0:1787826416.606074:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1147 00000100:00100000:2.0:1787826416.606080:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb95680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:2403:x1874670563873280:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826416.606088:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826416.606093:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b81f6e lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e84 expref: 37 pid: 16564 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.606102:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b81f6e lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e84 expref: 37 pid: 16564 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.606113:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b81f6e lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0e84 expref: 37 pid: 16564 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.606121:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826416.606125:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b8209b lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.606132:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b8209b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.606139:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b8209b lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.606158:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826416.606188:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb95680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:2403:x1874670563873280:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 107us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826416.606194:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1147 00010000:00010000:3.0:1787826416.606682:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b8209b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.606691:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b8209b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.606715:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b820a2 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.606727:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b8207f lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ef4 expref: 35 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.606734:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b820a2 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.606777:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b8207f lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ef4 expref: 35 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.606790:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b8207f lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ef4 expref: 35 pid: 9966 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826416.606804:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3fb94b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1874670585247744:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826416.606868:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf1850cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787826416.610163:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826416.610280:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3fb94b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1874670585247744:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826416.610304:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b820a2 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826416.610376:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563873408 00000100:00100000:2.0:1787826416.610382:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563873408 00010000:00010000:2.0:1787826416.610416:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b8207f lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ef4 expref: 36 pid: 9966 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826416.610452:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1148 00000100:00100000:2.0:1787826416.610461:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb95e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:2401:x1874670563873408:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826416.610498:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826416.610505:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b8207f lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ef4 expref: 36 pid: 9966 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.610519:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b8207f lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ef4 expref: 36 pid: 9966 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.610540:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b8207f lrc: 0/0,0 mode: --/CR res: [0x200000405:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ef4 expref: 36 pid: 9966 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.610555:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2a:0x0].0x0 (ffff90cf3ab61e00) 00010000:00010000:2.0:1787826416.610559:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b820a2 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.610568:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b820a2 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.610579:0:10340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b820a2 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.610597:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826416.610645:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb95e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:2401:x1874670563873408:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 185us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826416.610652:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1148 00010000:00010000:0.0:1787826416.610795:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b820a2 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.610802:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b820a2 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826416.611088:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce06306580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6521:1874670585247872:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787826416.611148:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826416.611191:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce02742540 going to sleep for 11 seconds 00000100:00100000:2.0:1787826416.611679:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585247872 00000100:00100000:2.0:1787826416.611686:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585247872 00000100:00100000:2.0:1787826416.611727:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1445 00000100:00100000:2.0:1787826416.611735:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06305e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+12:6521:x1874670585247872:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787826416.611826:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06305e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+12:6521:x1874670585247872:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 92us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826416.611832:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1445 00000100:00100000:1.0:1787826416.612298:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce06306580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6521:1874670585247872:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787826416.612384:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f809680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6521:1874670585248000:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787826416.612421:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826416.612451:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3f7d8780 going to sleep for 11 seconds 00000100:00100000:0.0:1787826416.612526:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585248000 00000100:00100000:0.0:1787826416.612532:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585248000 00000100:00100000:0.0:1787826416.612565:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1446 00000100:00100000:0.0:1787826416.612572:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f80b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:6521:x1874670585248000:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787826416.612642:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f80b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:6521:x1874670585248000:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 71us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826416.612649:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1446 00000100:00100000:1.0:1787826416.612970:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f809680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6521:1874670585248000:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787826416.613086:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934928 00000100:00100000:1.0:1787826416.613144:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f809680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6521:1874670585248128:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787826416.613171:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826416.613205:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce02742d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787826416.613263:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585248128 00000100:00100000:3.0:1787826416.613269:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585248128 00000100:00100000:3.0:1787826416.613306:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1447 00000100:00100000:3.0:1787826416.613314:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f808f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+11:6521:x1874670585248128:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787826416.613451:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f808f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+12:6521:x1874670585248128:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 138us (279us total) trans 21474837005 rc 0/0 00000100:00100000:3.0:1787826416.613459:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1447 00000100:00100000:1.0:1787826416.613709:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f809680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6521:1874670585248128:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787826416.613778:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934929 00010000:00010000:1.0:1787826416.613805:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b820a2 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.613815:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b820a2 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.613822:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b820a2 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.613828:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826416.613833:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b820a2 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.613840:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b820a2 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.613856:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2a:0x0].0x0 (ffff90cf3ab61e00) 00010000:00010000:1.0:1787826416.613859:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787826416.613864:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b820a2 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.613870:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b820a2 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.613884:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b8209b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.613890:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b8209b lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.613895:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b8209b lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.613900:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826416.613902:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b8209b lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.613907:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b8209b lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.613915:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826416.613917:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787826416.613920:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b8209b lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.613925:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b8209b lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.613936:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826416.613938:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787826416.613945:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82040 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ed8 expref: 37 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826416.614031:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eea6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55541:x1874670563872768:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 16120us (16736us total) trans 8589934930 rc 0/0 00000100:00100000:1.0:1787826416.614038:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1129 00000020:00080000:1.0:1787826416.614042:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1787826416.616918:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826416.617047:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563873536 00000100:00100000:0.0:1787826416.617057:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563873536 00000100:00100000:0.0:1787826416.617144:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3770 00000100:00100000:0.0:1787826416.617154:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb96580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55541:x1874670563873536:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826416.617183:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826416.617206:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b820a9 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0f09 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.617260:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b820a9 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f09 expref: 37 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.617274:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b820a9 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f09 expref: 37 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.617298:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826416.617302:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826416.617305:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165e600, rc 0) 00000100:00100000:0.0:1787826416.617370:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb96580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:55541:x1874670563873536:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 218us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826416.617377:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3770 00000100:00100000:2.0:1787826416.627232:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826416.627342:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563873792 00000100:00100000:0.0:1787826416.627351:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563873792 00000100:00100000:0.0:1787826416.627408:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1131 00000100:00100000:0.0:1787826416.627417:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:55541:x1874670563873792:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:0.0:1787826416.627665:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:55541:x1874670563873792:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 248us (440us total) trans 8589934931 rc 0/0 00000100:00100000:0.0:1787826416.627673:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1131 00000100:00100000:1.0:1787826416.630009:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826416.630330:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563874048 00000100:00100000:0.0:1787826416.630340:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563874048 00000100:00100000:0.0:1787826416.630412:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1132 00000100:00100000:0.0:1787826416.630422:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049bbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:55541:x1874670563874048:12345-192.168.203.39@tcp:35:lfs.0 00000004:00080000:0.0:1787826416.630601:0:6521:0:(mdd_object.c:4014:mdd_close()) Object [0x200000405:0x2a:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:0.0:1787826416.630676:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b820b0 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.630691:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b820b0 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.630702:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b820b0 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.630714:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b820b0 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.630721:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b820b0 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.630727:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b820b0 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.630750:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787826416.630830:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049bbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+39:55541:x1874670563874048:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 410us (830us total) trans 8589934932 rc 0/0 00000100:00100000:0.0:1787826416.630838:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1132 00010000:00010000:1.0:1787826416.630944:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826416.630951:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b820b0 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.630963:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165ec00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:1.0:1787826416.630967:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b820b0 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.630974:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b820b0 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.630987:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2a:0x0].0x0 (ffff90cf3ab61e00) 00010000:00010000:1.0:1787826416.630990:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787826416.630993:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b820b0 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.630999:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b820b0 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.631011:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826416.631013:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826416.631014:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826416.687624:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826416.691034:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563874176 00000100:00100000:1.0:1787826416.691049:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563874176 00000100:00100000:2.0:1787826416.692918:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3771 00000100:00100000:2.0:1787826416.692932:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+39:55543:x1874670563874176:12345-192.168.203.39@tcp:101:getfattr.0 00010000:00010000:2.0:1787826416.692959:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826416.692985:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b820b7 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0f10 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.693050:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b820be lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.693064:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b820be lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.693534:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b820be lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.693554:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b820c5 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.693562:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b820c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.693570:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b820c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.693649:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b820cc lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.693659:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b820cc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.693665:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b820cc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826416.693705:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:2.0:1787826416.693709:0:16564:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826416.693730:0:16564:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b820cc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.693742:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b820cc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.693751:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b820be lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.693817:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b820be lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.693825:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b820be lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.693832:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826416.693836:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b820be lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.693844:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b820be lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.693856:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf39e67700) 00010000:00010000:2.0:1787826416.693859:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826416.693863:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b820be lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.693870:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b820be lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.693882:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b820c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.693889:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b820c5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.693895:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b820c5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.693900:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826416.693904:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b820c5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.693909:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b820c5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.693917:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf39e67300) 00010000:00010000:2.0:1787826416.693919:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826416.693921:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b820c5 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.693927:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b820c5 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.693960:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b820b7 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f10 expref: 41 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.693975:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b820cc lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f10 expref: 40 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.693983:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826416.693985:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826416.693988:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834800, rc 0) 00000100:00100000:2.0:1787826416.694219:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55543:x1874670563874176:12345-192.168.203.39@tcp:101:getfattr.0 Request processed in 1289us (6604us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826416.694226:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3771 00000100:00100000:3.0:1787826416.734854:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826416.735004:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563874304 00000100:00100000:1.0:1787826416.735013:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563874304 00000100:00100000:1.0:1787826416.735087:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3772 00000100:00100000:1.0:1787826416.735097:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb95a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55547:x1874670563874304:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:1.0:1787826416.735169:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b820d3 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.735193:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b820d3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.735208:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b820d3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.735222:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b820da lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.735229:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b820da lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.735236:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b820da lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.735306:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b820e1 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.735315:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b820e1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.735321:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b820e1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826416.735373:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:1.0:1787826416.735377:0:8247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826416.735389:0:8247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b820e1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.735402:0:8247:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b820d3 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.735409:0:8247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b820d3 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.735418:0:8247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b820d3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.735425:0:8247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b820d3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.735430:0:8247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46a600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826416.735434:0:8247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b820d3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.735440:0:8247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b820d3 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.735452:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf3ab61200) 00010000:00010000:1.0:1787826416.735455:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826416.735460:0:8247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b820d3 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.735465:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b820d3 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.735511:0:8247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b820da lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.735518:0:8247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b820da lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.735523:0:8247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b820da lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.735528:0:8247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46ae00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826416.735531:0:8247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b820da lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.735537:0:8247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b820da lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.735544:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf3ab61600) 00010000:00010000:1.0:1787826416.735546:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826416.735550:0:8247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b820da lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.735555:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b820da lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.735565:0:8247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b820e1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.735571:0:8247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b820e1 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.735576:0:8247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b820e1 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.735580:0:8247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46b400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826416.735583:0:8247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b820e1 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.735588:0:8247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b820e1 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.735594:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826416.735596:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826416.735599:0:8247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b820e1 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.735604:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b820e1 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826416.735673:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb95a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55547:x1874670563874304:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 577us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826416.735680:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3772 00000100:00100000:3.0:1787826416.777296:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826416.777586:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563874560 00000100:00100000:1.0:1787826416.777596:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563874560 00000100:00100000:1.0:1787826416.777655:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3773 00000100:00100000:1.0:1787826416.777664:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb96940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55549:x1874670563874560:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826416.777684:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826416.777704:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b820e8 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0f17 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.777817:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b820ef lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.777831:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b820ef lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.777844:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b820ef lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826416.777856:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:1.0:1787826416.777982:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b820e8 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f17 expref: 43 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.778001:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b820ef lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f17 expref: 42 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.778011:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826416.778014:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787826416.778018:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46ae00, rc 0) 00000100:00100000:1.0:1787826416.778073:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb96940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+42:55549:x1874670563874560:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 410us (788us total) trans 8589934933 rc 0/0 00000100:00100000:1.0:1787826416.778080:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3773 00000100:00100000:3.0:1787826416.792321:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826416.792522:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563874816 00000100:00100000:0.0:1787826416.792531:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563874816 00000100:00100000:0.0:1787826416.792594:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3774 00000100:00100000:0.0:1787826416.792603:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb94f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+42:55549:x1874670563874816:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826416.792626:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826416.792647:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b820fd lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0f1e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.792746:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b82104 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.792761:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b820cc lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f10 expref: 43 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.792770:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b82104 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.792802:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b820cc lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f10 expref: 43 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.792814:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b820cc lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f10 expref: 43 pid: 16564 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826416.792826:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce06307840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1874670585248256:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826416.792904:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3f7d8a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787826416.801444:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce06307840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1874670585248256:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826416.801509:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b82104 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826416.802076:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826416.802312:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563874944 00000100:00100000:2.0:1787826416.802319:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563874944 00010000:00010000:2.0:1787826416.802356:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b820cc lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f10 expref: 44 pid: 16564 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826416.802447:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1149 00000100:00100000:2.0:1787826416.802457:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb952c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:2403:x1874670563874944:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826416.802495:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826416.802503:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b820cc lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f10 expref: 44 pid: 16564 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.802515:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b820cc lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f10 expref: 44 pid: 16564 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.802538:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b820cc lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f10 expref: 44 pid: 16564 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.802553:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826416.802558:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b82104 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.802566:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b82104 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.802573:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b82104 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.802603:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826416.802660:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb952c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:2403:x1874670563874944:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 204us (1320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826416.802668:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1149 00010000:00010000:0.0:1787826416.802721:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b82104 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.802728:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b82104 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826416.802748:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:0.0:1787826416.802871:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b820fd lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f1e expref: 44 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.802901:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b82104 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f1e expref: 43 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.802908:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826416.802910:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787826416.802913:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165f600, rc 0) 00000100:00100000:0.0:1787826416.802945:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb94f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55549:x1874670563874816:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 10343us (10634us total) trans 8589934934 rc 0/0 00000100:00100000:0.0:1787826416.802952:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3774 00000100:00100000:0.0:1787826416.809444:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826416.809547:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563875072 00000100:00100000:1.0:1787826416.809557:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563875072 00000100:00100000:1.0:1787826416.809609:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1133 00000100:00100000:1.0:1787826416.809619:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06307840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55549:x1874670563875072:12345-192.168.203.39@tcp:33:lfs.0 00000100:00100000:1.0:1787826416.809772:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06307840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55549:x1874670563875072:12345-192.168.203.39@tcp:33:lfs.0 Request processed in 154us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826416.809780:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1133 00000100:00100000:1.0:1787826416.815814:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826416.815904:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563875328 00000100:00100000:2.0:1787826416.815923:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563875328 00000100:00100000:2.0:1787826416.815980:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1134 00000100:00100000:2.0:1787826416.815990:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049b92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55549:x1874670563875328:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:2.0:1787826416.816223:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049b92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55549:x1874670563875328:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 233us (428us total) trans 8589934935 rc 0/0 00000100:00100000:2.0:1787826416.816230:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1134 00000100:00100000:3.0:1787826416.821322:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826416.821417:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563875584 00000100:00100000:2.0:1787826416.821426:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563875584 00000100:00100000:2.0:1787826416.821509:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3775 00000100:00100000:2.0:1787826416.821520:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55549:x1874670563875584:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826416.821543:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826416.821546:0:16564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:2.0:1787826416.821573:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b82104 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f1e expref: 44 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.821594:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b820ef lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f17 expref: 43 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.821605:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826416.821610:0:16564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826416.821621:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b82112 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0f25 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.821740:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82119 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.821753:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82119 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.821767:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82119 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826416.821779:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:2.0:1787826416.821908:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b82112 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f25 expref: 45 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.822708:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82119 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f25 expref: 44 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.822718:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826416.822721:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787826416.822724:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835800, rc 0) 00000100:00100000:0.0:1787826416.827389:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55549:x1874670563875584:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 5860us (6065us total) trans 8589934936 rc 0/0 00000100:00100000:0.0:1787826416.827403:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3775 00000100:00100000:0.0:1787826416.831272:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826416.831410:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563875840 00000100:00100000:1.0:1787826416.831421:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563875840 00000100:00100000:1.0:1787826416.831507:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1135 00000100:00100000:1.0:1787826416.831518:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eea4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55549:x1874670563875840:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:1.0:1787826416.831586:0:6521:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000405:0x1d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82119 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f25 expref: 44 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.831623:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82127 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.831636:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b820a9 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f09 expref: 44 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.831645:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82127 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.831673:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b820a9 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f09 expref: 44 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.831686:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b820a9 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f09 expref: 44 pid: 6519 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826416.831699:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce049b8f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1874670585248384:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826416.831776:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce02742540 going to sleep for 11 seconds 00000100:00100000:0.0:1787826416.834831:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce049b8f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1874670585248384:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826416.834859:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82127 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826416.840633:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826416.841118:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563875968 00000100:00100000:2.0:1787826416.841127:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563875968 00010000:00010000:2.0:1787826416.841166:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b820a9 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f09 expref: 45 pid: 6519 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826416.841221:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1150 00000100:00100000:2.0:1787826416.841230:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce063061c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+45:2403:x1874670563875968:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826416.841244:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826416.841252:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b820a9 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f09 expref: 45 pid: 6519 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.841264:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b820a9 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f09 expref: 45 pid: 6519 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.841291:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b820a9 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f09 expref: 45 pid: 6519 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.841307:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826416.841312:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82127 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.841321:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82127 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.841329:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82127 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.841369:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826416.841419:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce063061c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:2403:x1874670563875968:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 190us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826416.841427:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1150 00010000:00010000:1.0:1787826416.841633:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82127 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.841641:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82127 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.841794:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82127 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.841802:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82127 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.841809:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82127 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.841815:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46a400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826416.841819:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82127 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.841827:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82127 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.841836:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826416.841838:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787826416.841841:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82127 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.841847:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82127 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.841857:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826416.841858:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787826416.841863:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82119 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f25 expref: 43 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826416.841979:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eea4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55549:x1874670563875840:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 10462us (10715us total) trans 8589934937 rc -22/-22 00000100:00100000:1.0:1787826416.841989:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1135 00000100:00100000:1.0:1787826416.846105:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826416.846222:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563876096 00000100:00100000:0.0:1787826416.846232:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563876096 00000100:00100000:0.0:1787826416.846293:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3776 00000100:00100000:0.0:1787826416.846303:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049bbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55549:x1874670563876096:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826416.846327:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826416.846347:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b8212e lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0f2c expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.846791:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b8212e lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f2c expref: 44 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.846807:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b8212e lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f2c expref: 44 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.846831:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826416.846834:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826416.846840:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165ee00, rc 0) 00000100:00100000:0.0:1787826416.846908:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049bbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55549:x1874670563876096:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 606us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826416.847656:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3776 00000100:00100000:3.0:1787826416.861083:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826416.861181:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563876352 00000100:00100000:2.0:1787826416.861190:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563876352 00000100:00100000:2.0:1787826416.861263:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3777 00000100:00100000:2.0:1787826416.861273:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55549:x1874670563876352:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826416.861292:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826416.861314:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b82135 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0f33 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.861788:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8213c lrc: 3/1,0 mode: --/PR res: [0x200000405:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.861809:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8213c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.861819:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8213c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826416.861829:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x2b:0x0]: returning size 0 00010000:00010000:2.0:1787826416.861870:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b82135 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f33 expref: 47 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.861892:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8213c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f33 expref: 46 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.861902:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2b:0x0].0x0 (ffff90cf39e67300) 00010000:00010000:2.0:1787826416.861905:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826416.861908:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834400, rc 0) 00000100:00100000:3.0:1787826416.862880:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+46:55549:x1874670563876352:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1603us (1800us total) trans 8589934938 rc 0/0 00000100:00100000:3.0:1787826416.862890:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3777 00000100:00100000:3.0:1787826416.869586:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826416.869714:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563876608 00000100:00100000:0.0:1787826416.869724:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563876608 00000100:00100000:0.0:1787826416.869779:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3778 00000100:00100000:0.0:1787826416.869787:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+46:55549:x1874670563876608:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826416.869808:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826416.869827:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b8214a lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0f3a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.869930:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b82151 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.869943:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b82151 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.869954:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b82151 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826416.869965:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:0.0:1787826416.870047:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b8214a lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f3a expref: 49 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.870069:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b82151 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f3a expref: 48 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.870077:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826416.870080:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787826416.870084:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165e400, rc 0) 00000100:00100000:0.0:1787826416.870138:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55549:x1874670563876608:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 352us (562us total) trans 8589934939 rc 0/0 00000100:00100000:0.0:1787826416.870145:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3778 00000100:00100000:1.0:1787826416.875305:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826416.875447:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563876864 00000100:00100000:3.0:1787826416.875456:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563876864 00000100:00100000:3.0:1787826416.875584:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1136 00000100:00100000:3.0:1787826416.875595:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049b92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55549:x1874670563876864:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:3.0:1787826416.875667:0:14257:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000405:0x1d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b82151 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f3a expref: 48 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.875705:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b8215f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.875718:0:14257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b8212e lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f2c expref: 48 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.875728:0:14257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b8215f lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.875758:0:14257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b8212e lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f2c expref: 48 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826416.875777:0:14257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b8212e lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f2c expref: 48 pid: 32404 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826416.875790:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3fb97c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585248512:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826416.875872:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf1850cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787826416.882179:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826416.883432:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563876992 00000100:00100000:2.0:1787826416.883443:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563876992 00010000:00010000:2.0:1787826416.883526:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b8212e lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f2c expref: 49 pid: 32404 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826416.883570:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1151 00000100:00100000:2.0:1787826416.883580:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf185da850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:2404:x1874670563876992:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826416.883594:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826416.883612:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b8212e lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f2c expref: 49 pid: 32404 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.883630:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b8212e lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f2c expref: 49 pid: 32404 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.883652:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826416.883657:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b8215f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.883666:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b8215f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.883672:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b8215f lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.883690:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826416.883745:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf185da850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:2404:x1874670563876992:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 166us (1592us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826416.883753:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1151 00010000:00010000:1.0:1787826416.886996:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b8212e lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f2c expref: 48 pid: 32404 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826416.887021:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3fb97c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585248512:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826416.887102:0:14257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b8215f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.887118:0:14257:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b8215f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.887124:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b8215f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.887151:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82166 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.887163:0:14257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8213c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f33 expref: 47 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.887180:0:14257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82166 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x2b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.887217:0:14257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8213c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f33 expref: 47 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.887234:0:14257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8213c lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f33 expref: 47 pid: 6518 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826416.887248:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce049b8f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585248640:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826416.887331:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce02742d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787826416.892139:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826416.892289:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563877120 00000100:00100000:2.0:1787826416.892299:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563877120 00010000:00010000:2.0:1787826416.892342:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8213c lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f33 expref: 48 pid: 6518 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826416.892399:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1152 00000100:00100000:2.0:1787826416.892408:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce063061c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:2404:x1874670563877120:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826416.892423:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826416.892430:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8213c lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f33 expref: 48 pid: 6518 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.892448:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8213c lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f33 expref: 48 pid: 6518 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.892511:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2b:0x0].0x0 (ffff90cf39e67300) 00010000:00010000:2.0:1787826416.892517:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82166 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x2b:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.892526:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82166 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2b:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.892534:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82166 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x2b:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.892552:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826416.892719:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce063061c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:2404:x1874670563877120:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 189us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826416.892730:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1152 00010000:00010000:1.0:1787826416.895529:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8213c lrc: 0/0,0 mode: --/PR res: [0x200000405:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f33 expref: 47 pid: 6518 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826416.895555:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce049b8f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585248640:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826416.895577:0:14257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82166 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.895588:0:14257:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82166 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.895593:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82166 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826416.895929:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce049b8f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585248768:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1787826416.895988:0:14257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826416.896025:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce02725c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826416.896550:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585248768 00000100:00100000:2.0:1787826416.896558:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585248768 00000100:00100000:2.0:1787826416.896625:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1448 00000100:00100000:2.0:1787826416.896639:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+12:14257:x1874670585248768:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1787826416.896729:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+12:14257:x1874670585248768:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 96us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826416.896737:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1448 00000100:00100000:1.0:1787826416.897090:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce049b8f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585248768:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:1.0:1787826416.897147:0:14257:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934940 00000001:00080000:1.0:1787826416.897229:0:14257:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934941 00010000:00010000:1.0:1787826416.897250:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82166 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.897259:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82166 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x2b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.897266:0:14257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82166 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x2b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.897272:0:14257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46a400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826416.897276:0:14257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82166 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x2b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.897283:0:14257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82166 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x2b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.897299:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2b:0x0].0x0 (ffff90cf39e67300) 00010000:00010000:1.0:1787826416.897302:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787826416.897307:0:14257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82166 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x2b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.897313:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82166 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x2b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.897333:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b8215f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.897340:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b8215f lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.897628:0:14257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b8215f lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.897634:0:14257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826416.897637:0:14257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b8215f lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.897643:0:14257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b8215f lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.897653:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826416.897655:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787826416.897658:0:14257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b8215f lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.897664:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b8215f lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.897676:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826416.897679:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787826416.897684:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b82151 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f3a expref: 49 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826416.897785:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049b92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55549:x1874670563876864:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 22191us (22490us total) trans 8589934942 rc 0/0 00000100:00100000:1.0:1787826416.897793:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1136 00000020:00080000:1.0:1787826416.897797:0:14257:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1787826416.900412:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826416.900671:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563877248 00000100:00100000:2.0:1787826416.900681:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563877248 00000100:00100000:2.0:1787826416.900734:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3779 00000100:00100000:2.0:1787826416.900743:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06307840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55549:x1874670563877248:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826416.900765:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826416.900784:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8216d lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0f41 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.900837:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8216d lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f41 expref: 49 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.900851:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8216d lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f41 expref: 49 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826416.900869:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826416.900872:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826416.900876:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835c00, rc 0) 00000100:00100000:2.0:1787826416.900934:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06307840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:55549:x1874670563877248:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 192us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826416.900941:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3779 00000100:00100000:2.0:1787826416.906129:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826416.906294:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563877504 00000100:00100000:1.0:1787826416.906305:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563877504 00000100:00100000:1.0:1787826416.906363:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1137 00000100:00100000:1.0:1787826416.906373:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9ae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:55549:x1874670563877504:12345-192.168.203.39@tcp:35:lfs.0 00000004:00080000:1.0:1787826416.906708:0:6521:0:(mdd_object.c:4014:mdd_close()) Object [0x200000405:0x2b:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787826416.906781:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].27, 64 off10400 00000004:00080000:1.0:1787826416.906793:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1362918320683ns, next at 1363918318384ns, rc = 0 00000001:00080000:1.0:1787826416.906800:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934943 00010000:00010000:1.0:1787826416.906841:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82174 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.907037:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82174 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.907049:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82174 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.907059:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82174 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.907065:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82174 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.907071:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82174 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.908089:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787826416.908220:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9ae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+51:55549:x1874670563877504:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 1844us (2097us total) trans 8589934944 rc 0/0 00000100:00100000:0.0:1787826416.908231:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1137 00000020:00080000:0.0:1787826416.908236:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787826416.908708:0:7460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826416.908717:0:7460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82174 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.908725:0:7460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46a400 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:1.0:1787826416.908729:0:7460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82174 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.908737:0:7460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82174 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.908753:0:7460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2b:0x0].0x0 (ffff90cf3ab61600) 00010000:00010000:1.0:1787826416.909010:0:7460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787826416.909016:0:7460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82174 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.909023:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82174 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.909115:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826416.909118:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826416.909119:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826416.912435:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826416.912592:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563877760 00000100:00100000:1.0:1787826416.912697:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563877760 00000100:00100000:1.0:1787826416.912810:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1138 00000100:00100000:1.0:1787826416.912820:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06306580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+51:55549:x1874670563877760:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:1.0:1787826416.913148:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06306580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+52:55549:x1874670563877760:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 329us (721us total) trans 8589934945 rc 0/0 00000100:00100000:1.0:1787826416.913166:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1138 00000100:00100000:2.0:1787826416.943452:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826416.943582:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563877888 00000100:00100000:1.0:1787826416.943593:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563877888 00000100:00100000:1.0:1787826416.943655:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3780 00000100:00100000:1.0:1787826416.943665:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+52:55551:x1874670563877888:12345-192.168.203.39@tcp:101:getfattr.0 00010000:00010000:1.0:1787826416.943689:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826416.943714:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b8217b lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0f48 expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.943785:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82182 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.943800:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82182 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.943811:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82182 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.943824:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82189 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.943831:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82189 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.943837:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82189 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.943919:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b82190 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.943928:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b82190 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.943935:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b82190 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826416.943978:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:1.0:1787826416.943982:0:32404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826416.944001:0:32404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b82190 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.944014:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b82190 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.944023:0:32404:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82182 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.944029:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82182 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.944035:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82182 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.944042:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82182 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.944048:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46ae00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826416.944052:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82182 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.944059:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82182 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.944070:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf3ab61600) 00010000:00010000:1.0:1787826416.944074:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826416.944078:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82182 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.944088:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82182 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.944101:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82189 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.944106:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82189 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.944112:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82189 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.944117:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46a600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826416.944120:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82189 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.944126:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82189 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.944133:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf3ab61200) 00010000:00010000:1.0:1787826416.944136:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826416.944139:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82189 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.944145:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82189 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.944369:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b8217b lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f48 expref: 54 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.944392:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b82190 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f48 expref: 53 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826416.944400:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826416.944403:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826416.944405:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46b400, rc 0) 00000100:00100000:1.0:1787826416.944519:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55551:x1874670563877888:12345-192.168.203.39@tcp:101:getfattr.0 Request processed in 808us (1030us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826416.944527:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3780 00000100:00100000:3.0:1787826416.955773:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826416.957909:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563878016 00000100:00100000:0.0:1787826416.957923:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563878016 00000100:00100000:0.0:1787826416.958000:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2094 00000100:00100000:0.0:1787826416.958010:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb96d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2403:x1874670563878016:12345-192.168.203.39@tcp:101:getfattr.0 00010000:00010000:0.0:1787826416.958028:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826416.958047:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000952ff42d/0x22153cd396b82197 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0f4f expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826416.958108:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf41c86d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1874670585248896:192.168.203.39@tcp:106: 00000100:00100000:0.0:1787826416.958216:0:8435:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3f7d8000 going to sleep for 11 seconds 00010000:00010000:1.0:1787826416.963751:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826416.970072:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf41c86d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1874670585248896:192.168.203.39@tcp:106: 00010000:00010000:0.0:1787826416.970119:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000952ff42d/0x22153cd396b82197 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f4f expref: 15 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.970144:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000952ff42d/0x22153cd396b82197 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f4f expref: 15 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826416.970158:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165e200, rc 0) 00000100:00100000:0.0:1787826416.970223:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb96d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2403:x1874670563878016:12345-192.168.203.39@tcp:101:getfattr.0 Request processed in 12215us (14460us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826416.970232:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2094 00000100:00100000:2.0:1787826417.018610:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826417.018692:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563878144 00000100:00100000:3.0:1787826417.018703:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563878144 00000100:00080000:0.0:1787826417.019006:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787826417.019047:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3781 00000100:00100000:3.0:1787826417.019060:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9ad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55555:x1874670563878144:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:3.0:1787826417.019136:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b8219e lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.019153:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b8219e lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.019167:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b8219e lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.019189:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b821a5 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.019196:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b821a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.019203:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b821a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.019285:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b821ac lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.019296:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b821ac lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.019304:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b821ac lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826417.019361:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:3.0:1787826417.019366:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826417.019379:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b821ac lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.019400:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b8219e lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.019406:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b8219e lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.019413:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b8219e lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.019419:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826417.019422:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b8219e lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.019429:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b8219e lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.019441:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf39656700) 00010000:00010000:3.0:1787826417.019445:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826417.019449:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b8219e lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.019454:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b8219e lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.019516:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b821a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.019522:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b821a5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.019527:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b821a5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.019532:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826417.019535:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b821a5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.019540:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b821a5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.019547:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf39656100) 00010000:00010000:3.0:1787826417.019549:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826417.019552:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b821a5 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.019557:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b821a5 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.019568:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b821ac lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.019574:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b821ac lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.019578:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b821ac lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.019582:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826417.019585:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b821ac lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.019590:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b821ac lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.019596:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826417.019598:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826417.019601:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b821ac lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.019607:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b821ac lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826417.019685:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9ad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55555:x1874670563878144:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 627us (1083us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826417.019693:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3781 00000100:00100000:3.0:1787826417.053549:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826417.053740:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563878400 00000100:00100000:1.0:1787826417.054575:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563878400 00000100:00100000:2.0:1787826417.055095:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3782 00000100:00100000:2.0:1787826417.055107:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb97c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55557:x1874670563878400:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826417.055127:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826417.055148:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b821b3 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0f56 expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.055422:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b821ba lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.055438:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b821ba lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.055450:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b821ba lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826417.055462:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:2.0:1787826417.055588:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b821b3 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f56 expref: 56 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.055607:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b821ba lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f56 expref: 55 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.055615:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826417.055618:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787826417.055621:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835000, rc 0) 00000100:00100000:2.0:1787826417.055740:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb97c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+55:55557:x1874670563878400:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 634us (2200us total) trans 8589934946 rc 0/0 00000100:00100000:2.0:1787826417.055748:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3782 00000100:00100000:0.0:1787826417.069019:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826417.069119:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563878528 00000100:00100000:1.0:1787826417.069130:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563878528 00000100:00100000:1.0:1787826417.069212:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2095 00000100:00100000:1.0:1787826417.069223:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c86d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2401:x1874670563878528:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826417.069240:0:30695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826417.069258:0:30695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000381c17db/0x22153cd396b821c8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0f5d expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826417.069324:0:30695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0373e940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:30695:1874670585249024:192.168.203.39@tcp:106: 00000100:00100000:1.0:1787826417.069403:0:30695:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3780 going to sleep for 11 seconds 00000100:00080000:0.0:1787826417.069528:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826417.073764:0:30695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0373e940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:30695:1874670585249024:192.168.203.39@tcp:106: 00010000:00010000:1.0:1787826417.073804:0:30695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000381c17db/0x22153cd396b821c8 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f5d expref: 15 pid: 30695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.073835:0:30695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000381c17db/0x22153cd396b821c8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f5d expref: 15 pid: 30695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.073850:0:30695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46a400, rc 0) 00000100:00100000:1.0:1787826417.073911:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c86d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2401:x1874670563878528:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 4689us (4899us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826417.073919:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2095 00000100:00100000:3.0:1787826417.082114:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826417.086947:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563878784 00000100:00100000:1.0:1787826417.086962:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563878784 00000100:00100000:1.0:1787826417.087051:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3783 00000100:00100000:1.0:1787826417.087063:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+55:55557:x1874670563878784:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826417.087085:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826417.087106:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b821cf lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0f64 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.087417:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b821d6 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.087434:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b82190 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f48 expref: 56 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.087442:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b821d6 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.087495:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b82190 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f48 expref: 56 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.087514:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b82190 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f48 expref: 56 pid: 32404 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826417.087528:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0373e940 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1874670585249152:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826417.087720:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3300 going to sleep for 11 seconds 00000100:00100000:1.0:1787826417.092976:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0373e940 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1874670585249152:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826417.093005:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b821d6 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826417.093325:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826417.093502:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563878912 00000100:00100000:0.0:1787826417.093509:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563878912 00010000:00010000:0.0:1787826417.093544:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b82190 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f48 expref: 57 pid: 32404 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826417.093581:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1153 00000100:00100000:0.0:1787826417.093590:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb95680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+57:2403:x1874670563878912:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826417.093612:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826417.093620:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b82190 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f48 expref: 57 pid: 32404 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.093632:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b82190 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f48 expref: 57 pid: 32404 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.093657:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b82190 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f48 expref: 57 pid: 32404 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.093675:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826417.093680:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b821d6 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.093689:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b821d6 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.093697:0:10340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b821d6 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.093726:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826417.093776:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb95680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+56:2403:x1874670563878912:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 186us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826417.093784:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1153 00010000:00010000:1.0:1787826417.093904:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b821d6 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.093913:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b821d6 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826417.093931:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:1.0:1787826417.094047:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b821cf lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f64 expref: 57 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.094062:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b821d6 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f64 expref: 56 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.094070:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826417.094073:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787826417.094076:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46a600, rc 0) 00000100:00100000:1.0:1787826417.094101:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+56:55557:x1874670563878784:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 7041us (11996us total) trans 8589934947 rc 0/0 00000100:00100000:1.0:1787826417.094108:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3783 00000100:00100000:0.0:1787826417.099051:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826417.099145:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563879168 00000100:00100000:2.0:1787826417.099165:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563879168 00000100:00100000:2.0:1787826417.099237:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3784 00000100:00100000:2.0:1787826417.099248:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+56:55557:x1874670563879168:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826417.099272:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826417.099296:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b821e4 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0f6b expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.099810:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b821eb lrc: 3/1,0 mode: --/PR res: [0x200000405:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.099824:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b821eb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.099835:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b821eb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826417.099845:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x2c:0x0]: returning size 0 00010000:00010000:2.0:1787826417.099893:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b821e4 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f6b expref: 59 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.099920:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b821eb lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f6b expref: 58 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.099929:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2c:0x0].0x0 (ffff90cf39e67e00) 00010000:00010000:2.0:1787826417.099933:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826417.099936:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835a00, rc 0) 00000100:00100000:2.0:1787826417.099998:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:55557:x1874670563879168:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 752us (955us total) trans 8589934948 rc 0/0 00000100:00100000:2.0:1787826417.100005:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3784 00000100:00100000:3.0:1787826417.108301:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826417.108670:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563879424 00000100:00100000:1.0:1787826417.108681:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563879424 00000100:00100000:1.0:1787826417.108780:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3785 00000100:00100000:1.0:1787826417.108791:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb95e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:55557:x1874670563879424:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826417.108814:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826417.108835:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b821f9 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0f72 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.108963:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82200 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.108979:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b821eb lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f6b expref: 59 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.108988:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82200 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.109020:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b821eb lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f6b expref: 59 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.109034:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b821eb lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f6b expref: 59 pid: 9966 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826417.109047:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0373e940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1874670585249280:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826417.109180:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3300 going to sleep for 11 seconds 00000100:00100000:1.0:1787826417.116342:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0373e940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1874670585249280:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826417.116385:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82200 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826417.117504:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826417.117577:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563879552 00000100:00100000:0.0:1787826417.117584:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563879552 00010000:00010000:0.0:1787826417.117627:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b821eb lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f6b expref: 60 pid: 9966 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826417.117661:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1154 00000100:00100000:0.0:1787826417.117670:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb952c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:2404:x1874670563879552:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826417.117683:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826417.117689:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b821eb lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f6b expref: 60 pid: 9966 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.117703:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b821eb lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f6b expref: 60 pid: 9966 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.117725:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b821eb lrc: 0/0,0 mode: --/PR res: [0x200000405:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f6b expref: 60 pid: 9966 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.117741:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2c:0x0].0x0 (ffff90cf39e67e00) 00010000:00010000:0.0:1787826417.117746:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82200 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.117765:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82200 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.117773:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82200 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.117802:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826417.117861:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb952c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:2404:x1874670563879552:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 190us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826417.117868:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1154 00010000:00010000:1.0:1787826417.118095:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82200 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.118103:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82200 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826417.118123:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x2c:0x0]: returning size 0 00000004:00080000:1.0:1787826417.118297:0:6518:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x109:0x0], index 1: 0 00010000:00010000:1.0:1787826417.118393:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82200 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.118401:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82200 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.118407:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82200 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.118412:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46ae00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826417.118416:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82200 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.118424:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82200 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.118433:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2c:0x0].0x0 (ffff90cf39e67e00) 00010000:00010000:1.0:1787826417.118436:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826417.118440:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82200 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.118450:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82200 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.118548:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b821f9 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x2c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f72 expref: 59 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.118558:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2c:0x0].0x0 (ffff90cf39e67e00) 00010000:00010000:1.0:1787826417.118561:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787826417.118564:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b821f9 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x2c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f72 expref: 59 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.118579:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46a400, rc 0) 00000100:00100000:1.0:1787826417.118609:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb95e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:55557:x1874670563879424:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 9821us (10318us total) trans 8589934949 rc 301/301 00000100:00100000:1.0:1787826417.118616:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3785 00000100:00100000:3.0:1787826417.121693:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826417.122118:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563879808 00000100:00100000:0.0:1787826417.122127:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563879808 00000100:00100000:0.0:1787826417.122207:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1139 00000100:00100000:0.0:1787826417.122217:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb94b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:55557:x1874670563879808:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:0.0:1787826417.122527:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb94b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55557:x1874670563879808:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 311us (843us total) trans 8589934950 rc 0/0 00000100:00100000:0.0:1787826417.122536:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1139 00000100:00100000:3.0:1787826417.126212:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826417.126405:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563879936 00000100:00100000:2.0:1787826417.126414:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563879936 00000100:00100000:2.0:1787826417.126468:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3786 00000100:00100000:2.0:1787826417.126507:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55557:x1874670563879936:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826417.126532:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826417.126553:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b8220e lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0f79 expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.126654:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82215 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.126670:0:8247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b821d6 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f64 expref: 60 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.126678:0:8247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82215 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.126713:0:8247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b821d6 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f64 expref: 60 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.126725:0:8247:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b821d6 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f64 expref: 60 pid: 6520 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826417.126737:0:8247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a9ada40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8247:1874670585249408:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826417.126808:0:8247:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce04d24240 going to sleep for 11 seconds 00000100:00100000:2.0:1787826417.132104:0:8247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a9ada40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8247:1874670585249408:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826417.132135:0:8247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82215 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826417.134726:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826417.134885:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563880064 00000100:00100000:2.0:1787826417.134894:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563880064 00010000:00010000:2.0:1787826417.134932:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b821d6 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f64 expref: 61 pid: 6520 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826417.134979:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1155 00000100:00100000:2.0:1787826417.134989:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+61:2403:x1874670563880064:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826417.135003:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826417.135010:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b821d6 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f64 expref: 61 pid: 6520 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.135022:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b821d6 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f64 expref: 61 pid: 6520 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.135044:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b821d6 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f64 expref: 61 pid: 6520 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.135059:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826417.135065:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82215 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.135074:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82215 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.135082:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82215 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.135117:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826417.135161:0:8247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82215 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.135177:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82215 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826417.135180:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:2403:x1874670563880064:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 192us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826417.135187:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1155 00000004:00200000:0.0:1787826417.135226:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:0.0:1787826417.135230:0:8247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826417.135251:0:8247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82215 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.135282:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b8220e lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f79 expref: 60 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.135297:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82215 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f79 expref: 59 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.135305:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826417.135308:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826417.135310:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834400, rc 0) 00000100:00100000:0.0:1787826417.135336:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55557:x1874670563879936:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 8832us (9134us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826417.135342:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3786 00000100:00100000:3.0:1787826417.138538:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826417.138872:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563880192 00000100:00100000:1.0:1787826417.138882:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563880192 00000100:00100000:1.0:1787826417.138945:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2096 00000100:00100000:1.0:1787826417.138956:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2401:x1874670563880192:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826417.138973:0:28853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826417.138990:0:28853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000381c17db/0x22153cd396b8221c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0f80 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826417.139049:0:28853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0373e940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28853:1874670585249536:192.168.203.39@tcp:106: 00000100:00100000:1.0:1787826417.139132:0:28853:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3780 going to sleep for 11 seconds 00000100:00100000:1.0:1787826417.149757:0:28853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0373e940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28853:1874670585249536:192.168.203.39@tcp:106: 00010000:00010000:1.0:1787826417.149802:0:28853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000381c17db/0x22153cd396b8221c lrc: 1/0,0 mode: --/PR res: [0x280000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f80 expref: 15 pid: 28853 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.149829:0:28853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000381c17db/0x22153cd396b8221c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f80 expref: 15 pid: 28853 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.149841:0:28853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46a400, rc 0) 00000100:00100000:1.0:1787826417.149903:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2401:x1874670563880192:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 10948us (11373us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826417.149912:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2096 00000100:00100000:2.0:1787826417.154949:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826417.155144:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563880320 00000100:00100000:1.0:1787826417.155154:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563880320 00000100:00100000:1.0:1787826417.155224:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3787 00000100:00100000:1.0:1787826417.155234:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9ada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55557:x1874670563880320:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826417.155254:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826417.155278:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82223 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0f87 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.155347:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b8222a lrc: 3/1,0 mode: --/PR res: [0x200000405:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.155369:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b8222a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x2c:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.155379:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b8222a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x2c:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826417.155421:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x2c:0x0]: returning size 0 00000004:00200000:1.0:1787826417.155425:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826417.155443:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b8222a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x2c:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.156054:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82223 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f87 expref: 61 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.156078:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b8222a lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x2c:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f87 expref: 60 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.156087:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2c:0x0].0x0 (ffff90cf3ab61600) 00010000:00010000:1.0:1787826417.156090:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787826417.156093:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46ac00, rc 0) 00000100:00100000:0.0:1787826417.157196:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9ada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:55557:x1874670563880320:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1957us (2251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826417.157209:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3787 00000100:00100000:3.0:1787826417.162583:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826417.167268:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563880448 00000100:00100000:0.0:1787826417.167283:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563880448 00000100:00100000:0.0:1787826417.167523:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2097 00000100:00100000:0.0:1787826417.167536:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2402:x1874670563880448:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826417.167554:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826417.167575:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b49a3b43/0x22153cd396b82231 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x109:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0f8e expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826417.167600:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x109:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826417.167618:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x109:0x0].0x0 since=1363s v=(0 0) 00010000:00010000:0.0:1787826417.167622:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x109:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826417.167632:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b49a3b43/0x22153cd396b82231 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x109:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f8e expref: 17 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.167652:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b49a3b43/0x22153cd396b82231 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x109:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f8e expref: 17 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.167665:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165fa00, rc 0) 00000100:00100000:0.0:1787826417.167727:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+17:2402:x1874670563880448:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 195us (5153us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826417.167734:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2097 00000100:00080000:3.0:1787826417.168895:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787826417.171416:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826417.171516:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563880704 00000100:00100000:0.0:1787826417.171524:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563880704 00000100:00100000:0.0:1787826417.171589:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3788 00000100:00100000:0.0:1787826417.171600:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:55557:x1874670563880704:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826417.171619:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826417.171640:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b82238 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0f95 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.171741:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b8223f lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.171755:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b8223f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.171766:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b8223f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826417.171778:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:0.0:1787826417.171874:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b82238 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f95 expref: 63 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.171892:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b8223f lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f95 expref: 62 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.171901:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826417.171904:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787826417.171907:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165f400, rc 0) 00000100:00100000:0.0:1787826417.171968:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+62:55557:x1874670563880704:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 371us (562us total) trans 8589934951 rc 0/0 00000100:00100000:0.0:1787826417.171976:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3788 00000100:00100000:2.0:1787826417.175942:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826417.176045:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563880832 00000100:00100000:1.0:1787826417.176054:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563880832 00000100:00100000:1.0:1787826417.176112:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2098 00000100:00100000:1.0:1787826417.176122:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9ade00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2402:x1874670563880832:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826417.176139:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826417.176157:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000816b8b1f/0x22153cd396b8224d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0f9c expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826417.176223:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0373e940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1874670585249664:192.168.203.39@tcp:106: 00000100:00100000:1.0:1787826417.176302:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3780 going to sleep for 11 seconds 00000100:00100000:1.0:1787826417.178735:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0373e940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1874670585249664:192.168.203.39@tcp:106: 00010000:00010000:1.0:1787826417.178773:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000816b8b1f/0x22153cd396b8224d lrc: 1/0,0 mode: --/PR res: [0x280000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f9c expref: 15 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.178802:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000816b8b1f/0x22153cd396b8224d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f9c expref: 15 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.178814:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46ae00, rc 0) 00000100:00100000:1.0:1787826417.178864:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9ade00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2402:x1874670563880832:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 2743us (2931us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826417.178872:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2098 00000100:00100000:3.0:1787826417.181705:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826417.181816:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563880960 00000100:00100000:1.0:1787826417.181824:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563880960 00000100:00100000:1.0:1787826417.181870:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2099 00000100:00100000:1.0:1787826417.181880:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2401:x1874670563880960:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826417.181896:0:8545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826417.181912:0:8545:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000381c17db/0x22153cd396b82254 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0fa3 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826417.181967:0:8545:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0373e940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8545:1874670585249792:192.168.203.39@tcp:106: 00000100:00100000:1.0:1787826417.182043:0:8545:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3780 going to sleep for 11 seconds 00000100:00100000:1.0:1787826417.184179:0:8545:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0373e940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8545:1874670585249792:192.168.203.39@tcp:106: 00010000:00010000:1.0:1787826417.184216:0:8545:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000381c17db/0x22153cd396b82254 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fa3 expref: 15 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.184241:0:8545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000381c17db/0x22153cd396b82254 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fa3 expref: 15 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.184260:0:8545:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46a400, rc 0) 00000100:00100000:1.0:1787826417.184316:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2401:x1874670563880960:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 2437us (2618us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826417.184324:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2099 00000100:00100000:3.0:1787826417.187163:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826417.187259:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563881088 00000100:00100000:1.0:1787826417.187269:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563881088 00000100:00100000:1.0:1787826417.187327:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2100 00000100:00100000:1.0:1787826417.187337:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2401:x1874670563881088:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:1.0:1787826417.187387:0:30398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000816b8b1f/0x22153cd396b8225b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.187406:0:30398:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006d612c5b/0x22153cd396b82086 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0efb expref: 14 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.187416:0:30398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x108:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787826417.187420:0:30398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x108:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826417.187425:0:30398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000816b8b1f/0x22153cd396b8225b lrc: 4/1,0 mode: --/PR res: [0x280000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.187458:0:30398:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006d612c5b/0x22153cd396b82086 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0efb expref: 14 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.187498:0:30398:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006d612c5b/0x22153cd396b82086 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0efb expref: 14 pid: 30398 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826417.187521:0:30398:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0373e940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:30398:1874670585249920:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826417.187601:0:30398:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3780 going to sleep for 11 seconds 00000100:00100000:3.0:1787826417.191180:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826417.191295:0:30398:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0373e940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:30398:1874670585249920:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826417.191323:0:30398:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000816b8b1f/0x22153cd396b8225b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826417.191414:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563881216 00000100:00100000:0.0:1787826417.191421:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563881216 00010000:00010000:0.0:1787826417.191457:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006d612c5b/0x22153cd396b82086 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0efb expref: 15 pid: 30398 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826417.191530:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1156 00000100:00100000:0.0:1787826417.191539:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2403:x1874670563881216:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826417.191553:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826417.191572:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006d612c5b/0x22153cd396b82086 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x108:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0efb expref: 15 pid: 30398 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.191584:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006d612c5b/0x22153cd396b82086 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x108:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0efb expref: 15 pid: 30398 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.191607:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d612c5b/0x22153cd396b82086 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x108:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0efb expref: 15 pid: 30398 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.191625:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x108:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826417.191629:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x108:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826417.191634:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000816b8b1f/0x22153cd396b8225b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.191644:0:10340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000816b8b1f/0x22153cd396b8225b lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.191665:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826417.191723:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2403:x1874670563881216:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 185us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826417.191731:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1156 00010000:00010000:1.0:1787826417.191902:0:30398:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000816b8b1f/0x22153cd396b8225b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x108:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.191910:0:30398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000816b8b1f/0x22153cd396b8225b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x108:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.191930:0:30398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000816b8b1f/0x22153cd396b8225b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x108:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.191939:0:30398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000816b8b1f/0x22153cd396b8225b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x108:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.191947:0:30398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000816b8b1f/0x22153cd396b8225b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x108:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.191954:0:30398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46ae00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:1.0:1787826417.191958:0:30398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000816b8b1f/0x22153cd396b8225b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x108:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.191968:0:30398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000816b8b1f/0x22153cd396b8225b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x108:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.191980:0:30398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000816b8b1f/0x22153cd396b8225b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x108:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.191987:0:30398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000816b8b1f/0x22153cd396b8225b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x108:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826417.192034:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2401:x1874670563881088:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 4699us (4881us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826417.192043:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2100 00000100:00100000:2.0:1787826417.196034:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826417.196221:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563881344 00000100:00100000:3.0:1787826417.196231:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563881344 00000100:00100000:3.0:1787826417.196326:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2101 00000100:00100000:3.0:1787826417.196337:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2401:x1874670563881344:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826417.196363:0:14864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826417.196384:0:14864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000482bb568/0x22153cd396b82262 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x108:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0faa expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826417.196410:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x108:0x0] initial LVB size: 0, mtime: 0x6a9010ec, atime: 0x6a9010ec, ctime: 0x6a9010f1, blocks: 0x0 00010000:00010000:3.0:1787826417.196429:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x108:0x0].0x0 since=1363s v=(0 0) 00010000:00010000:3.0:1787826417.196434:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x108:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826417.196443:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000482bb568/0x22153cd396b82262 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x108:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0faa expref: 14 pid: 14864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.196460:0:14864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000482bb568/0x22153cd396b82262 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x108:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0faa expref: 14 pid: 14864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.196519:0:14864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400200, rc 0) 00000100:00100000:3.0:1787826417.196576:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2401:x1874670563881344:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 241us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826417.196584:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2101 00000100:00100000:2.0:1787826417.256034:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826417.256990:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563881472 00000100:00100000:1.0:1787826417.257002:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563881472 00000100:00100000:1.0:1787826417.257071:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3789 00000100:00100000:1.0:1787826417.257081:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+62:55557:x1874670563881472:12345-192.168.203.39@tcp:44:lfs.0 00000001:00080000:0.0:1787826417.259887:0:34481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934951 is committed 00010000:00010000:1.0:1787826417.259987:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b82078 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.260001:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b82078 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.260010:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b82078 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.260017:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46b200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826417.260028:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b82078 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.260035:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b82078 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.260051:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2a:0x0].0x0 (ffff90cf3ab61e00) 00010000:00010000:1.0:1787826417.260055:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826417.260059:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b82078 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.260066:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b82078 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.260092:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b8208d lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.260099:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b8208d lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.260105:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b8208d lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.260110:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46ba00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826417.260113:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b8208d lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.260119:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b8208d lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.260127:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826417.260129:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826417.260133:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b8208d lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.260139:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b8208d lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787826417.260201:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 27 committed 00000100:00100000:2.0:1787826417.260428:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787826417.260447:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3abc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585250048:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787826417.260530:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826417.260595:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585250048 00000100:00100000:3.0:1787826417.260602:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585250048 00000100:00100000:3.0:1787826417.260662:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2102 00000100:00100000:3.0:1787826417.260672:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9ac780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3647:x1874670585250048:12345-0@lo:6:osp-syn-1-0.0 00000100:00080000:2.0:1787826417.260679:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:3.0:1787826417.260695:0:8437:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:264 count 1 00010000:00010000:3.0:1787826417.260717:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e843828/0x22153cd396b82269 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.260738:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b82094 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f02 expref: 16 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787826417.260889:0:34481:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90cf3f7d8780 refcount 2 committed 0 result 0 batchid 4294969335 00010000:00010000:3.0:1787826417.260944:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x108:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787826417.260951:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x108:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826417.260956:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e843828/0x22153cd396b82269 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.260985:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b82094 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f02 expref: 16 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.260999:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b82094 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f02 expref: 16 pid: 30694 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826417.261018:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3abc0b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1874670585250176:192.168.203.39@tcp:104: 00000020:00080000:0.0:1787826417.261114:0:34481:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cf2f575400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90cf3f7d8b40 00000020:00080000:0.0:1787826417.261118:0:34481:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cf2f575000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90ce045e6a00 00000020:00080000:0.0:1787826417.261138:0:34481:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969334 batchid updated 00000020:00080000:0.0:1787826417.261157:0:34512:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969335 committed batchid 4294969334 00000020:00080000:0.0:1787826417.261222:0:34512:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969334 00000100:00100000:3.0:1787826417.261369:0:8437:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf1850cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787826417.261668:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:55557:x1874670563881472:12345-192.168.203.39@tcp:44:lfs.0 Request processed in 4586us (5640us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826417.261677:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3789 00000100:00100000:0.0:1787826417.266246:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826417.266380:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826417.266459:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563881728 00000100:00100000:1.0:1787826417.266468:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563881728 00010000:00010000:1.0:1787826417.266536:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b82094 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f02 expref: 17 pid: 30694 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826417.266570:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1157 00000100:00100000:1.0:1787826417.266580:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+17:2404:x1874670563881728:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826417.266595:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826417.266600:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b82094 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x108:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f02 expref: 17 pid: 30694 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.266613:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b82094 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x108:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f02 expref: 17 pid: 30694 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.266638:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x108:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826417.266643:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x108:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826417.266648:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009e843828/0x22153cd396b82269 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x108:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.266658:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e843828/0x22153cd396b82269 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x108:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.266683:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826417.266737:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+17:2404:x1874670563881728:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 159us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826417.266745:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1157 00010000:00010000:3.0:1787826417.267570:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b82094 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f02 expref: 16 pid: 30694 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826417.267588:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3abc0b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1874670585250176:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826417.267609:0:8437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009e843828/0x22153cd396b82269 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x108:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.267619:0:8437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009e843828/0x22153cd396b82269 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x108:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.267626:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e843828/0x22153cd396b82269 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x108:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.267636:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e843828/0x22153cd396b82269 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x108:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.267642:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e843828/0x22153cd396b82269 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x108:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.267662:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787826417.267906:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826417.267913:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e843828/0x22153cd396b82269 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x108:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.267921:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401a00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:1.0:1787826417.267925:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e843828/0x22153cd396b82269 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x108:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.267935:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e843828/0x22153cd396b82269 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x108:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.267950:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e843828/0x22153cd396b82269 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x108:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.267957:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e843828/0x22153cd396b82269 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x108:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.267975:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826417.267977:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826417.267979:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826417.268254:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9ac780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3647:x1874670585250048:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7582us (7722us total) trans 17179869664 rc 0/0 00000100:00100000:3.0:1787826417.268263:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2102 00000100:00100000:3.0:1787826417.268286:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563881600 00000100:00100000:3.0:1787826417.268291:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563881600 00000004:00080000:1.0:1787826417.268375:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3abc3480/2, rc 0, transno 17179869664 00000100:00100000:1.0:1787826417.268383:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3abc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585250048:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787826417.269326:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2103 00000100:00100000:2.0:1787826417.269587:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2403:x1874670563881600:12345-192.168.203.39@tcp:16:lfs.0 00000100:00100000:2.0:1787826417.269687:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2403:x1874670563881600:12345-192.168.203.39@tcp:16:lfs.0 Request processed in 351us (3450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826417.269694:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2103 00000001:00080000:0.0:1787826417.276141:0:27651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179869664 is committed 00000001:00080000:0.0:1787826417.276161:0:27651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179869663 is committed 00000100:00100000:0.0:1787826417.285588:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826417.285733:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563881856 00000100:00100000:2.0:1787826417.285742:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563881856 00000100:00100000:2.0:1787826417.285793:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2104 00000100:00100000:2.0:1787826417.285804:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2403:x1874670563881856:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:2.0:1787826417.285846:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005c6f0c33/0x22153cd396b82270 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.285864:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x108:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826417.285868:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x108:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826417.285875:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c6f0c33/0x22153cd396b82270 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.285889:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c6f0c33/0x22153cd396b82270 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.285920:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005c6f0c33/0x22153cd396b82270 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.285928:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c6f0c33/0x22153cd396b82270 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.285936:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c6f0c33/0x22153cd396b82270 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.285942:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834600 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826417.285946:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c6f0c33/0x22153cd396b82270 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.285955:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c6f0c33/0x22153cd396b82270 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.285968:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c6f0c33/0x22153cd396b82270 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.285976:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c6f0c33/0x22153cd396b82270 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826417.286123:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2403:x1874670563881856:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 320us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826417.286131:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2104 00000100:00100000:1.0:1787826417.291078:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826417.291191:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563882112 00000100:00100000:0.0:1787826417.291201:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563882112 00000100:00100000:0.0:1787826417.291297:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3790 00000100:00100000:0.0:1787826417.291308:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:55557:x1874670563882112:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:0.0:1787826417.291380:0:8247:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826417.291417:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b8222a lrc: 0/0,0 mode: --/PR res: [0x200000405:0x2c:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f87 expref: 33 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.291436:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2c:0x0].0x0 (ffff90cf3ab61600) 00010000:00010000:0.0:1787826417.291446:0:8247:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826417.291510:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b82277 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.291521:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b82277 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.291531:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b82277 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826417.291641:0:8247:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c3f535ba reply state 00000000dd58edeb transno 8589934952 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b82277 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.291653:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b82277 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.291658:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2c:0x0].0x0 (ffff90ce036ca500) 00010000:00010000:0.0:1787826417.291661:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826417.291663:0:8247:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787826417.291763:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:55557:x1874670563882112:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 449us (687us total) trans 8589934952 rc 0/0 00000100:00100000:0.0:1787826417.291771:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3790 00000100:00100000:3.0:1787826417.294962:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826417.295039:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563882240 00000100:00100000:2.0:1787826417.295049:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563882240 00000100:00100000:2.0:1787826417.295103:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3791 00000100:00100000:2.0:1787826417.295113:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:55557:x1874670563882240:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826417.295136:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826417.295157:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8227e lrc: 2/0,0 mode: --/CR res: [0x200000405:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0fb1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.295222:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8227e lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fb1 expref: 35 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.295236:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8227e lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fb1 expref: 35 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.295255:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2c:0x0].0x0 (ffff90ce036ca500) 00010000:00010000:2.0:1787826417.295258:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826417.295262:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835a00, rc 0) 00000100:00100000:2.0:1787826417.295324:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:55557:x1874670563882240:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 212us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826417.295331:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3791 00000100:00100000:3.0:1787826417.298662:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826417.298760:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563882368 00000100:00100000:0.0:1787826417.298770:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563882368 00000100:00100000:0.0:1787826417.298818:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2105 00000100:00100000:0.0:1787826417.298828:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:55557:x1874670563882368:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826417.298845:0:30695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826417.298864:0:30695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d39501d2/0x22153cd396b82285 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0fb8 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.298895:0:30695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b49a3b43/0x22153cd396b82231 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f8e expref: 10 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.298910:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x109:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826417.298915:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x109:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826417.298920:0:30695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d39501d2/0x22153cd396b82285 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fb8 expref: 10 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.298955:0:30695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b49a3b43/0x22153cd396b82231 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f8e expref: 10 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.298969:0:30695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b49a3b43/0x22153cd396b82231 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f8e expref: 10 pid: 8437 timeout: 1463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826417.298982:0:30695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf136d4f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:30695:1874670585250304:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826417.299060:0:30695:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce04aa5780 going to sleep for 11 seconds 00000100:00100000:0.0:1787826417.301795:0:30695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf136d4f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:30695:1874670585250304:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826417.301831:0:30695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d39501d2/0x22153cd396b82285 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fb8 expref: 10 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.301851:0:30695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165e600, rc 0) 00000100:00100000:0.0:1787826417.301911:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:55557:x1874670563882368:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 3084us (3257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826417.301920:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2105 00000100:00100000:3.0:1787826417.303787:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826417.305308:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563882496 00000100:00100000:2.0:1787826417.305320:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563882496 00010000:00010000:2.0:1787826417.305511:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b49a3b43/0x22153cd396b82231 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f8e expref: 10 pid: 8437 timeout: 1463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826417.305552:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1158 00000100:00100000:2.0:1787826417.305563:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf185d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563882496:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826417.305581:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826417.305603:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b49a3b43/0x22153cd396b82231 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x109:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f8e expref: 10 pid: 8437 timeout: 1463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.305617:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b49a3b43/0x22153cd396b82231 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x109:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f8e expref: 10 pid: 8437 timeout: 1463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.305641:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b49a3b43/0x22153cd396b82231 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x109:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f8e expref: 10 pid: 8437 timeout: 1463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.305658:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x109:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826417.305663:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x109:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826417.305669:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d39501d2/0x22153cd396b82285 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fb8 expref: 9 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.305679:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d39501d2/0x22153cd396b82285 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fb8 expref: 9 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.305713:0:6503:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d39501d2/0x22153cd396b82285 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fb8 expref: 9 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826417.305727:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a9af480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6503:1874670585250432:192.168.203.39@tcp:105: 00000100:00100000:2.0:1787826417.305911:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce04d24240 going to sleep for 11 seconds 00000100:00100000:2.0:1787826417.309301:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a9af480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6503:1874670585250432:192.168.203.39@tcp:105: 00010000:00010000:2.0:1787826417.309327:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826417.309449:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf185d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563882496:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3827us (5608us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826417.309461:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1158 00000100:00100000:3.0:1787826417.309707:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826417.309765:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563882624 00000100:00100000:2.0:1787826417.309772:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563882624 00000100:00100000:2.0:1787826417.309824:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2106 00000100:00100000:2.0:1787826417.309833:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563882624:12345-192.168.203.39@tcp:2:lfs.0 00002000:00010000:2.0:1787826417.310007:0:28853:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x109:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787826417.310011:0:28853:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x109:0x0] updating lvb mtime from disk: 0 -> 1787826412 00002000:00010000:2.0:1787826417.310013:0:28853:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x109:0x0] updating lvb atime from disk: 0 -> 1787826412 00002000:00010000:2.0:1787826417.310015:0:28853:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x109:0x0] updating lvb ctime from disk: 0 -> 1787826417 00002000:00010000:2.0:1787826417.310017:0:28853:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x109:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1787826417.310044:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563882624:12345-192.168.203.39@tcp:2:lfs.0 Request processed in 213us (338us total) trans 17179869665 rc 0/0 00000100:00100000:2.0:1787826417.310051:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2106 00000100:00100000:3.0:1787826417.312854:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826417.312941:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563882880 00000100:00100000:2.0:1787826417.312950:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563882880 00000100:00100000:2.0:1787826417.313008:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3792 00000100:00100000:2.0:1787826417.313018:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:55557:x1874670563882880:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:2.0:1787826417.313069:0:16564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826417.313096:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82215 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f79 expref: 35 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.313116:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826417.313123:0:16564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826417.313179:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b8228c lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.313196:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b8228c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.313206:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b8228c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826417.313305:0:16564:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c89bcfff reply state 000000006f49183b transno 8589934953 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b8228c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.313315:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b8228c lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.313321:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826417.313323:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826417.313326:0:16564:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826417.313631:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55557:x1874670563882880:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 456us (626us total) trans 8589934953 rc 0/0 00000100:00100000:2.0:1787826417.313638:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3792 00000100:00100000:3.0:1787826417.316641:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826417.316890:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563883008 00000100:00100000:1.0:1787826417.316908:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563883008 00000100:00100000:1.0:1787826417.316995:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2107 00000100:00100000:1.0:1787826417.317005:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:55557:x1874670563883008:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826417.317023:0:30694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826417.317041:0:30694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4b5afc1/0x22153cd396b82293 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0fbf expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.317072:0:30694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000482bb568/0x22153cd396b82262 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0faa expref: 15 pid: 14864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.317084:0:30694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x108:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826417.317089:0:30694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x108:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826417.317093:0:30694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4b5afc1/0x22153cd396b82293 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fbf expref: 15 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.317129:0:30694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000482bb568/0x22153cd396b82262 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0faa expref: 15 pid: 14864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.317143:0:30694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000482bb568/0x22153cd396b82262 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0faa expref: 15 pid: 14864 timeout: 1463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826417.317930:0:30694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0373cb40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:30694:1874670585250560:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826417.318110:0:30694:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3780 going to sleep for 11 seconds 00000100:00100000:2.0:1787826417.321824:0:30694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0373cb40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:30694:1874670585250560:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826417.321862:0:30694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a4b5afc1/0x22153cd396b82293 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fbf expref: 15 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.321883:0:30694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46b000, rc 0) 00000100:00100000:2.0:1787826417.321999:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:55557:x1874670563883008:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 4994us (5365us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826417.322007:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2107 00000100:00100000:3.0:1787826417.325714:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826417.325814:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563883136 00000100:00100000:0.0:1787826417.325824:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563883136 00010000:00010000:0.0:1787826417.325865:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000482bb568/0x22153cd396b82262 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0faa expref: 15 pid: 14864 timeout: 1463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826417.325907:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1159 00000100:00100000:0.0:1787826417.325918:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2403:x1874670563883136:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826417.325933:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826417.325954:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000482bb568/0x22153cd396b82262 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x108:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0faa expref: 15 pid: 14864 timeout: 1463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.325968:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000482bb568/0x22153cd396b82262 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x108:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0faa expref: 15 pid: 14864 timeout: 1463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.325990:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000482bb568/0x22153cd396b82262 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x108:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0faa expref: 15 pid: 14864 timeout: 1463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.326008:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x108:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826417.326012:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x108:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826417.326019:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a4b5afc1/0x22153cd396b82293 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fbf expref: 14 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.326030:0:10341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4b5afc1/0x22153cd396b82293 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fbf expref: 14 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.326069:0:10341:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a4b5afc1/0x22153cd396b82293 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fbf expref: 14 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826417.326089:0:10341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf136d4f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10341:1874670585250688:192.168.203.39@tcp:105: 00000100:00100000:0.0:1787826417.326330:0:10341:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce04aa5780 going to sleep for 11 seconds 00000100:00100000:2.0:1787826417.330050:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826417.330145:0:10341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf136d4f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10341:1874670585250688:192.168.203.39@tcp:105: 00010000:00010000:0.0:1787826417.330184:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826417.330238:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2403:x1874670563883136:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4321us (4533us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826417.330248:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1159 00000100:00100000:1.0:1787826417.330980:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563883264 00000100:00100000:1.0:1787826417.330989:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563883264 00000100:00100000:1.0:1787826417.331039:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2108 00000100:00100000:1.0:1787826417.331049:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563883264:12345-192.168.203.39@tcp:2:lfs.0 00002000:00010000:1.0:1787826417.331216:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x108:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787826417.331219:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x108:0x0] updating lvb mtime from disk: 1787826412 -> 1787826412 00002000:00010000:1.0:1787826417.331222:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x108:0x0] updating lvb atime from disk: 1787826412 -> 1787826412 00002000:00010000:1.0:1787826417.331224:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x108:0x0] updating lvb ctime from disk: 1787826417 -> 1787826417 00002000:00010000:1.0:1787826417.331226:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x108:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1787826417.331268:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2404:x1874670563883264:12345-192.168.203.39@tcp:2:lfs.0 Request processed in 220us (1226us total) trans 21474837006 rc 0/0 00000100:00100000:1.0:1787826417.331275:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2108 00000001:00080000:0.0:1787826417.335689:0:26205:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474837006 is committed 00000001:00080000:0.0:1787826417.335705:0:26205:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474837005 is committed 00000100:00100000:2.0:1787826417.337591:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826417.337857:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563883520 00000100:00100000:1.0:1787826417.337868:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563883520 00000100:00100000:1.0:1787826417.337924:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1140 00000100:00100000:1.0:1787826417.337934:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eea7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55557:x1874670563883520:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:1.0:1787826417.338011:0:14257:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000405:0x1d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b8223f lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f95 expref: 36 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.338050:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b8229a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.338063:0:14257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8216d lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f41 expref: 36 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.338070:0:14257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b821ba lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f56 expref: 36 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.338083:0:14257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b8229a lrc: 5/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.338116:0:14257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b821ba lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f56 expref: 36 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.338128:0:14257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b821ba lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f56 expref: 36 pid: 8247 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826417.338141:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0373c780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585250816:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826417.338248:0:14257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8216d lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f41 expref: 36 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.338257:0:14257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8216d lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f41 expref: 36 pid: 16564 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826417.338266:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0373f0c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585250944:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826417.338291:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3780 going to sleep for 11 seconds 00000100:00100000:2.0:1787826417.341721:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826417.341858:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563883776 00000100:00100000:0.0:1787826417.341867:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563883776 00000100:00100000:0.0:1787826417.341919:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1141 00000100:00100000:0.0:1787826417.341929:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9acb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:42220:x1874670563883776:12345-192.168.203.39@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787826417.342148:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9acb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:42220:x1874670563883776:12345-192.168.203.39@tcp:35:ldlm_bl.0 Request processed in 220us (434us total) trans 8589934954 rc 0/0 00000100:00100000:0.0:1787826417.342165:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1141 00000100:00100000:1.0:1787826417.343726:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0373c780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585250816:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826417.343741:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0373f0c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585250944:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826417.343782:0:14257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b8229a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826417.345693:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826417.345797:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563883904 00000100:00100000:0.0:1787826417.345805:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563883904 00010000:00010000:0.0:1787826417.345845:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b821ba lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f56 expref: 38 pid: 8247 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826417.345888:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1160 00000100:00100000:0.0:1787826417.345897:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa870c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:2403:x1874670563883904:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826417.345912:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826417.345919:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b821ba lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f56 expref: 38 pid: 8247 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.345932:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b821ba lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f56 expref: 38 pid: 8247 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.345956:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b821ba lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f56 expref: 38 pid: 8247 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.345972:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826417.345977:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b8229a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.345986:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b8229a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.346004:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826417.346060:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa870c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:2403:x1874670563883904:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 164us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826417.346068:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1160 00000100:00100000:3.0:1787826417.348741:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826417.348835:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563884032 00000100:00100000:2.0:1787826417.348844:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563884032 00010000:00010000:2.0:1787826417.348883:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8216d lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f41 expref: 37 pid: 16564 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826417.348923:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1161 00000100:00100000:2.0:1787826417.348932:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa86940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:2403:x1874670563884032:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826417.348946:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826417.348953:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8216d lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f41 expref: 37 pid: 16564 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.348965:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8216d lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f41 expref: 37 pid: 16564 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.348986:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8216d lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f41 expref: 37 pid: 16564 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.349000:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826417.349005:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b8229a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.349014:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b8229a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.349021:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b8229a lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.349062:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826417.349115:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa86940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:2403:x1874670563884032:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 184us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826417.349123:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1161 00010000:00010000:3.0:1787826417.349641:0:14257:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b8229a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.349650:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b8229a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.349671:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b822a1 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.349683:0:14257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8227e lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fb1 expref: 35 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.349691:0:14257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b822a1 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x2c:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.349723:0:14257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8227e lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fb1 expref: 35 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.349741:0:14257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8227e lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fb1 expref: 35 pid: 6520 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826417.349754:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aa84000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585251072:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826417.349814:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf1850cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826417.357308:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aa84000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585251072:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826417.357990:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00010000:00010000:1.0:1787826417.358689:0:14257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b822a1 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x2c:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826417.358900:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563884160 00000100:00100000:3.0:1787826417.358909:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563884160 00010000:00010000:3.0:1787826417.358949:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8227e lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fb1 expref: 36 pid: 6520 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826417.359026:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1162 00000100:00100000:3.0:1787826417.359037:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136d4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:2404:x1874670563884160:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826417.359051:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826417.359057:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8227e lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fb1 expref: 36 pid: 6520 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.359071:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8227e lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fb1 expref: 36 pid: 6520 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.359093:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8227e lrc: 0/0,0 mode: --/CR res: [0x200000405:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fb1 expref: 36 pid: 6520 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.359109:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2c:0x0].0x0 (ffff90ce036ca500) 00010000:00010000:3.0:1787826417.359114:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b822a1 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x2c:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.359127:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b822a1 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2c:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.359134:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b822a1 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x2c:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.359176:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826417.359232:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136d4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:2404:x1874670563884160:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 195us (1243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826417.359239:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1162 00010000:00010000:1.0:1787826417.359292:0:14257:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b822a1 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.359299:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b822a1 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826417.359609:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0373f0c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585251200:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1787826417.359657:0:14257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826417.359687:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826417.359706:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585251200 00000100:00100000:1.0:1787826417.359710:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585251200 00000100:00100000:1.0:1787826417.359750:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1449 00000100:00100000:1.0:1787826417.359758:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:14257:x1874670585251200:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1787826417.359829:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:14257:x1874670585251200:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 72us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826417.359836:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1449 00000100:00080000:1.0:1787826417.359853:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826417.359879:0:14257:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474837005 gen 2 00000004:00080000:1.0:1787826417.359885:0:14257:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474836993 committed transno 21474837005 00000004:00080000:1.0:1787826417.359903:0:14257:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce04f052c0, transno 21474836995 00000004:00080000:1.0:1787826417.359914:0:14257:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474836997 committed transno 21474837005 00000004:00080000:1.0:1787826417.359928:0:14257:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf41c87c00, transno 21474836999 00000004:00080000:1.0:1787826417.359933:0:14257:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837001 committed transno 21474837005 00000004:00080000:1.0:1787826417.359940:0:14257:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3f80a1c0, transno 21474837003 00000004:00080000:1.0:1787826417.359944:0:14257:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837005 committed transno 21474837005 00000100:00100000:1.0:1787826417.359957:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0373f0c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585251200:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1787826417.359992:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0373f0c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585251328:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1787826417.360018:0:14257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826417.360035:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3f7d8900 going to sleep for 11 seconds 00000004:00080000:1.0:1787826417.360115:0:34500:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 3 done 00000100:00100000:1.0:1787826417.360722:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585251328 00000100:00100000:1.0:1787826417.360728:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585251328 00000100:00100000:1.0:1787826417.360859:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1450 00000100:00100000:1.0:1787826417.360868:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:14257:x1874670585251328:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1787826417.360952:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:14257:x1874670585251328:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 86us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826417.360959:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1450 00000100:00100000:0.0:1787826417.361018:0:14257:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869664 gen 2 00000004:00080000:0.0:1787826417.361023:0:14257:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869651 committed transno 17179869664 00000004:00080000:0.0:1787826417.361037:0:14257:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce04f070c0, transno 17179869652 00000004:00080000:0.0:1787826417.361047:0:14257:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869654 committed transno 17179869664 00000004:00080000:0.0:1787826417.361055:0:14257:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3f80ad00, transno 17179869656 00000004:00080000:0.0:1787826417.361059:0:14257:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869658 committed transno 17179869664 00000004:00080000:0.0:1787826417.361067:0:14257:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3ab93480, transno 17179869660 00000004:00080000:0.0:1787826417.361070:0:14257:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869662 committed transno 17179869664 00000004:00080000:0.0:1787826417.361082:0:14257:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3abc3480, transno 17179869664 00000100:00100000:0.0:1787826417.361087:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0373f0c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585251328:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:0.0:1787826417.361206:0:14257:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934955 00000100:00100000:0.0:1787826417.361260:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf136d43c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585251456:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1787826417.361292:0:14257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826417.361650:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a18180 going to sleep for 11 seconds 00000100:00100000:2.0:1787826417.361881:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585251456 00000100:00100000:2.0:1787826417.361887:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585251456 00000100:00100000:2.0:1787826417.361918:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1451 00000100:00100000:2.0:1787826417.361925:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136d4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:14257:x1874670585251456:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1787826417.362046:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136d4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:14257:x1874670585251456:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 120us (752us total) trans 17179869666 rc 0/0 00000100:00100000:2.0:1787826417.362053:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1451 00000004:00080000:1.0:1787826417.362086:0:34502:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 4 done 00000100:00100000:0.0:1787826417.362317:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf136d43c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585251456:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:0.0:1787826417.362379:0:14257:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934956 00010000:00010000:0.0:1787826417.362413:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b822a1 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.362423:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b822a1 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x2c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.362430:0:14257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b822a1 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x2c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.362435:0:14257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826417.362439:0:14257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b822a1 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x2c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.362445:0:14257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b822a1 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x2c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.362461:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2c:0x0].0x0 (ffff90ce036ca500) 00010000:00010000:0.0:1787826417.362464:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787826417.363535:0:14257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b822a1 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x2c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.363549:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b822a1 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x2c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.363568:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b8229a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.363574:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b8229a lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.363579:0:14257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b8229a lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.363584:0:14257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46aa00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826417.363586:0:14257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b8229a lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.363592:0:14257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b8229a lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.363603:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826417.363605:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787826417.363609:0:14257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b8229a lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.363614:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b8229a lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.363628:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826417.363630:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787826417.363637:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b8223f lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0f95 expref: 37 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826417.363736:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eea7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55557:x1874670563883520:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 25803us (26152us total) trans 8589934957 rc 0/0 00000100:00100000:0.0:1787826417.363746:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1140 00000020:00080000:0.0:1787826417.363751:0:14257:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1787826417.373161:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826417.373268:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563884288 00000100:00100000:1.0:1787826417.373278:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563884288 00000100:00100000:1.0:1787826417.373720:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3793 00000100:00100000:1.0:1787826417.373730:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55557:x1874670563884288:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826417.373763:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826417.373785:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b822a8 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0fc6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.373839:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b822a8 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fc6 expref: 37 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.373855:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b822a8 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fc6 expref: 37 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.373881:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826417.373884:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826417.373888:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46a800, rc 0) 00000100:00100000:1.0:1787826417.374116:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:55557:x1874670563884288:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 231us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826417.374125:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3793 00000100:00100000:2.0:1787826417.381950:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826417.382054:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563884544 00000100:00100000:0.0:1787826417.382064:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563884544 00000100:00100000:0.0:1787826417.382123:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1142 00000100:00100000:0.0:1787826417.382133:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9afc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:55557:x1874670563884544:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:0.0:1787826417.382889:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9afc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:55557:x1874670563884544:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 755us (946us total) trans 8589934958 rc 0/0 00000100:00100000:0.0:1787826417.382899:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1142 00000100:00100000:3.0:1787826417.389040:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826417.389968:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563884800 00000100:00100000:0.0:1787826417.389980:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563884800 00000100:00100000:0.0:1787826417.390046:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1143 00000100:00100000:0.0:1787826417.390057:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:55557:x1874670563884800:12345-192.168.203.39@tcp:35:lfs.0 00000004:00080000:0.0:1787826417.390255:0:14257:0:(mdd_object.c:4014:mdd_close()) Object [0x200000405:0x2c:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:0.0:1787826417.390332:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b822af lrc: 3/0,1 mode: --/PW res: [0x200000405:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.390348:0:14257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b822af lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.390362:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b822af lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.390370:0:14257:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b822af lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.390376:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b822af lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.390394:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b822af lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.390418:0:14257:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787826417.391437:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826417.391448:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b822af lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.391457:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165f400 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:1.0:1787826417.391614:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b822af lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.391625:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b822af lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.391640:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2c:0x0].0x0 (ffff90ce036ca500) 00010000:00010000:1.0:1787826417.391643:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787826417.391648:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b822af lrc: 1/0,0 mode: --/PW res: [0x200000405:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.391653:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b822af lrc: 0/0,0 mode: --/PW res: [0x200000405:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.391671:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826417.391673:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826417.391675:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826417.392758:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+39:55557:x1874670563884800:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 2694us (3718us total) trans 8589934959 rc 0/0 00000100:00100000:0.0:1787826417.392771:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1143 00000100:00100000:3.0:1787826417.418388:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826417.418495:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563884928 00000100:00100000:2.0:1787826417.418505:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563884928 00000100:00100000:2.0:1787826417.418564:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3794 00000100:00100000:2.0:1787826417.418574:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+39:55559:x1874670563884928:12345-192.168.203.39@tcp:101:getfattr.0 00010000:00010000:2.0:1787826417.418597:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826417.418618:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b822b6 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0fcd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.418681:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b822bd lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.418696:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b822bd lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.418708:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b822bd lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.418720:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b822c4 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.418726:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b822c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.418733:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b822c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.418820:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b822cb lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.418830:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b822cb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.418838:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b822cb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826417.418875:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:2.0:1787826417.418879:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826417.418910:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b822cb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.418921:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b822cb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.418929:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b822bd lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.418935:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b822bd lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.418945:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b822bd lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.418952:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b822bd lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.418967:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826417.418972:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b822bd lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.418980:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b822bd lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.418991:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf39e67700) 00010000:00010000:2.0:1787826417.418994:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826417.418999:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b822bd lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.419005:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b822bd lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.419020:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b822c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.419026:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b822c4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.419031:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b822c4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.419036:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826417.419039:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b822c4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.419044:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b822c4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.419051:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf39e67a00) 00010000:00010000:2.0:1787826417.419053:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826417.419056:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b822c4 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.419062:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b822c4 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.419091:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b822b6 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fcd expref: 41 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.419106:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b822cb lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fcd expref: 40 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.419113:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826417.419116:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826417.419118:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835a00, rc 0) 00000100:00100000:2.0:1787826417.419184:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55559:x1874670563884928:12345-192.168.203.39@tcp:101:getfattr.0 Request processed in 611us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826417.419192:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3794 00000100:00100000:2.0:1787826417.456960:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826417.457147:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563885056 00000100:00100000:0.0:1787826417.457159:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563885056 00000100:00100000:0.0:1787826417.457235:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3795 00000100:00100000:0.0:1787826417.457246:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9af0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55563:x1874670563885056:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:0.0:1787826417.457328:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b822d2 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.457345:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b822d2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.457359:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b822d2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.457372:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b822d9 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.457378:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b822d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.457385:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b822d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.457463:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b822e0 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.457507:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b822e0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.457515:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b822e0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826417.457551:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:0.0:1787826417.457556:0:8247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826417.457567:0:8247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b822e0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.457581:0:8247:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b822d2 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.457588:0:8247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b822d2 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.457595:0:8247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b822d2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.457601:0:8247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b822d2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.457607:0:8247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165fe00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826417.457611:0:8247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b822d2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.457628:0:8247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b822d2 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.457640:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90ce036ca200) 00010000:00010000:0.0:1787826417.457643:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826417.457647:0:8247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b822d2 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.457654:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b822d2 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.457672:0:8247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b822d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.457678:0:8247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b822d9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.457684:0:8247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b822d9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.457689:0:8247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165ec00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826417.457692:0:8247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b822d9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.457698:0:8247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b822d9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.457704:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90ce036cae00) 00010000:00010000:0.0:1787826417.457706:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826417.457709:0:8247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b822d9 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.457715:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b822d9 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.457724:0:8247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b822e0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.457734:0:8247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b822e0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.457740:0:8247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b822e0 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.457745:0:8247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165fc00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826417.457762:0:8247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b822e0 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.457768:0:8247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b822e0 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.457774:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826417.457776:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826417.457779:0:8247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b822e0 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.457784:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b822e0 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826417.457859:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9af0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55563:x1874670563885056:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 614us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826417.457867:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3795 00000100:00100000:3.0:1787826417.480066:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826417.480226:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563885312 00000100:00100000:2.0:1787826417.480236:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563885312 00000100:00100000:2.0:1787826417.480308:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3796 00000100:00100000:2.0:1787826417.480319:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8acf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55565:x1874670563885312:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826417.480338:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826417.480359:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b822e7 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0fd4 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.480460:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b822ee lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.480512:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b822ee lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.480524:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b822ee lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826417.480535:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:2.0:1787826417.480630:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b822e7 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fd4 expref: 43 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.480647:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b822ee lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fd4 expref: 42 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.480654:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826417.480656:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787826417.480659:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834800, rc 0) 00000100:00100000:2.0:1787826417.480720:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8acf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+42:55565:x1874670563885312:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 403us (663us total) trans 8589934960 rc 0/0 00000100:00100000:2.0:1787826417.480728:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3796 00000100:00100000:3.0:1787826417.485091:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826417.485212:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563885568 00000100:00100000:1.0:1787826417.485223:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563885568 00000100:00100000:1.0:1787826417.485311:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3797 00000100:00100000:1.0:1787826417.485320:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+42:55565:x1874670563885568:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826417.485343:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826417.485365:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b822fc lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0fdb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.485465:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b82303 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.485509:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b822cb lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fcd expref: 43 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.485518:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b82303 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.485562:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b822cb lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fcd expref: 43 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.485575:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b822cb lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fcd expref: 43 pid: 6520 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826417.485588:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0373ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1874670585251584:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826417.485670:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3f7d8000 going to sleep for 11 seconds 00000100:00100000:3.0:1787826417.489190:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826417.489295:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563885696 00000100:00100000:0.0:1787826417.489304:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563885696 00010000:00010000:0.0:1787826417.489357:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b822cb lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fcd expref: 44 pid: 6520 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826417.489399:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1163 00000100:00100000:0.0:1787826417.489409:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8af0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:2404:x1874670563885696:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826417.489425:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826417.489431:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b822cb lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fcd expref: 44 pid: 6520 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.489443:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b822cb lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fcd expref: 44 pid: 6520 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.489466:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826417.489501:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b82303 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.489511:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b82303 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.489518:0:10340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b82303 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.489535:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826417.489578:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8af0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:2404:x1874670563885696:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 171us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826417.489585:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1163 00010000:00010000:1.0:1787826417.491282:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b822cb lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fcd expref: 43 pid: 6520 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826417.491317:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0373ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1874670585251584:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826417.491341:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b82303 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.491351:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b82303 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.491357:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b82303 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826417.491380:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:1.0:1787826417.491514:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b822fc lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fdb expref: 44 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.491530:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b82303 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fdb expref: 43 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.491538:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826417.491540:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787826417.491544:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46bc00, rc 0) 00000100:00100000:1.0:1787826417.491600:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55565:x1874670563885568:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 6281us (6517us total) trans 8589934961 rc 0/0 00000100:00100000:1.0:1787826417.491608:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3797 00000100:00100000:3.0:1787826417.494878:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826417.495319:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563885824 00000100:00100000:0.0:1787826417.495330:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563885824 00000100:00100000:0.0:1787826417.495383:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1144 00000100:00100000:0.0:1787826417.495393:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55565:x1874670563885824:12345-192.168.203.39@tcp:33:lfs.0 00000100:00100000:0.0:1787826417.495560:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55565:x1874670563885824:12345-192.168.203.39@tcp:33:lfs.0 Request processed in 168us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826417.495574:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1144 00000100:00100000:3.0:1787826417.498652:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826417.501515:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563886080 00000100:00100000:0.0:1787826417.501529:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563886080 00000100:00100000:0.0:1787826417.501601:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1145 00000100:00100000:0.0:1787826417.501611:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55565:x1874670563886080:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:0.0:1787826417.501842:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55565:x1874670563886080:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 232us (3199us total) trans 8589934962 rc 0/0 00000100:00100000:0.0:1787826417.501851:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1145 00000100:00100000:3.0:1787826417.515150:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826417.515230:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563886336 00000100:00100000:1.0:1787826417.515243:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563886336 00000100:00100000:1.0:1787826417.515322:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3798 00000100:00100000:1.0:1787826417.515331:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8afc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55565:x1874670563886336:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826417.515354:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826417.515357:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:1.0:1787826417.515385:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b82303 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fdb expref: 44 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.515408:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b822ee lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fd4 expref: 43 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.515419:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826417.515424:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826417.515436:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b82311 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0fe2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.515581:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82318 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.515594:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82318 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.515605:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82318 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826417.515615:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:1.0:1787826417.515717:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b82311 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fe2 expref: 45 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.515730:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82318 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fe2 expref: 44 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.515737:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826417.515739:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787826417.515741:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46a400, rc 0) 00000100:00100000:1.0:1787826417.515795:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8afc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55565:x1874670563886336:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 465us (655us total) trans 8589934963 rc 0/0 00000100:00100000:1.0:1787826417.515803:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3798 00000100:00100000:3.0:1787826417.519096:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826417.519224:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563886592 00000100:00100000:2.0:1787826417.519233:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563886592 00000100:00100000:2.0:1787826417.519298:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1146 00000100:00100000:2.0:1787826417.519307:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eea6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55565:x1874670563886592:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:2.0:1787826417.519371:0:6522:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000405:0x1d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82318 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fe2 expref: 44 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.519422:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82326 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.519433:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b822a8 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fc6 expref: 44 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.519442:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82326 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.519512:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b822a8 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fc6 expref: 44 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.519526:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b822a8 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fc6 expref: 44 pid: 6518 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826417.519542:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a9ae940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585251712:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826417.519690:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf1817e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826417.525161:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a9ae940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585251712:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826417.525198:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82326 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826417.527793:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826417.528805:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563886720 00000100:00100000:1.0:1787826417.528817:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563886720 00010000:00010000:1.0:1787826417.528865:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b822a8 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fc6 expref: 45 pid: 6518 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826417.528944:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1164 00000100:00100000:1.0:1787826417.528954:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8af840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+45:2403:x1874670563886720:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826417.528969:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826417.528977:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b822a8 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fc6 expref: 45 pid: 6518 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.528990:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b822a8 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fc6 expref: 45 pid: 6518 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.529012:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b822a8 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fc6 expref: 45 pid: 6518 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.529029:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826417.529034:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82326 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.529043:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82326 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.529051:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82326 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.529086:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826417.529145:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8af840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:2403:x1874670563886720:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 192us (1363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826417.529152:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1164 00010000:00010000:3.0:1787826417.529263:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82326 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.529270:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82326 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.529450:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82326 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.529458:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82326 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.529465:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82326 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.529491:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826417.529496:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82326 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.529504:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82326 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.529513:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826417.529516:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787826417.529520:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82326 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.529526:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82326 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.529536:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826417.529539:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787826417.529543:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82318 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fe2 expref: 43 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826417.529646:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eea6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55565:x1874670563886592:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 10339us (10558us total) trans 8589934964 rc -22/-22 00000100:00100000:3.0:1787826417.529655:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1146 00000100:00100000:3.0:1787826417.533137:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826417.533545:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563886848 00000100:00100000:2.0:1787826417.533554:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563886848 00000100:00100000:2.0:1787826417.533603:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3799 00000100:00100000:2.0:1787826417.533612:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55565:x1874670563886848:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826417.533634:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826417.533654:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8232d lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0fe9 expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.533709:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8232d lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fe9 expref: 44 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.533724:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8232d lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fe9 expref: 44 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.533741:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826417.533744:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826417.533747:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835c00, rc 0) 00000100:00100000:2.0:1787826417.533798:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55565:x1874670563886848:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 186us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826417.533805:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3799 00000100:00100000:2.0:1787826417.545878:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826417.545977:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563887104 00000100:00100000:0.0:1787826417.545986:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563887104 00000100:00100000:0.0:1787826417.546046:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3800 00000100:00100000:0.0:1787826417.546056:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9acb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55565:x1874670563887104:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826417.546074:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826417.546096:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b82334 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0ff0 expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.546601:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b8233b lrc: 3/1,0 mode: --/PR res: [0x200000405:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.546615:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b8233b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.546627:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b8233b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826417.546638:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x2d:0x0]: returning size 0 00010000:00010000:0.0:1787826417.546677:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b82334 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ff0 expref: 47 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.546700:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b8233b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ff0 expref: 46 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.546711:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2d:0x0].0x0 (ffff90ce036ca200) 00010000:00010000:0.0:1787826417.546714:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826417.546717:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165ec00, rc 0) 00000100:00100000:0.0:1787826417.546781:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9acb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+46:55565:x1874670563887104:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 725us (913us total) trans 8589934965 rc 0/0 00000100:00100000:0.0:1787826417.546788:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3800 00000100:00100000:2.0:1787826417.556229:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826417.556427:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563887360 00000100:00100000:1.0:1787826417.556437:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563887360 00000100:00100000:1.0:1787826417.556508:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3801 00000100:00100000:1.0:1787826417.556517:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9afc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+46:55565:x1874670563887360:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826417.556538:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826417.556555:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b82349 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0ff7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.556648:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b82350 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.556663:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b82350 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.556674:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b82350 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826417.556684:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:1.0:1787826417.556968:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b82349 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ff7 expref: 49 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.556986:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b82350 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ff7 expref: 48 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.556999:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826417.557002:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787826417.557005:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46aa00, rc 0) 00000100:00100000:1.0:1787826417.557101:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9afc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55565:x1874670563887360:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 584us (890us total) trans 8589934966 rc 0/0 00000100:00100000:1.0:1787826417.557108:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3801 00000100:00100000:3.0:1787826417.559589:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826417.559806:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563887616 00000100:00100000:0.0:1787826417.559816:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563887616 00000100:00100000:0.0:1787826417.559877:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1147 00000100:00100000:0.0:1787826417.559888:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55565:x1874670563887616:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:0.0:1787826417.559955:0:14257:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000405:0x1d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b82350 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ff7 expref: 48 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.559992:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b8235e lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.560005:0:14257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8232d lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fe9 expref: 48 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.560018:0:14257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b8235e lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.560054:0:14257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8232d lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fe9 expref: 48 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.560067:0:14257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8232d lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fe9 expref: 48 pid: 8247 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826417.560082:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab930c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585251840:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826417.560180:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a180c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826417.567561:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab930c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585251840:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826417.567592:0:14257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b8235e lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826417.570406:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826417.575584:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563887744 00000100:00100000:0.0:1787826417.575600:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563887744 00010000:00010000:2.0:1787826417.580061:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8232d lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fe9 expref: 49 pid: 8247 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826417.580159:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1165 00000100:00100000:2.0:1787826417.580180:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf185d8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:2404:x1874670563887744:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826417.580198:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826417.580205:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8232d lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fe9 expref: 49 pid: 8247 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.580219:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8232d lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fe9 expref: 49 pid: 8247 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.580247:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8232d lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fe9 expref: 49 pid: 8247 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.580264:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826417.580270:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b8235e lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.580280:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b8235e lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.580287:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b8235e lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.580326:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826417.580439:0:14257:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b8235e lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.580448:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b8235e lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.580488:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b82365 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.580500:0:14257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b8233b lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ff0 expref: 48 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.580507:0:14257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b82365 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x2d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.580537:0:14257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b8233b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ff0 expref: 48 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.580550:0:14257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b8233b lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ff0 expref: 48 pid: 9966 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826417.580564:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0373ed00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585251968:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826417.580661:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3f7d8900 going to sleep for 11 seconds 00000100:00100000:2.0:1787826417.580748:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf185d8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:2404:x1874670563887744:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 579us (10406us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826417.580757:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1165 00000100:00100000:1.0:1787826417.586874:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0373ed00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585251968:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826417.586908:0:14257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b82365 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x2d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826417.592209:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826417.592322:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563887872 00000100:00100000:2.0:1787826417.592332:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563887872 00010000:00010000:2.0:1787826417.592379:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b8233b lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ff0 expref: 48 pid: 9966 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826417.592425:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1166 00000100:00100000:2.0:1787826417.592434:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8ae940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:2404:x1874670563887872:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826417.592450:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826417.592457:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b8233b lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ff0 expref: 48 pid: 9966 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.592515:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b8233b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ff0 expref: 48 pid: 9966 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.592540:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b8233b lrc: 0/0,0 mode: --/PR res: [0x200000405:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ff0 expref: 48 pid: 9966 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.592557:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2d:0x0].0x0 (ffff90ce036ca200) 00010000:00010000:2.0:1787826417.592563:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b82365 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x2d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.592572:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b82365 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.592579:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b82365 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x2d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.592603:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826417.592659:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8ae940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+47:2404:x1874670563887872:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 227us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826417.592667:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1166 00010000:00010000:1.0:1787826417.592738:0:14257:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b82365 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2d:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.592747:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b82365 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2d:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826417.593052:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0373ed00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585252096:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1787826417.593099:0:14257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826417.593137:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3f7d8900 going to sleep for 11 seconds 00000100:00100000:2.0:1787826417.593428:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585252096 00000100:00100000:2.0:1787826417.593434:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585252096 00000100:00100000:2.0:1787826417.593524:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1452 00000100:00100000:2.0:1787826417.593532:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14257:x1874670585252096:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1787826417.593609:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14257:x1874670585252096:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 78us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826417.593616:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1452 00000100:00100000:0.0:1787826417.593692:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0373ed00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585252096:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:0.0:1787826417.593747:0:14257:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934967 00000001:00080000:0.0:1787826417.593814:0:14257:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934968 00010000:00010000:0.0:1787826417.593832:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b82365 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2d:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.593840:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b82365 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x2d:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.593846:0:14257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b82365 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x2d:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.593852:0:14257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46a800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826417.593857:0:14257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b82365 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x2d:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.593864:0:14257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b82365 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x2d:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.593877:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2d:0x0].0x0 (ffff90ce036ca200) 00010000:00010000:0.0:1787826417.593879:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787826417.593884:0:14257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b82365 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x2d:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.593889:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b82365 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x2d:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.593907:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b8235e lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.593913:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b8235e lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.593919:0:14257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b8235e lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.593924:0:14257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165fc00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826417.593927:0:14257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b8235e lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.593932:0:14257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b8235e lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.593943:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826417.593945:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787826417.593948:0:14257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b8235e lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.593953:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b8235e lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.593963:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826417.593965:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787826417.593970:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b82350 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ff7 expref: 49 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826417.594051:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55565:x1874670563887616:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 34165us (34471us total) trans 8589934969 rc 0/0 00000100:00100000:0.0:1787826417.594059:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1147 00000020:00080000:0.0:1787826417.594063:0:14257:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1787826417.608942:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826417.609087:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563888000 00000100:00100000:2.0:1787826417.609098:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563888000 00000100:00100000:2.0:1787826417.609163:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3802 00000100:00100000:2.0:1787826417.609183:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55565:x1874670563888000:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826417.609210:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826417.609233:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8236c lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab0ffe expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.609295:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8236c lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ffe expref: 49 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.609311:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8236c lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ffe expref: 49 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.609332:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826417.609335:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826417.609339:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834400, rc 0) 00000100:00100000:2.0:1787826417.609408:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:55565:x1874670563888000:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 228us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826417.609416:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3802 00000100:00100000:2.0:1787826417.613749:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826417.614026:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563888256 00000100:00100000:3.0:1787826417.614036:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563888256 00000100:00100000:3.0:1787826417.614128:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1148 00000100:00100000:3.0:1787826417.614138:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9ae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:55565:x1874670563888256:12345-192.168.203.39@tcp:35:lfs.0 00000004:00080000:3.0:1787826417.614563:0:6522:0:(mdd_object.c:4014:mdd_close()) Object [0x200000405:0x2d:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787826417.614619:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].27, 64 off10376 00000004:00080000:3.0:1787826417.614630:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1363626157749ns, next at 1364626155675ns, rc = 0 00000001:00080000:3.0:1787826417.614636:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934970 00010000:00010000:3.0:1787826417.614676:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b82373 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.614691:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b82373 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.614703:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b82373 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.614710:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b82373 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.614717:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b82373 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.614722:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b82373 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.614750:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826417.615095:0:7460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826417.615103:0:7460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b82373 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.615110:0:7460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401e00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826417.615114:0:7460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b82373 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.615121:0:7460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b82373 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.615133:0:7460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2d:0x0].0x0 (ffff90cf06894a00) 00010000:00010000:0.0:1787826417.615137:0:7460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787826417.615141:0:7460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b82373 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.615157:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b82373 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.615183:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826417.615185:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826417.615187:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826417.615220:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9ae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+51:55565:x1874670563888256:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 1081us (1477us total) trans 8589934971 rc 0/0 00000100:00100000:3.0:1787826417.615230:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1148 00000020:00080000:3.0:1787826417.615236:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787826417.618953:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826417.619038:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563888512 00000100:00100000:0.0:1787826417.619047:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563888512 00000100:00100000:0.0:1787826417.619127:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1149 00000100:00100000:0.0:1787826417.619136:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+51:55565:x1874670563888512:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:0.0:1787826417.619389:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+52:55565:x1874670563888512:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 245us (436us total) trans 8589934972 rc 0/0 00000100:00100000:0.0:1787826417.619398:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1149 00000100:00100000:1.0:1787826417.663034:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826417.664210:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563888640 00000100:00100000:2.0:1787826417.664222:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563888640 00000100:00100000:2.0:1787826417.664547:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3803 00000100:00100000:2.0:1787826417.664558:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+52:55567:x1874670563888640:12345-192.168.203.39@tcp:101:getfattr.0 00010000:00010000:2.0:1787826417.664580:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826417.664606:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8237a lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1005 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.664675:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b82381 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.664689:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b82381 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.664703:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b82381 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.664718:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82388 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.664725:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82388 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.664733:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82388 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.664821:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b8238f lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.664830:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b8238f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.664837:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b8238f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826417.664875:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:2.0:1787826417.664879:0:16564:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826417.664898:0:16564:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b8238f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.664911:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b8238f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.664920:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b82381 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.664926:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b82381 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.664934:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b82381 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.664940:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826417.664943:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b82381 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.664951:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b82381 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.664963:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf39e67700) 00010000:00010000:2.0:1787826417.664966:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826417.664971:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b82381 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.664978:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b82381 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.664991:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82388 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.664998:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82388 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.665004:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82388 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.665010:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826417.665012:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82388 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.665018:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82388 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.665026:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf39e67a00) 00010000:00010000:2.0:1787826417.665028:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826417.665031:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82388 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.665038:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82388 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.665068:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8237a lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1005 expref: 54 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.665085:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b8238f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1005 expref: 53 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.665092:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826417.665094:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826417.665097:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835800, rc 0) 00000100:00100000:2.0:1787826417.665984:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55567:x1874670563888640:12345-192.168.203.39@tcp:101:getfattr.0 Request processed in 1424us (2953us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826417.665997:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3803 00000100:00100000:1.0:1787826417.679387:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826417.679510:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563888768 00000100:00100000:2.0:1787826417.679521:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563888768 00000100:00100000:2.0:1787826417.679587:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2109 00000100:00100000:2.0:1787826417.679599:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670563888768:12345-192.168.203.39@tcp:101:getfattr.0 00010000:00010000:2.0:1787826417.679618:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826417.679636:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004da8c6f7/0x22153cd396b82396 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab100c expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826417.679691:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf136d4f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1874670585252224:192.168.203.39@tcp:106: 00000100:00100000:2.0:1787826417.679832:0:8435:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a13f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826417.682973:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf136d4f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1874670585252224:192.168.203.39@tcp:106: 00010000:00010000:2.0:1787826417.683017:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004da8c6f7/0x22153cd396b82396 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab100c expref: 11 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.683043:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004da8c6f7/0x22153cd396b82396 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab100c expref: 11 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.683056:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835c00, rc 0) 00000100:00100000:2.0:1787826417.683114:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670563888768:12345-192.168.203.39@tcp:101:getfattr.0 Request processed in 3517us (3740us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826417.683123:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2109 00000100:00100000:3.0:1787826417.721764:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826417.721886:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563888896 00000100:00100000:2.0:1787826417.721897:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563888896 00000100:00100000:2.0:1787826417.721963:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3804 00000100:00100000:2.0:1787826417.721975:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8acb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55571:x1874670563888896:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:2.0:1787826417.722070:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8239d lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.722087:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8239d lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.722100:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8239d lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.722115:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b823a4 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.722122:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b823a4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.722130:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b823a4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.722231:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b823ab lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.722240:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b823ab lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.722246:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b823ab lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826417.722284:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:2.0:1787826417.722288:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826417.722301:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b823ab lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.722314:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8239d lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.722320:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8239d lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.722326:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8239d lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.722332:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8239d lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.722353:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826417.722358:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8239d lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.722365:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8239d lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.722377:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf39e67700) 00010000:00010000:2.0:1787826417.722380:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826417.722385:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8239d lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.722391:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8239d lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.722409:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b823a4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.722414:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b823a4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.722420:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b823a4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.722425:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826417.722427:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b823a4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.722432:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b823a4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.722439:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf39e67a00) 00010000:00010000:2.0:1787826417.722442:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826417.722445:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b823a4 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.722450:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b823a4 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.722460:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b823ab lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.722465:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b823ab lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.722521:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b823ab lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.722528:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826417.722530:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b823ab lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.722540:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b823ab lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.722548:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826417.722550:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826417.722553:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b823ab lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.722558:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b823ab lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826417.722630:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8acb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55571:x1874670563888896:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 656us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826417.722638:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3804 00000100:00100000:1.0:1787826417.765742:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826417.766007:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563889152 00000100:00100000:0.0:1787826417.766017:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563889152 00000100:00100000:0.0:1787826417.766084:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3805 00000100:00100000:0.0:1787826417.766095:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55573:x1874670563889152:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826417.766114:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826417.766134:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b823b2 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1013 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.766262:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b823b9 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.766277:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b823b9 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.766289:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b823b9 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826417.766301:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:0.0:1787826417.766611:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b823b2 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1013 expref: 56 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.766630:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b823b9 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1013 expref: 55 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.766639:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826417.766642:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787826417.766645:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165fe00, rc 0) 00000100:00100000:0.0:1787826417.766750:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+55:55573:x1874670563889152:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 656us (1016us total) trans 8589934973 rc 0/0 00000100:00100000:0.0:1787826417.766766:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3805 00000100:00100000:2.0:1787826417.773821:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826417.773921:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563889280 00000100:00100000:1.0:1787826417.773930:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563889280 00000100:00100000:1.0:1787826417.774024:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2110 00000100:00100000:1.0:1787826417.774035:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136d4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563889280:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826417.774063:0:30398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826417.774081:0:30398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000816b8b1f/0x22153cd396b823c7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab101a expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826417.774140:0:30398:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf07965a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:30398:1874670585252352:192.168.203.39@tcp:106: 00000100:00100000:1.0:1787826417.774283:0:30398:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3780 going to sleep for 11 seconds 00000100:00100000:1.0:1787826417.777505:0:30398:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf07965a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:30398:1874670585252352:192.168.203.39@tcp:106: 00010000:00010000:1.0:1787826417.777544:0:30398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000816b8b1f/0x22153cd396b823c7 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab101a expref: 11 pid: 30398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.777568:0:30398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000816b8b1f/0x22153cd396b823c7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab101a expref: 11 pid: 30398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.777582:0:30398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46ae00, rc 0) 00000100:00100000:1.0:1787826417.777638:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136d4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563889280:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 3605us (3826us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826417.777647:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2110 00000100:00100000:2.0:1787826417.782983:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826417.783236:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563889536 00000100:00100000:0.0:1787826417.783246:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563889536 00000100:00100000:0.0:1787826417.783359:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3806 00000100:00100000:0.0:1787826417.783370:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06306580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+55:55573:x1874670563889536:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826417.783393:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826417.783415:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b823ce lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1021 expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.783546:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b823d5 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.783566:0:8247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b8238f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1005 expref: 56 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.783575:0:8247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b823d5 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.783606:0:8247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b8238f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1005 expref: 56 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.783618:0:8247:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b8238f lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1005 expref: 56 pid: 16564 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826417.783631:0:8247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab930c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8247:1874670585252480:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826417.783754:0:8247:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a18c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826417.788949:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826417.789030:0:8247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab930c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8247:1874670585252480:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826417.789071:0:8247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b823d5 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826417.789134:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563889664 00000100:00100000:3.0:1787826417.789141:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563889664 00010000:00010000:3.0:1787826417.789196:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b8238f lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1005 expref: 57 pid: 16564 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826417.789237:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1167 00000100:00100000:3.0:1787826417.789246:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce063061c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+57:2403:x1874670563889664:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826417.789261:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826417.789268:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b8238f lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1005 expref: 57 pid: 16564 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.789280:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b8238f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1005 expref: 57 pid: 16564 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.789303:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b8238f lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1005 expref: 57 pid: 16564 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.789318:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826417.789323:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b823d5 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.789337:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b823d5 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.789360:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b823d5 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.789385:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826417.789998:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce063061c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+56:2403:x1874670563889664:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 750us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826417.790007:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1167 00010000:00010000:3.0:1787826417.790036:0:8247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b823d5 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.790056:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b823d5 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826417.790076:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:3.0:1787826417.790290:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b823ce lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1021 expref: 57 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.790307:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b823d5 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1021 expref: 56 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.790314:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826417.790317:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787826417.790319:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165ec00, rc 0) 00000100:00100000:3.0:1787826417.792754:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06306580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+56:55573:x1874670563889536:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 9376us (9986us total) trans 8589934974 rc 0/0 00000100:00100000:3.0:1787826417.792769:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3806 00000100:00100000:1.0:1787826417.797783:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826417.797873:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563889920 00000100:00100000:0.0:1787826417.797882:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563889920 00000100:00100000:0.0:1787826417.797971:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3807 00000100:00100000:0.0:1787826417.797981:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf07965a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+56:55573:x1874670563889920:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826417.798003:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826417.798024:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b823e3 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1028 expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.798855:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b823ea lrc: 3/1,0 mode: --/PR res: [0x200000405:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.798871:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b823ea lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.798885:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b823ea lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826417.798894:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x2e:0x0]: returning size 0 00010000:00010000:0.0:1787826417.798936:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b823e3 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1028 expref: 59 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.798960:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b823ea lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1028 expref: 58 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.798968:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2e:0x0].0x0 (ffff90ce036cae00) 00010000:00010000:0.0:1787826417.798971:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826417.798974:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165fa00, rc 0) 00000100:00100000:0.0:1787826417.799030:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf07965a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:55573:x1874670563889920:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1051us (1257us total) trans 8589934975 rc 0/0 00000100:00100000:0.0:1787826417.799049:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3807 00000100:00100000:3.0:1787826417.802832:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826417.809780:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563890176 00000100:00100000:2.0:1787826417.809795:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563890176 00000100:00100000:2.0:1787826417.810358:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3808 00000100:00100000:2.0:1787826417.810371:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8af0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:55573:x1874670563890176:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826417.810394:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826417.810415:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b823f8 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab102f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.810574:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b823ff lrc: 3/0,1 mode: --/EX res: [0x200000405:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.810595:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b823ea lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1028 expref: 59 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.810605:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b823ff lrc: 4/0,1 mode: --/EX res: [0x200000405:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.810637:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b823ea lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1028 expref: 59 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.810918:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b823ea lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1028 expref: 59 pid: 9966 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826417.810935:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3fb94b40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1874670585252608:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826417.811029:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a13f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826417.814389:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3fb94b40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1874670585252608:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826417.814419:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b823ff lrc: 3/0,1 mode: --/EX res: [0x200000405:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826417.815090:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826417.815179:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563890304 00000100:00100000:2.0:1787826417.815186:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563890304 00010000:00010000:2.0:1787826417.815229:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b823ea lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1028 expref: 60 pid: 9966 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826417.815265:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1168 00000100:00100000:2.0:1787826417.815276:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8af840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:2403:x1874670563890304:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826417.815290:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826417.815296:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b823ea lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1028 expref: 60 pid: 9966 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.815308:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b823ea lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1028 expref: 60 pid: 9966 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.815332:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b823ea lrc: 0/0,0 mode: --/PR res: [0x200000405:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1028 expref: 60 pid: 9966 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.815349:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2e:0x0].0x0 (ffff90ce036cae00) 00010000:00010000:2.0:1787826417.815354:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b823ff lrc: 3/0,1 mode: --/EX res: [0x200000405:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.815368:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b823ff lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.815375:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b823ff lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.815446:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826417.815534:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8af840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:2403:x1874670563890304:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 261us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826417.815542:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1168 00010000:00010000:0.0:1787826417.816145:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b823ff lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.816154:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b823ff lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826417.816180:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x2e:0x0]: returning size 0 00000004:00080000:1.0:1787826417.816379:0:6520:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x109:0x0], index 0: 0 00010000:00010000:1.0:1787826417.816930:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b823ff lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.816940:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b823ff lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.816947:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b823ff lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.816953:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826417.816957:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b823ff lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.816964:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b823ff lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.816978:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2e:0x0].0x0 (ffff90ce036cae00) 00010000:00010000:1.0:1787826417.816981:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826417.816985:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b823ff lrc: 2/0,0 mode: --/EX res: [0x200000405:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.816991:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b823ff lrc: 0/0,0 mode: --/EX res: [0x200000405:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.817038:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b823f8 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x2e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab102f expref: 59 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.817049:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2e:0x0].0x0 (ffff90ce036cae00) 00010000:00010000:1.0:1787826417.817051:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787826417.817054:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b823f8 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x2e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab102f expref: 59 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.817067:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834c00, rc 0) 00000100:00100000:1.0:1787826417.817177:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8af0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:55573:x1874670563890176:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 6808us (14353us total) trans 8589934976 rc 301/301 00000100:00100000:1.0:1787826417.817185:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3808 00000100:00100000:1.0:1787826417.828142:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826417.828242:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563890560 00000100:00100000:3.0:1787826417.828255:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563890560 00000100:00100000:3.0:1787826417.828329:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1150 00000100:00100000:3.0:1787826417.828681:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:55573:x1874670563890560:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:3.0:1787826417.829117:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55573:x1874670563890560:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 775us (990us total) trans 8589934977 rc 0/0 00000100:00100000:3.0:1787826417.829127:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1150 00000100:00100000:1.0:1787826417.832236:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826417.832736:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563890688 00000100:00100000:0.0:1787826417.832750:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563890688 00000100:00100000:1.0:1787826417.832909:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3809 00000100:00100000:1.0:1787826417.832921:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55573:x1874670563890688:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826417.832960:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826417.832989:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b8240d lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1036 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.833112:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82414 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.833131:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b823d5 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1021 expref: 60 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.833141:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82414 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.833197:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b823d5 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1021 expref: 60 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.833212:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b823d5 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1021 expref: 60 pid: 8247 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826417.833229:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3abc0780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1874670585252736:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826417.833349:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826417.836810:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3abc0780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1874670585252736:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826417.836841:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82414 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826417.837940:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826417.838047:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563890816 00000100:00100000:0.0:1787826417.838058:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563890816 00010000:00010000:0.0:1787826417.838118:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b823d5 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1021 expref: 61 pid: 8247 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826417.838190:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1169 00000100:00100000:0.0:1787826417.838202:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+61:2404:x1874670563890816:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826417.838224:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826417.838235:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b823d5 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1021 expref: 61 pid: 8247 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.838252:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b823d5 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1021 expref: 61 pid: 8247 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.838285:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b823d5 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1021 expref: 61 pid: 8247 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.838308:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826417.838315:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82414 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.838326:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82414 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.838336:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82414 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.839780:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826417.839874:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:2404:x1874670563890816:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 1669us (1942us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826417.839887:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1169 00010000:00010000:2.0:1787826417.843689:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82414 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.843713:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82414 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826417.843861:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:2.0:1787826417.843866:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826417.843888:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82414 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.843936:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b8240d lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1036 expref: 60 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.843959:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82414 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1036 expref: 59 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.843968:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826417.843971:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826417.843974:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46ae00, rc 0) 00000100:00100000:2.0:1787826417.844112:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55573:x1874670563890688:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 11190us (11887us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826417.844122:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3809 00000100:00100000:1.0:1787826417.854366:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826417.854439:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563890944 00000100:00100000:2.0:1787826417.854454:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563890944 00000100:00100000:2.0:1787826417.854555:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2111 00000100:00100000:2.0:1787826417.854565:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049b92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2401:x1874670563890944:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826417.854583:0:28853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826417.854599:0:28853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002904bac2/0x22153cd396b8241b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab103d expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826417.854663:0:28853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3fb94b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28853:1874670585252864:192.168.203.39@tcp:106: 00000100:00100000:2.0:1787826417.854760:0:28853:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a13f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826417.862757:0:28853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3fb94b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28853:1874670585252864:192.168.203.39@tcp:106: 00010000:00010000:2.0:1787826417.862793:0:28853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002904bac2/0x22153cd396b8241b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab103d expref: 11 pid: 28853 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.862819:0:28853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002904bac2/0x22153cd396b8241b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab103d expref: 11 pid: 28853 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.862833:0:28853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835a00, rc 0) 00000100:00100000:2.0:1787826417.862906:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049b92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2401:x1874670563890944:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 8342us (8557us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826417.862916:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2111 00000100:00100000:1.0:1787826417.867002:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826417.868509:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563891072 00000100:00100000:3.0:1787826417.868530:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563891072 00000100:00100000:3.0:1787826417.868768:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3810 00000100:00100000:3.0:1787826417.868785:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049b8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55573:x1874670563891072:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826417.868816:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826417.868847:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b82422 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1044 expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.868941:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b82429 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.868958:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b82429 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.868973:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b82429 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826417.869038:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x2e:0x0]: returning size 0 00000004:00200000:3.0:1787826417.869044:0:8247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826417.869066:0:8247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b82429 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.869100:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b82422 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1044 expref: 61 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.869122:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b82429 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1044 expref: 60 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.869132:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2e:0x0].0x0 (ffff90cf06894b00) 00010000:00010000:3.0:1787826417.869136:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787826417.869140:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401800, rc 0) 00000100:00100000:3.0:1787826417.869240:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049b8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:55573:x1874670563891072:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 459us (2247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826417.869249:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3810 00000100:00100000:1.0:1787826417.883048:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826417.883172:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563891200 00000100:00100000:2.0:1787826417.883181:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563891200 00000100:00100000:2.0:1787826417.883245:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2112 00000100:00100000:2.0:1787826417.883256:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2403:x1874670563891200:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826417.883277:0:30696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826417.883298:0:30696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002904bac2/0x22153cd396b82430 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x109:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab104b expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787826417.883324:0:30696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x109:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826417.883344:0:30696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x109:0x0].0x0 since=1363s v=(0 0) 00010000:00010000:2.0:1787826417.883349:0:30696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x109:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826417.883358:0:30696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002904bac2/0x22153cd396b82430 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x109:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab104b expref: 8 pid: 30696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.883376:0:30696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002904bac2/0x22153cd396b82430 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x109:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab104b expref: 8 pid: 30696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.883389:0:30696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835a00, rc 0) 00000100:00100000:2.0:1787826417.883450:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2403:x1874670563891200:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 196us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826417.883457:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2112 00000100:00100000:1.0:1787826417.893867:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826417.894597:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563891456 00000100:00100000:3.0:1787826417.894615:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563891456 00000100:00100000:3.0:1787826417.894703:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3811 00000100:00100000:3.0:1787826417.894716:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:55573:x1874670563891456:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826417.894744:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826417.896320:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b82437 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1052 expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.900468:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b8243e lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.900539:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b8243e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.900552:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b8243e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826417.900571:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:2.0:1787826417.900699:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b82437 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1052 expref: 63 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.900720:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b8243e lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1052 expref: 62 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.900729:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826417.900732:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787826417.900736:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834c00, rc 0) 00000100:00100000:2.0:1787826417.900814:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+62:55573:x1874670563891456:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 6100us (6955us total) trans 8589934978 rc 0/0 00000100:00100000:2.0:1787826417.900824:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3811 00000100:00100000:0.0:1787826417.907913:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826417.908062:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563891584 00000100:00100000:1.0:1787826417.908075:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563891584 00000100:00100000:1.0:1787826417.908196:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2113 00000100:00100000:1.0:1787826417.908208:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab93840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563891584:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826417.908232:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826417.908256:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000381c17db/0x22153cd396b8244c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1059 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826417.908454:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f8c2d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1874670585252992:192.168.203.39@tcp:106: 00000100:00100000:1.0:1787826417.908680:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3540 going to sleep for 11 seconds 00000100:00100000:2.0:1787826417.911815:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f8c2d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1874670585252992:192.168.203.39@tcp:106: 00010000:00010000:2.0:1787826417.911872:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000381c17db/0x22153cd396b8244c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1059 expref: 11 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.911903:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000381c17db/0x22153cd396b8244c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1059 expref: 11 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826417.911919:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46a400, rc 0) 00000100:00100000:2.0:1787826417.912037:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab93840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563891584:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 3831us (4140us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826417.912048:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2113 00000100:00100000:2.0:1787826417.916226:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826417.916582:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563891712 00000100:00100000:1.0:1787826417.916596:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563891712 00000100:00100000:1.0:1787826417.916704:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2114 00000100:00100000:1.0:1787826417.916716:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb94b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2402:x1874670563891712:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826417.916740:0:8545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826417.916833:0:8545:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bacf1a1a/0x22153cd396b82453 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1060 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826417.916917:0:8545:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f8c3840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8545:1874670585253120:192.168.203.39@tcp:106: 00000100:00100000:1.0:1787826417.917038:0:8545:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e36c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826417.919318:0:8545:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f8c3840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8545:1874670585253120:192.168.203.39@tcp:106: 00010000:00010000:1.0:1787826417.919388:0:8545:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bacf1a1a/0x22153cd396b82453 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1060 expref: 11 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.919418:0:8545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bacf1a1a/0x22153cd396b82453 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1060 expref: 11 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826417.919441:0:8545:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46b200, rc 0) 00000100:00100000:1.0:1787826417.919820:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb94b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2402:x1874670563891712:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 3102us (3605us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826417.919831:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2114 00000100:00100000:3.0:1787826417.922495:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826417.922726:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563891840 00000100:00100000:0.0:1787826417.922737:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563891840 00000100:00100000:0.0:1787826417.922840:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2115 00000100:00100000:0.0:1787826417.922850:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563891840:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:0.0:1787826417.922904:0:30695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b8245a lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.922927:0:30695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d39501d2/0x22153cd396b82285 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fb8 expref: 10 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.922938:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x109:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826417.922943:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x109:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826417.922948:0:30695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b8245a lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.922992:0:30695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d39501d2/0x22153cd396b82285 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fb8 expref: 10 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.923007:0:30695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d39501d2/0x22153cd396b82285 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fb8 expref: 10 pid: 30695 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826417.923025:0:30695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab903c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:30695:1874670585253248:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826417.923230:0:30695:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a18180 going to sleep for 11 seconds 00000100:00100000:1.0:1787826417.926302:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3fb95680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585253376:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826417.926415:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826417.926618:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585253376 00000100:00100000:2.0:1787826417.926629:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585253376 00000100:00100000:2.0:1787826417.926703:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1453 00000100:00100000:2.0:1787826417.926714:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3647:x1874670585253376:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787826417.926770:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445871616 avail 1299632128 00000100:00100000:2.0:1787826417.926829:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3647:x1874670585253376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 118us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826417.926837:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1453 00000100:00100000:1.0:1787826417.927622:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3fb95680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585253376:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787826417.927866:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3fb95680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874670585253632:0@lo:400:kworker.0 00000100:00100000:2.0:1787826417.927919:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826417.927944:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce044d0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1874670585254144:0@lo:400:kworker.0 00000100:00100000:2.0:1787826417.927969:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826417.927986:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f809680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874670585254656:0@lo:400:kworker.0 00000100:00100000:2.0:1787826417.928010:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826417.928030:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787826417.928036:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3fb952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e3c550b8-2c3c-46c3-ad36-671c284167ea:3645:1874670585253504:0@lo:400:kworker.0 00000100:00100000:2.0:1787826417.928067:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826417.928251:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f82f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874670585254016:0@lo:400:kworker.0 00000100:00100000:2.0:1787826417.928280:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826417.928302:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f80a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585254528:0@lo:400:kworker.0 00000100:00100000:2.0:1787826417.928328:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826417.928521:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585253632 00000100:00100000:2.0:1787826417.928528:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585253632 00000100:00100000:2.0:1787826417.928578:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585254144 00000100:00100000:2.0:1787826417.928581:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585254144 00000100:00100000:2.0:1787826417.928615:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585254656 00000100:00100000:2.0:1787826417.928619:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585254656 00000100:00100000:2.0:1787826417.928637:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585254016 00000100:00100000:2.0:1787826417.928640:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585254016 00000100:00100000:2.0:1787826417.928660:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1583 00000100:00100000:2.0:1787826417.928669:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f80a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874670585253632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826417.928726:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f80a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874670585253632:12345-0@lo:400:kworker.0 Request processed in 58us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826417.928734:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1583 00000100:00100000:2.0:1787826417.928751:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1584 00000100:00100000:1.0:1787826417.928879:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585254528 00000100:00100000:1.0:1787826417.928884:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585254528 00000100:00100000:1.0:1787826417.928915:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1454 00000100:00100000:1.0:1787826417.928922:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf13669e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1874670585254528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826417.928968:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf13669e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1874670585254528:12345-0@lo:400:kworker.0 Request processed in 46us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826417.928974:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1454 00000100:00080000:1.0:1787826417.928993:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787826417.928997:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826417.929010:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fdf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585253760:0@lo:400:kworker.0 00000100:00100000:1.0:1787826417.929042:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826417.929065:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f80ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874670585254272:0@lo:400:kworker.0 00000100:00100000:1.0:1787826417.929101:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826417.929117:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787826417.929124:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f82de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585253888:0@lo:400:kworker.0 00000100:00100000:1.0:1787826417.929147:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826417.929176:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f808b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1874670585254400:0@lo:400:kworker.0 00000100:00100000:1.0:1787826417.929200:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826417.929231:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585253760 00000100:00100000:1.0:1787826417.929234:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585253760 00000100:00100000:1.0:1787826417.929270:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585253888 00000100:00100000:1.0:1787826417.929273:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585253888 00000100:00100000:1.0:1787826417.929295:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 936 00000100:00100000:1.0:1787826417.929303:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3646:x1874670585253760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826417.929357:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3646:x1874670585253760:12345-0@lo:400:kworker.0 Request processed in 55us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826417.929363:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 936 00000100:00100000:1.0:1787826417.929376:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 937 00000100:00100000:1.0:1787826417.929381:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3646:x1874670585253888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826417.929413:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3646:x1874670585253888:12345-0@lo:400:kworker.0 Request processed in 31us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826417.929419:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 937 00000100:00080000:1.0:1787826417.929437:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787826417.929439:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826417.929467:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f82de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585253888:0@lo:400:kworker.0 00000100:00100000:1.0:1787826417.929515:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fdf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585253760:0@lo:400:kworker.0 00000100:00100000:1.0:1787826417.929547:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585254272 00000100:00100000:1.0:1787826417.929551:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585254272 00000100:00100000:1.0:1787826417.929575:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585254400 00000100:00100000:1.0:1787826417.929578:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585254400 00000100:00100000:1.0:1787826417.929592:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1585 00000100:00100000:1.0:1787826417.929598:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1366bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874670585254656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826417.929630:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1366bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874670585254656:12345-0@lo:400:kworker.0 Request processed in 32us (1619us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826417.929637:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1585 00000100:00100000:1.0:1787826417.929649:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1586 00000100:00100000:1.0:1787826417.929655:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf13668780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874670585254016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826417.929681:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf13668780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874670585254016:12345-0@lo:400:kworker.0 Request processed in 26us (1400us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826417.929686:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1586 00000100:00100000:1.0:1787826417.929697:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1587 00000100:00100000:1.0:1787826417.929703:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874670585254272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826417.929730:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874670585254272:12345-0@lo:400:kworker.0 Request processed in 28us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826417.929736:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1587 00000100:00100000:1.0:1787826417.929747:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1588 00000100:00100000:1.0:1787826417.929753:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874670585254400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826417.929792:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874670585254400:12345-0@lo:400:kworker.0 Request processed in 40us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826417.929798:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1588 00000100:00080000:1.0:1787826417.929811:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787826417.929813:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787826417.929830:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f808b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1874670585254400:0@lo:400:kworker.0 00000100:00100000:1.0:1787826417.929841:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f80ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874670585254272:0@lo:400:kworker.0 00000100:00100000:2.0:1787826417.930179:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf13668f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874670585254144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826417.930224:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf13668f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874670585254144:12345-0@lo:400:kworker.0 Request processed in 1467us (2253us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826417.930232:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1584 00000100:00100000:2.0:1787826417.930275:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f82f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874670585254016:0@lo:400:kworker.0 00000100:00100000:2.0:1787826417.930290:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f80a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585254528:0@lo:400:kworker.0 00000100:00100000:2.0:1787826417.930303:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3fb95680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874670585253632:0@lo:400:kworker.0 00000100:00100000:2.0:1787826417.930314:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce044d0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1874670585254144:0@lo:400:kworker.0 00000100:00100000:2.0:1787826417.930326:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f809680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874670585254656:0@lo:400:kworker.0 00000100:00100000:3.0:1787826417.930515:0:34488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585253504 00000100:00100000:3.0:1787826417.930522:0:34488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585253504 00000100:00100000:3.0:1787826417.930570:0:34488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787826417.930578:0:34488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf2f426850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3c550b8-2c3c-46c3-ad36-671c284167ea+24:3645:x1874670585253504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826417.930618:0:34488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf2f426850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3c550b8-2c3c-46c3-ad36-671c284167ea+24:3645:x1874670585253504:12345-0@lo:400:kworker.0 Request processed in 42us (2551us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826417.930625:0:34488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787826417.930736:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3fb952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e3c550b8-2c3c-46c3-ad36-671c284167ea:3645:1874670585253504:0@lo:400:kworker.0 00000100:00100000:1.0:1787826417.931732:0:30695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab903c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:30695:1874670585253248:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826417.931774:0:30695:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b8245a lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826417.931972:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826417.932178:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787826417.932200:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab92580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585254784:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787826417.932258:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826417.932299:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585254784 00000100:00100000:1.0:1787826417.932306:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585254784 00000100:00100000:1.0:1787826417.932400:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1455 00000100:00100000:1.0:1787826417.932410:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1366b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1874670585254784:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787826417.932491:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563891968 00000100:00100000:3.0:1787826417.932496:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563891968 00010000:00010000:3.0:1787826417.932523:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d39501d2/0x22153cd396b82285 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fb8 expref: 11 pid: 30695 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826417.932597:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1170 00000100:00100000:3.0:1787826417.932606:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1366a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2404:x1874670563891968:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826417.932618:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826417.932644:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d39501d2/0x22153cd396b82285 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x109:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fb8 expref: 11 pid: 30695 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.932660:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d39501d2/0x22153cd396b82285 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x109:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fb8 expref: 11 pid: 30695 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.932689:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d39501d2/0x22153cd396b82285 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x109:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fb8 expref: 11 pid: 30695 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.932709:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x109:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826417.932714:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x109:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826417.932721:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b8245a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.932733:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b8245a lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.932763:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826417.932815:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1366a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563891968:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 210us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826417.932824:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1170 00010000:00010000:3.0:1787826417.932907:0:30695:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b8245a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x109:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.932917:0:30695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b8245a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x109:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.932942:0:30695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b8245a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x109:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.932952:0:30695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b8245a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x109:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.932962:0:30695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b8245a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x109:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.932969:0:30695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165e400 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826417.932974:0:30695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b8245a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x109:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.932992:0:30695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b8245a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x109:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.933005:0:30695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b8245a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x109:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826417.933014:0:30695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b8245a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x109:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826417.933090:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563891840:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 10241us (10628us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826417.933099:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2115 00000100:00100000:3.0:1787826417.936890:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826417.936979:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563892096 00000100:00100000:0.0:1787826417.937218:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563892096 00000100:00100000:0.0:1787826417.937291:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2116 00000100:00100000:0.0:1787826417.937304:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa86940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563892096:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826417.937328:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826417.937354:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000952ff42d/0x22153cd396b82461 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x109:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1067 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826417.937386:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x109:0x0] initial LVB size: 0, mtime: 0x6a9010ec, atime: 0x6a9010ec, ctime: 0x6a9010f1, blocks: 0x0 00010000:00010000:0.0:1787826417.937411:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x109:0x0].0x0 since=1363s v=(0 0) 00010000:00010000:0.0:1787826417.937417:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x109:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826417.937428:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000952ff42d/0x22153cd396b82461 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x109:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1067 expref: 10 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.937448:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000952ff42d/0x22153cd396b82461 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x109:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1067 expref: 10 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826417.937465:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165e200, rc 0) 00000100:00100000:0.0:1787826417.937646:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa86940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563892096:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 344us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826417.937654:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2116 00000004:00000024:1.0:1787826417.938221:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446182912 avail 1299943424 00000100:00100000:1.0:1787826417.938366:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1366b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1874670585254784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 5956us (6104us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826417.938377:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1455 00000100:00100000:2.0:1787826417.942353:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab92580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585254784:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787826417.987956:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826417.997649:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826417.997771:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563892224 00000100:00100000:1.0:1787826417.997784:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563892224 00000100:00100000:1.0:1787826417.997864:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3812 00000100:00100000:1.0:1787826417.997876:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1366a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+62:55573:x1874670563892224:12345-192.168.203.39@tcp:44:lfs.0 00000001:00080000:0.0:1787826418.005263:0:34481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934978 is committed 00000004:00080000:0.0:1787826418.005314:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 28 committed 00000100:00100000:1.0:1787826418.005624:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787826418.005654:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f8c3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585254912:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787826418.005756:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826418.005823:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585254912 00000100:00100000:1.0:1787826418.005832:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585254912 00000100:00100000:1.0:1787826418.005890:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2117 00000100:00100000:1.0:1787826418.005900:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874670585254912:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787826418.005935:0:8435:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:264 count 1 00010000:00010000:1.0:1787826418.005968:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bacf1a1a/0x22153cd396b82468 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.005996:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a4b5afc1/0x22153cd396b82293 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fbf expref: 7 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.006007:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x108:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787826418.006012:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x108:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826418.006017:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bacf1a1a/0x22153cd396b82468 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.006053:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a4b5afc1/0x22153cd396b82293 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fbf expref: 7 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.006071:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a4b5afc1/0x22153cd396b82293 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fbf expref: 7 pid: 30694 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826418.006085:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f8c1680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1874670585255040:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826418.006161:0:8435:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e36c0 going to sleep for 11 seconds 00000020:00080000:0.0:1787826418.006429:0:34481:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90cf10a2f9c0 refcount 2 committed 0 result 0 batchid 4294969336 00000020:00080000:0.0:1787826418.006435:0:34481:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cf39612400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90ce04aa5f00 00000020:00080000:0.0:1787826418.006438:0:34481:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cf39612500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90cf0c488400 00000020:00080000:0.0:1787826418.006496:0:34481:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969335 batchid updated 00000020:00080000:2.0:1787826418.006554:0:34512:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969336 committed batchid 4294969335 00000020:00080000:2.0:1787826418.006634:0:34512:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969335 00010000:00010000:3.0:1787826418.006763:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b82277 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.006774:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b82277 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.006782:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b82277 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.006789:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165e000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826418.006794:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b82277 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.006803:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b82277 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.006828:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2c:0x0].0x0 (ffff90ce036ca500) 00010000:00010000:3.0:1787826418.006831:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826418.006837:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b82277 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.006845:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b82277 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.006875:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b8228c lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.006882:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b8228c lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.006888:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b8228c lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.006893:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826418.006896:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b8228c lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.006902:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b8228c lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.006910:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826418.006913:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826418.006916:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b8228c lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.006921:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b8228c lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826418.008011:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1366a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:55573:x1874670563892224:12345-192.168.203.39@tcp:44:lfs.0 Request processed in 10127us (10367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826418.008025:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3812 00000100:00100000:2.0:1787826418.010123:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826418.010899:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563892352 00000100:00100000:3.0:1787826418.010912:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563892352 00010000:00010000:3.0:1787826418.010969:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a4b5afc1/0x22153cd396b82293 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fbf expref: 8 pid: 30694 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826418.011033:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1171 00000100:00100000:3.0:1787826418.011045:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2403:x1874670563892352:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826418.011066:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826418.011073:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a4b5afc1/0x22153cd396b82293 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x108:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fbf expref: 8 pid: 30694 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.011095:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a4b5afc1/0x22153cd396b82293 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x108:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fbf expref: 8 pid: 30694 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.011194:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x108:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826418.011199:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x108:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826418.011206:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bacf1a1a/0x22153cd396b82468 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x108:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.011219:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bacf1a1a/0x22153cd396b82468 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x108:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.011245:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826418.011325:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2403:x1874670563892352:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 281us (1217us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826418.011338:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1171 00010000:00010000:1.0:1787826418.012058:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4b5afc1/0x22153cd396b82293 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x108:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0fbf expref: 7 pid: 30694 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826418.012268:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f8c1680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1874670585255040:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826418.012299:0:8435:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bacf1a1a/0x22153cd396b82468 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x108:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.012317:0:8435:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bacf1a1a/0x22153cd396b82468 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x108:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.012323:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bacf1a1a/0x22153cd396b82468 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x108:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.012335:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bacf1a1a/0x22153cd396b82468 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x108:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.012343:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bacf1a1a/0x22153cd396b82468 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x108:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.013013:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787826418.013586:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1874670585254912:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7682us (7825us total) trans 21474837007 rc 0/0 00000100:00100000:1.0:1787826418.013598:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2117 00000004:00080000:3.0:1787826418.013885:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3f8c3c00/2, rc 0, transno 21474837007 00000100:00100000:3.0:1787826418.013893:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f8c3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585254912:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787826418.014351:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826418.014533:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563892480 00000100:00100000:1.0:1787826418.014541:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563892480 00000100:00100000:1.0:1787826418.014601:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2118 00000100:00100000:1.0:1787826418.014612:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb952c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2404:x1874670563892480:12345-192.168.203.39@tcp:16:lfs.0 00000100:00100000:1.0:1787826418.014738:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb952c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2404:x1874670563892480:12345-192.168.203.39@tcp:16:lfs.0 Request processed in 128us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826418.014746:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2118 00010000:00010000:0.0:1787826418.017329:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826418.017424:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bacf1a1a/0x22153cd396b82468 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x108:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.017440:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46b200 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826418.017444:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bacf1a1a/0x22153cd396b82468 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x108:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.017454:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bacf1a1a/0x22153cd396b82468 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x108:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.017563:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bacf1a1a/0x22153cd396b82468 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x108:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.017572:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bacf1a1a/0x22153cd396b82468 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x108:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.017604:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826418.017606:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826418.017608:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826418.024249:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826418.024374:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563892608 00000100:00100000:1.0:1787826418.024388:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563892608 00000100:00100000:1.0:1787826418.024467:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2119 00000100:00100000:1.0:1787826418.024509:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb95680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2402:x1874670563892608:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:1.0:1787826418.024573:0:30694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a4b5afc1/0x22153cd396b8246f lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.024596:0:30694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x109:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787826418.024603:0:30694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x109:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826418.024611:0:30694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4b5afc1/0x22153cd396b8246f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.024760:0:30694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a4b5afc1/0x22153cd396b8246f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.024861:0:30694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a4b5afc1/0x22153cd396b8246f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.024871:0:30694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a4b5afc1/0x22153cd396b8246f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.024880:0:30694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a4b5afc1/0x22153cd396b8246f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.024888:0:30694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46b000 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:1.0:1787826418.024893:0:30694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4b5afc1/0x22153cd396b8246f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.024914:0:30694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4b5afc1/0x22153cd396b8246f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.024934:0:30694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a4b5afc1/0x22153cd396b8246f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.024942:0:30694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a4b5afc1/0x22153cd396b8246f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826418.025045:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb95680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2402:x1874670563892608:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 538us (811us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826418.025055:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2119 00000100:00100000:1.0:1787826418.035420:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826418.035999:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563892864 00000100:00100000:3.0:1787826418.036013:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563892864 00000100:00100000:3.0:1787826418.036092:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3813 00000100:00100000:3.0:1787826418.036103:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:55573:x1874670563892864:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:3.0:1787826418.036188:0:8247:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826418.036228:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b82429 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1044 expref: 33 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.036250:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2e:0x0].0x0 (ffff90cf06894b00) 00010000:00010000:3.0:1787826418.036266:0:8247:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826418.036305:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b82476 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.036321:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b82476 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.036332:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b82476 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826418.036556:0:8247:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000833019ed reply state 00000000352d4bd5 transno 8589934979 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b82476 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.036571:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b82476 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.036582:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2e:0x0].0x0 (ffff90cf06894300) 00010000:00010000:3.0:1787826418.036585:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826418.036589:0:8247:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826418.036924:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:55573:x1874670563892864:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 820us (1519us total) trans 8589934979 rc 0/0 00000100:00100000:3.0:1787826418.036933:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3813 00000100:00100000:2.0:1787826418.041643:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826418.043749:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563892992 00000100:00100000:0.0:1787826418.043767:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563892992 00000100:00100000:0.0:1787826418.043864:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3814 00000100:00100000:0.0:1787826418.043877:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f936d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:55573:x1874670563892992:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826418.043912:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826418.043941:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b8247d lrc: 2/0,0 mode: --/CR res: [0x200000405:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab106e expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.044184:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b8247d lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab106e expref: 35 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.044207:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b8247d lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab106e expref: 35 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.044235:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2e:0x0].0x0 (ffff90cf06894300) 00010000:00010000:0.0:1787826418.044239:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826418.044245:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165e400, rc 0) 00000100:00100000:0.0:1787826418.044348:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f936d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:55573:x1874670563892992:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 473us (2720us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826418.044357:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3814 00000100:00100000:0.0:1787826418.048918:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826418.049228:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563893120 00000100:00100000:1.0:1787826418.049242:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563893120 00000100:00100000:1.0:1787826418.049322:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2120 00000100:00100000:1.0:1787826418.049334:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab91680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:55573:x1874670563893120:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826418.049358:0:14864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826418.049389:0:14864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4b5afc1/0x22153cd396b82484 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1075 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.049424:0:14864:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002904bac2/0x22153cd396b82430 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab104b expref: 8 pid: 30696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.049431:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x109:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787826418.049436:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x109:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826418.049441:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4b5afc1/0x22153cd396b82484 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1075 expref: 8 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.049500:0:14864:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002904bac2/0x22153cd396b82430 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab104b expref: 8 pid: 30696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.049512:0:14864:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002904bac2/0x22153cd396b82430 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab104b expref: 8 pid: 30696 timeout: 1464 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826418.049526:0:14864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f8c2940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14864:1874670585255168:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826418.049642:0:14864:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e36c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826418.054202:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826418.054303:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563893248 00000100:00100000:1.0:1787826418.054313:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563893248 00010000:00010000:1.0:1787826418.054379:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002904bac2/0x22153cd396b82430 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab104b expref: 9 pid: 30696 timeout: 1464 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826418.054435:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1172 00000100:00100000:1.0:1787826418.054447:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf185d9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2401:x1874670563893248:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826418.054465:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826418.054529:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002904bac2/0x22153cd396b82430 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x109:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab104b expref: 9 pid: 30696 timeout: 1464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.054544:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002904bac2/0x22153cd396b82430 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x109:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab104b expref: 9 pid: 30696 timeout: 1464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.054588:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x109:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826418.054594:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x109:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826418.054603:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a4b5afc1/0x22153cd396b82484 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x109:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1075 expref: 9 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.054614:0:10340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4b5afc1/0x22153cd396b82484 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x109:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1075 expref: 9 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.054663:0:10340:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a4b5afc1/0x22153cd396b82484 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x109:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1075 expref: 9 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826418.054681:0:10340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f8c2580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10340:1874670585255296:192.168.203.39@tcp:105: 00000100:00100000:1.0:1787826418.054792:0:10340:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3540 going to sleep for 11 seconds 00010000:00010000:0.0:1787826418.054966:0:14864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002904bac2/0x22153cd396b82430 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x109:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab104b expref: 9 pid: 30696 timeout: 1464 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826418.055082:0:14864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f8c2940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14864:1874670585255168:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826418.055120:0:14864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a4b5afc1/0x22153cd396b82484 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1075 expref: 8 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.055134:0:14864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46b000, rc 0) 00000100:00100000:0.0:1787826418.055195:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab91680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:55573:x1874670563893120:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 5862us (6291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826418.055205:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2120 00000100:00100000:1.0:1787826418.067300:0:10340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f8c2580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10340:1874670585255296:192.168.203.39@tcp:105: 00010000:00010000:1.0:1787826418.067348:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826418.067429:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf185d9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2401:x1874670563893248:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 12982us (13240us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826418.067444:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1172 00000100:00100000:3.0:1787826418.067821:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826418.068444:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563893376 00000100:00100000:0.0:1787826418.068456:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563893376 00000100:00100000:0.0:1787826418.068563:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2121 00000100:00100000:0.0:1787826418.068574:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2404:x1874670563893376:12345-192.168.203.39@tcp:2:lfs.0 00002000:00010000:0.0:1787826418.069060:0:8437:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x109:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787826418.069065:0:8437:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x109:0x0] updating lvb mtime from disk: 0 -> 1787826412 00002000:00010000:0.0:1787826418.069068:0:8437:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x109:0x0] updating lvb atime from disk: 0 -> 1787826412 00002000:00010000:0.0:1787826418.069070:0:8437:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x109:0x0] updating lvb ctime from disk: 0 -> 1787826418 00002000:00010000:0.0:1787826418.069072:0:8437:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x109:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1787826418.069199:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2404:x1874670563893376:12345-192.168.203.39@tcp:2:lfs.0 Request processed in 625us (1378us total) trans 21474837008 rc 0/0 00000100:00100000:0.0:1787826418.069208:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2121 00000100:00100000:3.0:1787826418.079029:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826418.082968:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563893632 00000100:00100000:2.0:1787826418.082992:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563893632 00000100:00100000:2.0:1787826418.083712:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3815 00000100:00100000:2.0:1787826418.083732:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03892940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:55573:x1874670563893632:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:2.0:1787826418.083983:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826418.084030:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82414 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1036 expref: 35 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.084059:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826418.084066:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826418.084148:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b8248b lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.084177:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b8248b lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.084190:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b8248b lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826418.085185:0:6518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000096b0d85a reply state 000000003495cbad transno 8589934980 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b8248b lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.085211:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b8248b lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.085219:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826418.085223:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826418.085228:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826418.086828:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03892940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55573:x1874670563893632:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 3089us (7809us total) trans 8589934980 rc 0/0 00000100:00100000:2.0:1787826418.086844:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3815 00000100:00100000:0.0:1787826418.101250:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826418.101407:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563893760 00000100:00100000:1.0:1787826418.101419:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563893760 00000100:00100000:1.0:1787826418.102844:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2122 00000100:00100000:1.0:1787826418.102867:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab92580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:55573:x1874670563893760:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826418.102890:0:8545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826418.102915:0:8545:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8fb1ffc/0x22153cd396b82492 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab107c expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.102955:0:8545:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000952ff42d/0x22153cd396b82461 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1067 expref: 11 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.102967:0:8545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x109:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826418.102972:0:8545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x109:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826418.102977:0:8545:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8fb1ffc/0x22153cd396b82492 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab107c expref: 11 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.103017:0:8545:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000952ff42d/0x22153cd396b82461 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1067 expref: 11 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.103033:0:8545:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000952ff42d/0x22153cd396b82461 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1067 expref: 11 pid: 8437 timeout: 1464 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826418.103049:0:8545:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f8c2580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8545:1874670585255424:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826418.103172:0:8545:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826418.107712:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826418.108233:0:8545:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f8c2580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8545:1874670585255424:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826418.108284:0:8545:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a8fb1ffc/0x22153cd396b82492 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab107c expref: 11 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.108316:0:8545:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46ac00, rc 0) 00000100:00100000:2.0:1787826418.108403:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab92580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:55573:x1874670563893760:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 5545us (7170us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826418.108413:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2122 00000100:00100000:3.0:1787826418.108532:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563893888 00000100:00100000:3.0:1787826418.108540:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563893888 00010000:00010000:3.0:1787826418.108592:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000952ff42d/0x22153cd396b82461 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1067 expref: 11 pid: 8437 timeout: 1464 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826418.108630:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1173 00000100:00100000:3.0:1787826418.108641:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2404:x1874670563893888:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826418.108659:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826418.108686:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000952ff42d/0x22153cd396b82461 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x109:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1067 expref: 11 pid: 8437 timeout: 1464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.108701:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000952ff42d/0x22153cd396b82461 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x109:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1067 expref: 11 pid: 8437 timeout: 1464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.108729:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000952ff42d/0x22153cd396b82461 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x109:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1067 expref: 11 pid: 8437 timeout: 1464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.108751:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x109:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826418.108757:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x109:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826418.108764:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a8fb1ffc/0x22153cd396b82492 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab107c expref: 10 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.108776:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8fb1ffc/0x22153cd396b82492 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab107c expref: 10 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.108820:0:6504:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a8fb1ffc/0x22153cd396b82492 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab107c expref: 10 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826418.108835:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce038912c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6504:1874670585255552:192.168.203.39@tcp:105: 00000100:00100000:3.0:1787826418.108921:0:6504:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf1850c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826418.116224:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826418.116421:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce038912c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6504:1874670585255552:192.168.203.39@tcp:105: 00010000:00010000:3.0:1787826418.116645:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826418.116720:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563893888:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 8079us (9022us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826418.116732:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1173 00000100:00100000:1.0:1787826418.117136:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563894016 00000100:00100000:1.0:1787826418.117145:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563894016 00000100:00100000:1.0:1787826418.117214:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2123 00000100:00100000:1.0:1787826418.117224:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670563894016:12345-192.168.203.39@tcp:2:lfs.0 00002000:00010000:1.0:1787826418.118685:0:30398:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x109:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787826418.118694:0:30398:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x109:0x0] updating lvb mtime from disk: 1787826412 -> 1787826412 00002000:00010000:1.0:1787826418.118698:0:30398:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x109:0x0] updating lvb atime from disk: 1787826412 -> 1787826412 00002000:00010000:1.0:1787826418.118700:0:30398:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x109:0x0] updating lvb ctime from disk: 1787826417 -> 1787826418 00002000:00010000:1.0:1787826418.118703:0:30398:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x109:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1787826418.119187:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2403:x1874670563894016:12345-192.168.203.39@tcp:2:lfs.0 Request processed in 1957us (2972us total) trans 17179869667 rc 0/0 00000100:00100000:1.0:1787826418.119200:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2123 00000100:00100000:0.0:1787826418.124028:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826418.124746:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563894272 00000100:00100000:1.0:1787826418.124881:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563894272 00000100:00100000:1.0:1787826418.125127:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1151 00000100:00100000:1.0:1787826418.125140:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eea5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55573:x1874670563894272:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:1.0:1787826418.125256:0:14257:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000405:0x1d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b8243e lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1052 expref: 36 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.125641:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82499 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.125658:0:14257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8236c lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ffe expref: 36 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.125666:0:14257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b823b9 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1013 expref: 36 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.125674:0:14257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82499 lrc: 5/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.125726:0:14257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b823b9 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1013 expref: 36 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.125749:0:14257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b823b9 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1013 expref: 36 pid: 6518 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826418.126140:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f8c2580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585255680:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826418.126634:0:14257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8236c lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ffe expref: 36 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.126648:0:14257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8236c lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ffe expref: 36 pid: 32404 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826418.126659:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f8c2940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585255808:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826418.126689:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3300 going to sleep for 11 seconds 00000100:00100000:1.0:1787826418.129616:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f8c2580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585255680:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826418.129633:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f8c2940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585255808:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826418.129667:0:14257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82499 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826418.133395:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826418.133468:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826418.133609:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563894656 00000100:00100000:3.0:1787826418.133622:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563894656 00000100:00100000:3.0:1787826418.133695:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1152 00000100:00100000:3.0:1787826418.133705:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:42220:x1874670563894656:12345-192.168.203.39@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787826418.134004:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:42220:x1874670563894656:12345-192.168.203.39@tcp:35:ldlm_bl.0 Request processed in 298us (533us total) trans 8589934981 rc 0/0 00000100:00100000:3.0:1787826418.134014:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1152 00000100:00100000:2.0:1787826418.134315:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563894400 00000100:00100000:2.0:1787826418.134322:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563894400 00010000:00010000:2.0:1787826418.134354:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8236c lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ffe expref: 38 pid: 32404 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826418.134397:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1174 00000100:00100000:2.0:1787826418.134405:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab930c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:2404:x1874670563894400:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826418.134419:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826418.134427:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8236c lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ffe expref: 38 pid: 32404 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.134439:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8236c lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ffe expref: 38 pid: 32404 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.134467:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8236c lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab0ffe expref: 38 pid: 32404 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.134514:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826418.134520:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82499 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.134536:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82499 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.134543:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826418.134571:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab930c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:2404:x1874670563894400:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 167us (1193us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826418.134578:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1174 00000100:00100000:0.0:1787826418.139870:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826418.139981:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563894784 00000100:00100000:1.0:1787826418.139994:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563894784 00010000:00010000:1.0:1787826418.140051:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b823b9 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1013 expref: 37 pid: 6518 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826418.140232:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1175 00000100:00100000:1.0:1787826418.140249:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f05a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:2401:x1874670563894784:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826418.140440:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826418.140450:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b823b9 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1013 expref: 37 pid: 6518 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.140466:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b823b9 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1013 expref: 37 pid: 6518 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.140678:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b823b9 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1013 expref: 37 pid: 6518 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.140699:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826418.140706:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82499 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.140716:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82499 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.140725:0:10340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82499 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.140757:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826418.141216:0:14257:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82499 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.141227:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82499 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.141259:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b824a0 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.141282:0:14257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b8247d lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab106e expref: 36 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.141291:0:14257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b824a0 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.141334:0:14257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b8247d lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab106e expref: 36 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.141360:0:14257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b8247d lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab106e expref: 36 pid: 9966 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826418.141375:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce04f052c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585255936:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826418.141453:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f05a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:2401:x1874670563894784:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 1209us (1600us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826418.141464:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1175 00000100:00100000:0.0:1787826418.141723:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a18f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826418.148753:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826418.148887:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563894912 00000100:00100000:3.0:1787826418.148900:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563894912 00010000:00010000:3.0:1787826418.148966:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b8247d lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab106e expref: 36 pid: 9966 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826418.149017:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1176 00000100:00100000:3.0:1787826418.149028:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:2403:x1874670563894912:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826418.149048:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826418.149056:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b8247d lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab106e expref: 36 pid: 9966 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.149082:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b8247d lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab106e expref: 36 pid: 9966 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.149113:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2e:0x0].0x0 (ffff90cf06894300) 00010000:00010000:3.0:1787826418.149118:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b824a0 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.149129:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b824a0 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.149138:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b824a0 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.149161:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826418.149250:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:2403:x1874670563894912:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 222us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826418.149687:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1176 00010000:00010000:0.0:1787826418.152239:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b8247d lrc: 0/0,0 mode: --/CR res: [0x200000405:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab106e expref: 35 pid: 9966 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826418.152456:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce04f052c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585255936:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826418.152646:0:14257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b824a0 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.152660:0:14257:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b824a0 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.152666:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b824a0 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826418.153071:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce04f052c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585256064:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1787826418.153193:0:14257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826418.153237:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a18180 going to sleep for 11 seconds 00000100:00100000:1.0:1787826418.153350:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585256064 00000100:00100000:1.0:1787826418.153359:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585256064 00000100:00100000:1.0:1787826418.153432:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1456 00000100:00100000:1.0:1787826418.153442:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f07840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14257:x1874670585256064:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1787826418.153579:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f07840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14257:x1874670585256064:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 138us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826418.153587:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1456 00000100:00100000:0.0:1787826418.153873:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce04f052c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585256064:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1787826418.153928:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce04f052c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585256192:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1787826418.153960:0:14257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826418.153975:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a18180 going to sleep for 11 seconds 00000100:00100000:1.0:1787826418.154647:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585256192 00000100:00100000:1.0:1787826418.154657:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585256192 00000100:00100000:1.0:1787826418.154708:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1457 00000100:00100000:1.0:1787826418.154717:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14257:x1874670585256192:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1787826418.154854:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14257:x1874670585256192:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 137us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826418.154862:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1457 00000100:00100000:3.0:1787826418.155813:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce04f052c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585256192:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:3.0:1787826418.156024:0:14257:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934982 00000100:00100000:3.0:1787826418.156127:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce038912c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585256320:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1787826418.156203:0:14257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826418.156252:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585256320 00000100:00100000:3.0:1787826418.156258:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585256320 00000100:00100000:3.0:1787826418.156314:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1458 00000100:00100000:3.0:1787826418.156323:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce038903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:14257:x1874670585256320:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1787826418.157052:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3ab4c600 going to sleep for 11 seconds 00000100:00100000:3.0:1787826418.158231:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce038903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:14257:x1874670585256320:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 1900us (2020us total) trans 21474837009 rc 0/0 00000100:00100000:3.0:1787826418.158245:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1458 00000100:00100000:2.0:1787826418.159135:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce038912c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585256320:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:2.0:1787826418.159276:0:14257:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934983 00010000:00010000:2.0:1787826418.159326:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b824a0 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.161023:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b824a0 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.161036:0:14257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b824a0 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.161044:0:14257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165ec00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826418.161049:0:14257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b824a0 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.161072:0:14257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b824a0 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.161098:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2e:0x0].0x0 (ffff90cf06894300) 00010000:00010000:2.0:1787826418.161101:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787826418.161108:0:14257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b824a0 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.161117:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b824a0 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.161144:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82499 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.161150:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82499 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.161156:0:14257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82499 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.161173:0:14257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46a600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826418.161176:0:14257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82499 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.161182:0:14257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82499 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.161191:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826418.161193:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787826418.161196:0:14257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82499 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.161201:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82499 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.161218:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826418.161220:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787826418.161229:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b8243e lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1052 expref: 37 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826418.162991:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eea5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55573:x1874670563894272:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 37838us (39033us total) trans 8589934984 rc 0/0 00000100:00100000:2.0:1787826418.163010:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1151 00000020:00080000:2.0:1787826418.163019:0:14257:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1787826418.174840:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826418.174949:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563895040 00000100:00100000:2.0:1787826418.174963:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563895040 00000100:00100000:2.0:1787826418.175044:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3816 00000100:00100000:2.0:1787826418.175056:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55573:x1874670563895040:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826418.175102:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826418.175128:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b824a7 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1083 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.175221:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b824a7 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1083 expref: 37 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.175239:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b824a7 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1083 expref: 37 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.175270:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826418.175274:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826418.175278:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834c00, rc 0) 00000100:00100000:2.0:1787826418.175366:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:55573:x1874670563895040:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 311us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826418.175374:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3816 00000100:00100000:0.0:1787826418.182027:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826418.182242:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563895296 00000100:00100000:3.0:1787826418.182256:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563895296 00000100:00100000:3.0:1787826418.182408:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1153 00000100:00100000:3.0:1787826418.182422:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:55573:x1874670563895296:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:3.0:1787826418.184020:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:55573:x1874670563895296:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 1590us (1997us total) trans 8589934985 rc 0/0 00000100:00100000:3.0:1787826418.184037:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1153 00000100:00100000:1.0:1787826418.190969:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826418.191281:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563895552 00000100:00100000:2.0:1787826418.191295:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563895552 00000100:00100000:2.0:1787826418.191383:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1154 00000100:00100000:2.0:1787826418.191397:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:55573:x1874670563895552:12345-192.168.203.39@tcp:35:lfs.0 00000004:00080000:2.0:1787826418.191708:0:14257:0:(mdd_object.c:4014:mdd_close()) Object [0x200000405:0x2e:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:1.0:1787826418.192536:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b824ae lrc: 3/0,1 mode: --/PW res: [0x200000405:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.192562:0:14257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b824ae lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.192577:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b824ae lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.192589:0:14257:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b824ae lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.192596:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b824ae lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.192603:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b824ae lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.192766:0:14257:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787826418.192918:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+39:55573:x1874670563895552:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 1520us (1959us total) trans 8589934986 rc 0/0 00000100:00100000:1.0:1787826418.192930:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1154 00010000:00010000:2.0:1787826418.197499:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826418.197520:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b824ae lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.197534:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46b400 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826418.197539:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b824ae lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.197551:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b824ae lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.197574:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2e:0x0].0x0 (ffff90cf06894300) 00010000:00010000:2.0:1787826418.197578:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787826418.197583:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b824ae lrc: 1/0,0 mode: --/PW res: [0x200000405:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.197589:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b824ae lrc: 0/0,0 mode: --/PW res: [0x200000405:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.197612:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826418.197614:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826418.197616:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826418.217932:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826418.218044:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563895680 00000100:00100000:0.0:1787826418.218056:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563895680 00000100:00100000:0.0:1787826418.218132:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3817 00000100:00100000:0.0:1787826418.218142:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f935680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+39:55576:x1874670563895680:12345-192.168.203.39@tcp:101:getfattr.0 00010000:00010000:0.0:1787826418.218181:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826418.218209:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b824b5 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab108a expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.218298:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b824bc lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.218315:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b824bc lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.218327:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b824bc lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.218348:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b824c3 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.218356:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b824c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.218362:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b824c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.218454:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b824ca lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.218464:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b824ca lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.218509:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b824ca lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826418.218554:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:0.0:1787826418.218559:0:32404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826418.218580:0:32404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b824ca lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.218593:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b824ca lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.218604:0:32404:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b824bc lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.218611:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b824bc lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.218618:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b824bc lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.218625:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b824bc lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.218630:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165fc00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826418.218635:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b824bc lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.218643:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b824bc lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.218661:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf3abcb300) 00010000:00010000:0.0:1787826418.218664:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826418.218670:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b824bc lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.218677:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b824bc lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.218693:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b824c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.218698:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b824c3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.218703:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b824c3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.218709:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165f400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826418.218712:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b824c3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.218718:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b824c3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.218724:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf3abcb900) 00010000:00010000:0.0:1787826418.218726:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826418.218729:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b824c3 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.218734:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b824c3 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.218770:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b824b5 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab108a expref: 41 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.218787:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b824ca lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab108a expref: 40 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.218795:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826418.218797:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826418.218800:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165e400, rc 0) 00000100:00100000:0.0:1787826418.218867:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f935680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55576:x1874670563895680:12345-192.168.203.39@tcp:101:getfattr.0 Request processed in 725us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826418.218875:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3817 00000100:00100000:0.0:1787826418.243371:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826418.243447:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563895808 00000100:00100000:2.0:1787826418.243460:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563895808 00000100:00100000:0.0:1787826418.243574:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3818 00000100:00100000:0.0:1787826418.243589:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55580:x1874670563895808:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:0.0:1787826418.243771:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b824d1 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.243792:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b824d1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.243806:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b824d1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.243821:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b824d8 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.243828:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b824d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.243836:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b824d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.243933:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b824df lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.243943:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b824df lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.243951:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b824df lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826418.244002:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:0.0:1787826418.244007:0:16564:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826418.244022:0:16564:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b824df lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.244037:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b824d1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.244043:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b824d1 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.244050:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b824d1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.244056:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165fa00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826418.244061:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b824d1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.244069:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b824d1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.244084:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf3abcb300) 00010000:00010000:0.0:1787826418.244087:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826418.244092:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b824d1 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.244098:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b824d1 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.244119:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b824d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.244124:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b824d8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.244130:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b824d8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.244135:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165f400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826418.244138:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b824d8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.244144:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b824d8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.244152:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf3abcb900) 00010000:00010000:0.0:1787826418.244154:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826418.244157:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b824d8 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.244174:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b824d8 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.244189:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b824df lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.244195:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b824df lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.244201:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b824df lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.244206:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165fc00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826418.244209:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b824df lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.244216:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b824df lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.244222:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826418.244225:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826418.244228:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b824df lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.244234:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b824df lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826418.244365:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55580:x1874670563895808:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 778us (1008us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826418.244375:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3818 00000100:00100000:1.0:1787826418.259831:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826418.259922:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563896064 00000100:00100000:2.0:1787826418.259935:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563896064 00000100:00100000:2.0:1787826418.260023:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3819 00000100:00100000:2.0:1787826418.260035:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce063061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55582:x1874670563896064:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826418.260064:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826418.260096:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b824e6 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1091 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.260259:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b824ed lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.260278:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b824ed lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.260293:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b824ed lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826418.260307:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:2.0:1787826418.260456:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b824e6 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1091 expref: 43 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.261209:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b824ed lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1091 expref: 42 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.261224:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826418.261227:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787826418.261231:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834800, rc 0) 00000100:00100000:2.0:1787826418.261382:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce063061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+42:55582:x1874670563896064:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1348us (1565us total) trans 8589934987 rc 0/0 00000100:00100000:2.0:1787826418.261395:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3819 00000100:00100000:2.0:1787826418.274704:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826418.274898:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563896320 00000100:00100000:3.0:1787826418.274911:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563896320 00000100:00100000:3.0:1787826418.274989:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3820 00000100:00100000:3.0:1787826418.275001:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f9361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+42:55582:x1874670563896320:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826418.275035:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826418.275068:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b824fb lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1098 expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.275262:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b82502 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.275281:0:8247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b824ca lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab108a expref: 43 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.275291:0:8247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b82502 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.275333:0:8247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b824ca lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab108a expref: 43 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.275464:0:8247:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b824ca lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab108a expref: 43 pid: 32404 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826418.275530:0:8247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03891a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8247:1874670585256448:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826418.278172:0:8247:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf117b00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826418.278230:0:8247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03891a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8247:1874670585256448:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826418.278264:0:8247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b82502 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826418.279851:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826418.280585:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563896448 00000100:00100000:3.0:1787826418.280598:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563896448 00010000:00010000:0.0:1787826418.280924:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b824ca lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab108a expref: 44 pid: 32404 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826418.281027:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1177 00000100:00100000:0.0:1787826418.281039:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f9370c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:2403:x1874670563896448:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826418.281059:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826418.281068:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b824ca lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab108a expref: 44 pid: 32404 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.281084:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b824ca lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab108a expref: 44 pid: 32404 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.281113:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b824ca lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab108a expref: 44 pid: 32404 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.281134:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826418.281141:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b82502 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.281152:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b82502 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.281173:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b82502 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.281213:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826418.281290:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f9370c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:2403:x1874670563896448:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 253us (1449us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826418.281300:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1177 00010000:00010000:3.0:1787826418.281606:0:8247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b82502 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.281625:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b82502 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826418.281655:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:3.0:1787826418.281838:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b824fb lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1098 expref: 44 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.281862:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b82502 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1098 expref: 43 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.281871:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826418.281874:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787826418.281877:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400600, rc 0) 00000100:00100000:3.0:1787826418.281928:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f9361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55582:x1874670563896320:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 6929us (7238us total) trans 8589934988 rc 0/0 00000100:00100000:3.0:1787826418.281936:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3820 00000100:00100000:1.0:1787826418.284946:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826418.285176:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563896576 00000100:00100000:3.0:1787826418.285189:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563896576 00000100:00100000:3.0:1787826418.285262:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1155 00000100:00100000:3.0:1787826418.285274:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55582:x1874670563896576:12345-192.168.203.39@tcp:33:lfs.0 00000100:00100000:3.0:1787826418.285539:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55582:x1874670563896576:12345-192.168.203.39@tcp:33:lfs.0 Request processed in 266us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826418.285547:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1155 00000100:00100000:1.0:1787826418.287850:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826418.288041:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563896832 00000100:00100000:3.0:1787826418.288053:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563896832 00000100:00100000:3.0:1787826418.288120:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1156 00000100:00100000:3.0:1787826418.288132:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8ae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55582:x1874670563896832:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:3.0:1787826418.289764:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8ae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55582:x1874670563896832:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 1621us (1911us total) trans 8589934989 rc 0/0 00000100:00100000:3.0:1787826418.289779:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1156 00000100:00100000:0.0:1787826418.294044:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826418.294146:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563897088 00000100:00100000:2.0:1787826418.294159:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563897088 00000100:00100000:2.0:1787826418.294278:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3821 00000100:00100000:2.0:1787826418.294290:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55582:x1874670563897088:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826418.294321:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826418.294325:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:2.0:1787826418.294377:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b82502 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1098 expref: 44 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.294404:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b824ed lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1091 expref: 43 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.294417:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826418.294424:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826418.294440:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b82510 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab109f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.294608:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82517 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.294694:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82517 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.294826:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82517 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826418.294841:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:2.0:1787826418.294976:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b82510 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab109f expref: 45 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.294992:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82517 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab109f expref: 44 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.295000:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826418.295003:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787826418.295006:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834600, rc 0) 00000100:00100000:2.0:1787826418.295078:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55582:x1874670563897088:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 790us (1048us total) trans 8589934990 rc 0/0 00000100:00100000:2.0:1787826418.295087:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3821 00000100:00100000:2.0:1787826418.298918:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826418.299051:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563897344 00000100:00100000:1.0:1787826418.299064:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563897344 00000100:00100000:1.0:1787826418.299128:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1157 00000100:00100000:1.0:1787826418.299140:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eea4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55582:x1874670563897344:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:1.0:1787826418.299254:0:6521:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000405:0x1d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82517 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab109f expref: 44 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.299306:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b82525 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.299322:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b824a7 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1083 expref: 44 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.299332:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b82525 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.299706:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b824a7 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1083 expref: 44 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.299726:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b824a7 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1083 expref: 44 pid: 6520 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826418.299747:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a8af840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1874670585256576:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826418.299942:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826418.303110:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826418.303199:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563897472 00000100:00100000:2.0:1787826418.303211:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563897472 00010000:00010000:2.0:1787826418.303264:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b824a7 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1083 expref: 45 pid: 6520 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826418.303307:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1178 00000100:00100000:2.0:1787826418.303318:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+45:2403:x1874670563897472:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826418.303342:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826418.303358:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b824a7 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1083 expref: 45 pid: 6520 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.303374:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b824a7 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1083 expref: 45 pid: 6520 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.303405:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826418.303412:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b82525 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.303423:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b82525 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.303431:0:10340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b82525 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.303456:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826418.303562:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+45:2403:x1874670563897472:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 246us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826418.303572:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1178 00010000:00010000:0.0:1787826418.305245:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b824a7 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1083 expref: 44 pid: 6520 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826418.305276:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a8af840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1874670585256576:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826418.305309:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b82525 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.305572:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b82525 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.305580:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b82525 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.305936:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b82525 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.305946:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b82525 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.305954:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b82525 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.305960:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46b200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826418.305965:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b82525 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.305974:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b82525 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.305994:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826418.305998:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787826418.306003:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b82525 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.306015:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b82525 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.306029:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826418.306031:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787826418.306037:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82517 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab109f expref: 43 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826418.306286:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eea4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55582:x1874670563897344:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 7146us (7383us total) trans 8589934991 rc -22/-22 00000100:00100000:1.0:1787826418.306298:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1157 00000100:00100000:1.0:1787826418.309784:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826418.309879:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563897600 00000100:00100000:0.0:1787826418.309892:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563897600 00000100:00100000:0.0:1787826418.310003:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3822 00000100:00100000:0.0:1787826418.310015:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55582:x1874670563897600:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826418.310046:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826418.310074:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b8252c lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab10a6 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.310147:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b8252c lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10a6 expref: 44 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.310174:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b8252c lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10a6 expref: 44 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.310196:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826418.310199:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826418.310203:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165e400, rc 0) 00000100:00100000:0.0:1787826418.310282:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55582:x1874670563897600:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 269us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826418.310289:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3822 00000100:00100000:1.0:1787826418.314418:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826418.314554:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563897856 00000100:00100000:2.0:1787826418.314567:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563897856 00000100:00100000:2.0:1787826418.314695:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3823 00000100:00100000:2.0:1787826418.314709:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55582:x1874670563897856:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826418.314738:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826418.314770:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b82533 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab10ad expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.315414:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8253a lrc: 3/1,0 mode: --/PR res: [0x200000405:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.315436:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8253a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.315450:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8253a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826418.315463:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x2f:0x0]: returning size 0 00010000:00010000:2.0:1787826418.315579:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b82533 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10ad expref: 47 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.315610:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8253a lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10ad expref: 46 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.315620:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2f:0x0].0x0 (ffff90cf39e67800) 00010000:00010000:2.0:1787826418.315624:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826418.315628:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834400, rc 0) 00000100:00100000:2.0:1787826418.315704:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+46:55582:x1874670563897856:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 998us (1300us total) trans 8589934992 rc 0/0 00000100:00100000:2.0:1787826418.315712:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3823 00000100:00100000:3.0:1787826418.319202:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826418.319868:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563898112 00000100:00100000:0.0:1787826418.319881:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563898112 00000100:00100000:0.0:1787826418.319962:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3824 00000100:00100000:0.0:1787826418.319974:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03891680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+46:55582:x1874670563898112:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826418.320005:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826418.320034:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b82548 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab10b4 expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.320184:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b8254f lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.320205:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b8254f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.320219:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b8254f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826418.320235:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:0.0:1787826418.320892:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b82548 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10b4 expref: 49 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.320918:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b8254f lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10b4 expref: 48 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.320929:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826418.320932:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787826418.320936:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165ec00, rc 0) 00000100:00100000:0.0:1787826418.321017:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03891680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55582:x1874670563898112:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1045us (1830us total) trans 8589934993 rc 0/0 00000100:00100000:0.0:1787826418.321030:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3824 00000100:00100000:1.0:1787826418.325822:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826418.325989:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563898368 00000100:00100000:2.0:1787826418.326003:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563898368 00000100:00100000:2.0:1787826418.326126:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1158 00000100:00100000:2.0:1787826418.326139:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1366a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55582:x1874670563898368:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:2.0:1787826418.326262:0:14257:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000405:0x1d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b8254f lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10b4 expref: 48 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.326315:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b8255d lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.326331:0:14257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b8252c lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10a6 expref: 48 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.326356:0:14257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b8255d lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.326402:0:14257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b8252c lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10a6 expref: 48 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.326417:0:14257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b8252c lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10a6 expref: 48 pid: 16564 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826418.326434:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f934b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585256704:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826418.326811:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a13840 going to sleep for 11 seconds 00000100:00100000:2.0:1787826418.330777:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f934b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585256704:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826418.330815:0:14257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b8255d lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826418.330973:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826418.331051:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563898496 00000100:00100000:3.0:1787826418.331059:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563898496 00010000:00010000:3.0:1787826418.331108:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b8252c lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10a6 expref: 49 pid: 16564 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826418.331151:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1179 00000100:00100000:3.0:1787826418.331172:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf185d9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:2403:x1874670563898496:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826418.331195:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826418.331204:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b8252c lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10a6 expref: 49 pid: 16564 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.331218:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b8252c lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10a6 expref: 49 pid: 16564 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.331249:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b8252c lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10a6 expref: 49 pid: 16564 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.331267:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826418.331274:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b8255d lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.331285:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b8255d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.331294:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b8255d lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.331334:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826418.331562:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf185d9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:2403:x1874670563898496:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 400us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826418.331572:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1179 00010000:00010000:1.0:1787826418.331730:0:14257:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b8255d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.331738:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b8255d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.331776:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82564 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.331789:0:14257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8253a lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10ad expref: 47 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.331797:0:14257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82564 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x2f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.331836:0:14257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8253a lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10ad expref: 47 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.331851:0:14257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8253a lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10ad expref: 47 pid: 6518 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826418.331992:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce044d0780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585256832:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826418.332061:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3780 going to sleep for 11 seconds 00000100:00100000:3.0:1787826418.335887:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826418.336013:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563898624 00000100:00100000:0.0:1787826418.336024:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563898624 00010000:00010000:0.0:1787826418.336079:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8253a lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10ad expref: 48 pid: 6518 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826418.336127:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1180 00000100:00100000:0.0:1787826418.336138:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03893c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:2403:x1874670563898624:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826418.336156:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826418.336175:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8253a lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10ad expref: 48 pid: 6518 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.336190:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8253a lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10ad expref: 48 pid: 6518 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.336221:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2f:0x0].0x0 (ffff90cf39e67800) 00010000:00010000:0.0:1787826418.336228:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82564 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x2f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.336239:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82564 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.336247:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82564 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x2f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.336270:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826418.336353:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03893c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:2403:x1874670563898624:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 216us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826418.336366:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1180 00010000:00010000:1.0:1787826418.337964:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8253a lrc: 0/0,0 mode: --/PR res: [0x200000405:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10ad expref: 47 pid: 6518 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826418.338004:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce044d0780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585256832:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826418.338039:0:14257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82564 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.338051:0:14257:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82564 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.338057:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82564 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826418.339091:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce044d0780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585256960:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1787826418.339186:0:14257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826418.339236:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3300 going to sleep for 11 seconds 00000100:00100000:2.0:1787826418.339321:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585256960 00000100:00100000:2.0:1787826418.339329:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585256960 00000100:00100000:2.0:1787826418.339438:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1459 00000100:00100000:2.0:1787826418.339448:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f809680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14257:x1874670585256960:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1787826418.339584:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f809680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14257:x1874670585256960:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 138us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826418.339593:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1459 00000100:00100000:3.0:1787826418.339845:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce044d0780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585256960:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:3.0:1787826418.339933:0:14257:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934994 00000001:00080000:3.0:1787826418.340014:0:14257:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934995 00010000:00010000:3.0:1787826418.340044:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82564 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.340054:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82564 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x2f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.340061:0:14257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82564 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x2f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.340068:0:14257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46ae00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826418.340073:0:14257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82564 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x2f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.340080:0:14257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82564 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x2f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.340101:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2f:0x0].0x0 (ffff90cf39e67800) 00010000:00010000:3.0:1787826418.340105:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787826418.340110:0:14257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82564 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x2f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.340117:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82564 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x2f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.340140:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b8255d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.340147:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b8255d lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.340152:0:14257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b8255d lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.340157:0:14257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826418.340159:0:14257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b8255d lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.340178:0:14257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b8255d lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.340187:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826418.340190:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787826418.340193:0:14257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b8255d lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.340199:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b8255d lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.340213:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826418.340216:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787826418.340224:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b8254f lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10b4 expref: 49 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826418.340351:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1366a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55582:x1874670563898368:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 14208us (14591us total) trans 8589934996 rc 0/0 00000100:00100000:3.0:1787826418.340360:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1158 00000020:00080000:3.0:1787826418.340365:0:14257:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1787826418.343564:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826418.343657:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563898752 00000100:00100000:0.0:1787826418.343669:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563898752 00000100:00100000:0.0:1787826418.343749:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3825 00000100:00100000:0.0:1787826418.343761:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03892d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55582:x1874670563898752:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826418.343793:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826418.343822:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b8256b lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab10bb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.344038:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b8256b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10bb expref: 49 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.344056:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b8256b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10bb expref: 49 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.344077:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826418.344080:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826418.344085:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165f600, rc 0) 00000100:00100000:0.0:1787826418.344152:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03892d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:55582:x1874670563898752:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 394us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826418.344169:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3825 00000100:00100000:0.0:1787826418.347049:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826418.347171:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563899008 00000100:00100000:1.0:1787826418.347183:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563899008 00000100:00100000:1.0:1787826418.347247:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1159 00000100:00100000:1.0:1787826418.347258:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:55582:x1874670563899008:12345-192.168.203.39@tcp:35:lfs.0 00000004:00080000:1.0:1787826418.348119:0:6521:0:(mdd_object.c:4014:mdd_close()) Object [0x200000405:0x2f:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787826418.348206:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].28, 64 off10464 00000004:00080000:1.0:1787826418.348219:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1364359747023ns, next at 1365359744490ns, rc = 0 00000001:00080000:1.0:1787826418.348227:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934997 00010000:00010000:1.0:1787826418.348276:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82572 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.348295:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82572 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.348309:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82572 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.348318:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82572 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.348326:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82572 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.348434:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82572 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.348459:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826418.348554:0:7460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826418.348563:0:7460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82572 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.348571:0:7460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46ba00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826418.348577:0:7460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82572 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.348586:0:7460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82572 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.348602:0:7460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2f:0x0].0x0 (ffff90cf3ab61e00) 00010000:00010000:0.0:1787826418.348605:0:7460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00000100:00100000:1.0:1787826418.349042:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+51:55582:x1874670563899008:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 1777us (1997us total) trans 8589934998 rc 0/0 00000100:00100000:1.0:1787826418.349053:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1159 00000020:00080000:1.0:1787826418.349060:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787826418.349107:0:7460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82572 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.349117:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82572 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.349142:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826418.349144:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826418.349146:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826418.353233:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826418.353302:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563899264 00000100:00100000:3.0:1787826418.353314:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563899264 00000100:00100000:3.0:1787826418.353386:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1160 00000100:00100000:3.0:1787826418.353398:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+51:55582:x1874670563899264:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:3.0:1787826418.354190:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+52:55582:x1874670563899264:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 790us (967us total) trans 8589934999 rc 0/0 00000100:00100000:3.0:1787826418.354200:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1160 00000100:00100000:0.0:1787826418.372971:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826418.373206:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563899392 00000100:00100000:2.0:1787826418.373219:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563899392 00000100:00100000:2.0:1787826418.373288:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3826 00000100:00100000:2.0:1787826418.373298:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+52:55584:x1874670563899392:12345-192.168.203.39@tcp:101:getfattr.0 00010000:00010000:2.0:1787826418.373327:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826418.373361:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b82579 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab10c2 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.373439:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b82580 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.373454:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b82580 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.373467:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b82580 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.373516:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82587 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.373524:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82587 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.373530:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82587 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.373888:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8258e lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.373899:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8258e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.373906:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8258e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826418.373956:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:2.0:1787826418.373961:0:16564:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826418.373985:0:16564:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8258e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.373998:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8258e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.374006:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b82580 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.374014:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b82580 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.374020:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b82580 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.374027:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826418.374031:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b82580 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.374038:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b82580 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.374052:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf39e67c00) 00010000:00010000:2.0:1787826418.374055:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826418.374060:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b82580 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.374067:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b82580 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.374086:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82587 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.374092:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82587 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.374097:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82587 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.374102:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826418.374105:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82587 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.374111:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82587 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.374118:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf39e67000) 00010000:00010000:2.0:1787826418.374119:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826418.374122:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82587 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.374127:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82587 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.374176:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b82579 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10c2 expref: 54 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.374192:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8258e lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10c2 expref: 53 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.374205:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826418.374207:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826418.374210:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834400, rc 0) 00000100:00100000:2.0:1787826418.374371:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55584:x1874670563899392:12345-192.168.203.39@tcp:101:getfattr.0 Request processed in 1072us (1412us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826418.374379:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3826 00000100:00100000:1.0:1787826418.386883:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826418.387229:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563899520 00000100:00100000:2.0:1787826418.387243:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563899520 00000100:00100000:2.0:1787826418.387369:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2124 00000100:00100000:2.0:1787826418.387383:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f80a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2401:x1874670563899520:12345-192.168.203.39@tcp:101:getfattr.0 00010000:00010000:2.0:1787826418.387410:0:30694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826418.387434:0:30694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c800962/0x22153cd396b82595 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab10c9 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826418.387540:0:30694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f934b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:30694:1874670585257088:192.168.203.39@tcp:106: 00000100:00100000:2.0:1787826418.387786:0:30694:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a13840 going to sleep for 11 seconds 00000100:00100000:2.0:1787826418.390072:0:30694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f934b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:30694:1874670585257088:192.168.203.39@tcp:106: 00010000:00010000:2.0:1787826418.390115:0:30694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008c800962/0x22153cd396b82595 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10c9 expref: 9 pid: 30694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.390138:0:30694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c800962/0x22153cd396b82595 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10c9 expref: 9 pid: 30694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.390150:0:30694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834800, rc 0) 00000100:00100000:2.0:1787826418.390241:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f80a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2401:x1874670563899520:12345-192.168.203.39@tcp:101:getfattr.0 Request processed in 2860us (3375us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826418.390250:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2124 00000100:00100000:0.0:1787826418.415033:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826418.415143:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563899648 00000100:00100000:3.0:1787826418.415157:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563899648 00000100:00100000:3.0:1787826418.415249:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3827 00000100:00100000:3.0:1787826418.415260:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8ae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55588:x1874670563899648:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:3.0:1787826418.415529:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b8259c lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.415553:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b8259c lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.415567:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b8259c lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.415583:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b825a3 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.415591:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b825a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.415598:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b825a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.416952:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b825aa lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.416977:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b825aa lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.416989:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b825aa lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826418.417053:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:2.0:1787826418.417058:0:9966:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826418.417077:0:9966:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b825aa lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.417094:0:9966:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b8259c lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.417101:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b8259c lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.417107:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b8259c lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.417115:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b8259c lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.417122:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826418.417127:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b8259c lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.417141:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b8259c lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.417157:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf06894b00) 00010000:00010000:2.0:1787826418.417170:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826418.417175:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b8259c lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.417182:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b8259c lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.417212:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b825a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.417218:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b825a3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.417223:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b825a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.417229:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826418.417232:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b825a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.417238:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b825a3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.417246:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf06894700) 00010000:00010000:2.0:1787826418.417249:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826418.417252:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b825a3 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.417262:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b825a3 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.417276:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b825aa lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.417282:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b825aa lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.417288:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b825aa lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.417293:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826418.417296:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b825aa lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.417302:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b825aa lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.417315:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826418.417317:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826418.417320:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b825aa lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.417325:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b825aa lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826418.417888:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8ae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55588:x1874670563899648:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 2622us (2863us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826418.417902:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3827 00000100:00100000:2.0:1787826418.436302:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f934b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585257344:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826418.436410:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826418.436485:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787826418.436493:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03890780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585257216:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787826418.436521:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826418.436600:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787826418.436609:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f937c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585257472:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787826418.436632:0:25628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585257344 00000100:00100000:2.0:1787826418.436635:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826418.436641:0:25628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585257344 00000100:00100000:2.0:1787826418.436707:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585257216 00000100:00100000:2.0:1787826418.436710:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585257216 00000100:00100000:2.0:1787826418.436731:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585257472 00000100:00100000:2.0:1787826418.436734:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585257472 00000100:00100000:2.0:1787826418.436752:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 782 00000100:00100000:2.0:1787826418.436939:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f937840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874670585257344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787826418.436980:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 160009024 pending 0 free 3920248832 avail 3688726528 00000100:00100000:2.0:1787826418.437035:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f937840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874670585257344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826418.437187:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787826418.437198:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03890f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585257600:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787826418.437231:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826418.437574:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 783 00000100:00100000:0.0:1787826418.437589:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f9343c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1874670585257216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787826418.437603:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 160009024 pending 0 free 3920248832 avail 3688726528 00000100:00100000:0.0:1787826418.437639:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f9343c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1874670585257216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (1117us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826418.437646:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 783 00000100:00100000:0.0:1787826418.437667:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585257600 00000100:00100000:0.0:1787826418.437671:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585257600 00000100:00100000:0.0:1787826418.437691:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 784 00000100:00100000:0.0:1787826418.437698:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f934000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874670585257472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787826418.437717:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 186235712 pending 0 free 3919187968 avail 3687665664 00000100:00100000:3.0:1787826418.437937:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f937c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585257472:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787826418.438094:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f934000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874670585257472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (1122us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826418.438101:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 784 00000100:00100000:0.0:1787826418.438116:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 785 00000100:00100000:0.0:1787826418.438124:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03891e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1874670585257600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787826418.438136:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 186235712 pending 0 free 3919187968 avail 3687665664 00000100:00100000:0.0:1787826418.438185:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03891e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1874670585257600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826418.438191:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 785 00000100:00100000:1.0:1787826418.438401:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826418.438519:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563899904 00000100:00100000:0.0:1787826418.438524:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563899904 00000100:00100000:0.0:1787826418.438570:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3828 00000100:00100000:0.0:1787826418.438577:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f80ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55590:x1874670563899904:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826418.438594:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826418.438621:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b825b1 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab10d0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826418.438673:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03890f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585257600:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787826418.438752:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b825b8 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.438787:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b825b8 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826418.438800:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 782 00010000:00010000:0.0:1787826418.438803:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b825b8 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826418.438816:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000100:00100000:2.0:1787826418.438854:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03890780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585257216:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787826418.438871:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f934b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585257344:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1787826418.438953:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b825b1 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10d0 expref: 56 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.438979:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b825b8 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10d0 expref: 55 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.438990:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826418.438993:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787826418.438997:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165e600, rc 0) 00000100:00100000:0.0:1787826418.439058:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f80ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+55:55590:x1874670563899904:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 482us (660us total) trans 8589935000 rc 0/0 00000100:00100000:0.0:1787826418.439065:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3828 00000100:00100000:0.0:1787826418.445292:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826418.445624:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563900032 00000100:00100000:3.0:1787826418.445639:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563900032 00000100:00100000:2.0:1787826418.445989:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2125 00000100:00100000:2.0:1787826418.446003:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8af840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2404:x1874670563900032:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826418.446026:0:30695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826418.446051:0:30695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c800962/0x22153cd396b825c6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab10d7 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826418.446140:0:30695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f934b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:30695:1874670585257728:192.168.203.39@tcp:106: 00000100:00100000:2.0:1787826418.446259:0:30695:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a13840 going to sleep for 11 seconds 00000100:00100000:2.0:1787826418.449019:0:30695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f934b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:30695:1874670585257728:192.168.203.39@tcp:106: 00010000:00010000:2.0:1787826418.449074:0:30695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008c800962/0x22153cd396b825c6 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10d7 expref: 9 pid: 30695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.449107:0:30695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c800962/0x22153cd396b825c6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10d7 expref: 9 pid: 30695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.449123:0:30695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834800, rc 0) 00000100:00100000:2.0:1787826418.449210:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8af840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2404:x1874670563900032:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 3209us (3933us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826418.449221:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2125 00000100:00100000:1.0:1787826418.453530:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826418.453760:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563900288 00000100:00100000:0.0:1787826418.453773:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563900288 00000100:00100000:0.0:1787826418.453851:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3829 00000100:00100000:0.0:1787826418.453862:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f808b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+55:55590:x1874670563900288:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826418.453898:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826418.453926:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b825cd lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab10de expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.454089:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b825d4 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.454107:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8258e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10c2 expref: 56 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.454117:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b825d4 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.454172:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8258e lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10c2 expref: 56 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.454189:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8258e lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10c2 expref: 56 pid: 16564 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826418.454206:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab16940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1874670585257856:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826418.454313:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a18cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826418.460707:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826418.460733:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab16940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1874670585257856:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826418.460964:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b825d4 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826418.460976:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563900416 00000100:00100000:3.0:1787826418.460984:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563900416 00010000:00010000:3.0:1787826418.461041:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8258e lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10c2 expref: 57 pid: 16564 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826418.461123:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1181 00000100:00100000:3.0:1787826418.461134:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab14f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+57:2404:x1874670563900416:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826418.461153:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826418.461174:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8258e lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10c2 expref: 57 pid: 16564 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.461188:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8258e lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10c2 expref: 57 pid: 16564 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.461215:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8258e lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10c2 expref: 57 pid: 16564 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.461240:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826418.461246:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b825d4 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.461257:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b825d4 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.461266:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b825d4 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.461299:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826418.461376:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab14f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+56:2404:x1874670563900416:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 243us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826418.461384:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1181 00010000:00010000:2.0:1787826418.461438:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b825d4 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.461446:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b825d4 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826418.461515:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:2.0:1787826418.461690:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b825cd lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10de expref: 57 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.461709:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b825d4 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10de expref: 56 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.461717:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826418.461721:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787826418.461724:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165ee00, rc 0) 00000100:00100000:2.0:1787826418.461754:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f808b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+56:55590:x1874670563900288:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 7895us (8240us total) trans 8589935001 rc 0/0 00000100:00100000:2.0:1787826418.461763:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3829 00000100:00100000:0.0:1787826418.467089:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826418.467196:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563900672 00000100:00100000:1.0:1787826418.467210:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563900672 00000100:00100000:1.0:1787826418.467287:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3830 00000100:00100000:1.0:1787826418.467299:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab16940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+56:55590:x1874670563900672:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826418.467331:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826418.467379:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b825e2 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab10e5 expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.468049:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b825e9 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.468070:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b825e9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.468084:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b825e9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826418.468096:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x30:0x0]: returning size 0 00010000:00010000:1.0:1787826418.468175:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b825e2 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10e5 expref: 59 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.468205:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b825e9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10e5 expref: 58 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.468216:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x30:0x0].0x0 (ffff90cf3ab61f00) 00010000:00010000:1.0:1787826418.468219:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826418.468224:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46bc00, rc 0) 00000100:00100000:1.0:1787826418.468315:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab16940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:55590:x1874670563900672:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1018us (1240us total) trans 8589935002 rc 0/0 00000100:00100000:1.0:1787826418.468324:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3830 00000100:00100000:0.0:1787826418.474790:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826418.475124:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563900928 00000100:00100000:3.0:1787826418.475136:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563900928 00000100:00100000:3.0:1787826418.475227:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3831 00000100:00100000:3.0:1787826418.475239:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:55590:x1874670563900928:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826418.475271:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826418.475305:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b825f7 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab10ec expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.475548:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b825fe lrc: 3/0,1 mode: --/EX res: [0x200000405:0x30:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.475566:0:9966:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b825e9 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10e5 expref: 59 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.475584:0:9966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b825fe lrc: 4/0,1 mode: --/EX res: [0x200000405:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.475632:0:9966:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b825e9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10e5 expref: 59 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.475647:0:9966:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b825e9 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10e5 expref: 59 pid: 32404 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826418.475664:0:9966:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03890f00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9966:1874670585257984:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826418.475766:0:9966:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce057f6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826418.478926:0:9966:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03890f00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9966:1874670585257984:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826418.478969:0:9966:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b825fe lrc: 3/0,1 mode: --/EX res: [0x200000405:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826418.480866:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826418.481124:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563901056 00000100:00100000:2.0:1787826418.481138:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563901056 00010000:00010000:2.0:1787826418.481210:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b825e9 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10e5 expref: 60 pid: 32404 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826418.481262:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1182 00000100:00100000:2.0:1787826418.481274:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03976940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:2403:x1874670563901056:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826418.481294:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826418.481302:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b825e9 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10e5 expref: 60 pid: 32404 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.481317:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b825e9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10e5 expref: 60 pid: 32404 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.481349:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b825e9 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10e5 expref: 60 pid: 32404 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.482172:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x30:0x0].0x0 (ffff90cf3ab61f00) 00010000:00010000:2.0:1787826418.482183:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b825fe lrc: 3/0,1 mode: --/EX res: [0x200000405:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.482196:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b825fe lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.482204:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b825fe lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.482248:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826418.482325:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03976940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:2403:x1874670563901056:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 1050us (1470us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826418.482334:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1182 00010000:00010000:3.0:1787826418.482605:0:9966:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b825fe lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x30:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.482615:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b825fe lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x30:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826418.482641:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x30:0x0]: returning size 0 00000004:00080000:3.0:1787826418.482859:0:9966:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x10a:0x0], index 1: 0 00010000:00010000:3.0:1787826418.483002:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b825fe lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x30:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.483010:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b825fe lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x30:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.483018:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b825fe lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x30:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.483025:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826418.483057:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b825fe lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x30:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.483065:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b825fe lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x30:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.483079:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x30:0x0].0x0 (ffff90cf3ab61f00) 00010000:00010000:3.0:1787826418.483082:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826418.483087:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b825fe lrc: 2/0,0 mode: --/EX res: [0x200000405:0x30:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.483094:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b825fe lrc: 0/0,0 mode: --/EX res: [0x200000405:0x30:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.483154:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b825f7 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x30:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10ec expref: 59 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.483178:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x30:0x0].0x0 (ffff90cf3ab61f00) 00010000:00010000:3.0:1787826418.483180:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787826418.483184:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b825f7 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x30:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10ec expref: 59 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.483202:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400400, rc 0) 00000100:00100000:3.0:1787826418.483267:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:55590:x1874670563900928:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 8029us (8495us total) trans 8589935003 rc 301/301 00000100:00100000:3.0:1787826418.483276:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3831 00000100:00100000:0.0:1787826418.488310:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826418.488566:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563901312 00000100:00100000:1.0:1787826418.488580:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563901312 00000100:00100000:1.0:1787826418.488650:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1161 00000100:00100000:1.0:1787826418.488874:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecaed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:55590:x1874670563901312:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:1.0:1787826418.489310:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecaed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55590:x1874670563901312:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 648us (1014us total) trans 8589935004 rc 0/0 00000100:00100000:1.0:1787826418.489319:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1161 00000100:00100000:1.0:1787826418.495260:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826418.495549:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563901440 00000100:00100000:0.0:1787826418.495563:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563901440 00000100:00100000:0.0:1787826418.495643:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3832 00000100:00100000:0.0:1787826418.495656:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55590:x1874670563901440:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826418.495691:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826418.495721:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b8260c lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab10f3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.496006:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b82613 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.496024:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b825d4 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10de expref: 60 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.496040:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b82613 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.496085:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b825d4 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10de expref: 60 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.496100:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b825d4 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10de expref: 60 pid: 6519 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826418.496116:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf1ecafc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1874670585258112:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826418.496296:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a18540 going to sleep for 11 seconds 00000100:00100000:2.0:1787826418.498849:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf1ecafc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1874670585258112:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826418.498886:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b82613 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826418.500610:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826418.500987:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563901568 00000100:00100000:2.0:1787826418.501000:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563901568 00010000:00010000:2.0:1787826418.501050:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b825d4 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10de expref: 61 pid: 6519 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826418.501144:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1183 00000100:00100000:2.0:1787826418.501156:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+61:2404:x1874670563901568:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826418.501199:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826418.501212:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b825d4 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10de expref: 61 pid: 6519 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.501228:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b825d4 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10de expref: 61 pid: 6519 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.501258:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b825d4 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10de expref: 61 pid: 6519 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.501280:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826418.501286:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b82613 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.501296:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b82613 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.501304:0:10340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b82613 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.501345:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826418.501421:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:2404:x1874670563901568:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 266us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826418.501429:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1183 00010000:00010000:0.0:1787826418.502203:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b82613 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.502218:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b82613 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826418.502286:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:0.0:1787826418.502292:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826418.502319:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b82613 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.502380:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b8260c lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10f3 expref: 60 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.502403:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b82613 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10f3 expref: 59 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.502418:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826418.502421:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826418.502426:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165e400, rc 0) 00000100:00100000:0.0:1787826418.502735:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55590:x1874670563901440:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 7072us (7481us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826418.502744:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3832 00000100:00100000:1.0:1787826418.505778:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826418.506749:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563901696 00000100:00100000:2.0:1787826418.506764:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563901696 00000100:00100000:2.0:1787826418.506842:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2126 00000100:00100000:2.0:1787826418.506853:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2404:x1874670563901696:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826418.506881:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826418.506903:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002904bac2/0x22153cd396b8261a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab10fa expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826418.506982:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f934b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1874670585258240:192.168.203.39@tcp:106: 00000100:00100000:2.0:1787826418.507083:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a13840 going to sleep for 11 seconds 00000100:00100000:1.0:1787826418.510196:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f934b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1874670585258240:192.168.203.39@tcp:106: 00010000:00010000:1.0:1787826418.510251:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002904bac2/0x22153cd396b8261a lrc: 1/0,0 mode: --/PR res: [0x280000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10fa expref: 9 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.510282:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002904bac2/0x22153cd396b8261a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10fa expref: 9 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.510297:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835a00, rc 0) 00000100:00100000:1.0:1787826418.510394:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2404:x1874670563901696:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 3540us (4627us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826418.510404:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2126 00000100:00100000:1.0:1787826418.513825:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826418.513978:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563901824 00000100:00100000:2.0:1787826418.513991:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563901824 00000100:00100000:2.0:1787826418.514061:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3833 00000100:00100000:2.0:1787826418.514072:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03985a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55590:x1874670563901824:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826418.514099:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826418.514129:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b82621 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1101 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.514238:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82628 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.514255:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82628 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.514269:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82628 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826418.514345:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x30:0x0]: returning size 0 00000004:00200000:2.0:1787826418.514351:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826418.514375:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82628 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.514410:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b82621 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1101 expref: 61 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.514433:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82628 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1101 expref: 60 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.514443:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x30:0x0].0x0 (ffff90cf39e67c00) 00010000:00010000:2.0:1787826418.514446:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787826418.514450:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834c00, rc 0) 00000100:00100000:2.0:1787826418.514590:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03985a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:55590:x1874670563901824:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 520us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826418.514598:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3833 00000100:00100000:1.0:1787826418.526087:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826418.526294:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563901952 00000100:00100000:0.0:1787826418.526306:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563901952 00000100:00100000:0.0:1787826418.526384:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2127 00000100:00100000:0.0:1787826418.526397:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03984f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2403:x1874670563901952:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826418.526422:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826418.526446:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091cba634/0x22153cd396b8262f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x10a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1108 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826418.526674:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826418.526703:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10a:0x0].0x0 since=1364s v=(0 0) 00010000:00010000:0.0:1787826418.526708:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826418.526721:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091cba634/0x22153cd396b8262f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1108 expref: 12 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.526743:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000091cba634/0x22153cd396b8262f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1108 expref: 12 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.526760:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165f400, rc 0) 00000100:00100000:0.0:1787826418.526830:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03984f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563901952:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 435us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826418.526839:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2127 00000100:00100000:0.0:1787826418.531649:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826418.531878:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563902208 00000100:00100000:3.0:1787826418.531892:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563902208 00000100:00100000:3.0:1787826418.531970:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3834 00000100:00100000:3.0:1787826418.531983:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecacf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:55590:x1874670563902208:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826418.532013:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826418.532040:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b82636 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab110f expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.532198:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b8263d lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.532218:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b8263d lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.532232:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b8263d lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826418.532249:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:3.0:1787826418.532627:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b82636 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab110f expref: 63 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.532652:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b8263d lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab110f expref: 62 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.532663:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826418.532666:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787826418.532670:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401800, rc 0) 00000100:00100000:2.0:1787826418.533035:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecacf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+62:55590:x1874670563902208:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1051us (1576us total) trans 8589935005 rc 0/0 00000100:00100000:2.0:1787826418.533045:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3834 00000100:00100000:1.0:1787826418.535952:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826418.536049:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563902336 00000100:00100000:3.0:1787826418.536061:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563902336 00000100:00100000:3.0:1787826418.536133:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2128 00000100:00100000:3.0:1787826418.536145:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03987840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2403:x1874670563902336:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826418.536177:0:28853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826418.536201:0:28853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b8264b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1116 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826418.536281:0:28853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce038930c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28853:1874670585258368:192.168.203.39@tcp:106: 00000100:00100000:3.0:1787826418.536390:0:28853:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf117b0000 going to sleep for 11 seconds 00000100:00100000:3.0:1787826418.539138:0:28853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce038930c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28853:1874670585258368:192.168.203.39@tcp:106: 00010000:00010000:3.0:1787826418.539204:0:28853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b8264b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1116 expref: 9 pid: 28853 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.539237:0:28853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b8264b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1116 expref: 9 pid: 28853 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.539252:0:28853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400c00, rc 0) 00000100:00100000:3.0:1787826418.539322:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03987840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2403:x1874670563902336:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 3179us (3384us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826418.539341:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2128 00000100:00100000:2.0:1787826418.543202:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826418.543311:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563902464 00000100:00100000:1.0:1787826418.543322:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563902464 00000100:00100000:1.0:1787826418.543811:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2129 00000100:00100000:1.0:1787826418.543824:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f936940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2403:x1874670563902464:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826418.543849:0:30696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826418.543873:0:30696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003eb46645/0x22153cd396b82652 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab111d expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826418.543953:0:30696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce039852c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:30696:1874670585258496:192.168.203.39@tcp:106: 00000100:00100000:1.0:1787826418.544066:0:30696:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3780 going to sleep for 11 seconds 00000100:00100000:3.0:1787826418.546446:0:30696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce039852c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:30696:1874670585258496:192.168.203.39@tcp:106: 00010000:00010000:3.0:1787826418.546541:0:30696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003eb46645/0x22153cd396b82652 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab111d expref: 9 pid: 30696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.546574:0:30696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003eb46645/0x22153cd396b82652 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab111d expref: 9 pid: 30696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.546589:0:30696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46ba00, rc 0) 00000100:00100000:3.0:1787826418.546661:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f936940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2403:x1874670563902464:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 2839us (3544us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826418.546673:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2129 00000100:00100000:1.0:1787826418.549992:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826418.550111:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563902592 00000100:00100000:0.0:1787826418.550125:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563902592 00000100:00100000:0.0:1787826418.550244:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2130 00000100:00100000:0.0:1787826418.550256:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03985680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2404:x1874670563902592:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:0.0:1787826418.550340:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005a67399c/0x22153cd396b82659 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.550513:0:14864:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a4b5afc1/0x22153cd396b82484 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1075 expref: 8 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.550525:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x109:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826418.550530:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x109:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826418.550535:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a67399c/0x22153cd396b82659 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.550583:0:14864:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a4b5afc1/0x22153cd396b82484 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1075 expref: 8 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.550599:0:14864:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a4b5afc1/0x22153cd396b82484 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1075 expref: 8 pid: 14864 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826418.550617:0:14864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf1ecac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14864:1874670585258624:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826418.550724:0:14864:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a18f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826418.553269:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826418.553355:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563902720 00000100:00100000:3.0:1787826418.553366:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563902720 00010000:00010000:3.0:1787826418.553422:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a4b5afc1/0x22153cd396b82484 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1075 expref: 9 pid: 14864 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826418.553513:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1184 00000100:00100000:3.0:1787826418.553524:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03986580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563902720:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826418.553544:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826418.553574:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a4b5afc1/0x22153cd396b82484 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x109:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1075 expref: 9 pid: 14864 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.553590:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a4b5afc1/0x22153cd396b82484 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x109:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1075 expref: 9 pid: 14864 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.553622:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x109:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826418.553628:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x109:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826418.553635:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005a67399c/0x22153cd396b82659 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x109:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.553647:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a67399c/0x22153cd396b82659 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x109:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.553671:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826418.553728:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03986580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563902720:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 206us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826418.553738:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1184 00010000:00010000:0.0:1787826418.554229:0:14864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4b5afc1/0x22153cd396b82484 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1075 expref: 8 pid: 14864 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826418.554253:0:14864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf1ecac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14864:1874670585258624:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826418.554277:0:14864:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005a67399c/0x22153cd396b82659 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x109:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.554289:0:14864:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005a67399c/0x22153cd396b82659 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x109:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.554296:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a67399c/0x22153cd396b82659 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x109:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.554324:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005a67399c/0x22153cd396b82659 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x109:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.554333:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a67399c/0x22153cd396b82659 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x109:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.554354:0:14864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a67399c/0x22153cd396b82659 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x109:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.554362:0:14864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165fc00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826418.554366:0:14864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a67399c/0x22153cd396b82659 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x109:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.554381:0:14864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a67399c/0x22153cd396b82659 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x109:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.554397:0:14864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a67399c/0x22153cd396b82659 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x109:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.554405:0:14864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a67399c/0x22153cd396b82659 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x109:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826418.554672:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03985680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2404:x1874670563902592:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 4416us (4695us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826418.554684:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2130 00000100:00100000:1.0:1787826418.558908:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826418.559022:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563902848 00000100:00100000:0.0:1787826418.559035:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563902848 00000100:00100000:0.0:1787826418.559107:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2131 00000100:00100000:0.0:1787826418.559120:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03986940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2403:x1874670563902848:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826418.559144:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826418.559199:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a67399c/0x22153cd396b82660 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x109:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1124 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826418.559234:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x109:0x0] initial LVB size: 0, mtime: 0x6a9010ec, atime: 0x6a9010ec, ctime: 0x6a9010f2, blocks: 0x0 00010000:00010000:0.0:1787826418.559262:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x109:0x0].0x0 since=1364s v=(0 0) 00010000:00010000:0.0:1787826418.559268:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x109:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826418.559279:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a67399c/0x22153cd396b82660 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x109:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1124 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.559304:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005a67399c/0x22153cd396b82660 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x109:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1124 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.559320:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165fc00, rc 0) 00000100:00100000:0.0:1787826418.559418:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03986940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2403:x1874670563902848:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 300us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826418.559427:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2131 00000100:00100000:1.0:1787826418.606829:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826418.606990:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563902976 00000100:00100000:3.0:1787826418.607006:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563902976 00000100:00100000:3.0:1787826418.607091:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3835 00000100:00100000:3.0:1787826418.607104:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03986d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+62:55590:x1874670563902976:12345-192.168.203.39@tcp:44:lfs.0 00000001:00080000:0.0:1787826418.611625:0:34481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935005 is committed 00000004:00080000:0.0:1787826418.611682:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 28 committed 00000020:00080000:0.0:1787826418.611735:0:34481:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90cf1850c840 refcount 2 committed 0 result 0 batchid 4294969337 00000020:00080000:0.0:1787826418.611742:0:34481:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cf092f4400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90cf1850cf00 00000020:00080000:0.0:1787826418.611746:0:34481:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cf092f4600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90cf3a951400 00000020:00080000:0.0:1787826418.611773:0:34481:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969336 batchid updated 00000100:00100000:0.0:1787826418.611967:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03986d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:55590:x1874670563902976:12345-192.168.203.39@tcp:44:lfs.0 Request processed in 4858us (5147us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826418.611980:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3835 00000020:00080000:3.0:1787826418.612131:0:34512:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969337 committed batchid 4294969336 00000020:00080000:3.0:1787826418.612228:0:34512:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969336 00000100:00100000:3.0:1787826418.612672:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787826418.612695:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f934780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585258752:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787826418.612763:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826418.612948:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585258752 00000100:00100000:2.0:1787826418.612957:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585258752 00000100:00100000:2.0:1787826418.613014:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2132 00000100:00100000:2.0:1787826418.613025:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce038930c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3645:x1874670585258752:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787826418.613058:0:8545:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:265 count 1 00010000:00010000:2.0:1787826418.613092:0:8545:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000159f1fa4/0x22153cd396b82667 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.613121:0:8545:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a8fb1ffc/0x22153cd396b82492 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab107c expref: 11 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.613133:0:8545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x109:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826418.613139:0:8545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x109:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826418.613145:0:8545:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000159f1fa4/0x22153cd396b82667 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.613189:0:8545:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a8fb1ffc/0x22153cd396b82492 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab107c expref: 11 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.613205:0:8545:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a8fb1ffc/0x22153cd396b82492 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab107c expref: 11 pid: 8545 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826418.613218:0:8545:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f936580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8545:1874670585258880:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826418.613295:0:8545:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a139c0 going to sleep for 11 seconds 00010000:00010000:1.0:1787826418.613526:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b82476 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.613536:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b82476 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.613544:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b82476 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.613551:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826418.617524:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b82476 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.617565:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b82476 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.617593:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2e:0x0].0x0 (ffff90cf06894300) 00010000:00010000:1.0:1787826418.617597:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826418.617604:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b82476 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.617611:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b82476 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826418.617616:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00010000:00010000:1.0:1787826418.617664:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b8248b lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.617678:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b8248b lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.617685:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b8248b lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.617692:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826418.617696:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b8248b lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.617703:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b8248b lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.617711:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826418.617713:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826418.617716:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b8248b lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.617722:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b8248b lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826418.617947:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563903104 00000100:00100000:2.0:1787826418.617961:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563903104 00000100:00100000:2.0:1787826418.618032:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2133 00000100:00100000:2.0:1787826418.618044:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf2f791450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563903104:12345-192.168.203.39@tcp:16:lfs.0 00000100:00100000:2.0:1787826418.618205:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf2f791450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563903104:12345-192.168.203.39@tcp:16:lfs.0 Request processed in 163us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826418.618214:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2133 00000100:00100000:3.0:1787826418.619736:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826418.619887:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563903232 00000100:00100000:0.0:1787826418.619897:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563903232 00010000:00010000:0.0:1787826418.619944:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a8fb1ffc/0x22153cd396b82492 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab107c expref: 12 pid: 8545 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826418.619981:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1185 00000100:00100000:0.0:1787826418.619992:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03890b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563903232:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826418.620015:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826418.620021:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a8fb1ffc/0x22153cd396b82492 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x109:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab107c expref: 12 pid: 8545 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.620036:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a8fb1ffc/0x22153cd396b82492 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x109:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab107c expref: 12 pid: 8545 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.620069:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x109:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826418.620074:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x109:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826418.620082:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000159f1fa4/0x22153cd396b82667 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x109:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.620094:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000159f1fa4/0x22153cd396b82667 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x109:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.620119:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826418.620185:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03890b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563903232:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 194us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826418.620193:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1185 00010000:00010000:2.0:1787826418.620310:0:8545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8fb1ffc/0x22153cd396b82492 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab107c expref: 11 pid: 8545 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826418.620330:0:8545:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f936580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8545:1874670585258880:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826418.620375:0:8545:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000159f1fa4/0x22153cd396b82667 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x109:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.620393:0:8545:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000159f1fa4/0x22153cd396b82667 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x109:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.620401:0:8545:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000159f1fa4/0x22153cd396b82667 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x109:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.620413:0:8545:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000159f1fa4/0x22153cd396b82667 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x109:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.620422:0:8545:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000159f1fa4/0x22153cd396b82667 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x109:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.620451:0:8545:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787826418.620697:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce038930c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3645:x1874670585258752:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7673us (7932us total) trans 17179869668 rc 0/0 00000100:00100000:2.0:1787826418.620705:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2132 00000004:00080000:2.0:1787826418.620909:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3f934780/2, rc 0, transno 17179869668 00000100:00100000:2.0:1787826418.620916:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f934780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585258752:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1787826418.621048:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826418.621056:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000159f1fa4/0x22153cd396b82667 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x109:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.621065:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835800 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826418.621070:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000159f1fa4/0x22153cd396b82667 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x109:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.621086:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000159f1fa4/0x22153cd396b82667 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x109:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.621105:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000159f1fa4/0x22153cd396b82667 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x109:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.621114:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000159f1fa4/0x22153cd396b82667 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x109:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.621136:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826418.621138:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826418.621140:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826418.636588:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826418.636704:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563903360 00000100:00100000:2.0:1787826418.636719:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563903360 00000100:00100000:2.0:1787826418.636807:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2134 00000100:00100000:2.0:1787826418.636820:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03987c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2403:x1874670563903360:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:2.0:1787826418.636887:0:30694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000159f1fa4/0x22153cd396b8266e lrc: 3/1,0 mode: --/PR res: [0x280000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.636914:0:30694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x109:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826418.636920:0:30694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x109:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826418.636928:0:30694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000159f1fa4/0x22153cd396b8266e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.636944:0:30694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000159f1fa4/0x22153cd396b8266e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.636979:0:30694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000159f1fa4/0x22153cd396b8266e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.636988:0:30694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000159f1fa4/0x22153cd396b8266e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.636996:0:30694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000159f1fa4/0x22153cd396b8266e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.637005:0:30694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835800 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826418.637010:0:30694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000159f1fa4/0x22153cd396b8266e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.637021:0:30694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000159f1fa4/0x22153cd396b8266e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.637039:0:30694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000159f1fa4/0x22153cd396b8266e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.637048:0:30694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000159f1fa4/0x22153cd396b8266e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826418.637145:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03987c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2403:x1874670563903360:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 327us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826418.637154:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2134 00000100:00100000:3.0:1787826418.640367:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826418.640525:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563903616 00000100:00100000:0.0:1787826418.640538:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563903616 00000100:00100000:0.0:1787826418.640616:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3836 00000100:00100000:0.0:1787826418.640627:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03893480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:55590:x1874670563903616:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:0.0:1787826418.640714:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826418.640749:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82628 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1101 expref: 33 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.640783:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x30:0x0].0x0 (ffff90cf39e67c00) 00010000:00010000:0.0:1787826418.640801:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826418.640849:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b82675 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.640867:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b82675 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.640881:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b82675 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826418.641058:0:6518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000045f60a67 reply state 00000000f18d32a5 transno 8589935006 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b82675 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.641074:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b82675 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.641081:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x30:0x0].0x0 (ffff90ce036ca200) 00010000:00010000:0.0:1787826418.641084:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826418.641087:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787826418.641233:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03893480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:55590:x1874670563903616:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 606us (892us total) trans 8589935006 rc 0/0 00000100:00100000:0.0:1787826418.641240:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3836 00000100:00100000:1.0:1787826418.644704:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826418.644991:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563903744 00000100:00100000:0.0:1787826418.645004:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563903744 00000100:00100000:0.0:1787826418.645086:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3837 00000100:00100000:0.0:1787826418.645099:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03984780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:55590:x1874670563903744:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826418.645135:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826418.645172:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b8267c lrc: 2/0,0 mode: --/CR res: [0x200000405:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab112b expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.645249:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b8267c lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x30:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab112b expref: 35 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.645266:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b8267c lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x30:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab112b expref: 35 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.645294:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x30:0x0].0x0 (ffff90ce036ca200) 00010000:00010000:0.0:1787826418.645297:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826418.645302:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165ee00, rc 0) 00000100:00100000:0.0:1787826418.645389:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03984780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:55590:x1874670563903744:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 293us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826418.645397:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3837 00000100:00100000:1.0:1787826418.648694:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826418.648807:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563903872 00000100:00100000:2.0:1787826418.648820:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563903872 00000100:00100000:2.0:1787826418.648895:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2135 00000100:00100000:2.0:1787826418.648906:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce039861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:55590:x1874670563903872:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826418.648928:0:30695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826418.648951:0:30695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000159f1fa4/0x22153cd396b82683 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1132 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.648991:0:30695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000091cba634/0x22153cd396b8262f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1108 expref: 12 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.649002:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826418.649007:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826418.649013:0:30695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000159f1fa4/0x22153cd396b82683 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1132 expref: 12 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.649057:0:30695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000091cba634/0x22153cd396b8262f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1108 expref: 12 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.649081:0:30695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000091cba634/0x22153cd396b8262f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1108 expref: 12 pid: 8435 timeout: 1464 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826418.649099:0:30695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f936940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:30695:1874670585259008:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826418.649218:0:30695:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a139c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826418.652039:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826418.652155:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563904000 00000100:00100000:1.0:1787826418.652175:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563904000 00010000:00010000:1.0:1787826418.652231:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000091cba634/0x22153cd396b8262f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1108 expref: 13 pid: 8435 timeout: 1464 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826418.652284:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1186 00000100:00100000:1.0:1787826418.652295:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf185dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2403:x1874670563904000:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826418.652314:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826418.652360:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000091cba634/0x22153cd396b8262f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x10a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1108 expref: 13 pid: 8435 timeout: 1464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.652377:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000091cba634/0x22153cd396b8262f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x10a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1108 expref: 13 pid: 8435 timeout: 1464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.652411:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826418.652417:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826418.652426:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000159f1fa4/0x22153cd396b82683 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1132 expref: 13 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.652438:0:10340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000159f1fa4/0x22153cd396b82683 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x10a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1132 expref: 13 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.652553:0:10340:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000159f1fa4/0x22153cd396b82683 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x10a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1132 expref: 13 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826418.652572:0:10340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03984000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10340:1874670585259136:192.168.203.39@tcp:105: 00000100:00100000:1.0:1787826418.652684:0:10340:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3300 going to sleep for 11 seconds 00010000:00010000:2.0:1787826418.653187:0:30695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091cba634/0x22153cd396b8262f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x10a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1108 expref: 13 pid: 8435 timeout: 1464 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826418.653209:0:30695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f936940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:30695:1874670585259008:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826418.653241:0:30695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000159f1fa4/0x22153cd396b82683 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1132 expref: 12 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.653254:0:30695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835800, rc 0) 00000100:00100000:2.0:1787826418.653306:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce039861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:55590:x1874670563903872:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 4401us (4625us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826418.653316:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2135 00000100:00100000:1.0:1787826418.657224:0:10340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03984000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10340:1874670585259136:192.168.203.39@tcp:105: 00010000:00010000:1.0:1787826418.657263:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826418.658059:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf185dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2403:x1874670563904000:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5760us (6030us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826418.658074:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1186 00000100:00100000:1.0:1787826418.659298:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826418.659595:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563904128 00000100:00100000:0.0:1787826418.659607:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563904128 00000100:00100000:0.0:1787826418.659744:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2136 00000100:00100000:0.0:1787826418.659766:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03986580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2403:x1874670563904128:12345-192.168.203.39@tcp:2:lfs.0 00002000:00010000:0.0:1787826418.659989:0:8437:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x10a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787826418.659993:0:8437:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x10a:0x0] updating lvb mtime from disk: 0 -> 1787826412 00002000:00010000:0.0:1787826418.659996:0:8437:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x10a:0x0] updating lvb atime from disk: 0 -> 1787826412 00002000:00010000:0.0:1787826418.659998:0:8437:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x10a:0x0] updating lvb ctime from disk: 0 -> 1787826419 00002000:00010000:0.0:1787826418.660000:0:8437:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x10a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1787826418.660175:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03986580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563904128:12345-192.168.203.39@tcp:2:lfs.0 Request processed in 420us (884us total) trans 17179869669 rc 0/0 00000100:00100000:0.0:1787826418.660187:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2136 00000100:00100000:0.0:1787826418.663571:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826418.663740:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563904384 00000100:00100000:2.0:1787826418.663754:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563904384 00000100:00100000:2.0:1787826418.663842:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3838 00000100:00100000:2.0:1787826418.663854:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:55590:x1874670563904384:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:2.0:1787826418.663987:0:8247:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826418.664028:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b82613 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10f3 expref: 35 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.664056:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826418.664063:0:8247:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826418.664130:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b8268a lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.664146:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b8268a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.664275:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b8268a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826418.664619:0:8247:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000931de474 reply state 00000000696db621 transno 8589935007 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b8268a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.664634:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b8268a lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.664641:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826418.664644:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826418.664647:0:8247:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826418.664763:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55590:x1874670563904384:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 910us (1200us total) trans 8589935007 rc 0/0 00000100:00100000:2.0:1787826418.664776:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3838 00000100:00100000:3.0:1787826418.667064:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826418.667185:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563904512 00000100:00100000:0.0:1787826418.667197:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563904512 00000100:00100000:0.0:1787826418.667272:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2137 00000100:00100000:0.0:1787826418.667283:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03893840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:55590:x1874670563904512:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826418.667305:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826418.667328:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e32bc9b1/0x22153cd396b82691 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1139 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.667637:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005a67399c/0x22153cd396b82660 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1124 expref: 9 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.667649:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x109:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826418.667654:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x109:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826418.667725:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e32bc9b1/0x22153cd396b82691 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1139 expref: 9 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.667973:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005a67399c/0x22153cd396b82660 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1124 expref: 9 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.667992:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005a67399c/0x22153cd396b82660 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1124 expref: 9 pid: 8437 timeout: 1464 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826418.668010:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf1ecad2c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1874670585259264:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826418.668177:0:8435:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a18180 going to sleep for 11 seconds 00000100:00100000:0.0:1787826418.671828:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf1ecad2c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1874670585259264:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826418.671877:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e32bc9b1/0x22153cd396b82691 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1139 expref: 9 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.671903:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165e000, rc 0) 00000100:00100000:0.0:1787826418.671980:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03893840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:55590:x1874670563904512:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 4698us (4928us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826418.671991:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2137 00000100:00100000:1.0:1787826418.673953:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826418.674047:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563904640 00000100:00100000:2.0:1787826418.674058:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563904640 00010000:00010000:2.0:1787826418.674110:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005a67399c/0x22153cd396b82660 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1124 expref: 9 pid: 8437 timeout: 1464 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826418.674170:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1187 00000100:00100000:2.0:1787826418.674182:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03984000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563904640:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826418.674202:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826418.674229:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005a67399c/0x22153cd396b82660 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x109:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1124 expref: 9 pid: 8437 timeout: 1464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.674245:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005a67399c/0x22153cd396b82660 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x109:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1124 expref: 9 pid: 8437 timeout: 1464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.674275:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a67399c/0x22153cd396b82660 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x109:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1124 expref: 9 pid: 8437 timeout: 1464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.674298:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x109:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826418.674303:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x109:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826418.674311:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e32bc9b1/0x22153cd396b82691 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1139 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.674323:0:10341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e32bc9b1/0x22153cd396b82691 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1139 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.674388:0:10341:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e32bc9b1/0x22153cd396b82691 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1139 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826418.674406:0:10341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f936940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10341:1874670585259392:192.168.203.39@tcp:105: 00000100:00100000:2.0:1787826418.674555:0:10341:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a13840 going to sleep for 11 seconds 00000100:00100000:2.0:1787826418.676905:0:10341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f936940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10341:1874670585259392:192.168.203.39@tcp:105: 00010000:00010000:2.0:1787826418.676943:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826418.677015:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03984000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2404:x1874670563904640:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 2833us (3073us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826418.677028:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1187 00000100:00100000:1.0:1787826418.679439:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826418.679572:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563904768 00000100:00100000:3.0:1787826418.679584:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563904768 00000100:00100000:3.0:1787826418.679760:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2138 00000100:00100000:3.0:1787826418.679772:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03984f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2403:x1874670563904768:12345-192.168.203.39@tcp:2:lfs.0 00002000:00010000:3.0:1787826418.679975:0:28853:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x109:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787826418.679979:0:28853:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x109:0x0] updating lvb mtime from disk: 1787826412 -> 1787826412 00002000:00010000:3.0:1787826418.679982:0:28853:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x109:0x0] updating lvb atime from disk: 1787826412 -> 1787826412 00002000:00010000:3.0:1787826418.679985:0:28853:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x109:0x0] updating lvb ctime from disk: 1787826418 -> 1787826419 00002000:00010000:3.0:1787826418.679987:0:28853:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x109:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1787826418.680063:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03984f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670563904768:12345-192.168.203.39@tcp:2:lfs.0 Request processed in 292us (737us total) trans 21474837010 rc 0/0 00000100:00100000:3.0:1787826418.680073:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2138 00000100:00100000:1.0:1787826418.682169:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826418.682257:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563905024 00000100:00100000:3.0:1787826418.682270:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563905024 00000100:00100000:3.0:1787826418.682356:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1162 00000100:00100000:3.0:1787826418.682370:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eea5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55590:x1874670563905024:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:3.0:1787826418.682504:0:14257:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000405:0x1d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b8263d lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab110f expref: 36 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.682559:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b82698 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.682575:0:14257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b8256b lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10bb expref: 36 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.682583:0:14257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b825b8 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10d0 expref: 36 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.682592:0:14257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b82698 lrc: 5/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.682635:0:14257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b825b8 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10d0 expref: 36 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.682650:0:14257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b825b8 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10d0 expref: 36 pid: 6518 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826418.682792:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03893c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585259520:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826418.683010:0:14257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b8256b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10bb expref: 36 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.683020:0:14257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b8256b lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10bb expref: 36 pid: 6519 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826418.683030:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03890b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585259648:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826418.683058:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf117b0000 going to sleep for 11 seconds 00000100:00100000:0.0:1787826418.687565:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826418.687631:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826418.687876:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563905408 00000100:00100000:2.0:1787826418.687889:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563905408 00010000:00010000:2.0:1787826418.687947:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b8256b lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10bb expref: 37 pid: 6519 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826418.688002:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1188 00000100:00100000:2.0:1787826418.688013:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecada40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:2403:x1874670563905408:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826418.688034:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826418.688042:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b8256b lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10bb expref: 37 pid: 6519 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.688056:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b8256b lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10bb expref: 37 pid: 6519 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.688085:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826418.688092:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b82698 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.688103:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b82698 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.688111:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826418.688180:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecada40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:2403:x1874670563905408:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 168us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826418.688193:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1188 00000100:00100000:1.0:1787826418.688312:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563905280 00000100:00100000:1.0:1787826418.688317:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563905280 00000100:00100000:1.0:1787826418.688493:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1163 00000100:00100000:1.0:1787826418.688503:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:42220:x1874670563905280:12345-192.168.203.39@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787826418.688879:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:42220:x1874670563905280:12345-192.168.203.39@tcp:35:ldlm_bl.0 Request processed in 377us (1328us total) trans 8589935008 rc 0/0 00000100:00100000:1.0:1787826418.688886:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1163 00000100:00100000:3.0:1787826418.689128:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03893c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585259520:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826418.689144:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b8256b lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10bb expref: 37 pid: 6519 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826418.689174:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03890b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585259648:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826418.689207:0:14257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b82698 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826418.691946:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826418.692070:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563905536 00000100:00100000:2.0:1787826418.692083:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563905536 00010000:00010000:2.0:1787826418.692134:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b825b8 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10d0 expref: 37 pid: 6518 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826418.692237:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1189 00000100:00100000:2.0:1787826418.692248:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03987840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:2401:x1874670563905536:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826418.692269:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826418.692278:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b825b8 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10d0 expref: 37 pid: 6518 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.692293:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b825b8 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10d0 expref: 37 pid: 6518 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.692324:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b825b8 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab10d0 expref: 37 pid: 6518 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.692359:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826418.692367:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b82698 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.692379:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b82698 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.692388:0:10340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b82698 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.692433:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826418.692545:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03987840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:2401:x1874670563905536:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 298us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826418.692554:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1189 00010000:00010000:3.0:1787826418.692636:0:14257:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b82698 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.692645:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b82698 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.692681:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b8269f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x30:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.692694:0:14257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b8267c lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab112b expref: 35 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.692710:0:14257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b8269f lrc: 4/0,1 mode: --/EX res: [0x200000405:0x30:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.692750:0:14257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b8267c lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab112b expref: 35 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.692777:0:14257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b8267c lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab112b expref: 35 pid: 32404 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826418.692793:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03890b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585259776:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826418.692856:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf117b0000 going to sleep for 11 seconds 00000100:00100000:1.0:1787826418.696091:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826418.696572:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563905664 00000100:00100000:2.0:1787826418.696585:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563905664 00010000:00010000:2.0:1787826418.696636:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b8267c lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab112b expref: 36 pid: 32404 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826418.696694:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1190 00000100:00100000:2.0:1787826418.696705:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03985680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:2403:x1874670563905664:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826418.696727:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826418.696736:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b8267c lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab112b expref: 36 pid: 32404 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.696751:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b8267c lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab112b expref: 36 pid: 32404 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.696791:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x30:0x0].0x0 (ffff90ce036ca200) 00010000:00010000:2.0:1787826418.696797:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b8269f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x30:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.696809:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b8269f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x30:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.696818:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b8269f lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x30:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.696847:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826418.696922:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03985680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:2403:x1874670563905664:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 217us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826418.696930:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1190 00010000:00010000:3.0:1787826418.698441:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b8267c lrc: 0/0,0 mode: --/CR res: [0x200000405:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab112b expref: 35 pid: 32404 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826418.698626:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03890b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585259776:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826418.698719:0:14257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b8269f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x30:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.698732:0:14257:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b8269f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x30:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.698737:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b8269f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x30:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826418.699204:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03890b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585259904:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1787826418.699277:0:14257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826418.699321:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf117b0000 going to sleep for 11 seconds 00000100:00100000:0.0:1787826418.699550:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585259904 00000100:00100000:0.0:1787826418.699558:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585259904 00000100:00100000:0.0:1787826418.699769:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1460 00000100:00100000:0.0:1787826418.699781:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03893c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:14257:x1874670585259904:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1787826418.699892:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03893c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:14257:x1874670585259904:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 113us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826418.699901:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1460 00000100:00100000:3.0:1787826418.699966:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03890b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585259904:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1787826418.700023:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03890b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585260032:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1787826418.700051:0:14257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826418.700135:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f67eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826418.700199:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585260032 00000100:00100000:1.0:1787826418.700204:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585260032 00000100:00100000:1.0:1787826418.700233:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1461 00000100:00100000:1.0:1787826418.700239:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce038930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14257:x1874670585260032:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1787826418.700320:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce038930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14257:x1874670585260032:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 81us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826418.700327:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1461 00000100:00100000:3.0:1787826418.700406:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03890b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585260032:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:3.0:1787826418.700561:0:14257:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589935009 00000100:00100000:3.0:1787826418.700621:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03890b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585260160:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1787826418.700647:0:14257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826418.700679:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf396cf780 going to sleep for 11 seconds 00000100:00100000:1.0:1787826418.700896:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585260160 00000100:00100000:1.0:1787826418.700901:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585260160 00000100:00100000:1.0:1787826418.700927:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1462 00000100:00100000:1.0:1787826418.700933:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03890f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14257:x1874670585260160:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1787826418.701065:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03890f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:14257:x1874670585260160:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 131us (417us total) trans 17179869670 rc 0/0 00000100:00100000:1.0:1787826418.701072:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1462 00000100:00100000:3.0:1787826418.701144:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03890b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585260160:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:3.0:1787826418.701219:0:14257:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589935010 00010000:00010000:3.0:1787826418.701247:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b8269f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x30:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.701258:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b8269f lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x30:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.701266:0:14257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b8269f lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x30:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.701272:0:14257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826418.701277:0:14257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b8269f lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x30:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.701287:0:14257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b8269f lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x30:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.701306:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x30:0x0].0x0 (ffff90ce036ca200) 00010000:00010000:3.0:1787826418.701310:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787826418.701315:0:14257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b8269f lrc: 2/0,0 mode: --/EX res: [0x200000405:0x30:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.701321:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b8269f lrc: 0/0,0 mode: --/EX res: [0x200000405:0x30:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.701354:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b82698 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.701361:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b82698 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.701367:0:14257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b82698 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.701373:0:14257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826418.701376:0:14257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b82698 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.701382:0:14257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b82698 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.701391:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826418.701394:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787826418.701397:0:14257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b82698 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.701403:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b82698 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.701414:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826418.701417:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787826418.701424:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b8263d lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab110f expref: 37 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826418.701556:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eea5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55590:x1874670563905024:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 19190us (19408us total) trans 8589935011 rc 0/0 00000100:00100000:3.0:1787826418.701566:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1162 00000020:00080000:3.0:1787826418.701570:0:14257:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1787826418.705767:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826418.705876:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563905792 00000100:00100000:0.0:1787826418.705890:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563905792 00000100:00100000:0.0:1787826418.705970:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3839 00000100:00100000:0.0:1787826418.706395:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03986940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55590:x1874670563905792:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826418.706429:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826418.706457:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b826a6 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1140 expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.706821:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b826a6 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1140 expref: 37 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.706840:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b826a6 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1140 expref: 37 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.706861:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826418.706865:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826418.706871:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165e600, rc 0) 00000100:00100000:0.0:1787826418.706987:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03986940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:55590:x1874670563905792:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 597us (1235us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826418.706996:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3839 00000100:00100000:3.0:1787826418.709690:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826418.709965:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563906048 00000100:00100000:1.0:1787826418.709979:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563906048 00000100:00100000:1.0:1787826418.710057:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1164 00000100:00100000:1.0:1787826418.710069:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03890780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:55590:x1874670563906048:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:1.0:1787826418.710382:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03890780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:55590:x1874670563906048:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 314us (703us total) trans 8589935012 rc 0/0 00000100:00100000:1.0:1787826418.710391:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1164 00000100:00100000:1.0:1787826418.712611:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826418.712727:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563906304 00000100:00100000:0.0:1787826418.712740:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563906304 00000100:00100000:0.0:1787826418.712809:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1165 00000100:00100000:0.0:1787826418.712819:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce039852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:55590:x1874670563906304:12345-192.168.203.39@tcp:35:lfs.0 00000004:00080000:0.0:1787826418.713074:0:14257:0:(mdd_object.c:4014:mdd_close()) Object [0x200000405:0x30:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:0.0:1787826418.713192:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b826ad lrc: 3/0,1 mode: --/PW res: [0x200000405:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.713214:0:14257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b826ad lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.713228:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b826ad lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.713239:0:14257:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b826ad lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.713246:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b826ad lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.713253:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b826ad lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.713280:0:14257:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826418.713329:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826418.713933:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b826ad lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.713949:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165e200 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826418.713954:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b826ad lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.713963:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b826ad lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.713983:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x30:0x0].0x0 (ffff90ce036ca200) 00010000:00010000:0.0:1787826418.713986:0:8451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787826418.713990:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b826ad lrc: 1/0,0 mode: --/PW res: [0x200000405:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.713996:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b826ad lrc: 0/0,0 mode: --/PW res: [0x200000405:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.714010:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826418.714012:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826418.714013:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826418.714115:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce039852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+39:55590:x1874670563906304:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 1293us (1513us total) trans 8589935013 rc 0/0 00000100:00100000:0.0:1787826418.714125:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1165 00000100:00100000:3.0:1787826418.734373:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826418.734510:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563906432 00000100:00100000:2.0:1787826418.734523:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563906432 00000100:00100000:2.0:1787826418.734597:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3840 00000100:00100000:2.0:1787826418.734608:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03891a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+39:55592:x1874670563906432:12345-192.168.203.39@tcp:101:getfattr.0 00010000:00010000:2.0:1787826418.734642:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826418.734674:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b826b4 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1147 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.734766:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b826bb lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.734784:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b826bb lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.734799:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b826bb lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.734814:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b826c2 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.734822:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b826c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.734828:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b826c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.734925:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b826c9 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.734936:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b826c9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.734943:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b826c9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826418.734994:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:2.0:1787826418.735000:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826418.735024:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b826c9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.735038:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b826c9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.735049:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b826bb lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.735056:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b826bb lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.735063:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b826bb lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.735070:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b826bb lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.735076:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826418.735081:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b826bb lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.735090:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b826bb lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.735104:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf39e67000) 00010000:00010000:2.0:1787826418.735107:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826418.735112:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b826bb lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.735118:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b826bb lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.735135:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b826c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.735141:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b826c2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.735147:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b826c2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.735153:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826418.735156:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b826c2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.735173:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b826c2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.735181:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf39e67600) 00010000:00010000:2.0:1787826418.735184:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826418.735187:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b826c2 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.735197:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b826c2 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.735233:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b826b4 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1147 expref: 41 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.735253:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b826c9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1147 expref: 40 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.735261:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826418.735264:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826418.735267:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834a00, rc 0) 00000100:00100000:2.0:1787826418.735345:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03891a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55592:x1874670563906432:12345-192.168.203.39@tcp:101:getfattr.0 Request processed in 738us (989us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826418.735354:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3840 00000100:00100000:3.0:1787826418.778405:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826418.778570:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563906560 00000100:00100000:1.0:1787826418.778583:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563906560 00000100:00100000:1.0:1787826418.778657:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3841 00000100:00100000:1.0:1787826418.778670:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1366a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55596:x1874670563906560:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:1.0:1787826418.778788:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b826d0 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.778808:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b826d0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.778822:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b826d0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.778836:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b826d7 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.778842:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b826d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.778848:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b826d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.778958:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b826de lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.778968:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b826de lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.778975:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b826de lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826418.779026:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:1.0:1787826418.779032:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826418.779048:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b826de lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.779066:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b826d0 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.779074:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b826d0 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.779080:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b826d0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.779087:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b826d0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.779093:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46b200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826418.779098:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b826d0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.779107:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b826d0 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.779122:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf3ab61400) 00010000:00010000:1.0:1787826418.779126:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826418.779132:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b826d0 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.779139:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b826d0 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.779173:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b826d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.779181:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b826d7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.779187:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b826d7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.779193:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46bc00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826418.779196:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b826d7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.779202:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b826d7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.779209:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf3ab61200) 00010000:00010000:1.0:1787826418.779212:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826418.779214:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b826d7 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.779220:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b826d7 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.779231:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b826de lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.779236:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b826de lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.779241:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b826de lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.779246:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46aa00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826418.779249:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b826de lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.779254:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b826de lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.779265:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826418.779267:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826418.779270:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b826de lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.779275:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b826de lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826418.779388:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1366a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55596:x1874670563906560:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 719us (996us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826418.779397:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3841 00000100:00100000:1.0:1787826418.800981:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826418.801105:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563906816 00000100:00100000:2.0:1787826418.801118:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563906816 00000100:00100000:2.0:1787826418.801206:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3842 00000100:00100000:2.0:1787826418.801218:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab14f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55598:x1874670563906816:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826418.801248:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826418.801275:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b826e5 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab114e expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.801438:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b826ec lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.801458:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b826ec lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.801526:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b826ec lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826418.801541:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:2.0:1787826418.801680:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b826e5 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab114e expref: 43 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.801704:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b826ec lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab114e expref: 42 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.801716:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826418.801719:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787826418.801722:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835a00, rc 0) 00000100:00100000:2.0:1787826418.801800:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab14f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+42:55598:x1874670563906816:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 583us (834us total) trans 8589935014 rc 0/0 00000100:00100000:2.0:1787826418.801808:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3842 00000100:00100000:3.0:1787826418.810977:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826418.811093:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563907072 00000100:00100000:0.0:1787826418.811107:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563907072 00000100:00100000:0.0:1787826418.811197:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3843 00000100:00100000:0.0:1787826418.811209:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+42:55598:x1874670563907072:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826418.811242:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826418.811269:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b826fa lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1155 expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.811464:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b82701 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.811534:0:9966:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b826c9 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1147 expref: 43 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.811543:0:9966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b82701 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.811582:0:9966:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b826c9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1147 expref: 43 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.811597:0:9966:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b826c9 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1147 expref: 43 pid: 6519 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826418.811614:0:9966:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf1ecae580 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9966:1874670585260288:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826418.811708:0:9966:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a18180 going to sleep for 11 seconds 00000100:00100000:0.0:1787826418.817466:0:9966:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf1ecae580 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9966:1874670585260288:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826418.817547:0:9966:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b82701 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826418.819047:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826418.819285:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563907200 00000100:00100000:0.0:1787826418.819296:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563907200 00010000:00010000:0.0:1787826418.819442:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b826c9 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1147 expref: 44 pid: 6519 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826418.819659:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1191 00000100:00100000:0.0:1787826418.819673:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:2403:x1874670563907200:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826418.819693:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826418.819702:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b826c9 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1147 expref: 44 pid: 6519 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.819715:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b826c9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1147 expref: 44 pid: 6519 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.819742:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b826c9 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1147 expref: 44 pid: 6519 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.819770:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826418.819777:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b82701 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.819788:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b82701 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.819797:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b82701 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.819832:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826418.819899:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:2403:x1874670563907200:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 229us (860us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826418.819907:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1191 00010000:00010000:3.0:1787826418.819964:0:9966:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b82701 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.819973:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b82701 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826418.820001:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:3.0:1787826418.820179:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b826fa lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1155 expref: 44 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.820197:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b82701 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1155 expref: 43 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.820205:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826418.820208:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787826418.820210:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165f600, rc 0) 00000100:00100000:3.0:1787826418.820239:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55598:x1874670563907072:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 9034us (9278us total) trans 8589935015 rc 0/0 00000100:00100000:3.0:1787826418.820248:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3843 00000100:00100000:3.0:1787826418.822974:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826418.823142:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563907328 00000100:00100000:1.0:1787826418.823155:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563907328 00000100:00100000:1.0:1787826418.823234:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1166 00000100:00100000:1.0:1787826418.823245:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55598:x1874670563907328:12345-192.168.203.39@tcp:33:lfs.0 00000100:00100000:1.0:1787826418.823464:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55598:x1874670563907328:12345-192.168.203.39@tcp:33:lfs.0 Request processed in 220us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826418.823506:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1166 00000100:00100000:1.0:1787826418.825863:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826418.825959:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563907584 00000100:00100000:3.0:1787826418.825970:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563907584 00000100:00100000:3.0:1787826418.826036:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1167 00000100:00100000:3.0:1787826418.826047:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03976940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55598:x1874670563907584:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:3.0:1787826418.826400:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03976940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55598:x1874670563907584:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 290us (483us total) trans 8589935016 rc 0/0 00000100:00100000:3.0:1787826418.826410:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1167 00000100:00100000:1.0:1787826418.829727:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826418.831123:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826418.831222:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826418.831347:0:34485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563907968 00000100:00100000:2.0:1787826418.831360:0:34485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563907968 00000100:00100000:2.0:1787826418.831429:0:34485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 102 00000100:00100000:2.0:1787826418.831440:0:34485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf2f424450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:307626ff-a376-4faf-93e0-9f55b723d964+10:2404:x1874670563907968:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1787826418.831544:0:34485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf2f424450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:307626ff-a376-4faf-93e0-9f55b723d964+10:2404:x1874670563907968:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 106us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826418.831553:0:34485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 102 00000100:00100000:0.0:1787826418.833192:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563907840 00000100:00100000:0.0:1787826418.833207:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563907840 00000100:00100000:0.0:1787826418.833276:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563908096 00000100:00100000:0.0:1787826418.833280:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563908096 00000100:00100000:0.0:1787826418.833333:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1589 00000100:00100000:0.0:1787826418.833355:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05121a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:2404:x1874670563908096:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1787826418.833436:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05121a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:2404:x1874670563908096:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 83us (2213us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826418.833444:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1589 00000100:00100000:0.0:1787826418.833462:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3844 00000100:00100000:0.0:1787826418.833468:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce051203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55598:x1874670563907840:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826418.833508:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826418.833512:0:32404:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:0.0:1787826418.833546:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b82701 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1155 expref: 44 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.833571:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b826ec lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab114e expref: 43 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.833582:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826418.833588:0:32404:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826418.833604:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b8270f lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab115c expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.833727:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b82716 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.833743:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b82716 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.833870:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b82716 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826418.833895:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:0.0:1787826418.834025:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b8270f lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab115c expref: 45 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.834041:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b82716 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab115c expref: 44 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.834050:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826418.834052:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787826418.834055:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165fc00, rc 0) 00000100:00100000:0.0:1787826418.834085:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce051203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55598:x1874670563907840:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 617us (4373us total) trans 8589935017 rc 0/0 00000100:00100000:0.0:1787826418.834093:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3844 00000100:00080000:3.0:1787826418.834341:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787826418.836731:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826418.836792:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563908352 00000100:00100000:1.0:1787826418.836804:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563908352 00000100:00100000:1.0:1787826418.836868:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1168 00000100:00100000:1.0:1787826418.836880:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eea5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55598:x1874670563908352:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:1.0:1787826418.837113:0:6521:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000405:0x1d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b82716 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab115c expref: 44 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.837176:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82724 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.837192:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b826a6 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1140 expref: 44 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.837202:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82724 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.837249:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b826a6 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1140 expref: 44 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.837264:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b826a6 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1140 expref: 44 pid: 9966 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826418.837281:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce05120780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1874670585260416:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826418.837390:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826418.839033:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce05120780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1874670585260416:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826418.839217:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82724 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826418.840341:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826418.840594:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563908480 00000100:00100000:2.0:1787826418.840616:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563908480 00010000:00010000:2.0:1787826418.840670:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b826a6 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1140 expref: 45 pid: 9966 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826418.840721:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1192 00000100:00100000:2.0:1787826418.840733:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+45:2404:x1874670563908480:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826418.840754:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826418.840898:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b826a6 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1140 expref: 45 pid: 9966 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.840914:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b826a6 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1140 expref: 45 pid: 9966 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.840945:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b826a6 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1140 expref: 45 pid: 9966 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.840967:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826418.840973:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82724 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.840984:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82724 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.840992:0:10340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82724 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.841029:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826418.841167:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82724 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.841176:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82724 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.841412:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82724 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.841420:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82724 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.841425:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82724 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.841431:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46ba00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826418.841436:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82724 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.841445:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82724 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.841457:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826418.841460:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787826418.841464:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82724 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.841519:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82724 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826418.841533:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826418.841535:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787826418.841541:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b82716 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab115c expref: 44 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826418.841722:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:2404:x1874670563908480:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 989us (1396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826418.841733:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1192 00000100:00100000:1.0:1787826418.842206:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eea5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55598:x1874670563908352:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 5327us (5486us total) trans 8589935018 rc -22/-22 00000100:00100000:1.0:1787826418.842218:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1168 00000100:00100000:0.0:1787826418.844824:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826418.844916:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563908608 00000100:00100000:2.0:1787826418.844928:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563908608 00000100:00100000:2.0:1787826418.845000:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3845 00000100:00100000:2.0:1787826418.845010:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55598:x1874670563908608:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826418.845041:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826418.845068:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b8272b lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1163 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.845147:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b8272b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1163 expref: 44 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.845178:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b8272b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1163 expref: 44 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.845203:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826418.845206:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826418.845212:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834600, rc 0) 00000100:00100000:2.0:1787826418.845289:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55598:x1874670563908608:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 280us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826418.845298:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3845 00000100:00100000:0.0:1787826418.849641:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826418.849890:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563908864 00000100:00100000:3.0:1787826418.849903:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563908864 00000100:00100000:3.0:1787826418.849971:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3846 00000100:00100000:3.0:1787826418.849982:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55598:x1874670563908864:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826418.850009:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826418.850037:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b82732 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab116a expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.850733:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b82739 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.850752:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b82739 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.850765:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b82739 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826418.850779:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x31:0x0]: returning size 0 00010000:00010000:3.0:1787826418.850839:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b82732 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab116a expref: 47 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.850869:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b82739 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab116a expref: 46 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.850880:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x31:0x0].0x0 (ffff90cf06894c00) 00010000:00010000:3.0:1787826418.850883:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826418.850886:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400600, rc 0) 00000100:00100000:3.0:1787826418.850976:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+46:55598:x1874670563908864:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 996us (1350us total) trans 8589935019 rc 0/0 00000100:00100000:3.0:1787826418.850985:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3846 00000100:00100000:3.0:1787826418.854765:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826418.855910:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563909120 00000100:00100000:0.0:1787826418.855927:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563909120 00000100:00100000:0.0:1787826418.856048:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3847 00000100:00100000:0.0:1787826418.856060:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+46:55598:x1874670563909120:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826418.856093:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826418.856121:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b82747 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1171 expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.856276:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b8274e lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.856294:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b8274e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.856309:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b8274e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826418.856324:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:0.0:1787826418.856656:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b82747 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1171 expref: 49 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.856678:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b8274e lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1171 expref: 48 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.856688:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826418.856691:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787826418.856695:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165f600, rc 0) 00000100:00100000:0.0:1787826418.856899:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55598:x1874670563909120:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 840us (2157us total) trans 8589935020 rc 0/0 00000100:00100000:0.0:1787826418.856908:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3847 00000100:00100000:1.0:1787826418.860825:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826418.860933:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563909376 00000100:00100000:2.0:1787826418.860946:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563909376 00000100:00100000:2.0:1787826418.861013:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1169 00000100:00100000:2.0:1787826418.861026:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05120780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55598:x1874670563909376:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:2.0:1787826418.861130:0:6522:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000405:0x1d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b8274e lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1171 expref: 48 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.861192:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8275c lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.861208:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b8272b lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1163 expref: 48 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.861217:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8275c lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.861260:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b8272b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1163 expref: 48 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.861276:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b8272b lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1163 expref: 48 pid: 6518 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826418.861293:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f936940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585260544:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826418.861422:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a139c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826418.864878:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826418.865015:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563909504 00000100:00100000:3.0:1787826418.865029:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563909504 00010000:00010000:3.0:1787826418.865086:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b8272b lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1163 expref: 49 pid: 6518 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826418.865142:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1193 00000100:00100000:3.0:1787826418.865153:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf185da050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:2404:x1874670563909504:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826418.865184:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826418.865193:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b8272b lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1163 expref: 49 pid: 6518 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.865212:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b8272b lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1163 expref: 49 pid: 6518 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.865244:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826418.865250:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8275c lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.865262:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8275c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.865272:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8275c lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.865296:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826418.865379:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf185da050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:2404:x1874670563909504:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 228us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826418.865387:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1193 00010000:00010000:2.0:1787826418.865611:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b8272b lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1163 expref: 48 pid: 6518 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826418.865633:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f936940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585260544:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826418.865661:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8275c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.865673:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8275c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.865679:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8275c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.865705:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82763 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.865718:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b82739 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab116a expref: 47 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.865727:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82763 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x31:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.865771:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b82739 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab116a expref: 47 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.865787:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b82739 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab116a expref: 47 pid: 9966 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826418.865803:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f936940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585260672:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826418.865866:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a139c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826418.869747:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826418.869918:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f936940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585260672:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826418.869955:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82763 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x31:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826418.870028:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563909632 00000100:00100000:3.0:1787826418.870037:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563909632 00010000:00010000:3.0:1787826418.870089:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b82739 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab116a expref: 48 pid: 9966 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826418.870139:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1194 00000100:00100000:3.0:1787826418.870151:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecac3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:2404:x1874670563909632:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826418.870186:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826418.870197:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b82739 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab116a expref: 48 pid: 9966 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.870212:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b82739 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab116a expref: 48 pid: 9966 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.870250:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b82739 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab116a expref: 48 pid: 9966 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.870271:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x31:0x0].0x0 (ffff90cf06894c00) 00010000:00010000:3.0:1787826418.870277:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82763 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x31:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.870288:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82763 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x31:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.870298:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82763 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x31:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.870336:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826418.870509:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82763 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x31:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.870517:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82763 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x31:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826418.870937:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f936940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1874670585260800:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787826418.870998:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826418.871036:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce010f5cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826418.871066:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585260800 00000100:00100000:2.0:1787826418.871072:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585260800 00000100:00100000:2.0:1787826418.871110:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1463 00000100:00100000:2.0:1787826418.871117:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f936580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6522:x1874670585260800:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787826418.871244:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f936580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6522:x1874670585260800:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 127us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826418.871253:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1463 00000100:00100000:2.0:1787826418.871299:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f936940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1874670585260800:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787826418.871349:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589935021 00000001:00080000:2.0:1787826418.871394:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589935022 00010000:00010000:2.0:1787826418.871414:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82763 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x31:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.871423:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82763 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x31:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.871430:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82763 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x31:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.871436:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826418.871440:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82763 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x31:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.871449:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82763 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x31:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.871463:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x31:0x0].0x0 (ffff90cf06894c00) 00010000:00010000:2.0:1787826418.871466:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787826418.871502:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82763 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x31:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.871515:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82763 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x31:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.871541:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8275c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.871548:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8275c lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.871554:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8275c lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.871559:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826418.871562:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8275c lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.871569:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8275c lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.871578:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826418.871580:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787826418.871584:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8275c lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.871590:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8275c lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.871602:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826418.871605:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787826418.871611:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b8274e lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1171 expref: 50 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826418.871735:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecac3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:2404:x1874670563909632:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 1583us (2000us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826418.871746:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1194 00000100:00100000:2.0:1787826418.871799:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05120780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55598:x1874670563909376:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 10776us (10987us total) trans 8589935023 rc 0/0 00000100:00100000:2.0:1787826418.871808:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1169 00000020:00080000:2.0:1787826418.871812:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1787826418.874720:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826418.874891:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563909760 00000100:00100000:0.0:1787826418.874903:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563909760 00000100:00100000:0.0:1787826418.875015:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3848 00000100:00100000:0.0:1787826418.875030:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05120b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55598:x1874670563909760:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826418.875067:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826418.875096:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b8276a lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1178 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.875182:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b8276a lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1178 expref: 49 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.875204:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b8276a lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1178 expref: 49 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.875227:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826418.875231:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826418.875236:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165ea00, rc 0) 00000100:00100000:0.0:1787826418.875324:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05120b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:55598:x1874670563909760:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 297us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826418.875345:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3848 00000100:00100000:1.0:1787826418.878027:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826418.878130:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563910016 00000100:00100000:3.0:1787826418.878143:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563910016 00000100:00100000:3.0:1787826418.878230:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1170 00000100:00100000:3.0:1787826418.878242:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05123840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:55598:x1874670563910016:12345-192.168.203.39@tcp:35:lfs.0 00000004:00080000:3.0:1787826418.878710:0:6521:0:(mdd_object.c:4014:mdd_close()) Object [0x200000405:0x31:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787826418.878791:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].28, 64 off10440 00000004:00080000:3.0:1787826418.878806:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1364890333449ns, next at 1365890330143ns, rc = 0 00000001:00080000:3.0:1787826418.878814:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589935024 00010000:00010000:3.0:1787826418.878863:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b82771 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.878889:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b82771 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.878904:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b82771 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.878914:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b82771 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.878921:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b82771 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.878929:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b82771 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.878951:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787826418.879066:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05123840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+51:55598:x1874670563910016:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 824us (1053us total) trans 8589935025 rc 0/0 00000100:00100000:3.0:1787826418.879076:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1170 00000020:00080000:3.0:1787826418.879082:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787826418.879115:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826418.879122:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b82771 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.879130:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401800 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826418.879135:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b82771 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.879144:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b82771 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.879174:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x31:0x0].0x0 (ffff90cf06894200) 00010000:00010000:3.0:1787826418.879178:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787826418.879183:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b82771 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.879190:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b82771 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826418.879208:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826418.879210:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826418.879212:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826418.881548:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826418.881923:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563910272 00000100:00100000:1.0:1787826418.881936:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563910272 00000100:00100000:1.0:1787826418.882032:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1171 00000100:00100000:1.0:1787826418.882043:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+51:55598:x1874670563910272:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:1.0:1787826418.882607:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+52:55598:x1874670563910272:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 563us (1070us total) trans 8589935026 rc 0/0 00000100:00100000:1.0:1787826418.882616:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1171 00000100:00100000:1.0:1787826418.905690:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826418.906206:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563910400 00000100:00100000:0.0:1787826418.906221:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563910400 00000100:00100000:0.0:1787826418.906298:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3849 00000100:00100000:0.0:1787826418.906310:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05120f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+52:55600:x1874670563910400:12345-192.168.203.39@tcp:101:getfattr.0 00010000:00010000:0.0:1787826418.906344:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826418.906376:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b82778 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab117f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.906500:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b8277f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.906518:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b8277f lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.906531:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b8277f lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.906547:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b82786 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.906679:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b82786 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.906688:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b82786 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.907184:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b8278d lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.907199:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b8278d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.907208:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b8278d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826418.907265:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:0.0:1787826418.907271:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826418.907299:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b8278d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.907312:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b8278d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.907323:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b8277f lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.907330:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b8277f lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.907337:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b8277f lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.907350:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b8277f lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.907357:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165e600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826418.907362:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b8277f lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.907370:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b8277f lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.907386:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90ce036cad00) 00010000:00010000:0.0:1787826418.907391:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826418.907397:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b8277f lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.907404:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b8277f lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.907423:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b82786 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.907430:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b82786 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.907436:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b82786 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.907442:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165fe00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826418.907445:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b82786 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.907456:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b82786 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.907463:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90ce036cae00) 00010000:00010000:0.0:1787826418.907466:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826418.907976:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b82786 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.907990:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b82786 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.908045:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b82778 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab117f expref: 54 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.908065:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b8278d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab117f expref: 53 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.908073:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826418.908076:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826418.908078:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165f400, rc 0) 00000100:00100000:1.0:1787826418.908273:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05120f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55600:x1874670563910400:12345-192.168.203.39@tcp:101:getfattr.0 Request processed in 1961us (2594us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826418.908286:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3849 00000100:00100000:0.0:1787826418.913285:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826418.913625:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563910528 00000100:00100000:2.0:1787826418.913639:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563910528 00000100:00100000:2.0:1787826418.913751:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2139 00000100:00100000:2.0:1787826418.913777:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecae940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563910528:12345-192.168.203.39@tcp:101:getfattr.0 00010000:00010000:2.0:1787826418.913802:0:30694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826418.913828:0:30694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004da8c6f7/0x22153cd396b82794 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1186 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826418.913903:0:30694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f936940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:30694:1874670585260928:192.168.203.39@tcp:106: 00000100:00100000:2.0:1787826418.914016:0:30694:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce010f5900 going to sleep for 11 seconds 00000100:00100000:2.0:1787826418.915728:0:30694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f936940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:30694:1874670585260928:192.168.203.39@tcp:106: 00010000:00010000:2.0:1787826418.915911:0:30694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004da8c6f7/0x22153cd396b82794 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1186 expref: 13 pid: 30694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.915943:0:30694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004da8c6f7/0x22153cd396b82794 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1186 expref: 13 pid: 30694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.915960:0:30694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835c00, rc 0) 00000100:00100000:2.0:1787826418.916075:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecae940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563910528:12345-192.168.203.39@tcp:101:getfattr.0 Request processed in 2301us (2805us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826418.916089:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2139 00000100:00100000:1.0:1787826418.941793:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826418.941905:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563910656 00000100:00100000:0.0:1787826418.941919:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563910656 00000100:00100000:0.0:1787826418.942003:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3850 00000100:00100000:0.0:1787826418.942015:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05123480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55604:x1874670563910656:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:0.0:1787826418.942120:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8279b lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.942146:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8279b lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.942169:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8279b lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.942186:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b827a2 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.942193:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b827a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.942199:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b827a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.942315:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b827a9 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.942324:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b827a9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.942345:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b827a9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826418.942399:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:0.0:1787826418.942404:0:32404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826418.942419:0:32404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b827a9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.942436:0:32404:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8279b lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.942447:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8279b lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.942454:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8279b lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.942462:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8279b lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.942468:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165fe00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826418.942514:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8279b lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.942524:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8279b lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.942539:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90ce036cad00) 00010000:00010000:0.0:1787826418.942542:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826418.942552:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8279b lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.942559:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8279b lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.942582:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b827a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.942588:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b827a2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.942594:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b827a2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.942600:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165e600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826418.942604:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b827a2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.942610:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b827a2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.942618:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90ce036cae00) 00010000:00010000:0.0:1787826418.942621:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826418.942623:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b827a2 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.942629:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b827a2 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.942642:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b827a9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.942649:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b827a9 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.942655:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b827a9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.942660:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165e400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826418.942662:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b827a9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.942669:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b827a9 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.942680:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826418.942682:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826418.942685:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b827a9 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.942690:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b827a9 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826418.942791:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05123480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55604:x1874670563910656:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 776us (1012us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826418.942799:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3850 00000001:00080000:0.0:1787826418.955511:0:7449:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967718 is committed 00000100:00100000:0.0:1787826418.968786:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826418.968942:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563910912 00000100:00100000:2.0:1787826418.968955:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563910912 00000100:00100000:2.0:1787826418.969035:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3851 00000100:00100000:2.0:1787826418.969046:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55606:x1874670563910912:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826418.969070:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826418.969096:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b827b0 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab118d expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.969249:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b827b7 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.969266:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b827b7 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.969280:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b827b7 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826418.969292:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:2.0:1787826418.969442:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b827b0 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab118d expref: 56 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.969464:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b827b7 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab118d expref: 55 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.969923:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826418.969927:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787826418.969932:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834400, rc 0) 00000100:00100000:2.0:1787826418.970013:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+55:55606:x1874670563910912:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 967us (1256us total) trans 8589935027 rc 0/0 00000100:00100000:2.0:1787826418.970022:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3851 00000100:00100000:3.0:1787826418.972745:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826418.972848:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563911040 00000100:00100000:0.0:1787826418.972860:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563911040 00000100:00100000:0.0:1787826418.972928:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2140 00000100:00100000:0.0:1787826418.972938:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563911040:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826418.972960:0:14864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826418.972984:0:14864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b827c5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1194 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826418.973064:0:14864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf1ecaf0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14864:1874670585261056:192.168.203.39@tcp:106: 00000100:00100000:0.0:1787826418.973263:0:14864:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a180c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826418.975749:0:14864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf1ecaf0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14864:1874670585261056:192.168.203.39@tcp:106: 00010000:00010000:0.0:1787826418.975870:0:14864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b827c5 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1194 expref: 13 pid: 14864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.975909:0:14864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b827c5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1194 expref: 13 pid: 14864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.975925:0:14864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165e400, rc 0) 00000100:00100000:0.0:1787826418.976038:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563911040:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 3101us (3307us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826418.976049:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2140 00000100:00100000:1.0:1787826418.979272:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826418.979372:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563911296 00000100:00100000:0.0:1787826418.979385:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563911296 00000100:00100000:0.0:1787826418.979456:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3852 00000100:00100000:0.0:1787826418.979466:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05122940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+55:55606:x1874670563911296:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826418.979657:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826418.979685:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b827cc lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab119b expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.979835:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b827d3 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.979852:0:16564:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b8278d lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab117f expref: 56 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.979862:0:16564:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b827d3 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.979899:0:16564:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b8278d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab117f expref: 56 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.979919:0:16564:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b8278d lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab117f expref: 56 pid: 6519 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826418.979936:0:16564:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf1ecaf0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:16564:1874670585261184:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826418.980079:0:16564:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a180c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826418.984554:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826418.984813:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563911424 00000100:00100000:2.0:1787826418.984825:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563911424 00010000:00010000:2.0:1787826418.984880:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b8278d lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab117f expref: 57 pid: 6519 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826418.984932:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1195 00000100:00100000:2.0:1787826418.984943:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05120000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+57:2403:x1874670563911424:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826418.984964:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826418.984973:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b8278d lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab117f expref: 57 pid: 6519 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.984987:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b8278d lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab117f expref: 57 pid: 6519 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.985015:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826418.985023:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b827d3 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.985033:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b827d3 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.985042:0:10340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b827d3 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826418.985066:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826418.985132:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05120000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+57:2403:x1874670563911424:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 190us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826418.985142:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1195 00010000:00010000:0.0:1787826418.986270:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b8278d lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab117f expref: 56 pid: 6519 timeout: 1464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826418.986301:0:16564:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf1ecaf0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:16564:1874670585261184:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826418.986331:0:16564:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b827d3 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.986342:0:16564:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b827d3 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.986349:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b827d3 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826418.986378:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:0.0:1787826418.986597:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b827cc lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab119b expref: 57 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.986616:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b827d3 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab119b expref: 56 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826418.986626:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826418.986630:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787826418.986633:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165fe00, rc 0) 00000100:00100000:1.0:1787826418.986901:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05122940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+56:55606:x1874670563911296:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 7433us (7639us total) trans 8589935028 rc 0/0 00000100:00100000:1.0:1787826418.986911:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3852 00000100:00100000:1.0:1787826418.994245:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826418.994386:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563911680 00000100:00100000:2.0:1787826418.994400:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563911680 00000100:00100000:2.0:1787826418.994499:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3853 00000100:00100000:2.0:1787826418.994512:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05122580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+56:55606:x1874670563911680:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826418.994545:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826418.994574:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b827e1 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab11a2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.001525:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b827e8 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.001636:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b827e8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.001657:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b827e8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826419.001677:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x32:0x0]: returning size 0 00010000:00010000:2.0:1787826419.002506:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b827e1 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11a2 expref: 59 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.002548:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b827e8 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11a2 expref: 58 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.002630:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x32:0x0].0x0 (ffff90cf39e67600) 00010000:00010000:2.0:1787826419.002633:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826419.002638:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834600, rc 0) 00000100:00100000:3.0:1787826419.005225:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05122580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:55606:x1874670563911680:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 10698us (10978us total) trans 8589935029 rc 0/0 00000100:00100000:3.0:1787826419.005244:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3853 00010000:00010000:0.0:1787826419.011988:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826419.017842:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826419.020006:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563911936 00000100:00100000:1.0:1787826419.020136:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563911936 00000100:00100000:1.0:1787826419.020265:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3854 00000100:00100000:1.0:1787826419.020280:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab93840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:55606:x1874670563911936:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826419.020315:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826419.020344:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b827f6 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab11a9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787826419.020665:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787826419.021120:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b827fd lrc: 3/0,1 mode: --/EX res: [0x200000405:0x32:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.021143:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b827e8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11a2 expref: 59 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.021154:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b827fd lrc: 4/0,1 mode: --/EX res: [0x200000405:0x32:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.021212:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b827e8 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11a2 expref: 59 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.021231:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b827e8 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11a2 expref: 59 pid: 6519 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826419.021249:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03890780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1874670585261312:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826419.021391:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce02725c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826419.025206:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826419.026563:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563912064 00000100:00100000:0.0:1787826419.026581:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563912064 00010000:00010000:0.0:1787826419.026646:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b827e8 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11a2 expref: 60 pid: 6519 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826419.026699:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1196 00000100:00100000:0.0:1787826419.026711:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03984000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:2403:x1874670563912064:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826419.026734:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826419.026743:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b827e8 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11a2 expref: 60 pid: 6519 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.026760:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b827e8 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11a2 expref: 60 pid: 6519 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.027175:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x32:0x0].0x0 (ffff90cf39e67600) 00010000:00010000:0.0:1787826419.027183:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b827fd lrc: 3/0,1 mode: --/EX res: [0x200000405:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.027194:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b827fd lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.027202:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b827fd lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.027234:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826419.027314:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03984000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:2403:x1874670563912064:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 603us (2122us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826419.027328:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1196 00010000:00010000:2.0:1787826419.028369:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b827e8 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11a2 expref: 59 pid: 6519 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826419.028401:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03890780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1874670585261312:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826419.028433:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b827fd lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.028444:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b827fd lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.028451:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b827fd lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826419.028510:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x32:0x0]: returning size 0 00000004:00080000:2.0:1787826419.028751:0:6520:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x10a:0x0], index 0: 0 00010000:00010000:2.0:1787826419.028891:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b827fd lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.028901:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b827fd lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.028907:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b827fd lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.028914:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46b200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826419.028920:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b827fd lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.028929:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b827fd lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.028946:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x32:0x0].0x0 (ffff90cf39e67600) 00010000:00010000:2.0:1787826419.028951:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826419.028956:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b827fd lrc: 2/0,0 mode: --/EX res: [0x200000405:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.028963:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b827fd lrc: 0/0,0 mode: --/EX res: [0x200000405:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.029029:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b827f6 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x32:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11a9 expref: 59 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.029042:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x32:0x0].0x0 (ffff90cf39e67600) 00010000:00010000:2.0:1787826419.029044:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787826419.029048:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b827f6 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x32:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11a9 expref: 59 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.029067:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46ae00, rc 0) 00000100:00100000:2.0:1787826419.029139:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab93840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:55606:x1874670563911936:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 8862us (11311us total) trans 8589935030 rc 301/301 00000100:00100000:2.0:1787826419.029149:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3854 00000100:00100000:2.0:1787826419.034026:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826419.034135:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563912320 00000100:00100000:1.0:1787826419.034149:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563912320 00000100:00100000:1.0:1787826419.034235:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1172 00000100:00100000:1.0:1787826419.034248:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f936940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:55606:x1874670563912320:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:1.0:1787826419.035451:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f936940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55606:x1874670563912320:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 1198us (1432us total) trans 8589935031 rc 0/0 00000100:00100000:1.0:1787826419.035492:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1172 00000100:00100000:3.0:1787826419.050609:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826419.050718:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563912448 00000100:00100000:2.0:1787826419.050731:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563912448 00000100:00100000:2.0:1787826419.050845:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3855 00000100:00100000:2.0:1787826419.050857:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab91680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55606:x1874670563912448:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826419.050888:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826419.050915:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b8280b lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab11b0 expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.051091:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b82812 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.051120:0:8247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b827d3 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab119b expref: 60 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.051131:0:8247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b82812 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.051191:0:8247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b827d3 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab119b expref: 60 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.051207:0:8247:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b827d3 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab119b expref: 60 pid: 16564 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826419.051223:0:8247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f9352c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8247:1874670585261440:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826419.051703:0:8247:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce010f5840 going to sleep for 11 seconds 00000100:00100000:2.0:1787826419.056300:0:8247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f9352c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8247:1874670585261440:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826419.056659:0:8247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b82812 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826419.059089:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826419.059197:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563912576 00000100:00100000:0.0:1787826419.059209:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563912576 00010000:00010000:0.0:1787826419.059264:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b827d3 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab119b expref: 61 pid: 16564 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826419.059316:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1197 00000100:00100000:0.0:1787826419.059328:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab92580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+61:2403:x1874670563912576:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826419.059355:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826419.059364:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b827d3 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab119b expref: 61 pid: 16564 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.059379:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b827d3 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab119b expref: 61 pid: 16564 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.059410:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b827d3 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab119b expref: 61 pid: 16564 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.059432:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826419.059438:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b82812 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.059449:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b82812 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.059459:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b82812 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.059541:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826419.059606:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab92580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:2403:x1874670563912576:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 280us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826419.059614:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1197 00010000:00010000:3.0:1787826419.060022:0:8247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b82812 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.060031:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b82812 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826419.061167:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:3.0:1787826419.061176:0:8247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826419.061209:0:8247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b82812 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.061264:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b8280b lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11b0 expref: 60 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.061286:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b82812 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11b0 expref: 59 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.061296:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826419.061299:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826419.061303:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834800, rc 0) 00000100:00100000:3.0:1787826419.061499:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab91680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55606:x1874670563912448:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 10642us (11026us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826419.061509:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3855 00000100:00100000:3.0:1787826419.063957:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826419.064048:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563912704 00000100:00100000:1.0:1787826419.064059:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563912704 00000100:00100000:1.0:1787826419.064151:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2141 00000100:00100000:1.0:1787826419.064172:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563912704:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826419.064195:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826419.064218:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000381c17db/0x22153cd396b82819 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab11b7 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826419.064297:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03987840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1874670585261568:192.168.203.39@tcp:106: 00000100:00100000:1.0:1787826419.064415:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce02725cc0 going to sleep for 11 seconds 00000100:00080000:3.0:1787826419.064508:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826419.071548:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03987840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1874670585261568:192.168.203.39@tcp:106: 00010000:00010000:2.0:1787826419.071613:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000381c17db/0x22153cd396b82819 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11b7 expref: 13 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.072296:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000381c17db/0x22153cd396b82819 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11b7 expref: 13 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.072324:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46a400, rc 0) 00000100:00100000:3.0:1787826419.073423:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563912704:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 9244us (9469us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826419.073438:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2141 00000100:00100000:3.0:1787826419.078868:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826419.079212:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563912832 00000100:00100000:1.0:1787826419.079225:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563912832 00000100:00100000:1.0:1787826419.079311:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3856 00000100:00100000:1.0:1787826419.079323:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55606:x1874670563912832:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826419.079352:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826419.079383:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b82820 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab11be expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.079524:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b82827 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.079542:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b82827 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x32:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.079561:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b82827 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x32:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826419.079621:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x32:0x0]: returning size 0 00000004:00200000:1.0:1787826419.079626:0:16564:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826419.079650:0:16564:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b82827 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x32:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.079685:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b82820 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11be expref: 61 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.079707:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b82827 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x32:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11be expref: 60 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.079717:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x32:0x0].0x0 (ffff90cf3ab61200) 00010000:00010000:1.0:1787826419.079720:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787826419.079724:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46bc00, rc 0) 00000100:00100000:1.0:1787826419.079805:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:55606:x1874670563912832:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 483us (952us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826419.079814:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3856 00000100:00100000:1.0:1787826419.085237:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826419.085414:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563912960 00000100:00100000:2.0:1787826419.085427:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563912960 00000100:00080000:3.0:1787826419.085512:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826419.085553:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2142 00000100:00100000:2.0:1787826419.085566:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03985680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670563912960:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826419.085589:0:30398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826419.085615:0:30398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002904bac2/0x22153cd396b8282e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x10a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab11c5 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787826419.085649:0:30398:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826419.085676:0:30398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10a:0x0].0x0 since=1365s v=(0 0) 00010000:00010000:2.0:1787826419.085682:0:30398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826419.085694:0:30398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002904bac2/0x22153cd396b8282e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11c5 expref: 10 pid: 30398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.085716:0:30398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002904bac2/0x22153cd396b8282e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11c5 expref: 10 pid: 30398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.085733:0:30398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835a00, rc 0) 00000100:00100000:2.0:1787826419.085808:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03985680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670563912960:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 245us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826419.085817:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2142 00000100:00100000:3.0:1787826419.090667:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826419.091008:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563913216 00000100:00100000:1.0:1787826419.091131:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563913216 00000100:00100000:1.0:1787826419.091216:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3857 00000100:00100000:1.0:1787826419.091228:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:55606:x1874670563913216:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826419.091255:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826419.091282:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b82835 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab11cc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.091422:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b8283c lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.091441:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b8283c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.091454:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b8283c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826419.091511:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:1.0:1787826419.091653:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b82835 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11cc expref: 63 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.091678:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b8283c lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11cc expref: 62 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.091690:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826419.091693:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787826419.091697:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46ae00, rc 0) 00000100:00100000:1.0:1787826419.091782:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+62:55606:x1874670563913216:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 556us (1131us total) trans 8589935032 rc 0/0 00000100:00100000:1.0:1787826419.091790:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3857 00000100:00100000:3.0:1787826419.097132:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826419.098250:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563913344 00000100:00100000:2.0:1787826419.098267:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563913344 00000100:00100000:2.0:1787826419.098355:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2143 00000100:00100000:2.0:1787826419.098367:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563913344:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826419.098390:0:8545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826419.098416:0:8545:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b8284a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab11d3 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826419.098529:0:8545:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f9352c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8545:1874670585261696:192.168.203.39@tcp:106: 00000100:00100000:2.0:1787826419.098637:0:8545:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce010f5840 going to sleep for 11 seconds 00000100:00100000:2.0:1787826419.101534:0:8545:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f9352c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8545:1874670585261696:192.168.203.39@tcp:106: 00010000:00010000:2.0:1787826419.101590:0:8545:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b8284a lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11d3 expref: 13 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.101623:0:8545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b8284a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11d3 expref: 13 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.101640:0:8545:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834a00, rc 0) 00000100:00100000:2.0:1787826419.101713:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563913344:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 3348us (4597us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826419.101724:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2143 00000100:00100000:1.0:1787826419.107782:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826419.108728:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563913472 00000100:00100000:3.0:1787826419.108761:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563913472 00000100:00100000:3.0:1787826419.108879:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2144 00000100:00100000:3.0:1787826419.108901:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce039852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2402:x1874670563913472:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826419.108927:0:30696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826419.108963:0:30696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd505040/0x22153cd396b82851 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab11da expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826419.109060:0:30696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f8c0f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:30696:1874670585261824:192.168.203.39@tcp:106: 00000100:00100000:3.0:1787826419.109193:0:30696:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf396cf180 going to sleep for 11 seconds 00000100:00100000:3.0:1787826419.116953:0:30696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f8c0f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:30696:1874670585261824:192.168.203.39@tcp:106: 00010000:00010000:3.0:1787826419.117851:0:30696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fd505040/0x22153cd396b82851 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11da expref: 13 pid: 30696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.117910:0:30696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd505040/0x22153cd396b82851 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11da expref: 13 pid: 30696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.117926:0:30696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401800, rc 0) 00000100:00100000:2.0:1787826419.118101:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce039852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2402:x1874670563913472:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 9207us (10336us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826419.118112:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2144 00000100:00100000:1.0:1787826419.126458:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826419.126576:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563913600 00000100:00100000:2.0:1787826419.126588:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563913600 00000100:00100000:2.0:1787826419.126659:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2145 00000100:00100000:2.0:1787826419.126671:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03987840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2401:x1874670563913600:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:2.0:1787826419.126728:0:30695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b82858 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.126754:0:30695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000159f1fa4/0x22153cd396b82683 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1132 expref: 12 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.126764:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x10a:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787826419.126769:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10a:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826419.126775:0:30695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b82858 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.126815:0:30695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000159f1fa4/0x22153cd396b82683 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1132 expref: 12 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.126830:0:30695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000159f1fa4/0x22153cd396b82683 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1132 expref: 12 pid: 30695 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826419.126847:0:30695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f9352c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:30695:1874670585261952:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826419.126957:0:30695:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce010f5840 going to sleep for 11 seconds 00000100:00100000:2.0:1787826419.132316:0:30695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f9352c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:30695:1874670585261952:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826419.132366:0:30695:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b82858 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826419.133218:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826419.133324:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563913728 00000100:00100000:3.0:1787826419.133428:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563913728 00010000:00010000:3.0:1787826419.133621:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000159f1fa4/0x22153cd396b82683 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1132 expref: 13 pid: 30695 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826419.133715:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1198 00000100:00100000:3.0:1787826419.133728:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03976940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2404:x1874670563913728:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826419.133758:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826419.133787:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000159f1fa4/0x22153cd396b82683 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x10a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1132 expref: 13 pid: 30695 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.133803:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000159f1fa4/0x22153cd396b82683 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1132 expref: 13 pid: 30695 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.133836:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000159f1fa4/0x22153cd396b82683 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1132 expref: 13 pid: 30695 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.133858:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10a:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826419.133863:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10a:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826419.133870:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b82858 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.133881:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b82858 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.133933:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826419.134014:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03976940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563913728:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 288us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826419.134023:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1198 00010000:00010000:2.0:1787826419.134105:0:30695:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b82858 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x10a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.134120:0:30695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b82858 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x10a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.134146:0:30695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b82858 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x10a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.134164:0:30695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b82858 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x10a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.134173:0:30695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b82858 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.134181:0:30695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834a00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826419.134186:0:30695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b82858 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.134196:0:30695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b82858 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x10a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.134208:0:30695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b82858 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x10a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.134214:0:30695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b82858 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x10a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826419.134269:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03987840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2401:x1874670563913600:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 7601us (7829us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826419.134276:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2145 00000100:00100000:1.0:1787826419.141264:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826419.141775:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563913856 00000100:00100000:0.0:1787826419.141789:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563913856 00000100:00100000:0.0:1787826419.141902:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2146 00000100:00100000:0.0:1787826419.141913:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f877480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2404:x1874670563913856:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826419.141938:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826419.141966:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac666fdd/0x22153cd396b8285f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x10a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab11e1 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826419.142000:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10a:0x0] initial LVB size: 0, mtime: 0x6a9010ec, atime: 0x6a9010ec, ctime: 0x6a9010f3, blocks: 0x0 00010000:00010000:0.0:1787826419.142027:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10a:0x0].0x0 since=1365s v=(0 0) 00010000:00010000:0.0:1787826419.142033:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826419.142045:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac666fdd/0x22153cd396b8285f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11e1 expref: 12 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.142065:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ac666fdd/0x22153cd396b8285f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11e1 expref: 12 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.142081:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165fe00, rc 0) 00000100:00100000:0.0:1787826419.142171:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f877480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563913856:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 259us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826419.142179:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2146 00000100:00100000:1.0:1787826419.209313:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826419.209815:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563913984 00000100:00100000:2.0:1787826419.209829:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563913984 00000100:00100000:2.0:1787826419.209960:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3858 00000100:00100000:2.0:1787826419.209974:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f877840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+62:55606:x1874670563913984:12345-192.168.203.39@tcp:44:lfs.0 00000001:00080000:3.0:1787826419.214413:0:34481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935032 is committed 00000004:00080000:3.0:1787826419.214510:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 29 committed 00000020:00080000:3.0:1787826419.214550:0:34481:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90cf10a2f9c0 refcount 2 committed 0 result 0 batchid 4294969338 00000020:00080000:3.0:1787826419.214565:0:34481:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cf092f4700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90cf117b0000 00000020:00080000:3.0:1787826419.214568:0:34481:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cf092f4f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90cf26c05a00 00000020:00080000:3.0:1787826419.214596:0:34481:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969337 batchid updated 00000020:00080000:2.0:1787826419.214664:0:34512:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969338 committed batchid 4294969337 00000020:00080000:2.0:1787826419.214772:0:34512:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969337 00000100:00100000:2.0:1787826419.214961:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f877840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:55606:x1874670563913984:12345-192.168.203.39@tcp:44:lfs.0 Request processed in 4981us (5657us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826419.214973:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3858 00000100:00100000:3.0:1787826419.216272:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787826419.216301:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f8770c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585262080:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787826419.216392:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826419.216576:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585262080 00000100:00100000:2.0:1787826419.216593:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585262080 00000100:00100000:2.0:1787826419.216670:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2147 00000100:00100000:2.0:1787826419.216691:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:3644:x1874670585262080:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787826419.216732:0:30398:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:265 count 1 00010000:00010000:2.0:1787826419.216768:0:30398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b82866 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.216787:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b82675 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.216798:0:30398:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e32bc9b1/0x22153cd396b82691 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1139 expref: 9 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.216804:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b82675 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.216812:0:30398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x109:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787826419.216817:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b82675 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.216820:0:30398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x109:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826419.216830:0:30398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b82866 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.216831:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165fa00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826419.216872:0:30398:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e32bc9b1/0x22153cd396b82691 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1139 expref: 9 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.216890:0:30398:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e32bc9b1/0x22153cd396b82691 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1139 expref: 9 pid: 8435 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826419.216904:0:30398:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f9352c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:30398:1874670585262208:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826419.216975:0:30398:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce010f5840 going to sleep for 11 seconds 00010000:00010000:0.0:1787826419.217148:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b82675 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.217172:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b82675 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.217372:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x30:0x0].0x0 (ffff90ce036ca200) 00010000:00010000:0.0:1787826419.217377:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826419.217384:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b82675 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.217392:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b82675 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.217533:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b8268a lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.217542:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b8268a lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.217548:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b8268a lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.217559:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826419.217562:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b8268a lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.217568:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b8268a lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.217579:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826419.217581:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826419.217585:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b8268a lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.217591:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b8268a lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787826419.218169:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787826419.222278:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826419.222378:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826419.222596:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563914240 00000100:00100000:0.0:1787826419.222609:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563914240 00010000:00010000:0.0:1787826419.222665:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e32bc9b1/0x22153cd396b82691 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1139 expref: 10 pid: 8435 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826419.222714:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1199 00000100:00100000:0.0:1787826419.222726:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f875e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2401:x1874670563914240:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826419.222757:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826419.222764:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e32bc9b1/0x22153cd396b82691 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x109:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1139 expref: 10 pid: 8435 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.222780:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e32bc9b1/0x22153cd396b82691 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x109:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1139 expref: 10 pid: 8435 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.222813:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x109:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826419.222818:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x109:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826419.222825:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b82866 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x109:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.222838:0:10341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b82866 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x109:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.222879:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826419.222952:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f875e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2401:x1874670563914240:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 228us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826419.222962:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1199 00000100:00100000:3.0:1787826419.222994:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563914112 00000100:00100000:3.0:1787826419.223001:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563914112 00000100:00100000:3.0:1787826419.223861:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2148 00000100:00100000:3.0:1787826419.223878:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f877c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670563914112:12345-192.168.203.39@tcp:16:lfs.0 00000100:00100000:3.0:1787826419.223970:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f877c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670563914112:12345-192.168.203.39@tcp:16:lfs.0 Request processed in 98us (1707us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826419.223977:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2148 00010000:00010000:2.0:1787826419.224137:0:30398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e32bc9b1/0x22153cd396b82691 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x109:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1139 expref: 9 pid: 8435 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826419.224172:0:30398:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f9352c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:30398:1874670585262208:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826419.224205:0:30398:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b82866 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x109:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.224217:0:30398:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b82866 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x109:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.224225:0:30398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b82866 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x109:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.224239:0:30398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b82866 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x109:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.224249:0:30398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b82866 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x109:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.224274:0:30398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787826419.224515:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3644:x1874670585262080:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7826us (8121us total) trans 21474837011 rc 0/0 00000100:00100000:2.0:1787826419.224525:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2147 00010000:00010000:1.0:1787826419.225196:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826419.225209:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b82866 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x109:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.225220:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834a00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:1.0:1787826419.225226:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b82866 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x109:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.225247:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b82866 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x109:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.225272:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b82866 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x109:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.225280:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b82866 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x109:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.225304:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826419.225306:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826419.225308:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787826419.225377:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3f8770c0/2, rc 0, transno 21474837011 00000100:00100000:1.0:1787826419.225384:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f8770c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585262080:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787826419.244442:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826419.245854:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563914368 00000100:00100000:2.0:1787826419.245873:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563914368 00000100:00100000:2.0:1787826419.246021:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2149 00000100:00100000:2.0:1787826419.246036:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f875680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2402:x1874670563914368:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:2.0:1787826419.246104:0:30694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000382351a4/0x22153cd396b8286d lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.246129:0:30694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826419.246135:0:30694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826419.246142:0:30694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000382351a4/0x22153cd396b8286d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.246168:0:30694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000382351a4/0x22153cd396b8286d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.246201:0:30694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000382351a4/0x22153cd396b8286d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.246218:0:30694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000382351a4/0x22153cd396b8286d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.246227:0:30694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000382351a4/0x22153cd396b8286d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.246234:0:30694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834c00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826419.246239:0:30694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000382351a4/0x22153cd396b8286d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.246248:0:30694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000382351a4/0x22153cd396b8286d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.246266:0:30694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000382351a4/0x22153cd396b8286d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.246273:0:30694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000382351a4/0x22153cd396b8286d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826419.246380:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f875680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2402:x1874670563914368:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 348us (1961us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826419.246388:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2149 00000100:00100000:3.0:1787826419.252200:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826419.252310:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563914624 00000100:00100000:2.0:1787826419.252324:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563914624 00000100:00100000:2.0:1787826419.252411:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3859 00000100:00100000:2.0:1787826419.252424:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:55606:x1874670563914624:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:2.0:1787826419.252539:0:8247:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826419.252705:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b82827 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x32:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11be expref: 33 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.252732:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x32:0x0].0x0 (ffff90cf3ab61200) 00010000:00010000:2.0:1787826419.252747:0:8247:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826419.252798:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82874 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.252815:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82874 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.252827:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82874 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826419.252995:0:8247:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000028406171 reply state 000000005a121a97 transno 8589935033 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82874 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.253008:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82874 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.253015:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x32:0x0].0x0 (ffff90cf39e67100) 00010000:00010000:2.0:1787826419.253018:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826419.253021:0:8247:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826419.253264:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:55606:x1874670563914624:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 841us (1079us total) trans 8589935033 rc 0/0 00000100:00100000:2.0:1787826419.253277:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3859 00000100:00100000:3.0:1787826419.259063:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826419.259860:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563914752 00000100:00100000:0.0:1787826419.259874:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563914752 00000100:00100000:0.0:1787826419.260082:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3860 00000100:00100000:0.0:1787826419.260097:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:55606:x1874670563914752:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826419.260136:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826419.260177:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b8287b lrc: 2/0,0 mode: --/CR res: [0x200000405:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab11e8 expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.260261:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b8287b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11e8 expref: 35 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.260279:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b8287b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11e8 expref: 35 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.260307:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x32:0x0].0x0 (ffff90cf39e67100) 00010000:00010000:0.0:1787826419.260310:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826419.260314:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165fa00, rc 0) 00000100:00100000:0.0:1787826419.260402:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:55606:x1874670563914752:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 309us (1357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826419.260409:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3860 00000100:00100000:3.0:1787826419.265299:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826419.265770:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563914880 00000100:00100000:0.0:1787826419.265783:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563914880 00000100:00100000:0.0:1787826419.265917:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2150 00000100:00100000:0.0:1787826419.265929:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:55606:x1874670563914880:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826419.265953:0:14864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826419.265979:0:14864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d39501d2/0x22153cd396b82882 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab11ef expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.266034:0:14864:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002904bac2/0x22153cd396b8282e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11c5 expref: 10 pid: 30398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.266045:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826419.266050:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826419.266056:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d39501d2/0x22153cd396b82882 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11ef expref: 10 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.266103:0:14864:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002904bac2/0x22153cd396b8282e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11c5 expref: 10 pid: 30398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.266125:0:14864:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002904bac2/0x22153cd396b8282e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11c5 expref: 10 pid: 30398 timeout: 1465 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826419.266141:0:14864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf1ecaf0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14864:1874670585262336:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826419.266260:0:14864:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a180c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826419.273250:0:14864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf1ecaf0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14864:1874670585262336:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826419.273439:0:14864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d39501d2/0x22153cd396b82882 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11ef expref: 10 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.273520:0:14864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165e600, rc 0) 00000100:00100000:0.0:1787826419.273600:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:55606:x1874670563914880:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 7671us (8316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826419.273610:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2150 00000100:00100000:3.0:1787826419.280355:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826419.282076:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563915008 00000100:00100000:2.0:1787826419.282099:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563915008 00010000:00010000:2.0:1787826419.282186:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002904bac2/0x22153cd396b8282e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11c5 expref: 10 pid: 30398 timeout: 1465 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826419.282257:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1200 00000100:00100000:2.0:1787826419.282270:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf185d9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670563915008:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826419.282310:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826419.282424:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002904bac2/0x22153cd396b8282e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x10a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11c5 expref: 10 pid: 30398 timeout: 1465 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.282444:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002904bac2/0x22153cd396b8282e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11c5 expref: 10 pid: 30398 timeout: 1465 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.282528:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002904bac2/0x22153cd396b8282e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x10a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11c5 expref: 10 pid: 30398 timeout: 1465 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.282552:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826419.282557:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826419.282566:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d39501d2/0x22153cd396b82882 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11ef expref: 9 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.282578:0:10340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d39501d2/0x22153cd396b82882 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11ef expref: 9 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.282633:0:10340:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d39501d2/0x22153cd396b82882 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11ef expref: 9 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826419.282660:0:10340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f9352c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10340:1874670585262464:192.168.203.39@tcp:105: 00000100:00100000:2.0:1787826419.284099:0:10340:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce010f5cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826419.293878:0:10340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f9352c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10340:1874670585262464:192.168.203.39@tcp:105: 00010000:00010000:2.0:1787826419.293924:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826419.294009:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf185d9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670563915008:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 11739us (13678us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826419.294108:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1200 00000100:00100000:3.0:1787826419.298620:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826419.301738:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563915136 00000100:00100000:1.0:1787826419.301762:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563915136 00000100:00100000:1.0:1787826419.302143:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2151 00000100:00100000:1.0:1787826419.302168:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670563915136:12345-192.168.203.39@tcp:2:lfs.0 00002000:00010000:1.0:1787826419.302413:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x10a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787826419.302590:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x10a:0x0] updating lvb mtime from disk: 0 -> 1787826412 00002000:00010000:1.0:1787826419.302594:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x10a:0x0] updating lvb atime from disk: 0 -> 1787826412 00002000:00010000:1.0:1787826419.302596:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x10a:0x0] updating lvb ctime from disk: 0 -> 1787826419 00002000:00010000:1.0:1787826419.302598:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x10a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1787826419.302705:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670563915136:12345-192.168.203.39@tcp:2:lfs.0 Request processed in 550us (4101us total) trans 21474837012 rc 0/0 00000100:00100000:1.0:1787826419.302714:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2151 00000100:00100000:3.0:1787826419.307189:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826419.307592:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563915392 00000100:00100000:0.0:1787826419.307606:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563915392 00000100:00100000:0.0:1787826419.307690:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3861 00000100:00100000:0.0:1787826419.307702:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f05a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:55606:x1874670563915392:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:0.0:1787826419.307784:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826419.307823:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b82812 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11b0 expref: 35 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.307849:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826419.307866:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826419.307935:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b82889 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.307962:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b82889 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.307975:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b82889 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826419.309254:0:6518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000840d6d76 reply state 00000000ffed02d0 transno 8589935034 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b82889 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.309282:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b82889 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.309291:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826419.309295:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826419.309300:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787826419.309812:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f05a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55606:x1874670563915392:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 2107us (2636us total) trans 8589935034 rc 0/0 00000100:00100000:0.0:1787826419.309825:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3861 00000100:00100000:2.0:1787826419.314850:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826419.315090:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563915520 00000100:00100000:0.0:1787826419.315103:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563915520 00000100:00100000:0.0:1787826419.315221:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2152 00000100:00100000:0.0:1787826419.315235:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f9352c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:55606:x1874670563915520:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826419.315261:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826419.315287:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b82890 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab11f6 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.315345:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ac666fdd/0x22153cd396b8285f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11e1 expref: 13 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.315363:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826419.315368:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826419.315374:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b82890 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11f6 expref: 13 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.315429:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ac666fdd/0x22153cd396b8285f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11e1 expref: 13 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.315446:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ac666fdd/0x22153cd396b8285f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11e1 expref: 13 pid: 8437 timeout: 1465 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826419.315464:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf1ecaf0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1874670585262592:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826419.315594:0:8435:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a18180 going to sleep for 11 seconds 00000100:00100000:1.0:1787826419.320742:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826419.320938:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf1ecaf0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1874670585262592:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826419.320996:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b82890 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11f6 expref: 13 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.321025:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165e400, rc 0) 00000100:00100000:0.0:1787826419.321101:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f9352c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:55606:x1874670563915520:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 5870us (6343us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826419.321114:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2152 00000100:00100000:3.0:1787826419.321601:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563915648 00000100:00100000:3.0:1787826419.321611:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563915648 00010000:00010000:3.0:1787826419.321650:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ac666fdd/0x22153cd396b8285f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11e1 expref: 13 pid: 8437 timeout: 1465 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826419.321690:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1201 00000100:00100000:3.0:1787826419.321700:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f874f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2404:x1874670563915648:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826419.321719:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826419.321747:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ac666fdd/0x22153cd396b8285f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x10a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11e1 expref: 13 pid: 8437 timeout: 1465 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.321774:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ac666fdd/0x22153cd396b8285f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11e1 expref: 13 pid: 8437 timeout: 1465 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.321812:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac666fdd/0x22153cd396b8285f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x10a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11e1 expref: 13 pid: 8437 timeout: 1465 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.321831:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826419.321836:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826419.321845:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b82890 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11f6 expref: 12 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.321868:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b82890 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11f6 expref: 12 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.321912:0:6504:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b82890 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11f6 expref: 12 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826419.321929:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce04f070c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6504:1874670585262720:192.168.203.39@tcp:105: 00000100:00100000:3.0:1787826419.322182:0:6504:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf396cf180 going to sleep for 11 seconds 00000100:00100000:3.0:1787826419.327888:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce04f070c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6504:1874670585262720:192.168.203.39@tcp:105: 00010000:00010000:3.0:1787826419.327925:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826419.332247:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826419.332401:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563915776 00000100:00100000:3.0:1787826419.332414:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563915776 00000100:00100000:3.0:1787826419.332541:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2153 00000100:00100000:3.0:1787826419.332555:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f876940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2404:x1874670563915776:12345-192.168.203.39@tcp:2:lfs.0 00002000:00010000:3.0:1787826419.332779:0:28853:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x10a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787826419.332783:0:28853:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x10a:0x0] updating lvb mtime from disk: 1787826412 -> 1787826412 00002000:00010000:3.0:1787826419.332786:0:28853:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x10a:0x0] updating lvb atime from disk: 1787826412 -> 1787826412 00002000:00010000:3.0:1787826419.332788:0:28853:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x10a:0x0] updating lvb ctime from disk: 1787826419 -> 1787826419 00002000:00010000:3.0:1787826419.332790:0:28853:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x10a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1787826419.332854:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f876940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563915776:12345-192.168.203.39@tcp:2:lfs.0 Request processed in 303us (1281us total) trans 17179869671 rc 0/0 00000100:00100000:3.0:1787826419.333740:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2153 00000100:00100000:2.0:1787826419.336363:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f874f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2404:x1874670563915648:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 14640us (15615us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826419.336381:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1201 00000100:00100000:1.0:1787826419.339775:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826419.340408:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563916032 00000100:00100000:2.0:1787826419.340422:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563916032 00000100:00100000:2.0:1787826419.340704:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1173 00000100:00100000:2.0:1787826419.340718:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eea7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55606:x1874670563916032:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:2.0:1787826419.340854:0:6522:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000405:0x1d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b8283c lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11cc expref: 36 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.340919:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82897 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.340937:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b8276a lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1178 expref: 36 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.340952:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b827b7 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab118d expref: 36 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.340972:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82897 lrc: 5/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.341015:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b827b7 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab118d expref: 36 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.341031:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b827b7 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab118d expref: 36 pid: 8247 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826419.341048:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f934f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585262848:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826419.341173:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b8276a lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1178 expref: 36 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.341184:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b8276a lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1178 expref: 36 pid: 16564 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826419.341194:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f937480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585262976:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826419.341220:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce010f5840 going to sleep for 11 seconds 00000100:00100000:1.0:1787826419.344828:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826419.344995:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563916288 00000100:00100000:3.0:1787826419.345007:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563916288 00000100:00100000:3.0:1787826419.345079:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1174 00000100:00100000:3.0:1787826419.345091:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f876d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:42221:x1874670563916288:12345-192.168.203.39@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787826419.345888:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f876d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:42221:x1874670563916288:12345-192.168.203.39@tcp:35:ldlm_bl.0 Request processed in 794us (1070us total) trans 8589935035 rc 0/0 00000100:00100000:3.0:1787826419.345899:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1174 00000100:00100000:2.0:1787826419.346212:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f934f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585262848:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826419.346228:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f937480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585262976:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826419.346264:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82897 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826419.347738:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826419.349182:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563916416 00000100:00100000:2.0:1787826419.349199:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563916416 00010000:00010000:2.0:1787826419.349263:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b8276a lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1178 expref: 38 pid: 16564 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826419.349322:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1202 00000100:00100000:2.0:1787826419.349334:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecaf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:2401:x1874670563916416:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826419.349366:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826419.349374:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b8276a lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1178 expref: 38 pid: 16564 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.349387:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b8276a lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1178 expref: 38 pid: 16564 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.349417:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b8276a lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1178 expref: 38 pid: 16564 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.349440:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826419.349446:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82897 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.349457:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82897 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.349464:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826419.349592:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecaf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:2401:x1874670563916416:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 259us (1862us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826419.349606:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1202 00000100:00100000:0.0:1787826419.351591:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826419.351703:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563916544 00000100:00100000:2.0:1787826419.351714:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563916544 00010000:00010000:2.0:1787826419.351816:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b827b7 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab118d expref: 37 pid: 8247 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826419.351963:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1203 00000100:00100000:2.0:1787826419.351976:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecaf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:2403:x1874670563916544:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826419.351996:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826419.352004:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b827b7 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab118d expref: 37 pid: 8247 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.352019:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b827b7 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab118d expref: 37 pid: 8247 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.352047:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b827b7 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab118d expref: 37 pid: 8247 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.352066:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826419.352072:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82897 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.352084:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82897 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.352093:0:10340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82897 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.352139:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826419.352215:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecaf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:2403:x1874670563916544:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 241us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826419.352224:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1203 00010000:00010000:1.0:1787826419.352287:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82897 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.352296:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82897 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.352323:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b8289e lrc: 3/0,1 mode: --/EX res: [0x200000405:0x32:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.352352:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b8287b lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x32:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11e8 expref: 35 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.352362:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b8289e lrc: 4/0,1 mode: --/EX res: [0x200000405:0x32:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.352404:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b8287b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x32:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11e8 expref: 35 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.352420:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b8287b lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x32:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11e8 expref: 35 pid: 32404 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826419.352437:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f8743c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585263104:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826419.352527:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce02725c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826419.356702:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f8743c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585263104:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826419.356743:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b8289e lrc: 3/0,1 mode: --/EX res: [0x200000405:0x32:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826419.357661:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826419.357739:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563916672 00000100:00100000:2.0:1787826419.357747:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563916672 00010000:00010000:2.0:1787826419.357797:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b8287b lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x32:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11e8 expref: 36 pid: 32404 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826419.357847:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1204 00000100:00100000:2.0:1787826419.357926:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecac3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:2403:x1874670563916672:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826419.357947:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826419.358029:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b8287b lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11e8 expref: 36 pid: 32404 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.358045:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b8287b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11e8 expref: 36 pid: 32404 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.358079:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b8287b lrc: 0/0,0 mode: --/CR res: [0x200000405:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11e8 expref: 36 pid: 32404 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.358104:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x32:0x0].0x0 (ffff90cf39e67100) 00010000:00010000:2.0:1787826419.358113:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b8289e lrc: 3/0,1 mode: --/EX res: [0x200000405:0x32:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.358127:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b8289e lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x32:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.358137:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b8289e lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x32:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.358292:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826419.358373:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecac3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:2403:x1874670563916672:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 516us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826419.358383:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1204 00010000:00010000:3.0:1787826419.367782:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b8289e lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.367807:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b8289e lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826419.369435:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf1ecada40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1874670585263232:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787826419.369730:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826419.369820:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a18f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826419.369944:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585263232 00000100:00100000:2.0:1787826419.370024:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585263232 00000100:00100000:2.0:1787826419.370142:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1464 00000100:00100000:2.0:1787826419.370161:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6522:x1874670585263232:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787826419.370797:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6522:x1874670585263232:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 644us (1066us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826419.370807:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1464 00000100:00080000:3.0:1787826419.370877:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826419.371045:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf1ecada40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1874670585263232:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787826419.371115:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf1ecada40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1874670585263360:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787826419.371149:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826419.371219:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a18f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826419.371254:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585263360 00000100:00100000:2.0:1787826419.371259:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585263360 00000100:00100000:2.0:1787826419.371444:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1465 00000100:00100000:2.0:1787826419.371454:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecaed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6522:x1874670585263360:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787826419.371574:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecaed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6522:x1874670585263360:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 121us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826419.371581:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1465 00000100:00100000:0.0:1787826419.371696:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf1ecada40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1874670585263360:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787826419.371852:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589935036 00000100:00100000:0.0:1787826419.372072:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf1ecada40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1874670585263488:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787826419.372105:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826419.372133:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a18540 going to sleep for 11 seconds 00000100:00100000:2.0:1787826419.372189:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585263488 00000100:00100000:2.0:1787826419.372194:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585263488 00000100:00100000:2.0:1787826419.372231:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1466 00000100:00100000:2.0:1787826419.372240:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecafc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6522:x1874670585263488:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787826419.372670:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecafc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:6522:x1874670585263488:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 432us (563us total) trans 21474837013 rc 0/0 00000100:00100000:2.0:1787826419.372678:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1466 00000100:00100000:0.0:1787826419.372772:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf1ecada40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1874670585263488:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787826419.372850:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589935037 00010000:00010000:0.0:1787826419.373053:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b8289e lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.373065:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b8289e lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.373074:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b8289e lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.373081:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46aa00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826419.373086:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b8289e lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.373099:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b8289e lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.373119:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x32:0x0].0x0 (ffff90cf39e67100) 00010000:00010000:0.0:1787826419.373122:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787826419.373129:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b8289e lrc: 2/0,0 mode: --/EX res: [0x200000405:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.373136:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b8289e lrc: 0/0,0 mode: --/EX res: [0x200000405:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.373164:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82897 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.373170:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82897 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.373177:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82897 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.373183:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826419.373186:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82897 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.373192:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82897 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.373200:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826419.373203:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787826419.373206:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82897 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.373217:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82897 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.373232:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826419.373234:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787826419.373241:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b8283c lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11cc expref: 37 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826419.373500:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eea7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55606:x1874670563916032:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 32754us (33720us total) trans 8589935038 rc 0/0 00000100:00100000:0.0:1787826419.373511:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1173 00000020:00080000:0.0:1787826419.373516:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1787826419.376230:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826419.376349:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563916800 00000100:00100000:2.0:1787826419.376362:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563916800 00000100:00100000:2.0:1787826419.376513:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3862 00000100:00100000:2.0:1787826419.376525:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55606:x1874670563916800:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826419.376556:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826419.376582:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b828a5 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab11fd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.376668:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b828a5 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11fd expref: 37 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.376685:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b828a5 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11fd expref: 37 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.376707:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826419.376710:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826419.376715:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834400, rc 0) 00000100:00100000:2.0:1787826419.376787:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:55606:x1874670563916800:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 264us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826419.376795:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3862 00000100:00100000:1.0:1787826419.387624:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826419.388061:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563917056 00000100:00100000:3.0:1787826419.388078:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563917056 00000100:00100000:3.0:1787826419.388203:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1175 00000100:00100000:3.0:1787826419.388214:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f876580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:55606:x1874670563917056:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:3.0:1787826419.388551:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f876580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:55606:x1874670563917056:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 338us (942us total) trans 8589935039 rc 0/0 00000100:00100000:3.0:1787826419.388564:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1175 00000100:00100000:1.0:1787826419.392700:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826419.393008:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563917312 00000100:00100000:0.0:1787826419.393020:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563917312 00000100:00100000:0.0:1787826419.393127:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1176 00000100:00100000:0.0:1787826419.393140:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f874780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:55606:x1874670563917312:12345-192.168.203.39@tcp:35:lfs.0 00000004:00080000:0.0:1787826419.393600:0:6522:0:(mdd_object.c:4014:mdd_close()) Object [0x200000405:0x32:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:0.0:1787826419.393711:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b828ac lrc: 3/0,1 mode: --/PW res: [0x200000405:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.393733:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b828ac lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.393748:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b828ac lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.393817:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b828ac lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.393829:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b828ac lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.393835:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b828ac lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.393859:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787826419.393990:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f874780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+39:55606:x1874670563917312:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 852us (1305us total) trans 8589935040 rc 0/0 00000100:00100000:0.0:1787826419.393998:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1176 00010000:00010000:2.0:1787826419.394106:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826419.394116:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b828ac lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.394126:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165ee00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826419.394130:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b828ac lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.394138:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b828ac lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.394163:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x32:0x0].0x0 (ffff90cf39e67100) 00010000:00010000:2.0:1787826419.394166:0:8451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787826419.394173:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b828ac lrc: 1/0,0 mode: --/PW res: [0x200000405:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.394180:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b828ac lrc: 0/0,0 mode: --/PW res: [0x200000405:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.394197:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826419.394199:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826419.394201:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826419.423393:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826419.424416:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563917440 00000100:00100000:1.0:1787826419.424430:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563917440 00000100:00100000:1.0:1787826419.424673:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3863 00000100:00100000:1.0:1787826419.424687:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b430780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+39:55608:x1874670563917440:12345-192.168.203.39@tcp:101:getfattr.0 00010000:00010000:1.0:1787826419.424722:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826419.424764:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b828b3 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1204 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.424853:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b828ba lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.424872:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b828ba lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.424885:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b828ba lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.424900:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b828c1 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.424909:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b828c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.424916:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b828c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.425024:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b828c8 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.425033:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b828c8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.425040:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b828c8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826419.425089:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:1.0:1787826419.425094:0:16564:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826419.425118:0:16564:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b828c8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.425132:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b828c8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.425141:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b828ba lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.425148:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b828ba lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.425165:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b828ba lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.425176:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46ae00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826419.425180:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b828ba lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.425188:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b828ba lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.425203:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf3ab61400) 00010000:00010000:1.0:1787826419.425206:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826419.425212:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b828ba lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.425219:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b828ba lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.425238:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b828c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.425244:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b828c1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.425250:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b828c1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.425255:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46aa00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826419.425258:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b828c1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.425265:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b828c1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.425276:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf3ab61900) 00010000:00010000:1.0:1787826419.425279:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826419.425282:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b828c1 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.425289:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b828c1 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.425324:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b828b3 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1204 expref: 41 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.425340:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b828c8 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1204 expref: 40 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.425348:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826419.425351:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826419.425354:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46a400, rc 0) 00000100:00100000:1.0:1787826419.425447:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b430780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55608:x1874670563917440:12345-192.168.203.39@tcp:101:getfattr.0 Request processed in 764us (2182us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826419.425456:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3863 00000100:00100000:3.0:1787826419.463311:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826419.463550:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563917568 00000100:00100000:0.0:1787826419.463564:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563917568 00000100:00100000:0.0:1787826419.463648:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3864 00000100:00100000:0.0:1787826419.463660:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55612:x1874670563917568:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:0.0:1787826419.463786:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b828cf lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.463807:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b828cf lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.463822:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b828cf lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.463836:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b828d6 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.463843:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b828d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.463854:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b828d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.463949:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b828dd lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.463959:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b828dd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.463966:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b828dd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826419.464228:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:0.0:1787826419.464234:0:32404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826419.464250:0:32404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b828dd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.464267:0:32404:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b828cf lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.464275:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b828cf lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.464282:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b828cf lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.464289:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b828cf lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.464295:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165fa00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826419.464300:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b828cf lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.464309:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b828cf lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.464324:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf3abcb900) 00010000:00010000:0.0:1787826419.464328:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826419.464334:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b828cf lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.464341:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b828cf lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.464363:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b828d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.464370:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b828d6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.464376:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b828d6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.464380:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165ea00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826419.464383:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b828d6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.464390:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b828d6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.464397:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf3abcb300) 00010000:00010000:0.0:1787826419.464400:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826419.464403:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b828d6 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.464414:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b828d6 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.464425:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b828dd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.464431:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b828dd lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.464437:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b828dd lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.464442:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165e200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826419.464444:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b828dd lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.464450:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b828dd lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.464457:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826419.464459:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826419.464461:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b828dd lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.464467:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b828dd lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826419.464630:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55612:x1874670563917568:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 969us (1330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826419.464640:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3864 00000100:00100000:3.0:1787826419.495165:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826419.495504:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563917824 00000100:00100000:0.0:1787826419.495520:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563917824 00000100:00100000:2.0:1787826419.495700:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3865 00000100:00100000:2.0:1787826419.495715:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55614:x1874670563917824:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826419.495743:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826419.495771:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b828e4 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab120b expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.495905:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b828eb lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.495924:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b828eb lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.495943:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b828eb lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826419.495957:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:2.0:1787826419.496105:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b828e4 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab120b expref: 43 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.496127:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b828eb lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab120b expref: 42 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.496137:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826419.496140:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787826419.496145:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835800, rc 0) 00000100:00100000:2.0:1787826419.496244:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+42:55614:x1874670563917824:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 533us (1104us total) trans 8589935041 rc 0/0 00000100:00100000:2.0:1787826419.496256:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3865 00000100:00100000:1.0:1787826419.503739:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826419.504216:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563918080 00000100:00100000:2.0:1787826419.504229:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563918080 00000100:00100000:2.0:1787826419.504308:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3866 00000100:00100000:2.0:1787826419.504320:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+42:55614:x1874670563918080:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826419.504373:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826419.504401:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b828f9 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1212 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.504573:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b82900 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.504596:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b828c8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1204 expref: 43 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.504607:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b82900 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.504651:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b828c8 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1204 expref: 43 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.504666:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b828c8 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1204 expref: 43 pid: 16564 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826419.504684:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f937480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1874670585263616:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826419.504802:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce010f5e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826419.511138:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826419.511787:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563918208 00000100:00100000:0.0:1787826419.511799:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563918208 00010000:00010000:0.0:1787826419.511867:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b828c8 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1204 expref: 44 pid: 16564 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826419.511921:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1205 00000100:00100000:0.0:1787826419.511934:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8761c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:2403:x1874670563918208:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826419.511964:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826419.511972:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b828c8 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1204 expref: 44 pid: 16564 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.512231:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b828c8 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1204 expref: 44 pid: 16564 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.512264:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826419.512270:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b82900 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.512282:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b82900 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.512290:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b82900 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.512318:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826419.512415:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8761c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:2403:x1874670563918208:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 483us (1293us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826419.512423:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1205 00010000:00010000:2.0:1787826419.512720:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b828c8 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1204 expref: 43 pid: 16564 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826419.512741:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f937480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1874670585263616:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826419.512778:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b82900 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.512789:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b82900 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.512795:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b82900 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826419.512823:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:2.0:1787826419.514201:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b828f9 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1212 expref: 44 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.514231:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b82900 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1212 expref: 43 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.514240:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826419.514243:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787826419.514247:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835c00, rc 0) 00000100:00100000:2.0:1787826419.514397:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55614:x1874670563918080:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 10078us (10674us total) trans 8589935042 rc 0/0 00000100:00100000:2.0:1787826419.514407:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3866 00000100:00100000:1.0:1787826419.521564:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826419.527783:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563918336 00000100:00100000:0.0:1787826419.527806:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563918336 00000100:00100000:0.0:1787826419.527892:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1177 00000100:00100000:0.0:1787826419.527905:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55614:x1874670563918336:12345-192.168.203.39@tcp:33:lfs.0 00000100:00100000:0.0:1787826419.528558:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55614:x1874670563918336:12345-192.168.203.39@tcp:33:lfs.0 Request processed in 653us (7087us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826419.528569:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1177 00000100:00100000:1.0:1787826419.531382:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826419.532579:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563918592 00000100:00100000:0.0:1787826419.532597:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563918592 00000100:00100000:0.0:1787826419.532743:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1178 00000100:00100000:0.0:1787826419.532756:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f875e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55614:x1874670563918592:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:0.0:1787826419.533439:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f875e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55614:x1874670563918592:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 683us (2067us total) trans 8589935043 rc 0/0 00000100:00100000:0.0:1787826419.533450:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1178 00000100:00100000:2.0:1787826419.537705:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826419.538029:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563918848 00000100:00100000:1.0:1787826419.538044:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563918848 00000100:00100000:1.0:1787826419.538180:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3867 00000100:00100000:1.0:1787826419.538193:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f937480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55614:x1874670563918848:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826419.538230:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826419.538234:0:16564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:1.0:1787826419.538275:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b82900 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1212 expref: 44 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.538301:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b828eb lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab120b expref: 43 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.538313:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826419.538320:0:16564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826419.538348:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b8290e lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1219 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.538545:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b82915 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.538562:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b82915 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.538574:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b82915 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826419.538587:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:1.0:1787826419.538719:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b8290e lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1219 expref: 45 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.538736:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b82915 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1219 expref: 44 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.538751:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826419.538754:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787826419.538757:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46b400, rc 0) 00000100:00100000:1.0:1787826419.538851:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f937480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55614:x1874670563918848:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 660us (1160us total) trans 8589935044 rc 0/0 00000100:00100000:1.0:1787826419.538859:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3867 00000100:00100000:3.0:1787826419.541839:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826419.542006:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563919104 00000100:00100000:0.0:1787826419.542020:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563919104 00000100:00100000:0.0:1787826419.542093:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1179 00000100:00100000:0.0:1787826419.542104:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eea6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55614:x1874670563919104:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:0.0:1787826419.542209:0:6521:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000405:0x1d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b82915 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1219 expref: 44 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.542262:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b82923 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.542277:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b828a5 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11fd expref: 44 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.542292:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b82923 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.542346:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b828a5 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11fd expref: 44 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.542363:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b828a5 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11fd expref: 44 pid: 6520 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826419.542380:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0b431680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1874670585263744:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826419.542529:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce057f6540 going to sleep for 11 seconds 00000100:00100000:3.0:1787826419.545311:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0b431680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1874670585263744:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826419.545369:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b82923 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826419.547461:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826419.547995:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563919232 00000100:00100000:1.0:1787826419.548008:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563919232 00010000:00010000:1.0:1787826419.548067:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b828a5 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11fd expref: 45 pid: 6520 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826419.548118:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1206 00000100:00100000:1.0:1787826419.548130:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f934f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+45:2403:x1874670563919232:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826419.548150:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826419.548168:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b828a5 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11fd expref: 45 pid: 6520 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.548185:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b828a5 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11fd expref: 45 pid: 6520 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.548216:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b828a5 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11fd expref: 45 pid: 6520 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.548240:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826419.548246:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b82923 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.548258:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b82923 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.548266:0:10340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b82923 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.548298:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826419.548391:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f934f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:2403:x1874670563919232:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 262us (941us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826419.548399:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1206 00010000:00010000:3.0:1787826419.549277:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b82923 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.549291:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b82923 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.549713:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b82923 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.549724:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b82923 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.549732:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b82923 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.549738:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165ea00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826419.549743:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b82923 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.549752:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b82923 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.549868:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826419.549871:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787826419.549876:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b82923 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.549883:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b82923 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.549896:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826419.549898:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787826419.549905:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b82915 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1219 expref: 43 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826419.550064:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eea6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55614:x1874670563919104:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 7960us (8236us total) trans 8589935045 rc -22/-22 00000100:00100000:3.0:1787826419.550074:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1179 00000100:00100000:0.0:1787826419.554984:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826419.555089:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563919360 00000100:00100000:1.0:1787826419.555101:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563919360 00000100:00100000:1.0:1787826419.555233:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3868 00000100:00100000:1.0:1787826419.555246:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b4303c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55614:x1874670563919360:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826419.555279:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826419.555311:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b8292a lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1220 expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.555399:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b8292a lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1220 expref: 44 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.555419:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b8292a lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1220 expref: 44 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.555443:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826419.555447:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826419.555451:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46ba00, rc 0) 00000100:00100000:1.0:1787826419.555564:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b4303c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55614:x1874670563919360:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 320us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826419.555572:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3868 00000100:00100000:0.0:1787826419.560855:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826419.560944:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563919616 00000100:00100000:3.0:1787826419.560957:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563919616 00000100:00100000:3.0:1787826419.561033:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3869 00000100:00100000:3.0:1787826419.561046:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b433840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55614:x1874670563919616:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826419.561076:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826419.561107:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b82931 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1227 expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.562871:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b82938 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x33:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.562892:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b82938 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.562906:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b82938 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826419.562919:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x33:0x0]: returning size 0 00010000:00010000:3.0:1787826419.562978:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b82931 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1227 expref: 47 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.563020:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b82938 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1227 expref: 46 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.563030:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x33:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:3.0:1787826419.563033:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826419.563037:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401800, rc 0) 00000100:00100000:3.0:1787826419.563124:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b433840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+46:55614:x1874670563919616:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 2080us (2283us total) trans 8589935046 rc 0/0 00000100:00100000:3.0:1787826419.563134:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3869 00000100:00100000:3.0:1787826419.567083:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826419.567183:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563919872 00000100:00100000:2.0:1787826419.567210:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563919872 00000100:00100000:2.0:1787826419.567344:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3870 00000100:00100000:2.0:1787826419.567356:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a1b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+46:55614:x1874670563919872:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826419.567412:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826419.567456:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b82946 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab122e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.567656:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8294d lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.567673:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8294d lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.567688:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8294d lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826419.567703:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:2.0:1787826419.567842:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b82946 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab122e expref: 49 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.567860:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8294d lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab122e expref: 48 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.568286:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826419.568291:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787826419.568296:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834400, rc 0) 00000100:00100000:2.0:1787826419.568450:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a1b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55614:x1874670563919872:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1095us (1380us total) trans 8589935047 rc 0/0 00000100:00100000:2.0:1787826419.568512:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3870 00000100:00100000:0.0:1787826419.571671:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826419.571782:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563920128 00000100:00100000:1.0:1787826419.571795:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563920128 00000100:00100000:1.0:1787826419.571918:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1180 00000100:00100000:1.0:1787826419.571932:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b4321c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55614:x1874670563920128:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:1.0:1787826419.572106:0:14257:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000405:0x1d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8294d lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab122e expref: 48 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.572176:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b8295b lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.572192:0:14257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b8292a lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1220 expref: 48 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.572203:0:14257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b8295b lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.572250:0:14257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b8292a lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1220 expref: 48 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.572266:0:14257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b8292a lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1220 expref: 48 pid: 32404 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826419.572283:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f876d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585263872:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826419.572641:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce02725c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826419.576179:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826419.576286:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563920256 00000100:00100000:2.0:1787826419.576298:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563920256 00010000:00010000:2.0:1787826419.576370:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b8292a lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1220 expref: 49 pid: 32404 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826419.576418:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1207 00000100:00100000:2.0:1787826419.576429:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf185d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:2404:x1874670563920256:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826419.576448:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826419.576456:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b8292a lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1220 expref: 49 pid: 32404 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.576505:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b8292a lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1220 expref: 49 pid: 32404 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.576541:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826419.576548:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b8295b lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.576558:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b8295b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.576566:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b8295b lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.576591:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826419.576997:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf185d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:2404:x1874670563920256:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 566us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826419.577006:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1207 00010000:00010000:1.0:1787826419.577320:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b8292a lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1220 expref: 48 pid: 32404 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826419.577361:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f876d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585263872:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826419.577397:0:14257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b8295b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.577408:0:14257:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b8295b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.577414:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b8295b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.577440:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82962 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x33:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.577454:0:14257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b82938 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1227 expref: 47 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.577462:0:14257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82962 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x33:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.577522:0:14257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b82938 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1227 expref: 47 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.577537:0:14257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b82938 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1227 expref: 47 pid: 9966 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826419.577552:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f876d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585264000:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826419.577613:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce02725c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826419.587193:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f876d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585264000:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826419.587234:0:14257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82962 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x33:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826419.587284:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826419.587716:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563920384 00000100:00100000:1.0:1787826419.587725:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563920384 00010000:00010000:1.0:1787826419.587773:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b82938 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1227 expref: 48 pid: 9966 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826419.587820:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1208 00000100:00100000:1.0:1787826419.587831:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f934f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:2403:x1874670563920384:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826419.587850:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826419.587859:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b82938 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1227 expref: 48 pid: 9966 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.587873:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b82938 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1227 expref: 48 pid: 9966 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.587903:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b82938 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1227 expref: 48 pid: 9966 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.587922:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x33:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:1.0:1787826419.587929:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82962 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x33:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.587940:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82962 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x33:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.587949:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82962 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x33:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.588092:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826419.588175:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f934f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+47:2403:x1874670563920384:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 344us (1560us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826419.588184:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1208 00010000:00010000:0.0:1787826419.590266:0:14257:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82962 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x33:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.590287:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82962 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x33:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826419.590992:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0b430b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585264128:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1787826419.591151:0:14257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826419.593728:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce057f66c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826419.593839:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585264128 00000100:00100000:2.0:1787826419.593851:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585264128 00000100:00100000:2.0:1787826419.593972:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1467 00000100:00100000:2.0:1787826419.593984:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b4330c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:14257:x1874670585264128:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1787826419.594195:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b4330c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:14257:x1874670585264128:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 212us (3044us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826419.594204:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1467 00000100:00100000:0.0:1787826419.594289:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0b430b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585264128:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:0.0:1787826419.594402:0:14257:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589935048 00000001:00080000:0.0:1787826419.594561:0:14257:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589935049 00010000:00010000:0.0:1787826419.594585:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82962 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x33:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.594596:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82962 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x33:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.594604:0:14257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82962 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x33:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.594612:0:14257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46a600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826419.594617:0:14257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82962 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x33:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.594994:0:14257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82962 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x33:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.595029:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x33:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:0.0:1787826419.595032:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787826419.595038:0:14257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82962 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x33:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.595046:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82962 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x33:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.595075:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b8295b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.595082:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b8295b lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.595089:0:14257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b8295b lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.595100:0:14257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46b000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826419.595104:0:14257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b8295b lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.595111:0:14257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b8295b lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.595120:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826419.595122:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787826419.595126:0:14257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b8295b lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.595132:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b8295b lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.595146:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826419.595149:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787826419.595166:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8294d lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab122e expref: 49 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826419.595500:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b4321c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55614:x1874670563920128:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 23544us (23817us total) trans 8589935050 rc 0/0 00000100:00100000:0.0:1787826419.595512:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1180 00000020:00080000:0.0:1787826419.595517:0:14257:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1787826419.598765:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826419.598868:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563920512 00000100:00100000:1.0:1787826419.598881:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563920512 00000100:00100000:1.0:1787826419.598964:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3871 00000100:00100000:1.0:1787826419.598975:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b430b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55614:x1874670563920512:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826419.599133:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826419.599175:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82969 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1235 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.599259:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82969 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1235 expref: 49 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.599279:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82969 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1235 expref: 49 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.599527:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826419.599530:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826419.599536:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46ba00, rc 0) 00000100:00100000:1.0:1787826419.599621:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b430b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:55614:x1874670563920512:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 646us (868us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826419.600194:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3871 00000100:00100000:0.0:1787826419.605803:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826419.606160:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563920768 00000100:00100000:3.0:1787826419.606173:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563920768 00000100:00100000:3.0:1787826419.606316:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1181 00000100:00100000:3.0:1787826419.606343:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b430f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:55614:x1874670563920768:12345-192.168.203.39@tcp:35:lfs.0 00000004:00080000:3.0:1787826419.607026:0:6521:0:(mdd_object.c:4014:mdd_close()) Object [0x200000405:0x33:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787826419.607113:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].29, 64 off10528 00000004:00080000:3.0:1787826419.607128:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1365618656009ns, next at 1366618652827ns, rc = 0 00000001:00080000:3.0:1787826419.607137:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589935051 00010000:00010000:3.0:1787826419.607198:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b82970 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x33:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.607220:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b82970 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x33:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.607235:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b82970 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x33:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.607245:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b82970 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x33:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.607252:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b82970 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x33:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.607259:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b82970 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x33:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.607302:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787826419.607434:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b430f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+51:55614:x1874670563920768:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 1104us (1644us total) trans 8589935052 rc 0/0 00000100:00100000:3.0:1787826419.607444:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1181 00000020:00080000:3.0:1787826419.607451:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787826419.607969:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826419.607980:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b82970 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x33:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.607993:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400600 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826419.607998:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b82970 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x33:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.608015:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b82970 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x33:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.608031:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x33:0x0].0x0 (ffff90cf06894200) 00010000:00010000:0.0:1787826419.608035:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787826419.608040:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b82970 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x33:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.608047:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b82970 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x33:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.608070:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826419.608072:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826419.608074:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826419.610989:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826419.611137:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563921024 00000100:00100000:0.0:1787826419.611160:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563921024 00000100:00100000:0.0:1787826419.611237:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1182 00000100:00100000:0.0:1787826419.611251:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f936940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+51:55614:x1874670563921024:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:0.0:1787826419.611897:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f936940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+52:55614:x1874670563921024:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 376us (650us total) trans 8589935053 rc 0/0 00000100:00100000:0.0:1787826419.611911:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1182 00000100:00100000:1.0:1787826419.638550:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826419.638773:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563921152 00000100:00100000:0.0:1787826419.638786:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563921152 00000100:00100000:0.0:1787826419.638867:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3872 00000100:00100000:0.0:1787826419.638879:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f876d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+52:55616:x1874670563921152:12345-192.168.203.39@tcp:101:getfattr.0 00010000:00010000:0.0:1787826419.638914:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826419.638945:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b82977 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab123c expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.639045:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b8297e lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.639062:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b8297e lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.639077:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b8297e lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.639094:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b82985 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.639102:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b82985 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.639109:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b82985 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.639214:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b8298c lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.639224:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b8298c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.639231:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b8298c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826419.639281:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:0.0:1787826419.639287:0:32404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826419.639311:0:32404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b8298c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.639900:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b8298c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.639917:0:32404:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b8297e lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.639925:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b8297e lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.639932:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b8297e lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.639940:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b8297e lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.639947:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165ec00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826419.640002:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b8297e lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.640102:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b8297e lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.640119:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf3abcb300) 00010000:00010000:0.0:1787826419.640123:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826419.640128:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b8297e lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.640135:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b8297e lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.640167:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b82985 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.640174:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b82985 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.640180:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b82985 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.640186:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165fc00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826419.640189:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b82985 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.640194:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b82985 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.640202:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf3abcb900) 00010000:00010000:0.0:1787826419.640204:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826419.640207:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b82985 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.640214:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b82985 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.640256:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b82977 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab123c expref: 54 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.640272:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b8298c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab123c expref: 53 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.640286:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826419.640288:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826419.640291:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165e000, rc 0) 00000100:00100000:0.0:1787826419.641870:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f876d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55616:x1874670563921152:12345-192.168.203.39@tcp:101:getfattr.0 Request processed in 2976us (3318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826419.641885:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3872 00000100:00100000:1.0:1787826419.645790:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826419.645930:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563921280 00000100:00100000:2.0:1787826419.645943:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563921280 00000100:00100000:2.0:1787826419.646057:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2154 00000100:00100000:2.0:1787826419.646069:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f876580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670563921280:12345-192.168.203.39@tcp:101:getfattr.0 00010000:00010000:2.0:1787826419.646093:0:30696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826419.646116:0:30696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000159f1fa4/0x22153cd396b82993 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1243 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826419.646210:0:30696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f934b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:30696:1874670585264256:192.168.203.39@tcp:106: 00000100:00100000:2.0:1787826419.646311:0:30696:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce010f5900 going to sleep for 11 seconds 00000100:00100000:1.0:1787826419.650759:0:30696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f934b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:30696:1874670585264256:192.168.203.39@tcp:106: 00010000:00010000:1.0:1787826419.650820:0:30696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000159f1fa4/0x22153cd396b82993 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1243 expref: 11 pid: 30696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.650852:0:30696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000159f1fa4/0x22153cd396b82993 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1243 expref: 11 pid: 30696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.650869:0:30696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835800, rc 0) 00000100:00100000:1.0:1787826419.650946:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f876580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670563921280:12345-192.168.203.39@tcp:101:getfattr.0 Request processed in 4878us (5171us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826419.650957:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2154 00000100:00100000:0.0:1787826419.695095:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826419.695365:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563921408 00000100:00100000:3.0:1787826419.695378:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563921408 00000100:00100000:3.0:1787826419.695462:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3873 00000100:00100000:3.0:1787826419.695782:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b432940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55620:x1874670563921408:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:3.0:1787826419.695994:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b8299a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.696015:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b8299a lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.696032:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b8299a lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.696047:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b829a1 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.696055:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b829a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.696062:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b829a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.696176:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b829a8 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.696187:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b829a8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.696195:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b829a8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826419.696247:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:3.0:1787826419.696252:0:9966:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826419.696267:0:9966:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b829a8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.696285:0:9966:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b8299a lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.696293:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b8299a lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.696304:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b8299a lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.696311:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b8299a lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.696318:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826419.696323:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b8299a lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.696536:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b8299a lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.696554:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf06894400) 00010000:00010000:3.0:1787826419.696558:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826419.696563:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b8299a lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.696569:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b8299a lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.696596:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b829a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.696602:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b829a1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.696607:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b829a1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.696612:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826419.696615:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b829a1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.696621:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b829a1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.696708:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf06894200) 00010000:00010000:3.0:1787826419.696711:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826419.696715:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b829a1 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.696721:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b829a1 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.696733:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b829a8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.696739:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b829a8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.696746:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b829a8 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.696751:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826419.696754:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b829a8 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.696993:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b829a8 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.697002:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826419.697004:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826419.697008:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b829a8 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.697014:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b829a8 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826419.697209:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b432940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55620:x1874670563921408:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 1733us (2126us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826419.697220:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3873 00000100:00100000:1.0:1787826419.731262:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826419.732222:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563921664 00000100:00100000:2.0:1787826419.732241:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563921664 00000100:00100000:2.0:1787826419.732641:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3874 00000100:00100000:2.0:1787826419.732654:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f874780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55622:x1874670563921664:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826419.732683:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826419.732709:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b829af lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab124a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.732866:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b829b6 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.732888:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b829b6 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.732901:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b829b6 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826419.732915:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:2.0:1787826419.733061:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b829af lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab124a expref: 56 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.733083:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b829b6 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab124a expref: 55 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.733093:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826419.733096:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787826419.733100:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834c00, rc 0) 00000100:00100000:2.0:1787826419.733195:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f874780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+55:55622:x1874670563921664:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 543us (1948us total) trans 8589935054 rc 0/0 00000100:00100000:2.0:1787826419.733203:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3874 00000100:00100000:3.0:1787826419.738182:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826419.738502:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563921792 00000100:00100000:1.0:1787826419.738515:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563921792 00000100:00100000:1.0:1787826419.738612:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2155 00000100:00100000:1.0:1787826419.738627:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a1a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2402:x1874670563921792:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826419.738651:0:30695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826419.738676:0:30695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4b5afc1/0x22153cd396b829c4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1251 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826419.738759:0:30695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f8743c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:30695:1874670585264384:192.168.203.39@tcp:106: 00000100:00100000:1.0:1787826419.738898:0:30695:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce02725c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826419.743666:0:30695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f8743c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:30695:1874670585264384:192.168.203.39@tcp:106: 00010000:00010000:1.0:1787826419.743723:0:30695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a4b5afc1/0x22153cd396b829c4 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1251 expref: 11 pid: 30695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.743761:0:30695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4b5afc1/0x22153cd396b829c4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1251 expref: 11 pid: 30695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.743776:0:30695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46b000, rc 0) 00000100:00100000:1.0:1787826419.743902:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a1a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2402:x1874670563921792:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 5278us (5733us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826419.743913:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2155 00000100:00100000:3.0:1787826419.751394:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826419.753743:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563922048 00000100:00100000:2.0:1787826419.753826:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563922048 00000100:00100000:2.0:1787826419.753932:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3875 00000100:00100000:2.0:1787826419.753944:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a1b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+55:55622:x1874670563922048:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826419.754045:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826419.754073:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b829cb lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1258 expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.754227:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b829d2 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.754246:0:8247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b8298c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab123c expref: 56 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.754256:0:8247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b829d2 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.754315:0:8247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b8298c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab123c expref: 56 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.754332:0:8247:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b8298c lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab123c expref: 56 pid: 32404 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826419.754421:0:8247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f937c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8247:1874670585264512:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826419.754570:0:8247:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce010f5900 going to sleep for 11 seconds 00000100:00100000:3.0:1787826419.758451:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826419.758579:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563922176 00000100:00100000:1.0:1787826419.758590:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563922176 00010000:00010000:1.0:1787826419.758646:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b8298c lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab123c expref: 57 pid: 32404 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826419.758693:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1209 00000100:00100000:1.0:1787826419.758705:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a1a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+57:2403:x1874670563922176:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826419.758727:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826419.758735:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b8298c lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab123c expref: 57 pid: 32404 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.758751:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b8298c lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab123c expref: 57 pid: 32404 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.758780:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826419.758787:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b829d2 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.758804:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b829d2 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.758813:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b829d2 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.758838:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826419.758910:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a1a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+57:2403:x1874670563922176:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 207us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826419.758919:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1209 00010000:00010000:2.0:1787826419.759068:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b8298c lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab123c expref: 56 pid: 32404 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826419.759089:0:8247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f937c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8247:1874670585264512:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826419.759120:0:8247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b829d2 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.759130:0:8247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b829d2 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.759137:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b829d2 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826419.759177:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:2.0:1787826419.759353:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b829cb lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1258 expref: 57 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.759371:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b829d2 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1258 expref: 56 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.759379:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826419.759382:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787826419.759385:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835a00, rc 0) 00000100:00100000:2.0:1787826419.759414:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a1b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+56:55622:x1874670563922048:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 5473us (9187us total) trans 8589935055 rc 0/0 00000100:00100000:2.0:1787826419.759422:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3875 00000100:00100000:0.0:1787826419.763660:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826419.763868:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563922432 00000100:00100000:1.0:1787826419.763881:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563922432 00000100:00100000:1.0:1787826419.763988:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3876 00000100:00100000:1.0:1787826419.764002:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b431a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+56:55622:x1874670563922432:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826419.764037:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826419.764072:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b829e0 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab125f expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.765047:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b829e7 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.765068:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b829e7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.765082:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b829e7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826419.765095:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x34:0x0]: returning size 0 00010000:00010000:1.0:1787826419.765162:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b829e0 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab125f expref: 59 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.765192:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b829e7 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab125f expref: 58 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.765202:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x34:0x0].0x0 (ffff90cf3ab61900) 00010000:00010000:1.0:1787826419.765206:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826419.765209:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46a600, rc 0) 00000100:00100000:1.0:1787826419.765439:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b431a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:55622:x1874670563922432:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1439us (1793us total) trans 8589935056 rc 0/0 00000100:00100000:1.0:1787826419.765448:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3876 00000100:00100000:0.0:1787826419.768984:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826419.769110:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563922688 00000100:00100000:3.0:1787826419.769123:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563922688 00000100:00100000:3.0:1787826419.769246:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3877 00000100:00100000:3.0:1787826419.769260:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b433480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:55622:x1874670563922688:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826419.769296:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826419.769332:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b829f5 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1266 expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.769520:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b829fc lrc: 3/0,1 mode: --/EX res: [0x200000405:0x34:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.769537:0:9966:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b829e7 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab125f expref: 59 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.769547:0:9966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b829fc lrc: 4/0,1 mode: --/EX res: [0x200000405:0x34:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.769588:0:9966:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b829e7 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab125f expref: 59 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.769604:0:9966:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b829e7 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab125f expref: 59 pid: 32404 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826419.769620:0:9966:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03a18000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9966:1874670585264640:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826419.769730:0:9966:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf07f5a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826419.773636:0:9966:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03a18000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9966:1874670585264640:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826419.773690:0:9966:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b829fc lrc: 3/0,1 mode: --/EX res: [0x200000405:0x34:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826419.773700:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826419.773847:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563922816 00000100:00100000:2.0:1787826419.773856:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563922816 00010000:00010000:2.0:1787826419.773903:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b829e7 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab125f expref: 60 pid: 32404 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826419.773945:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1210 00000100:00100000:2.0:1787826419.773956:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a1bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:2404:x1874670563922816:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826419.774225:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826419.774235:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b829e7 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab125f expref: 60 pid: 32404 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.774251:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b829e7 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab125f expref: 60 pid: 32404 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.774283:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b829e7 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab125f expref: 60 pid: 32404 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.774302:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x34:0x0].0x0 (ffff90cf3ab61900) 00010000:00010000:2.0:1787826419.774308:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b829fc lrc: 3/0,1 mode: --/EX res: [0x200000405:0x34:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.774320:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b829fc lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x34:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.774329:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b829fc lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x34:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.774364:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826419.774516:0:9966:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b829fc lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.774524:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b829fc lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826419.774545:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x34:0x0]: returning size 0 00000004:00080000:3.0:1787826419.774764:0:9966:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x10b:0x0], index 1: 0 00010000:00010000:3.0:1787826419.774910:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b829fc lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.774919:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b829fc lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.774927:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b829fc lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.774934:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826419.774939:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b829fc lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.774947:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b829fc lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.774959:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x34:0x0].0x0 (ffff90cf3ab61900) 00010000:00010000:3.0:1787826419.774962:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826419.774966:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b829fc lrc: 2/0,0 mode: --/EX res: [0x200000405:0x34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.774973:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b829fc lrc: 0/0,0 mode: --/EX res: [0x200000405:0x34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.775027:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b829f5 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x34:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1266 expref: 60 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.775037:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x34:0x0].0x0 (ffff90cf3ab61900) 00010000:00010000:3.0:1787826419.775039:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787826419.775042:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b829f5 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x34:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1266 expref: 60 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.775057:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400c00, rc 0) 00000100:00100000:2.0:1787826419.775174:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a1bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:2404:x1874670563922816:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 1219us (1761us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826419.775185:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1210 00000100:00100000:3.0:1787826419.775352:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b433480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:55622:x1874670563922688:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 6094us (6379us total) trans 8589935057 rc 301/301 00000100:00100000:3.0:1787826419.775359:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3877 00000100:00100000:0.0:1787826419.779732:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826419.780022:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563923072 00000100:00100000:3.0:1787826419.780036:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563923072 00000100:00100000:3.0:1787826419.780107:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1183 00000100:00100000:3.0:1787826419.780119:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b432580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:55622:x1874670563923072:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:3.0:1787826419.781252:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b432580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55622:x1874670563923072:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 1128us (1528us total) trans 8589935058 rc 0/0 00000100:00100000:3.0:1787826419.781266:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1183 00000100:00100000:0.0:1787826419.784863:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826419.784960:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563923200 00000100:00100000:2.0:1787826419.784972:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563923200 00000100:00100000:2.0:1787826419.785045:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3878 00000100:00100000:2.0:1787826419.785057:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b433c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55622:x1874670563923200:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826419.785087:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826419.785112:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82a0a lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab126d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.785248:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b82a11 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.785266:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b829d2 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1258 expref: 60 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.785276:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b82a11 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.785317:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b829d2 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1258 expref: 60 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.785343:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b829d2 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1258 expref: 60 pid: 8247 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826419.785359:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f937c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1874670585264768:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826419.785766:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce010f5e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787826419.794672:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826419.794795:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563923328 00000100:00100000:1.0:1787826419.794807:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563923328 00010000:00010000:1.0:1787826419.794863:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b829d2 lrc: 5/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1258 expref: 61 pid: 8247 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826419.794918:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1211 00000100:00100000:1.0:1787826419.794930:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b432d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+61:2403:x1874670563923328:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826419.794949:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826419.794956:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b829d2 lrc: 5/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1258 expref: 61 pid: 8247 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.794971:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b829d2 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1258 expref: 61 pid: 8247 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.795002:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826419.795008:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b82a11 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.795020:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b82a11 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.795029:0:10340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b82a11 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.795052:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826419.795115:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b432d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+61:2403:x1874670563923328:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 187us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826419.795124:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1211 00010000:00010000:2.0:1787826419.795288:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b829d2 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1258 expref: 60 pid: 8247 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826419.795318:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f937c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1874670585264768:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826419.795358:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b82a11 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.795369:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b82a11 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.795375:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b82a11 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826419.795441:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:2.0:1787826419.795447:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826419.796080:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b82a11 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.796127:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82a0a lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab126d expref: 60 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.796148:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b82a11 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab126d expref: 59 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.796168:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826419.796172:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826419.796175:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834800, rc 0) 00000100:00100000:1.0:1787826419.796311:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b433c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55622:x1874670563923200:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 11254us (11458us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826419.796320:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3878 00000100:00100000:0.0:1787826419.800278:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826419.801240:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563923456 00000100:00100000:3.0:1787826419.801256:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563923456 00000100:00100000:0.0:1787826419.801825:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2156 00000100:00100000:0.0:1787826419.801838:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b431680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563923456:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826419.801863:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826419.801887:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac666fdd/0x22153cd396b82a18 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1274 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826419.801969:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03976940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1874670585264896:192.168.203.39@tcp:106: 00000100:00100000:0.0:1787826419.802090:0:8437:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce057f6000 going to sleep for 11 seconds 00000100:00100000:2.0:1787826419.806276:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03976940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1874670585264896:192.168.203.39@tcp:106: 00010000:00010000:2.0:1787826419.806404:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ac666fdd/0x22153cd396b82a18 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1274 expref: 11 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.806438:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac666fdd/0x22153cd396b82a18 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1274 expref: 11 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.806455:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165fe00, rc 0) 00000100:00100000:2.0:1787826419.806760:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b431680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563923456:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 4921us (6494us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826419.806770:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2156 00000100:00100000:3.0:1787826419.812619:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826419.812771:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563923584 00000100:00100000:2.0:1787826419.812785:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563923584 00000100:00100000:2.0:1787826419.812852:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3879 00000100:00100000:2.0:1787826419.812864:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a19680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55622:x1874670563923584:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826419.812892:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826419.812922:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82a1f lrc: 2/0,0 mode: --/CR res: [0x200000405:0x34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab127b expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.813019:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b82a26 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.813036:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b82a26 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x34:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.813051:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b82a26 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x34:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826419.813111:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x34:0x0]: returning size 0 00000004:00200000:2.0:1787826419.813116:0:8247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826419.813140:0:8247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b82a26 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x34:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.813182:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82a1f lrc: 0/0,0 mode: --/CR res: [0x200000405:0x34:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab127b expref: 61 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.813206:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b82a26 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x34:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab127b expref: 60 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.813216:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x34:0x0].0x0 (ffff90cf39e67b00) 00010000:00010000:2.0:1787826419.813219:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787826419.813223:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835a00, rc 0) 00000100:00100000:2.0:1787826419.813308:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a19680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:55622:x1874670563923584:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 445us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826419.813315:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3879 00000100:00100000:0.0:1787826419.818905:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826419.819002:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563923712 00000100:00100000:2.0:1787826419.819015:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563923712 00000100:00100000:2.0:1787826419.819124:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2157 00000100:00100000:2.0:1787826419.819137:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03976940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2403:x1874670563923712:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826419.819171:0:8545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826419.819207:0:8545:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c6f0c33/0x22153cd396b82a2d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x10b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1282 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787826419.819243:0:8545:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826419.819268:0:8545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10b:0x0].0x0 since=1365s v=(0 0) 00010000:00010000:2.0:1787826419.819275:0:8545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826419.819287:0:8545:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c6f0c33/0x22153cd396b82a2d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1282 expref: 14 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.819317:0:8545:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005c6f0c33/0x22153cd396b82a2d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1282 expref: 14 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.819335:0:8545:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834600, rc 0) 00000100:00100000:2.0:1787826419.819412:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03976940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2403:x1874670563923712:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 277us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826419.819420:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2157 00000100:00100000:1.0:1787826419.822739:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826419.823104:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563923968 00000100:00100000:2.0:1787826419.823117:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563923968 00000100:00100000:2.0:1787826419.823245:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3880 00000100:00100000:2.0:1787826419.823257:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:55622:x1874670563923968:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826419.823285:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826419.823313:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b82a34 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1289 expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.823514:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82a3b lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.823533:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82a3b lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.823548:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82a3b lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826419.823563:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:2.0:1787826419.823696:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b82a34 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1289 expref: 63 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.823720:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82a3b lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1289 expref: 62 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.823730:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826419.823734:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787826419.823737:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835800, rc 0) 00000100:00100000:2.0:1787826419.823829:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+62:55622:x1874670563923968:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 574us (1103us total) trans 8589935059 rc 0/0 00000100:00100000:2.0:1787826419.823837:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3880 00000100:00100000:3.0:1787826419.830293:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826419.831383:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563924096 00000100:00100000:0.0:1787826419.831400:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563924096 00000100:00100000:0.0:1787826419.831536:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2158 00000100:00100000:0.0:1787826419.831549:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a1a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563924096:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826419.831575:0:30398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826419.831600:0:30398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a67399c/0x22153cd396b82a49 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1290 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826419.831683:0:30398:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf136d7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:30398:1874670585265024:192.168.203.39@tcp:106: 00000100:00100000:0.0:1787826419.831805:0:30398:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce057f69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826419.842361:0:30398:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf136d7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:30398:1874670585265024:192.168.203.39@tcp:106: 00010000:00010000:2.0:1787826419.842422:0:30398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005a67399c/0x22153cd396b82a49 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1290 expref: 11 pid: 30398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.842456:0:30398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a67399c/0x22153cd396b82a49 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1290 expref: 11 pid: 30398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.842491:0:30398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165fc00, rc 0) 00000100:00100000:2.0:1787826419.842576:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a1a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563924096:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 11029us (12297us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826419.842587:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2158 00000100:00100000:1.0:1787826419.846936:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826419.847045:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563924224 00000100:00100000:2.0:1787826419.847057:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563924224 00000100:00100000:2.0:1787826419.847148:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2159 00000100:00100000:2.0:1787826419.847169:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f875e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670563924224:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826419.847191:0:30694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826419.847212:0:30694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b82a50 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1297 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826419.847281:0:30694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f937c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:30694:1874670585265152:192.168.203.39@tcp:106: 00000100:00100000:2.0:1787826419.847395:0:30694:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce010f5900 going to sleep for 11 seconds 00000100:00100000:1.0:1787826419.853397:0:30694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f937c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:30694:1874670585265152:192.168.203.39@tcp:106: 00010000:00010000:1.0:1787826419.853614:0:30694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b82a50 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1297 expref: 11 pid: 30694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.853647:0:30694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b82a50 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1297 expref: 11 pid: 30694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.853664:0:30694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835c00, rc 0) 00000100:00100000:1.0:1787826419.853797:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f875e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670563924224:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 6628us (6873us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826419.853818:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2159 00000100:00100000:0.0:1787826419.857868:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826419.858266:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563924352 00000100:00100000:3.0:1787826419.858281:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563924352 00000100:00100000:3.0:1787826419.858372:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2160 00000100:00100000:3.0:1787826419.858383:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136d4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563924352:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:3.0:1787826419.858444:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b82a57 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.858524:0:14864:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d39501d2/0x22153cd396b82882 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11ef expref: 10 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.858535:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x10a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826419.858541:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10a:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826419.858547:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b82a57 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.858831:0:14864:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d39501d2/0x22153cd396b82882 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11ef expref: 10 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.858849:0:14864:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d39501d2/0x22153cd396b82882 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11ef expref: 10 pid: 14864 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826419.858869:0:14864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03a192c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14864:1874670585265280:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826419.859974:0:14864:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf07f5ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1787826419.863557:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826419.863942:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563924480 00000100:00100000:1.0:1787826419.863954:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563924480 00010000:00010000:1.0:1787826419.864018:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d39501d2/0x22153cd396b82882 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11ef expref: 11 pid: 14864 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826419.864074:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1212 00000100:00100000:1.0:1787826419.864085:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f9370c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2404:x1874670563924480:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826419.864104:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826419.864133:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d39501d2/0x22153cd396b82882 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x10a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11ef expref: 11 pid: 14864 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.864149:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d39501d2/0x22153cd396b82882 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x10a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11ef expref: 11 pid: 14864 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.864193:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10a:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826419.864198:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10a:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826419.864207:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b82a57 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x10a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.864219:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b82a57 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x10a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.864244:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826419.864314:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f9370c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2404:x1874670563924480:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 230us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826419.864323:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1212 00010000:00010000:3.0:1787826419.864655:0:14864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d39501d2/0x22153cd396b82882 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11ef expref: 10 pid: 14864 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826419.864676:0:14864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03a192c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14864:1874670585265280:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826419.864705:0:14864:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b82a57 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x10a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.864719:0:14864:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b82a57 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x10a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.864726:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b82a57 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x10a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.864751:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b82a57 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x10a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.864760:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b82a57 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x10a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.864769:0:14864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b82a57 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.864777:0:14864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400c00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826419.864851:0:14864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b82a57 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.864861:0:14864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b82a57 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x10a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.864875:0:14864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b82a57 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x10a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.864883:0:14864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b82a57 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x10a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826419.864941:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136d4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563924352:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 6558us (7088us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826419.864950:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2160 00000100:00100000:0.0:1787826419.868557:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826419.870168:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563924608 00000100:00100000:1.0:1787826419.870185:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563924608 00000100:00100000:1.0:1787826419.870279:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2161 00000100:00100000:1.0:1787826419.870290:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670563924608:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826419.870315:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826419.870343:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000951304c9/0x22153cd396b82a5e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x10a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab129e expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826419.870376:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10a:0x0] initial LVB size: 0, mtime: 0x6a9010ec, atime: 0x6a9010ec, ctime: 0x6a9010f3, blocks: 0x0 00010000:00010000:1.0:1787826419.870402:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10a:0x0].0x0 since=1365s v=(0 0) 00010000:00010000:1.0:1787826419.870408:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826419.870420:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000951304c9/0x22153cd396b82a5e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab129e expref: 10 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.870441:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000951304c9/0x22153cd396b82a5e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab129e expref: 10 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.870457:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46b400, rc 0) 00000100:00100000:1.0:1787826419.870589:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670563924608:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 300us (2117us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826419.870597:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2161 00000100:00100000:2.0:1787826419.915263:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826419.916255:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563924736 00000100:00100000:3.0:1787826419.916270:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563924736 00000100:00100000:3.0:1787826419.916366:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3881 00000100:00100000:3.0:1787826419.916378:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f937c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+62:55622:x1874670563924736:12345-192.168.203.39@tcp:44:lfs.0 00000001:00080000:0.0:1787826419.925730:0:34481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935059 is committed 00000004:00080000:0.0:1787826419.925781:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 29 committed 00000020:00080000:0.0:1787826419.925836:0:34481:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90cf10a18f00 refcount 2 committed 0 result 0 batchid 4294969339 00000020:00080000:0.0:1787826419.925843:0:34481:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cf39612d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90cf10a18180 00000020:00080000:0.0:1787826419.925847:0:34481:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cf39612e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90ce01fd9a00 00000020:00080000:0.0:1787826419.925879:0:34481:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969338 batchid updated 00000020:00080000:3.0:1787826419.925957:0:34512:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969339 committed batchid 4294969338 00000020:00080000:3.0:1787826419.926061:0:34512:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969338 00000100:00100000:3.0:1787826419.926261:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f937c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:55622:x1874670563924736:12345-192.168.203.39@tcp:44:lfs.0 Request processed in 9877us (11005us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826419.926275:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3881 00010000:00010000:1.0:1787826419.929124:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82874 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.929146:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82874 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.929167:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82874 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.929176:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826419.929182:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82874 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.929191:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82874 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.929217:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x32:0x0].0x0 (ffff90cf39e67100) 00010000:00010000:1.0:1787826419.929221:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826419.929227:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82874 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.929235:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82874 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.929277:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b82889 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.929285:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b82889 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.929293:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b82889 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.929299:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165f400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826419.929302:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b82889 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.929319:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b82889 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.929334:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826419.929337:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826419.929341:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b82889 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826419.929381:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f934b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585265408:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787826419.929502:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826419.930091:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585265408 00000100:00100000:0.0:1787826419.930103:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585265408 00000100:00100000:0.0:1787826419.930178:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2162 00000100:00100000:0.0:1787826419.930190:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a192c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3646:x1874670585265408:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787826419.930231:0:8435:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:266 count 1 00010000:00010000:0.0:1787826419.930262:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002972f1b9/0x22153cd396b82a65 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.930287:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b82890 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11f6 expref: 13 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.930293:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b82889 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.930314:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x10a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826419.930320:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10a:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826419.930325:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002972f1b9/0x22153cd396b82a65 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.930382:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b82890 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11f6 expref: 13 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.930399:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b82890 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11f6 expref: 13 pid: 8435 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826419.930414:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0373ed00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1874670585265536:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826419.930518:0:8435:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce057f66c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826419.932444:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826419.932595:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563924864 00000100:00100000:3.0:1787826419.932606:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563924864 00000100:00100000:3.0:1787826419.932677:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2163 00000100:00100000:3.0:1787826419.932688:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecaf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563924864:12345-192.168.203.39@tcp:16:lfs.0 00000100:00100000:3.0:1787826419.932823:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecaf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563924864:12345-192.168.203.39@tcp:16:lfs.0 Request processed in 136us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826419.932832:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2163 00000100:00100000:0.0:1787826419.932957:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0373ed00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1874670585265536:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826419.933000:0:8435:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002972f1b9/0x22153cd396b82a65 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826419.936363:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826419.936526:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563924992 00000100:00100000:2.0:1787826419.936539:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563924992 00010000:00010000:2.0:1787826419.936597:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b82890 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11f6 expref: 14 pid: 8435 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826419.936645:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1213 00000100:00100000:2.0:1787826419.936655:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f874f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563924992:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826419.936675:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826419.936682:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b82890 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x10a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11f6 expref: 14 pid: 8435 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.936699:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b82890 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11f6 expref: 14 pid: 8435 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.936731:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a06ea081/0x22153cd396b82890 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab11f6 expref: 14 pid: 8435 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.936759:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10a:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826419.936764:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10a:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826419.936771:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002972f1b9/0x22153cd396b82a65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.936783:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002972f1b9/0x22153cd396b82a65 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.936823:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826419.936910:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f874f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2404:x1874670563924992:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 254us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826419.936919:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1213 00010000:00010000:0.0:1787826419.937112:0:8435:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002972f1b9/0x22153cd396b82a65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.937124:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002972f1b9/0x22153cd396b82a65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.937134:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002972f1b9/0x22153cd396b82a65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.937143:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002972f1b9/0x22153cd396b82a65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826419.937177:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787826419.937406:0:7460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826419.937415:0:7460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002972f1b9/0x22153cd396b82a65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.937425:0:7460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165ea00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:1.0:1787826419.937430:0:7460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002972f1b9/0x22153cd396b82a65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.937442:0:7460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002972f1b9/0x22153cd396b82a65 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.937458:0:7460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002972f1b9/0x22153cd396b82a65 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.937466:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002972f1b9/0x22153cd396b82a65 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.937518:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826419.937520:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826419.937523:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826419.937646:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a192c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3646:x1874670585265408:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7456us (8143us total) trans 17179869672 rc 0/0 00000100:00100000:0.0:1787826419.937656:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2162 00000004:00080000:2.0:1787826419.937781:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3f934b40/2, rc 0, transno 17179869672 00000100:00100000:2.0:1787826419.937789:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f934b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585265408:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787826419.953522:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826419.954424:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563925120 00000100:00100000:2.0:1787826419.954439:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563925120 00000100:00100000:2.0:1787826419.954559:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2164 00000100:00100000:2.0:1787826419.954572:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8761c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670563925120:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:2.0:1787826419.954633:0:30696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b82a6c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.954657:0:30696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826419.954662:0:30696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826419.954669:0:30696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b82a6c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.954692:0:30696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b82a6c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.954724:0:30696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b82a6c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.954733:0:30696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b82a6c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.954742:0:30696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b82a6c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.954749:0:30696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834a00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826419.954753:0:30696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b82a6c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.954763:0:30696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b82a6c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.954782:0:30696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b82a6c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.954789:0:30696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b82a6c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826419.954898:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8761c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670563925120:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 328us (1434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826419.954906:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2164 00000100:00100000:3.0:1787826419.962186:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826419.962314:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563925376 00000100:00100000:1.0:1787826419.962342:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563925376 00000100:00100000:1.0:1787826419.962420:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3882 00000100:00100000:1.0:1787826419.962432:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a18780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:55622:x1874670563925376:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:1.0:1787826419.962552:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826419.962592:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b82a26 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x34:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab127b expref: 33 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.962616:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x34:0x0].0x0 (ffff90cf39e67b00) 00010000:00010000:1.0:1787826419.962630:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826419.962675:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82a73 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.962692:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82a73 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.962703:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82a73 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826419.962870:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002cb40598 reply state 0000000066aa23e5 transno 8589935060 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82a73 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.962884:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82a73 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.962890:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x34:0x0].0x0 (ffff90cf3ab61b00) 00010000:00010000:1.0:1787826419.962893:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826419.962896:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826419.963769:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a18780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:55622:x1874670563925376:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 1330us (1721us total) trans 8589935060 rc 0/0 00000100:00100000:1.0:1787826419.963781:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3882 00000100:00100000:0.0:1787826419.967174:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826419.968635:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563925504 00000100:00100000:2.0:1787826419.968652:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563925504 00000100:00100000:2.0:1787826419.968755:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3883 00000100:00100000:2.0:1787826419.968767:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:55622:x1874670563925504:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826419.968802:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826419.968831:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82a7a lrc: 2/0,0 mode: --/CR res: [0x200000405:0x34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab12a5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.969224:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82a7a lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12a5 expref: 35 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.969244:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82a7a lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12a5 expref: 35 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826419.969270:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x34:0x0].0x0 (ffff90cf3ab61b00) 00010000:00010000:2.0:1787826419.969274:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826419.969279:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834a00, rc 0) 00000100:00100000:2.0:1787826419.969805:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:55622:x1874670563925504:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1038us (2654us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826419.969816:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3883 00000100:00100000:0.0:1787826419.979598:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826419.979814:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563925632 00000100:00100000:1.0:1787826419.979829:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563925632 00000100:00100000:1.0:1787826419.979909:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2165 00000100:00100000:1.0:1787826419.979921:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:55622:x1874670563925632:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826419.979945:0:30695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826419.979981:0:30695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006d542d7/0x22153cd396b82a81 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab12ac expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.980029:0:30695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005c6f0c33/0x22153cd396b82a2d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1282 expref: 14 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.980040:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826419.980056:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826419.980063:0:30695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006d542d7/0x22153cd396b82a81 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12ac expref: 14 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.980115:0:30695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005c6f0c33/0x22153cd396b82a2d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1282 expref: 14 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.980131:0:30695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005c6f0c33/0x22153cd396b82a2d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1282 expref: 14 pid: 8545 timeout: 1465 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826419.980148:0:30695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce049b92c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:30695:1874670585265664:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826419.980428:0:30695:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce02725cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826419.984307:0:30695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce049b92c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:30695:1874670585265664:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826419.984372:0:30695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000006d542d7/0x22153cd396b82a81 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12ac expref: 14 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826419.984401:0:30695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46aa00, rc 0) 00000100:00100000:1.0:1787826419.984550:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:55622:x1874670563925632:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 4630us (4966us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826419.984562:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2165 00000100:00100000:0.0:1787826419.986752:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826419.986855:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563925760 00000100:00100000:3.0:1787826419.986866:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563925760 00010000:00010000:3.0:1787826419.986920:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005c6f0c33/0x22153cd396b82a2d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1282 expref: 14 pid: 8545 timeout: 1465 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826419.987432:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1214 00000100:00100000:3.0:1787826419.987447:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf185db450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2403:x1874670563925760:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826419.987469:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826419.987531:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005c6f0c33/0x22153cd396b82a2d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x10b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1282 expref: 14 pid: 8545 timeout: 1465 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.987548:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005c6f0c33/0x22153cd396b82a2d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1282 expref: 14 pid: 8545 timeout: 1465 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.987579:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c6f0c33/0x22153cd396b82a2d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x10b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1282 expref: 14 pid: 8545 timeout: 1465 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.987603:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826419.987608:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826419.987616:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000006d542d7/0x22153cd396b82a81 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12ac expref: 13 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.987634:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006d542d7/0x22153cd396b82a81 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12ac expref: 13 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826419.987685:0:6503:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000006d542d7/0x22153cd396b82a81 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12ac expref: 13 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826419.987704:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03a18b40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6503:1874670585265792:192.168.203.39@tcp:105: 00000100:00100000:3.0:1787826419.987813:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf07f5a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826419.998741:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03a18b40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6503:1874670585265792:192.168.203.39@tcp:105: 00010000:00010000:3.0:1787826419.998782:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826419.998862:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf185db450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2403:x1874670563925760:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 11418us (12122us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826419.999113:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1214 00000100:00100000:2.0:1787826420.003130:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826420.003264:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563925888 00000100:00100000:1.0:1787826420.003277:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563925888 00000100:00100000:1.0:1787826420.003689:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2166 00000100:00100000:1.0:1787826420.003702:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2403:x1874670563925888:12345-192.168.203.39@tcp:2:lfs.0 00002000:00010000:1.0:1787826420.004420:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x10b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787826420.004425:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x10b:0x0] updating lvb mtime from disk: 0 -> 1787826412 00002000:00010000:1.0:1787826420.004428:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x10b:0x0] updating lvb atime from disk: 0 -> 1787826412 00002000:00010000:1.0:1787826420.004430:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x10b:0x0] updating lvb ctime from disk: 0 -> 1787826420 00002000:00010000:1.0:1787826420.004432:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x10b:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1787826420.004541:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2403:x1874670563925888:12345-192.168.203.39@tcp:2:lfs.0 Request processed in 841us (1425us total) trans 17179869673 rc 0/0 00000100:00100000:1.0:1787826420.004549:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2166 00000100:00100000:0.0:1787826420.008345:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826420.008442:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563926144 00000100:00100000:2.0:1787826420.008456:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563926144 00000100:00100000:2.0:1787826420.008585:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3884 00000100:00100000:2.0:1787826420.008598:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:55622:x1874670563926144:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:2.0:1787826420.008677:0:32404:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826420.008719:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b82a11 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab126d expref: 35 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.008744:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826420.008751:0:32404:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826420.008833:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b82a88 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.008851:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b82a88 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.008863:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b82a88 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826420.009008:0:32404:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e3785250 reply state 00000000d5ce2bee transno 8589935061 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b82a88 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.009022:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b82a88 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.009029:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826420.009032:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826420.009036:0:32404:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826420.009293:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55622:x1874670563926144:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 697us (971us total) trans 8589935061 rc 0/0 00000100:00100000:2.0:1787826420.009301:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3884 00000100:00100000:0.0:1787826420.011873:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826420.012189:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563926272 00000100:00100000:2.0:1787826420.012204:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563926272 00000100:00100000:2.0:1787826420.012345:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2167 00000100:00100000:2.0:1787826420.012358:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03890780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:55622:x1874670563926272:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826420.012382:0:8545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826420.012411:0:8545:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b82a8f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab12b3 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.012453:0:8545:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000951304c9/0x22153cd396b82a5e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab129e expref: 11 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.012465:0:8545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10a:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787826420.012503:0:8545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826420.012511:0:8545:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b82a8f lrc: 4/0,0 mode: --/PW res: [0x280000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12b3 expref: 11 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.012558:0:8545:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000951304c9/0x22153cd396b82a5e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab129e expref: 11 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.012575:0:8545:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000951304c9/0x22153cd396b82a5e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab129e expref: 11 pid: 8436 timeout: 1466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826420.012593:0:8545:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf1ecac3c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8545:1874670585265920:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826420.012692:0:8545:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce010f5480 going to sleep for 11 seconds 00000100:00100000:3.0:1787826420.018190:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826420.018436:0:8545:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf1ecac3c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8545:1874670585265920:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826420.018979:0:8545:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b82a8f lrc: 3/0,0 mode: --/PW res: [0x280000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12b3 expref: 11 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.019010:0:8545:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835c00, rc 0) 00000100:00100000:0.0:1787826420.019210:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563926400 00000100:00100000:0.0:1787826420.019220:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563926400 00010000:00010000:0.0:1787826420.019267:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000951304c9/0x22153cd396b82a5e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab129e expref: 12 pid: 8436 timeout: 1466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826420.019318:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1215 00000100:00100000:0.0:1787826420.019330:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a1a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563926400:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826420.019350:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826420.019378:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000951304c9/0x22153cd396b82a5e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x10a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab129e expref: 12 pid: 8436 timeout: 1466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.019394:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000951304c9/0x22153cd396b82a5e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab129e expref: 12 pid: 8436 timeout: 1466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.019433:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000951304c9/0x22153cd396b82a5e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x10a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab129e expref: 12 pid: 8436 timeout: 1466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.019452:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826420.019457:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826420.019465:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b82a8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12b3 expref: 11 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.019521:0:10341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b82a8f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12b3 expref: 11 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.019571:0:10341:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b82a8f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12b3 expref: 11 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826420.019589:0:10341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f80a1c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10341:1874670585266048:192.168.203.39@tcp:105: 00000100:00100000:2.0:1787826420.019883:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03890780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:55622:x1874670563926272:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 7525us (8019us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826420.019893:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2167 00000100:00100000:0.0:1787826420.019983:0:10341:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce057f66c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826420.022997:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826420.023424:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563926528 00000100:00100000:2.0:1787826420.023437:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563926528 00000100:00100000:1.0:1787826420.023752:0:10341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f80a1c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10341:1874670585266048:192.168.203.39@tcp:105: 00010000:00010000:1.0:1787826420.023790:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826420.023869:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a1a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2404:x1874670563926400:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4540us (5694us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826420.023886:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1215 00000100:00100000:2.0:1787826420.023970:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2168 00000100:00100000:2.0:1787826420.023983:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563926528:12345-192.168.203.39@tcp:2:lfs.0 00002000:00010000:2.0:1787826420.024363:0:30398:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x10a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787826420.024368:0:30398:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x10a:0x0] updating lvb mtime from disk: 1787826412 -> 1787826412 00002000:00010000:2.0:1787826420.024370:0:30398:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x10a:0x0] updating lvb atime from disk: 1787826412 -> 1787826412 00002000:00010000:2.0:1787826420.024373:0:30398:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x10a:0x0] updating lvb ctime from disk: 1787826419 -> 1787826420 00002000:00010000:2.0:1787826420.024374:0:30398:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x10a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1787826420.024409:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2404:x1874670563926528:12345-192.168.203.39@tcp:2:lfs.0 Request processed in 429us (1428us total) trans 21474837014 rc 0/0 00000100:00100000:2.0:1787826420.024417:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2168 00000100:00100000:2.0:1787826420.030690:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826420.030849:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563926784 00000100:00100000:0.0:1787826420.030866:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563926784 00000100:00100000:0.0:1787826420.030943:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1184 00000100:00100000:0.0:1787826420.030955:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eea5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55622:x1874670563926784:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:0.0:1787826420.031069:0:6522:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000405:0x1d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82a3b lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1289 expref: 36 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.031130:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b82a96 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.031145:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82969 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1235 expref: 36 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.031167:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b829b6 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab124a expref: 36 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.031175:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b82a96 lrc: 5/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.031297:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b829b6 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab124a expref: 36 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.031314:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b829b6 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab124a expref: 36 pid: 6520 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826420.031333:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f82da40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585266176:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826420.031672:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82969 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1235 expref: 36 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.031682:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82969 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1235 expref: 36 pid: 16564 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826420.031692:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f82e580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585266304:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826420.031725:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce057f69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826420.035236:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f82da40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585266176:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826420.035260:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f82e580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585266304:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826420.035301:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b82a96 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826420.035873:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826420.035916:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00010000:00010000:1.0:1787826420.035984:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826420.036303:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563927168 00000100:00100000:0.0:1787826420.036313:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563927168 00000100:00100000:3.0:1787826420.036427:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563927040 00010000:00010000:0.0:1787826420.036428:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82969 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1235 expref: 37 pid: 16564 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826420.036432:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563927040 00000100:00100000:0.0:1787826420.036496:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1216 00000100:00100000:3.0:1787826420.036496:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1185 00000100:00100000:0.0:1787826420.036507:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05120780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:2404:x1874670563927168:12345-192.168.203.39@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787826420.036520:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:42221:x1874670563927040:12345-192.168.203.39@tcp:35:ldlm_bl.0 00010000:00010000:0.0:1787826420.036622:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826420.036632:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82969 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1235 expref: 38 pid: 16564 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.036645:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82969 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1235 expref: 38 pid: 16564 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.036673:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82969 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1235 expref: 38 pid: 16564 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.036692:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826420.036698:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b82a96 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.036711:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b82a96 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.036718:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826420.036930:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05120780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:2404:x1874670563927168:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 423us (1011us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826420.036939:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1216 00000100:00100000:2.0:1787826420.041888:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:42221:x1874670563927040:12345-192.168.203.39@tcp:35:ldlm_bl.0 Request processed in 5355us (5996us total) trans 8589935062 rc 0/0 00000100:00100000:2.0:1787826420.041909:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1185 00000100:00100000:3.0:1787826420.044020:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826420.044211:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563927296 00000100:00100000:0.0:1787826420.044226:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563927296 00010000:00010000:0.0:1787826420.044282:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b829b6 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab124a expref: 37 pid: 6520 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826420.044346:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1217 00000100:00100000:0.0:1787826420.044588:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a1bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:2403:x1874670563927296:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826420.044611:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826420.044620:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b829b6 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab124a expref: 37 pid: 6520 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.044636:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b829b6 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab124a expref: 37 pid: 6520 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.044669:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b829b6 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab124a expref: 37 pid: 6520 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.044691:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826420.044698:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b82a96 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.044711:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b82a96 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.044720:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b82a96 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.044771:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826420.044844:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a1bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:2403:x1874670563927296:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 265us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826420.044853:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1217 00010000:00010000:2.0:1787826420.046245:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b82a96 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.046267:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b82a96 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.046305:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b82a9d lrc: 3/0,1 mode: --/EX res: [0x200000405:0x34:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.046323:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82a7a lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x34:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12a5 expref: 35 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.046333:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b82a9d lrc: 4/0,1 mode: --/EX res: [0x200000405:0x34:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.046385:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82a7a lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x34:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12a5 expref: 35 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.046402:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82a7a lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x34:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12a5 expref: 35 pid: 6518 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826420.046419:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce05123840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585266432:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826420.046555:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce010f5480 going to sleep for 11 seconds 00000100:00100000:2.0:1787826420.053623:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce05123840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585266432:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826420.053678:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b82a9d lrc: 3/0,1 mode: --/EX res: [0x200000405:0x34:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826420.055116:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826420.055704:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563927424 00000100:00100000:0.0:1787826420.055717:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563927424 00010000:00010000:0.0:1787826420.055790:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82a7a lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x34:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12a5 expref: 36 pid: 6518 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826420.055832:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1218 00000100:00100000:0.0:1787826420.055843:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce049b92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:2401:x1874670563927424:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826420.055868:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826420.055878:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82a7a lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x34:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12a5 expref: 36 pid: 6518 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.055893:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82a7a lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x34:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12a5 expref: 36 pid: 6518 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.055924:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82a7a lrc: 0/0,0 mode: --/CR res: [0x200000405:0x34:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12a5 expref: 36 pid: 6518 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.055950:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x34:0x0].0x0 (ffff90cf3ab61b00) 00010000:00010000:0.0:1787826420.055956:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b82a9d lrc: 3/0,1 mode: --/EX res: [0x200000405:0x34:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.055968:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b82a9d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x34:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.055978:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b82a9d lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x34:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.056022:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826420.056202:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b82a9d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x34:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826420.056211:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce049b92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:2401:x1874670563927424:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 362us (1098us total) trans 0 rc 0/0 00010000:00010000:2.0:1787826420.056212:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b82a9d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x34:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826420.056220:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1218 00000100:00100000:2.0:1787826420.056691:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce05123840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1874670585266560:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787826420.056789:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826420.056836:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce010f5900 going to sleep for 11 seconds 00000100:00100000:1.0:1787826420.057036:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585266560 00000100:00100000:1.0:1787826420.057042:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585266560 00000100:00100000:1.0:1787826420.057100:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1468 00000100:00100000:1.0:1787826420.057109:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:6522:x1874670585266560:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787826420.057248:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:6522:x1874670585266560:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 140us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826420.057256:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1468 00000100:00100000:2.0:1787826420.057309:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce05123840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1874670585266560:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787826420.057381:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce05123840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1874670585266688:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787826420.061765:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826420.061837:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585266688 00000100:00100000:2.0:1787826420.061844:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3ab4c600 going to sleep for 11 seconds 00000100:00100000:3.0:1787826420.061851:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585266688 00000100:00100000:3.0:1787826420.061935:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1469 00000100:00100000:3.0:1787826420.061947:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03984000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:6522:x1874670585266688:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787826420.062131:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03984000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:6522:x1874670585266688:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 186us (4715us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826420.062139:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1469 00000100:00100000:2.0:1787826420.062209:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce05123840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1874670585266688:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787826420.062412:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589935063 00000100:00100000:2.0:1787826420.062564:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce05123840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1874670585266816:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787826420.062612:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826420.062690:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf396cf180 going to sleep for 11 seconds 00000100:00100000:1.0:1787826420.066917:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585266816 00000100:00100000:1.0:1787826420.066941:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585266816 00000100:00100000:1.0:1787826420.067038:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1470 00000100:00100000:1.0:1787826420.067051:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:6522:x1874670585266816:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787826420.067638:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:6522:x1874670585266816:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 586us (5021us total) trans 17179869674 rc 0/0 00000100:00100000:1.0:1787826420.067649:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1470 00000100:00100000:2.0:1787826420.067887:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce05123840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1874670585266816:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787826420.067995:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589935064 00010000:00010000:2.0:1787826420.068041:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b82a9d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x34:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.068054:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b82a9d lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x34:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.068062:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b82a9d lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x34:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.068069:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826420.068074:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b82a9d lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x34:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.068085:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b82a9d lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x34:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.068111:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x34:0x0].0x0 (ffff90cf3ab61b00) 00010000:00010000:2.0:1787826420.068115:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787826420.068121:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b82a9d lrc: 2/0,0 mode: --/EX res: [0x200000405:0x34:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.068128:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b82a9d lrc: 0/0,0 mode: --/EX res: [0x200000405:0x34:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.068144:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b82a96 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.068162:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b82a96 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.068168:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b82a96 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.068173:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165fa00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826420.068176:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b82a96 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.068182:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b82a96 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.068190:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826420.068193:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787826420.068196:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b82a96 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.068208:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b82a96 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.068222:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826420.068224:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787826420.068232:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82a3b lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1289 expref: 37 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826420.068347:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eea5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55622:x1874670563926784:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 37393us (37673us total) trans 8589935065 rc 0/0 00000100:00100000:2.0:1787826420.068357:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1184 00000020:00080000:2.0:1787826420.068360:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1787826420.072650:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826420.072759:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563927552 00000100:00100000:3.0:1787826420.072772:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563927552 00000100:00100000:3.0:1787826420.072855:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3885 00000100:00100000:3.0:1787826420.072867:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f80a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55622:x1874670563927552:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826420.072901:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826420.072927:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b82aa4 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab12ba expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.073078:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b82aa4 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12ba expref: 37 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.073097:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b82aa4 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12ba expref: 37 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.073124:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826420.073128:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826420.073132:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400400, rc 0) 00000100:00100000:3.0:1787826420.073767:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f80a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:55622:x1874670563927552:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 898us (1132us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826420.073776:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3885 00000100:00100000:3.0:1787826420.077907:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826420.078708:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563927808 00000100:00100000:2.0:1787826420.078723:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563927808 00000100:00100000:2.0:1787826420.078856:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1186 00000100:00100000:2.0:1787826420.078870:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a18b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:55622:x1874670563927808:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:2.0:1787826420.079898:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a18b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:55622:x1874670563927808:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 1025us (2000us total) trans 8589935066 rc 0/0 00000100:00100000:2.0:1787826420.079911:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1186 00000100:00100000:3.0:1787826420.082585:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826420.082928:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563928064 00000100:00100000:2.0:1787826420.082942:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563928064 00000100:00100000:2.0:1787826420.083031:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1187 00000100:00100000:2.0:1787826420.083042:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a19a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:55622:x1874670563928064:12345-192.168.203.39@tcp:35:lfs.0 00000004:00080000:2.0:1787826420.083328:0:6522:0:(mdd_object.c:4014:mdd_close()) Object [0x200000405:0x34:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:2.0:1787826420.084114:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82aab lrc: 3/0,1 mode: --/PW res: [0x200000405:0x34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.084142:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82aab lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.084166:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82aab lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.084176:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82aab lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.084183:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82aab lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.084190:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82aab lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.084777:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787826420.084910:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a19a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+39:55622:x1874670563928064:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 1863us (2335us total) trans 8589935067 rc 0/0 00000100:00100000:2.0:1787826420.084920:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1187 00010000:00010000:0.0:1787826420.086249:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826420.086266:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82aab lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.086279:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835800 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826420.086284:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82aab lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.086295:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82aab lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.086319:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x34:0x0].0x0 (ffff90cf3ab61b00) 00010000:00010000:0.0:1787826420.086322:0:8451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787826420.086328:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82aab lrc: 1/0,0 mode: --/PW res: [0x200000405:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.086562:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82aab lrc: 0/0,0 mode: --/PW res: [0x200000405:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.086585:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826420.086587:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826420.086589:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826420.102219:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826420.102445:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563928192 00000100:00100000:1.0:1787826420.102458:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563928192 00000100:00100000:1.0:1787826420.102564:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3886 00000100:00100000:1.0:1787826420.102575:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+39:55624:x1874670563928192:12345-192.168.203.39@tcp:101:getfattr.0 00010000:00010000:1.0:1787826420.102607:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826420.102635:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b82ab2 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab12c1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.102720:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82ab9 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.102736:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82ab9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.102749:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82ab9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.102763:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b82ac0 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.102770:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b82ac0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.102777:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b82ac0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.102861:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b82ac7 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.102870:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b82ac7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.102876:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b82ac7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826420.102923:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:1.0:1787826420.102928:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826420.102950:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b82ac7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.102967:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b82ac7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.103130:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82ab9 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.103142:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82ab9 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.103157:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82ab9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.103165:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82ab9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.103173:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46a600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826420.103178:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82ab9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.103187:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82ab9 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.103202:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf04f8bb00) 00010000:00010000:1.0:1787826420.103206:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826420.103330:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82ab9 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.103338:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82ab9 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.103395:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b82ac0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.103403:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b82ac0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.103410:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b82ac0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.103415:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46b000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826420.103418:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b82ac0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.103423:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b82ac0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.103432:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf04f8b400) 00010000:00010000:1.0:1787826420.103434:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826420.103438:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b82ac0 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.103444:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b82ac0 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.103572:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b82ab2 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12c1 expref: 41 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.103589:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b82ac7 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12c1 expref: 40 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.103597:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826420.103600:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826420.103603:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46ac00, rc 0) 00000100:00100000:1.0:1787826420.103681:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55624:x1874670563928192:12345-192.168.203.39@tcp:101:getfattr.0 Request processed in 1107us (1484us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826420.103690:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3886 00000100:00100000:3.0:1787826420.141459:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826420.141639:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563928320 00000100:00100000:1.0:1787826420.141653:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563928320 00000100:00100000:1.0:1787826420.141724:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3887 00000100:00100000:1.0:1787826420.141735:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a19e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55628:x1874670563928320:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:1.0:1787826420.141960:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b82ace lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.142043:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b82ace lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.142055:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b82ace lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.142067:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b82ad5 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.142072:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b82ad5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.142076:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b82ad5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.142170:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82adc lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.142178:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82adc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.142185:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82adc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826420.142232:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:1.0:1787826420.142237:0:16564:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826420.142252:0:16564:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82adc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.142268:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b82ace lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.142275:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b82ace lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.142283:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b82ace lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.142290:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46bc00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826420.142296:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b82ace lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.142306:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b82ace lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.142319:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf04f8bb00) 00010000:00010000:1.0:1787826420.142322:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826420.142328:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b82ace lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.142555:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b82ace lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.142584:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b82ad5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.142592:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b82ad5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.142599:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b82ad5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.142605:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46b000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826420.142608:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b82ad5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.142614:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b82ad5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.142624:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf04f8b400) 00010000:00010000:1.0:1787826420.142626:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826420.142630:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b82ad5 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.142636:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b82ad5 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.142648:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82adc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.142654:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82adc lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.142660:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82adc lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.142667:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46a600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826420.142670:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82adc lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.142675:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82adc lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.142681:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826420.142682:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826420.142684:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82adc lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.142688:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82adc lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826420.142847:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a19e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55628:x1874670563928320:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 1111us (1401us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826420.142858:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3887 00000100:00100000:2.0:1787826420.164648:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826420.164779:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563928576 00000100:00100000:1.0:1787826420.164793:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563928576 00000100:00100000:1.0:1787826420.164875:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3888 00000100:00100000:1.0:1787826420.164887:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55630:x1874670563928576:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826420.164912:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826420.164939:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82ae3 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab12c8 expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.165100:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b82aea lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.165123:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b82aea lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.165138:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b82aea lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826420.165162:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:1.0:1787826420.165310:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82ae3 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12c8 expref: 43 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.165336:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b82aea lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12c8 expref: 42 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.165347:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826420.165360:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787826420.165364:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46b000, rc 0) 00000100:00100000:1.0:1787826420.165450:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+42:55630:x1874670563928576:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 565us (819us total) trans 8589935068 rc 0/0 00000100:00100000:1.0:1787826420.165459:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3888 00000100:00100000:3.0:1787826420.171440:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826420.171676:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563928832 00000100:00100000:0.0:1787826420.171689:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563928832 00000100:00100000:0.0:1787826420.171824:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3889 00000100:00100000:0.0:1787826420.171837:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a1ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+42:55630:x1874670563928832:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826420.171875:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826420.171903:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b82af8 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab12cf expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.172054:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b82aff lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.172072:0:9966:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b82ac7 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12c1 expref: 43 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.172082:0:9966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b82aff lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.172127:0:9966:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b82ac7 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12c1 expref: 43 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.172143:0:9966:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b82ac7 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12c1 expref: 43 pid: 6520 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826420.172178:0:9966:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f82e580 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9966:1874670585266944:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826420.172310:0:9966:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce057f69c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826420.178102:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826420.178271:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563928960 00000100:00100000:1.0:1787826420.178284:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563928960 00010000:00010000:1.0:1787826420.178354:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b82ac7 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12c1 expref: 44 pid: 6520 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826420.178406:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1219 00000100:00100000:1.0:1787826420.178563:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a18f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:2403:x1874670563928960:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826420.178588:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826420.178598:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b82ac7 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12c1 expref: 44 pid: 6520 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.178615:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b82ac7 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12c1 expref: 44 pid: 6520 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.178650:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826420.178657:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b82aff lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.178670:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b82aff lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.178684:0:10340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b82aff lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.178709:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826420.178714:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b82ac7 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12c1 expref: 44 pid: 6520 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826420.178734:0:9966:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f82e580 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9966:1874670585266944:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826420.178777:0:9966:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b82aff lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826420.178781:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a18f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:2403:x1874670563928960:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 366us (694us total) trans 0 rc 0/0 00010000:00010000:0.0:1787826420.178788:0:9966:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b82aff lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826420.178790:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1219 00010000:00010000:0.0:1787826420.178794:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b82aff lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826420.178826:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:0.0:1787826420.179007:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b82af8 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12cf expref: 44 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.179025:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b82aff lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12cf expref: 43 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.179034:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826420.179037:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787826420.179039:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165e400, rc 0) 00000100:00100000:0.0:1787826420.179071:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a1ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55630:x1874670563928832:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 7236us (7654us total) trans 8589935069 rc 0/0 00000100:00100000:0.0:1787826420.179081:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3889 00000100:00100000:1.0:1787826420.182873:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826420.183269:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563929088 00000100:00100000:2.0:1787826420.183282:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563929088 00000100:00100000:2.0:1787826420.183776:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1188 00000100:00100000:2.0:1787826420.183792:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55630:x1874670563929088:12345-192.168.203.39@tcp:33:lfs.0 00000100:00100000:2.0:1787826420.184031:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55630:x1874670563929088:12345-192.168.203.39@tcp:33:lfs.0 Request processed in 243us (1172us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826420.184040:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1188 00000100:00100000:2.0:1787826420.187261:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826420.187366:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563929344 00000100:00100000:0.0:1787826420.187380:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563929344 00000100:00100000:0.0:1787826420.187450:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1189 00000100:00100000:0.0:1787826420.187462:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55630:x1874670563929344:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:0.0:1787826420.187819:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55630:x1874670563929344:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 356us (573us total) trans 8589935070 rc 0/0 00000100:00100000:0.0:1787826420.187827:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1189 00000100:00100000:3.0:1787826420.194747:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826420.195455:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563929600 00000100:00100000:1.0:1787826420.195499:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563929600 00000100:00100000:1.0:1787826420.195630:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3890 00000100:00100000:1.0:1787826420.195643:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55630:x1874670563929600:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826420.195678:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826420.195682:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:1.0:1787826420.195719:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b82aff lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12cf expref: 44 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.195752:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b82aea lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12c8 expref: 43 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.195776:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826420.195783:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826420.195801:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82b0d lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab12d6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.195937:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82b14 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.195955:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82b14 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.195967:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82b14 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826420.196164:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:1.0:1787826420.196311:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82b0d lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12d6 expref: 45 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.196345:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82b14 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12d6 expref: 44 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.196353:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826420.196356:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787826420.196359:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46ba00, rc 0) 00000100:00100000:1.0:1787826420.196451:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55630:x1874670563929600:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 811us (1721us total) trans 8589935071 rc 0/0 00000100:00100000:1.0:1787826420.196461:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3890 00000100:00100000:3.0:1787826420.199287:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826420.199523:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563929856 00000100:00100000:2.0:1787826420.199536:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563929856 00000100:00100000:2.0:1787826420.199615:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1190 00000100:00100000:2.0:1787826420.199627:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eea4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55630:x1874670563929856:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:2.0:1787826420.199725:0:14257:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000405:0x1d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82b14 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12d6 expref: 44 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.199791:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82b22 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.199807:0:14257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b82aa4 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12ba expref: 44 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.199817:0:14257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82b22 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.199864:0:14257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b82aa4 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12ba expref: 44 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.199880:0:14257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b82aa4 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12ba expref: 44 pid: 9966 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826420.199899:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a9ac780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585267072:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826420.200600:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3ab4c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826420.203745:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826420.203940:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563929984 00000100:00100000:3.0:1787826420.203954:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563929984 00010000:00010000:3.0:1787826420.204021:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b82aa4 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12ba expref: 45 pid: 9966 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826420.204073:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1220 00000100:00100000:3.0:1787826420.204085:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+45:2404:x1874670563929984:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826420.204106:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826420.204114:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b82aa4 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12ba expref: 45 pid: 9966 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.204130:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b82aa4 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12ba expref: 45 pid: 9966 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.204174:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826420.204182:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82b22 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.204195:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82b22 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.204204:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82b22 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.204231:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826420.204295:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+45:2404:x1874670563929984:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 212us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826420.204304:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1220 00010000:00010000:1.0:1787826420.206061:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b82aa4 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12ba expref: 44 pid: 9966 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826420.206094:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a9ac780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585267072:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826420.206126:0:14257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82b22 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.206138:0:14257:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82b22 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.206144:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82b22 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.206529:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82b22 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.206540:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82b22 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.206547:0:14257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82b22 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.206554:0:14257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826420.206560:0:14257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82b22 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.206569:0:14257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82b22 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.206592:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826420.206595:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787826420.206600:0:14257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82b22 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.206608:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82b22 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.206621:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826420.206624:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787826420.206629:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82b14 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12d6 expref: 43 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826420.207125:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eea4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55630:x1874670563929856:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 7495us (7850us total) trans 8589935072 rc -22/-22 00000100:00100000:1.0:1787826420.207138:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1190 00000100:00100000:2.0:1787826420.209236:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826420.209353:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563930112 00000100:00100000:1.0:1787826420.209368:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563930112 00000100:00100000:1.0:1787826420.209530:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3891 00000100:00100000:1.0:1787826420.209542:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9ae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55630:x1874670563930112:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826420.209572:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826420.209599:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82b29 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab12dd expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.209675:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82b29 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12dd expref: 44 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.209700:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82b29 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12dd expref: 44 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.209723:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826420.209727:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826420.209730:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46a400, rc 0) 00000100:00100000:1.0:1787826420.209797:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9ae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55630:x1874670563930112:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 258us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826420.209805:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3891 00000100:00100000:3.0:1787826420.214465:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826420.214698:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563930368 00000100:00100000:2.0:1787826420.214712:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563930368 00000100:00100000:2.0:1787826420.214794:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3892 00000100:00100000:2.0:1787826420.214807:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a18b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55630:x1874670563930368:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826420.214836:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826420.214868:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82b30 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab12e4 expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.215560:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82b37 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.215580:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82b37 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.215594:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82b37 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826420.215606:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x35:0x0]: returning size 0 00010000:00010000:2.0:1787826420.215666:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82b30 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12e4 expref: 47 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.215693:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82b37 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12e4 expref: 46 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.215704:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x35:0x0].0x0 (ffff90cf39e67800) 00010000:00010000:2.0:1787826420.215707:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826420.215711:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834400, rc 0) 00000100:00100000:2.0:1787826420.215798:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a18b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+46:55630:x1874670563930368:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 993us (1350us total) trans 8589935073 rc 0/0 00000100:00100000:2.0:1787826420.215808:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3892 00000100:00100000:0.0:1787826420.219265:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826420.219430:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563930624 00000100:00100000:3.0:1787826420.219442:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563930624 00000100:00100000:3.0:1787826420.219624:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3893 00000100:00100000:3.0:1787826420.219637:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+46:55630:x1874670563930624:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826420.219670:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826420.219696:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b82b45 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab12eb expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.219864:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b82b4c lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.219883:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b82b4c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.219896:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b82b4c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826420.219911:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:3.0:1787826420.220041:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b82b45 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12eb expref: 49 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.220062:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b82b4c lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12eb expref: 48 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.220073:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826420.220077:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787826420.220081:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401e00, rc 0) 00000100:00100000:3.0:1787826420.220165:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55630:x1874670563930624:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 531us (917us total) trans 8589935074 rc 0/0 00000100:00100000:3.0:1787826420.220173:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3893 00000100:00100000:3.0:1787826420.223724:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826420.223897:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563930880 00000100:00100000:2.0:1787826420.223911:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563930880 00000100:00100000:2.0:1787826420.223981:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1191 00000100:00100000:2.0:1787826420.223992:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a19a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55630:x1874670563930880:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:2.0:1787826420.224094:0:6521:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000405:0x1d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b82b4c lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12eb expref: 48 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.224158:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b82b5a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.224176:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82b29 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12dd expref: 48 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.224185:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b82b5a lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.224230:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82b29 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12dd expref: 48 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.224245:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82b29 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12dd expref: 48 pid: 16564 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826420.224264:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a9ac3c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1874670585267200:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826420.224387:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf396cf180 going to sleep for 11 seconds 00000100:00100000:0.0:1787826420.227427:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a9ac3c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1874670585267200:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826420.227524:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b82b5a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826420.228992:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826420.229078:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563931008 00000100:00100000:1.0:1787826420.229089:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563931008 00010000:00010000:1.0:1787826420.229156:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82b29 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12dd expref: 49 pid: 16564 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826420.229208:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1221 00000100:00100000:1.0:1787826420.229221:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf185dac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:2404:x1874670563931008:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826420.229244:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826420.229253:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82b29 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12dd expref: 49 pid: 16564 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.229267:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82b29 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12dd expref: 49 pid: 16564 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.229298:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82b29 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12dd expref: 49 pid: 16564 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.229330:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826420.229344:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b82b5a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.229356:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b82b5a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.229366:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b82b5a lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.229410:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826420.229504:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf185dac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:2404:x1874670563931008:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 286us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826420.229514:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1221 00010000:00010000:3.0:1787826420.229652:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b82b5a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.229662:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b82b5a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.229694:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b82b61 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.229708:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82b37 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12e4 expref: 47 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.229718:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b82b61 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x35:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.229758:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82b37 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12e4 expref: 47 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.229774:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82b37 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12e4 expref: 47 pid: 8247 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826420.229790:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03a1a1c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1874670585267328:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826420.229850:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf07f5ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1787826420.236986:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826420.237089:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563931136 00000100:00100000:0.0:1787826420.237101:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563931136 00010000:00010000:0.0:1787826420.237168:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82b37 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12e4 expref: 48 pid: 8247 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826420.237219:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1222 00000100:00100000:0.0:1787826420.237232:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9ac780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:2402:x1874670563931136:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826420.237256:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826420.237265:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82b37 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12e4 expref: 48 pid: 8247 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.237281:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82b37 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12e4 expref: 48 pid: 8247 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.237314:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x35:0x0].0x0 (ffff90cf39e67800) 00010000:00010000:0.0:1787826420.237336:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b82b61 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x35:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.237349:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b82b61 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x35:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.237359:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b82b61 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x35:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.237388:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826420.237468:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9ac780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:2402:x1874670563931136:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 238us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826420.237504:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1222 00010000:00010000:3.0:1787826420.237988:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82b37 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12e4 expref: 47 pid: 8247 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826420.238010:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03a1a1c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1874670585267328:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826420.238042:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b82b61 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x35:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.238051:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b82b61 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x35:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.238056:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b82b61 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x35:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826420.238579:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03a1a1c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6521:1874670585267456:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787826420.238653:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826420.238687:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf07f5ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1787826420.238950:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585267456 00000100:00100000:0.0:1787826420.238958:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585267456 00000100:00100000:0.0:1787826420.239008:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1471 00000100:00100000:0.0:1787826420.239018:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a1bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+10:6521:x1874670585267456:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787826420.239122:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a1bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+10:6521:x1874670585267456:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 106us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826420.239130:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1471 00000100:00100000:3.0:1787826420.239357:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03a1a1c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6521:1874670585267456:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787826420.239422:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589935075 00000001:00080000:3.0:1787826420.239769:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589935076 00010000:00010000:3.0:1787826420.239799:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b82b61 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x35:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.239811:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b82b61 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x35:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.239819:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b82b61 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x35:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.239827:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826420.239832:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b82b61 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x35:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.239843:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b82b61 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x35:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.239862:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x35:0x0].0x0 (ffff90cf39e67800) 00010000:00010000:3.0:1787826420.239865:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787826420.239871:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b82b61 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x35:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.239877:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b82b61 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x35:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.239900:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b82b5a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.239907:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b82b5a lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.239913:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b82b5a lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.239919:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826420.239922:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b82b5a lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.239928:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b82b5a lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.239937:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826420.239939:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787826420.239942:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b82b5a lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.239952:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b82b5a lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.239964:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826420.239967:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787826420.239974:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b82b4c lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12eb expref: 49 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826420.240073:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a19a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55630:x1874670563930880:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 16082us (16365us total) trans 8589935077 rc 0/0 00000100:00100000:3.0:1787826420.240083:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1191 00000020:00080000:3.0:1787826420.240087:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1787826420.243853:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826420.243982:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563931264 00000100:00100000:1.0:1787826420.243996:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563931264 00000100:00100000:1.0:1787826420.244107:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3894 00000100:00100000:1.0:1787826420.244120:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55630:x1874670563931264:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826420.244166:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826420.244196:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82b68 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab12f2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.244276:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82b68 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12f2 expref: 49 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.244294:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82b68 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12f2 expref: 49 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.244337:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826420.244342:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826420.244348:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46a400, rc 0) 00000100:00100000:1.0:1787826420.244439:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:55630:x1874670563931264:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 322us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826420.244447:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3894 00000100:00100000:0.0:1787826420.247261:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826420.247369:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563931520 00000100:00100000:3.0:1787826420.247381:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563931520 00000100:00100000:3.0:1787826420.247452:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1192 00000100:00100000:3.0:1787826420.247463:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:55630:x1874670563931520:12345-192.168.203.39@tcp:35:lfs.0 00000004:00080000:3.0:1787826420.247886:0:14257:0:(mdd_object.c:4014:mdd_close()) Object [0x200000405:0x35:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787826420.247966:0:14257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].29, 64 off10504 00000004:00080000:3.0:1787826420.247979:0:14257:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1366259506827ns, next at 1367259503933ns, rc = 0 00000001:00080000:3.0:1787826420.247986:0:14257:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589935078 00010000:00010000:3.0:1787826420.248041:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b82b6f lrc: 3/0,1 mode: --/PW res: [0x200000405:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.248066:0:14257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b82b6f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.248084:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b82b6f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.248100:0:14257:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b82b6f lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.248107:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b82b6f lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.248114:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b82b6f lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.248158:0:14257:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787826420.248271:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+51:55630:x1874670563931520:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 808us (1024us total) trans 8589935079 rc 0/0 00000100:00100000:3.0:1787826420.248281:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1192 00000020:00080000:3.0:1787826420.248287:0:14257:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787826420.248650:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826420.248659:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b82b6f lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.248669:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400800 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:1.0:1787826420.248674:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b82b6f lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.248684:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b82b6f lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.248700:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x35:0x0].0x0 (ffff90cf06894200) 00010000:00010000:1.0:1787826420.248703:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787826420.248709:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b82b6f lrc: 1/0,0 mode: --/PW res: [0x200000405:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.248715:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b82b6f lrc: 0/0,0 mode: --/PW res: [0x200000405:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.248735:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826420.248737:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826420.248739:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826420.250552:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826420.250731:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563931776 00000100:00100000:0.0:1787826420.250744:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563931776 00000100:00100000:0.0:1787826420.250832:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1193 00000100:00100000:0.0:1787826420.250845:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a1a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+51:55630:x1874670563931776:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:0.0:1787826420.251158:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a1a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+52:55630:x1874670563931776:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 305us (608us total) trans 8589935080 rc 0/0 00000100:00100000:0.0:1787826420.251167:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1193 00000100:00100000:2.0:1787826420.269271:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826420.269441:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563931904 00000100:00100000:1.0:1787826420.269456:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563931904 00000100:00100000:1.0:1787826420.269587:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3895 00000100:00100000:1.0:1787826420.269600:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+52:55632:x1874670563931904:12345-192.168.203.39@tcp:101:getfattr.0 00010000:00010000:1.0:1787826420.269633:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826420.269664:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b82b76 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab12f9 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.269758:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b82b7d lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.269776:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b82b7d lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.269789:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b82b7d lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.269805:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b82b84 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.269812:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b82b84 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.269819:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b82b84 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.269922:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b82b8b lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.269933:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b82b8b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.269940:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b82b8b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826420.269991:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:1.0:1787826420.269995:0:16564:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826420.270021:0:16564:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b82b8b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.270034:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b82b8b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.270043:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b82b7d lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.270048:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b82b7d lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.270055:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b82b7d lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.270061:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46a800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826420.270065:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b82b7d lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.270073:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b82b7d lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.270088:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf04f8b400) 00010000:00010000:1.0:1787826420.270091:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826420.270097:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b82b7d lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.270104:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b82b7d lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.270125:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b82b84 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.270131:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b82b84 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.270137:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b82b84 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.270142:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46b400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826420.270145:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b82b84 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.270165:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b82b84 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.270173:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf04f8bb00) 00010000:00010000:1.0:1787826420.270175:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826420.270178:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b82b84 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.270183:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b82b84 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.270222:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b82b76 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12f9 expref: 54 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.270239:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b82b8b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12f9 expref: 53 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.270251:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826420.270253:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826420.270256:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46b000, rc 0) 00000100:00100000:1.0:1787826420.270648:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55632:x1874670563931904:12345-192.168.203.39@tcp:101:getfattr.0 Request processed in 1048us (1390us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826420.270659:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3895 00000100:00100000:1.0:1787826420.278642:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826420.278854:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563932032 00000100:00100000:2.0:1787826420.278867:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563932032 00000100:00100000:2.0:1787826420.278945:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2169 00000100:00100000:2.0:1787826420.278958:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2401:x1874670563932032:12345-192.168.203.39@tcp:101:getfattr.0 00010000:00010000:2.0:1787826420.278984:0:30696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826420.279007:0:30696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000382351a4/0x22153cd396b82b92 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1300 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826420.279093:0:30696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0300c3c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:30696:1874670585267584:192.168.203.39@tcp:106: 00000100:00100000:2.0:1787826420.279224:0:30696:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf396cf180 going to sleep for 11 seconds 00000100:00100000:2.0:1787826420.287644:0:30696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0300c3c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:30696:1874670585267584:192.168.203.39@tcp:106: 00010000:00010000:2.0:1787826420.287703:0:30696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000382351a4/0x22153cd396b82b92 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1300 expref: 15 pid: 30696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.287735:0:30696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000382351a4/0x22153cd396b82b92 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1300 expref: 15 pid: 30696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.287751:0:30696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834c00, rc 0) 00000100:00100000:2.0:1787826420.287894:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2401:x1874670563932032:12345-192.168.203.39@tcp:101:getfattr.0 Request processed in 8937us (9267us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826420.287905:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2169 00000100:00100000:3.0:1787826420.322133:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826420.322281:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563932160 00000100:00100000:0.0:1787826420.322294:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563932160 00000100:00100000:0.0:1787826420.322535:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3896 00000100:00100000:0.0:1787826420.322549:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a18f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55636:x1874670563932160:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:0.0:1787826420.322659:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b82b99 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.322682:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b82b99 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.322696:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b82b99 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.322712:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b82ba0 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.322720:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b82ba0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.322727:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b82ba0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.322832:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b82ba7 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.322843:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b82ba7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.322851:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b82ba7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826420.322902:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:0.0:1787826420.322907:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826420.322923:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b82ba7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.322939:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b82b99 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.322946:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b82b99 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.322952:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b82b99 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.322958:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165ec00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826420.322963:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b82b99 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.322972:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b82b99 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.322987:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf0c7da900) 00010000:00010000:0.0:1787826420.322990:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826420.322996:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b82b99 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.323002:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b82b99 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.323025:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b82ba0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.323035:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b82ba0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.323042:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b82ba0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.323048:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165e600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826420.323051:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b82ba0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.323057:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b82ba0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.323064:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf0c7dac00) 00010000:00010000:0.0:1787826420.323067:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826420.323069:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b82ba0 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.323074:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b82ba0 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.323087:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b82ba7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.323094:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b82ba7 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.323100:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b82ba7 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.323105:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165f600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826420.323108:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b82ba7 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.323112:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b82ba7 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.323119:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826420.323121:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826420.323124:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b82ba7 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.323130:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b82ba7 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826420.323238:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a18f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55636:x1874670563932160:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 692us (1120us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826420.323248:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3896 00000100:00100000:2.0:1787826420.344344:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826420.344541:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563932416 00000100:00100000:3.0:1787826420.344553:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563932416 00000100:00100000:3.0:1787826420.344629:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3897 00000100:00100000:3.0:1787826420.344641:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55638:x1874670563932416:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826420.344668:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826420.344697:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b82bae lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1307 expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.344947:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b82bb5 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.344966:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b82bb5 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.344981:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b82bb5 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826420.344993:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:3.0:1787826420.345132:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b82bae lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1307 expref: 56 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.345164:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b82bb5 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1307 expref: 55 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.345173:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826420.345176:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787826420.345180:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400c00, rc 0) 00000100:00100000:3.0:1787826420.345268:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+55:55638:x1874670563932416:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 628us (948us total) trans 8589935081 rc 0/0 00000100:00100000:3.0:1787826420.345276:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3897 00000100:00100000:3.0:1787826420.349419:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826420.349630:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563932544 00000100:00100000:2.0:1787826420.349644:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563932544 00000100:00100000:2.0:1787826420.349730:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2170 00000100:00100000:2.0:1787826420.349740:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b4321c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2403:x1874670563932544:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826420.349767:0:14864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826420.349791:0:14864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000382351a4/0x22153cd396b82bc3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab130e expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826420.349888:0:14864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0300e580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14864:1874670585267712:192.168.203.39@tcp:106: 00000100:00100000:2.0:1787826420.350176:0:14864:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf396cf180 going to sleep for 11 seconds 00000100:00100000:2.0:1787826420.353061:0:14864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0300e580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14864:1874670585267712:192.168.203.39@tcp:106: 00010000:00010000:2.0:1787826420.353120:0:14864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000382351a4/0x22153cd396b82bc3 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab130e expref: 15 pid: 14864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.353164:0:14864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000382351a4/0x22153cd396b82bc3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab130e expref: 15 pid: 14864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.353182:0:14864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834c00, rc 0) 00000100:00100000:2.0:1787826420.353257:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b4321c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2403:x1874670563932544:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 3516us (3854us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826420.353268:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2170 00000100:00100000:0.0:1787826420.359227:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826420.359585:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563932800 00000100:00100000:1.0:1787826420.359599:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563932800 00000100:00100000:1.0:1787826420.359789:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3898 00000100:00100000:1.0:1787826420.359802:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+55:55638:x1874670563932800:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826420.359838:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826420.359882:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b82bca lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1315 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.360081:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b82bd1 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.360097:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b82b8b lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12f9 expref: 56 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.360105:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b82bd1 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.360143:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b82b8b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12f9 expref: 56 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.360178:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b82b8b lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12f9 expref: 56 pid: 16564 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826420.360196:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aa86940 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1874670585267840:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826420.361057:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce02725cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826420.363116:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826420.363678:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aa86940 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1874670585267840:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826420.363721:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b82bd1 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826420.364018:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563932928 00000100:00100000:2.0:1787826420.364027:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563932928 00010000:00010000:2.0:1787826420.364076:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b82b8b lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12f9 expref: 57 pid: 16564 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826420.364125:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1223 00000100:00100000:2.0:1787826420.364135:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b430f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+57:2403:x1874670563932928:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826420.364166:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826420.364176:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b82b8b lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12f9 expref: 57 pid: 16564 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.364190:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b82b8b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12f9 expref: 57 pid: 16564 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.364732:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b82b8b lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12f9 expref: 57 pid: 16564 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.364942:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826420.364949:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b82bd1 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.364962:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b82bd1 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.364971:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b82bd1 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.365060:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826420.365161:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b430f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+56:2403:x1874670563932928:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 1015us (2049us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826420.365172:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1223 00010000:00010000:1.0:1787826420.365294:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b82bd1 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.365312:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b82bd1 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826420.365492:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:1.0:1787826420.366216:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b82bca lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1315 expref: 57 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.366242:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b82bd1 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1315 expref: 56 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.366252:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826420.366255:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787826420.366259:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46b400, rc 0) 00000100:00100000:1.0:1787826420.366342:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+56:55638:x1874670563932800:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 6541us (7139us total) trans 8589935082 rc 0/0 00000100:00100000:1.0:1787826420.366351:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3898 00000100:00100000:3.0:1787826420.370646:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826420.371078:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563933184 00000100:00100000:2.0:1787826420.371093:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563933184 00000100:00100000:2.0:1787826420.371243:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3899 00000100:00100000:2.0:1787826420.371258:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b432580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+56:55638:x1874670563933184:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826420.371291:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826420.371322:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82bdf lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab131c expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.372075:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82be6 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.372099:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82be6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.372115:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82be6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826420.372128:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x36:0x0]: returning size 0 00010000:00010000:2.0:1787826420.372202:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82bdf lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab131c expref: 59 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.372230:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82be6 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab131c expref: 58 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.372241:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x36:0x0].0x0 (ffff90cf39e67e00) 00010000:00010000:2.0:1787826420.372245:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826420.372248:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835800, rc 0) 00000100:00100000:2.0:1787826420.372346:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b432580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:55638:x1874670563933184:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1090us (1715us total) trans 8589935083 rc 0/0 00000100:00100000:2.0:1787826420.372355:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3899 00000100:00100000:3.0:1787826420.376009:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826420.376108:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563933440 00000100:00100000:1.0:1787826420.376124:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563933440 00000100:00100000:1.0:1787826420.376230:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3900 00000100:00100000:1.0:1787826420.376243:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b432d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:55638:x1874670563933440:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826420.376280:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826420.376309:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b82bf4 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1323 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.376616:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82bfb lrc: 3/0,1 mode: --/EX res: [0x200000405:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.376638:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82be6 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab131c expref: 59 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.376650:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82bfb lrc: 4/0,1 mode: --/EX res: [0x200000405:0x36:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.376722:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82be6 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab131c expref: 59 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.376740:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82be6 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab131c expref: 59 pid: 8247 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826420.376759:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aa86940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1874670585267968:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826420.376878:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce02725cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826420.380954:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826420.380989:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aa86940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1874670585267968:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826420.381029:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82bfb lrc: 3/0,1 mode: --/EX res: [0x200000405:0x36:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826420.381139:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563933568 00000100:00100000:2.0:1787826420.381158:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563933568 00010000:00010000:2.0:1787826420.381210:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82be6 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab131c expref: 60 pid: 8247 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826420.381249:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1224 00000100:00100000:2.0:1787826420.381261:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f936940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:2404:x1874670563933568:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826420.381280:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826420.381289:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82be6 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab131c expref: 60 pid: 8247 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.381316:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82be6 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab131c expref: 60 pid: 8247 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.381349:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82be6 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab131c expref: 60 pid: 8247 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.381367:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x36:0x0].0x0 (ffff90cf39e67e00) 00010000:00010000:2.0:1787826420.381372:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82bfb lrc: 3/0,1 mode: --/EX res: [0x200000405:0x36:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.381380:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82bfb lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x36:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.381387:0:10340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82bfb lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x36:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.381418:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826420.381443:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82bfb lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x36:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.381451:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82bfb lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x36:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826420.381504:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x36:0x0]: returning size 0 00000100:00100000:2.0:1787826420.381516:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f936940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:2404:x1874670563933568:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 256us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826420.381524:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1224 00000004:00080000:1.0:1787826420.382768:0:6519:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x10b:0x0], index 0: 0 00010000:00010000:1.0:1787826420.383569:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82bfb lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x36:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.383586:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82bfb lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x36:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.383594:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82bfb lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x36:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.383601:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46ba00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826420.383606:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82bfb lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x36:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.383627:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82bfb lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x36:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.383646:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x36:0x0].0x0 (ffff90cf39e67e00) 00010000:00010000:1.0:1787826420.383651:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826420.383657:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82bfb lrc: 2/0,0 mode: --/EX res: [0x200000405:0x36:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.383680:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82bfb lrc: 0/0,0 mode: --/EX res: [0x200000405:0x36:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.383755:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b82bf4 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x36:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1323 expref: 59 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.383767:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x36:0x0].0x0 (ffff90cf39e67e00) 00010000:00010000:1.0:1787826420.383770:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787826420.383775:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b82bf4 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x36:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1323 expref: 59 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.383805:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46a800, rc 0) 00000100:00100000:1.0:1787826420.383894:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b432d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:55638:x1874670563933440:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 7652us (7900us total) trans 8589935084 rc 301/301 00000100:00100000:1.0:1787826420.383905:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3900 00000100:00100000:3.0:1787826420.388243:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826420.389114:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563933824 00000100:00100000:0.0:1787826420.389204:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563933824 00000100:00100000:0.0:1787826420.389285:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1194 00000100:00100000:0.0:1787826420.389297:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f934f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:55638:x1874670563933824:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:0.0:1787826420.390342:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f934f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55638:x1874670563933824:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 1038us (2105us total) trans 8589935085 rc 0/0 00000100:00100000:0.0:1787826420.390355:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1194 00000100:00100000:3.0:1787826420.393735:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826420.394075:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563933952 00000100:00100000:2.0:1787826420.394088:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563933952 00000100:00100000:2.0:1787826420.394241:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3901 00000100:00100000:2.0:1787826420.394254:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f9370c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55638:x1874670563933952:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826420.394293:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826420.394338:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82c09 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab132a expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.394509:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82c10 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.394529:0:32404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b82bd1 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1315 expref: 60 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.394541:0:32404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82c10 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.394590:0:32404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b82bd1 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1315 expref: 60 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.394606:0:32404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b82bd1 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1315 expref: 60 pid: 6520 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826420.394624:0:32404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0300e580 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:32404:1874670585268096:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826420.394733:0:32404:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf1850c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826420.402561:0:32404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0300e580 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:32404:1874670585268096:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826420.402676:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00010000:00010000:1.0:1787826420.402750:0:32404:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82c10 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826420.402769:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563934080 00000100:00100000:3.0:1787826420.402778:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563934080 00010000:00010000:3.0:1787826420.402826:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b82bd1 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1315 expref: 61 pid: 6520 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826420.402873:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1225 00000100:00100000:3.0:1787826420.402882:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+61:2404:x1874670563934080:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826420.402901:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826420.402908:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b82bd1 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1315 expref: 61 pid: 6520 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.402921:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b82bd1 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1315 expref: 61 pid: 6520 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.402951:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b82bd1 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1315 expref: 61 pid: 6520 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.403035:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826420.403041:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82c10 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.403053:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82c10 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.403062:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82c10 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.403089:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826420.403118:0:32404:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82c10 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.403128:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82c10 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826420.403203:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:2404:x1874670563934080:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 321us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826420.403213:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1225 00000004:00200000:1.0:1787826420.403214:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:1.0:1787826420.403221:0:32404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826420.403248:0:32404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82c10 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.403288:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82c09 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab132a expref: 60 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.403307:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82c10 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab132a expref: 59 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.403315:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826420.403318:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826420.403321:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834c00, rc 0) 00000100:00100000:1.0:1787826420.403353:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f9370c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55638:x1874670563933952:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 9103us (9637us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826420.403361:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3901 00000100:00100000:3.0:1787826420.408169:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826420.408276:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563934208 00000100:00100000:2.0:1787826420.408289:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563934208 00000100:00100000:2.0:1787826420.408372:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2171 00000100:00100000:2.0:1787826420.408383:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f874f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563934208:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826420.408534:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826420.408560:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c800962/0x22153cd396b82c17 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1331 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826420.408648:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0300d680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1874670585268224:192.168.203.39@tcp:106: 00000100:00100000:2.0:1787826420.408750:0:8437:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf1850c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826420.413136:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0300d680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1874670585268224:192.168.203.39@tcp:106: 00010000:00010000:2.0:1787826420.413206:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008c800962/0x22153cd396b82c17 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1331 expref: 15 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.413238:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c800962/0x22153cd396b82c17 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1331 expref: 15 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.413255:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834800, rc 0) 00000100:00100000:2.0:1787826420.413356:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f874f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563934208:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 4973us (5214us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826420.413366:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2171 00000100:00100000:0.0:1787826420.417183:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826420.417570:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563934336 00000100:00100000:1.0:1787826420.417924:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563934336 00000100:00100000:1.0:1787826420.418200:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3902 00000100:00100000:1.0:1787826420.418215:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55638:x1874670563934336:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826420.418247:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826420.418283:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b82c1e lrc: 2/0,0 mode: --/CR res: [0x200000405:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1338 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.418402:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82c25 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.418421:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82c25 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x36:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.418438:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82c25 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x36:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826420.418535:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x36:0x0]: returning size 0 00000004:00200000:1.0:1787826420.418540:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826420.418564:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82c25 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x36:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.418598:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b82c1e lrc: 0/0,0 mode: --/CR res: [0x200000405:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1338 expref: 61 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.418899:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82c25 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x36:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1338 expref: 60 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.418912:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x36:0x0].0x0 (ffff90cf04f8b400) 00010000:00010000:1.0:1787826420.418916:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787826420.418920:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46ba00, rc 0) 00000100:00100000:1.0:1787826420.419219:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:55638:x1874670563934336:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1006us (2050us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826420.419230:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3902 00000100:00100000:3.0:1787826420.422232:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826420.422614:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563934464 00000100:00100000:2.0:1787826420.422628:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563934464 00000100:00100000:2.0:1787826420.422714:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2172 00000100:00100000:2.0:1787826420.422725:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01dfde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2403:x1874670563934464:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826420.422750:0:28853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826420.422780:0:28853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c800962/0x22153cd396b82c2c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x10b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab133f expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787826420.422814:0:28853:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826420.422840:0:28853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10b:0x0].0x0 since=1366s v=(0 0) 00010000:00010000:2.0:1787826420.422846:0:28853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826420.422857:0:28853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c800962/0x22153cd396b82c2c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab133f expref: 12 pid: 28853 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.422876:0:28853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008c800962/0x22153cd396b82c2c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab133f expref: 12 pid: 28853 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.422891:0:28853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834800, rc 0) 00000100:00100000:2.0:1787826420.422973:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01dfde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563934464:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 249us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826420.422981:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2172 00000100:00100000:3.0:1787826420.425892:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826420.426140:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563934720 00000100:00100000:2.0:1787826420.426162:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563934720 00000100:00100000:2.0:1787826420.426245:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3903 00000100:00100000:2.0:1787826420.426256:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01dff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:55638:x1874670563934720:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826420.426282:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826420.426310:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82c33 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1346 expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.426505:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82c3a lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.426527:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82c3a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.426541:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82c3a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826420.426557:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:2.0:1787826420.426705:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82c33 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1346 expref: 63 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.426727:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82c3a lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1346 expref: 62 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.426736:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826420.426740:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787826420.426743:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834a00, rc 0) 00000100:00100000:2.0:1787826420.426810:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01dff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+62:55638:x1874670563934720:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 556us (932us total) trans 8589935086 rc 0/0 00000100:00100000:2.0:1787826420.426819:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3903 00000100:00100000:1.0:1787826420.430265:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826420.430381:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563934848 00000100:00100000:0.0:1787826420.430405:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563934848 00000100:00100000:0.0:1787826420.430527:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2173 00000100:00100000:0.0:1787826420.430538:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa86940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563934848:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826420.430566:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826420.430597:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d39501d2/0x22153cd396b82c48 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab134d expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826420.430679:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a8af840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1874670585268352:192.168.203.39@tcp:106: 00000100:00100000:0.0:1787826420.430782:0:8435:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce057f6000 going to sleep for 11 seconds 00000100:00100000:2.0:1787826420.433884:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a8af840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1874670585268352:192.168.203.39@tcp:106: 00010000:00010000:2.0:1787826420.433941:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d39501d2/0x22153cd396b82c48 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab134d expref: 15 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.433972:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d39501d2/0x22153cd396b82c48 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab134d expref: 15 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.433987:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165e600, rc 0) 00000100:00100000:2.0:1787826420.434070:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa86940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563934848:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 3532us (3820us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826420.434081:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2173 00000100:00100000:0.0:1787826420.437254:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826420.437373:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563934976 00000100:00100000:1.0:1787826420.437608:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563934976 00000100:00100000:1.0:1787826420.437719:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2174 00000100:00100000:1.0:1787826420.437731:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8af840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563934976:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826420.437754:0:30694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826420.437778:0:30694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000421aa0a2/0x22153cd396b82c4f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1354 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826420.437857:0:30694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aa84000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:30694:1874670585268480:192.168.203.39@tcp:106: 00000100:00100000:1.0:1787826420.437957:0:30694:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf396cf180 going to sleep for 11 seconds 00000100:00100000:2.0:1787826420.440927:0:30694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aa84000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:30694:1874670585268480:192.168.203.39@tcp:106: 00010000:00010000:2.0:1787826420.440985:0:30694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000421aa0a2/0x22153cd396b82c4f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1354 expref: 15 pid: 30694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.441056:0:30694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000421aa0a2/0x22153cd396b82c4f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1354 expref: 15 pid: 30694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.441072:0:30694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46bc00, rc 0) 00000100:00100000:2.0:1787826420.441161:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8af840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563934976:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 3430us (3921us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826420.441170:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2174 00000100:00100000:0.0:1787826420.444266:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826420.444370:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563935104 00000100:00100000:1.0:1787826420.444392:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563935104 00000100:00100000:1.0:1787826420.444466:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2175 00000100:00100000:1.0:1787826420.444514:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf2f793c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2403:x1874670563935104:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:1.0:1787826420.444573:0:30695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8fb1ffc/0x22153cd396b82c56 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.444598:0:30695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000006d542d7/0x22153cd396b82a81 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12ac expref: 14 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.444609:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x10b:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787826420.444614:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10b:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826420.444619:0:30695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8fb1ffc/0x22153cd396b82c56 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.444669:0:30695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000006d542d7/0x22153cd396b82a81 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12ac expref: 14 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.444684:0:30695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000006d542d7/0x22153cd396b82a81 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12ac expref: 14 pid: 30695 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826420.444702:0:30695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aa84000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:30695:1874670585268608:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826420.444804:0:30695:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf396cf180 going to sleep for 11 seconds 00000100:00100000:0.0:1787826420.451872:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826420.451980:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563935232 00000100:00100000:2.0:1787826420.451992:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563935232 00010000:00010000:2.0:1787826420.452051:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000006d542d7/0x22153cd396b82a81 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12ac expref: 15 pid: 30695 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826420.452102:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1226 00000100:00100000:2.0:1787826420.452112:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0557b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2403:x1874670563935232:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826420.452133:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826420.452173:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000006d542d7/0x22153cd396b82a81 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x10b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12ac expref: 15 pid: 30695 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.452189:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000006d542d7/0x22153cd396b82a81 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x10b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12ac expref: 15 pid: 30695 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.452224:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10b:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826420.452230:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10b:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826420.452238:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a8fb1ffc/0x22153cd396b82c56 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x10b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.452252:0:10341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8fb1ffc/0x22153cd396b82c56 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x10b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.452280:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826420.452369:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0557b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2403:x1874670563935232:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 257us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826420.452378:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1226 00010000:00010000:1.0:1787826420.452902:0:30695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006d542d7/0x22153cd396b82a81 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12ac expref: 14 pid: 30695 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826420.452931:0:30695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aa84000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:30695:1874670585268608:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826420.452960:0:30695:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a8fb1ffc/0x22153cd396b82c56 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x10b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.452973:0:30695:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a8fb1ffc/0x22153cd396b82c56 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x10b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.452981:0:30695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8fb1ffc/0x22153cd396b82c56 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x10b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.453007:0:30695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8fb1ffc/0x22153cd396b82c56 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x10b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.453015:0:30695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8fb1ffc/0x22153cd396b82c56 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x10b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.453024:0:30695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8fb1ffc/0x22153cd396b82c56 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.453032:0:30695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46ac00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:1.0:1787826420.453037:0:30695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8fb1ffc/0x22153cd396b82c56 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.453046:0:30695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8fb1ffc/0x22153cd396b82c56 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x10b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.453063:0:30695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8fb1ffc/0x22153cd396b82c56 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x10b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.453072:0:30695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8fb1ffc/0x22153cd396b82c56 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x10b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826420.453154:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf2f793c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2403:x1874670563935104:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 8635us (8894us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826420.453164:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2175 00000100:00100000:0.0:1787826420.457368:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826420.461526:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563935360 00000100:00100000:1.0:1787826420.461546:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563935360 00000100:00100000:1.0:1787826420.461697:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2176 00000100:00100000:1.0:1787826420.461710:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05578780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2401:x1874670563935360:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826420.461737:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826420.461766:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a5fe178/0x22153cd396b82c5d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x10b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab135b expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826420.461802:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10b:0x0] initial LVB size: 0, mtime: 0x6a9010ec, atime: 0x6a9010ec, ctime: 0x6a9010f4, blocks: 0x0 00010000:00010000:1.0:1787826420.461828:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10b:0x0].0x0 since=1366s v=(0 0) 00010000:00010000:1.0:1787826420.461834:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826420.461846:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a5fe178/0x22153cd396b82c5d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab135b expref: 14 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.461868:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001a5fe178/0x22153cd396b82c5d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab135b expref: 14 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.461886:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46a600, rc 0) 00000100:00100000:1.0:1787826420.461972:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05578780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2401:x1874670563935360:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 265us (4622us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826420.461980:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2176 00000100:00100000:0.0:1787826420.510764:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826420.511079:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563935488 00000100:00100000:1.0:1787826420.511094:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563935488 00000100:00100000:1.0:1787826420.511203:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3904 00000100:00100000:1.0:1787826420.511216:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0557bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+62:55638:x1874670563935488:12345-192.168.203.39@tcp:44:lfs.0 00000001:00080000:0.0:1787826420.513429:0:34481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935086 is committed 00000004:00080000:0.0:1787826420.513502:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 30 committed 00000020:00080000:0.0:1787826420.513558:0:34481:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90cf3ab4c600 refcount 2 committed 0 result 0 batchid 4294969340 00000020:00080000:0.0:1787826420.513565:0:34481:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cf1f111e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90cf3ab4c6c0 00000020:00080000:0.0:1787826420.513569:0:34481:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cf1f111800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90cf080f6000 00000020:00080000:0.0:1787826420.513598:0:34481:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969339 batchid updated 00000020:00080000:2.0:1787826420.514208:0:34512:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969340 committed batchid 4294969339 00000020:00080000:2.0:1787826420.514317:0:34512:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969339 00010000:00010000:3.0:1787826420.514493:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82a73 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.514508:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82a73 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.514518:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82a73 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.514526:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46ae00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826420.514531:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82a73 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.514540:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82a73 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.514562:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x34:0x0].0x0 (ffff90cf3ab61b00) 00010000:00010000:3.0:1787826420.514565:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826420.514571:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82a73 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.514578:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82a73 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.514618:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b82a88 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.514625:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b82a88 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.514632:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b82a88 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.514640:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826420.514643:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b82a88 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.514648:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b82a88 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.514657:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826420.514659:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826420.514662:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b82a88 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.514668:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b82a88 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826420.515031:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0557bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:55638:x1874670563935488:12345-192.168.203.39@tcp:44:lfs.0 Request processed in 3809us (4278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826420.515044:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3904 00000100:00100000:2.0:1787826420.515125:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787826420.515157:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aa870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585268736:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787826420.515226:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826420.515425:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585268736 00000100:00100000:1.0:1787826420.515435:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585268736 00000100:00100000:1.0:1787826420.515522:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2177 00000100:00100000:1.0:1787826420.515533:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:3646:x1874670585268736:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787826420.515569:0:28853:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:266 count 1 00010000:00010000:1.0:1787826420.515602:0:28853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8fb1ffc/0x22153cd396b82c64 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.515628:0:28853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b82a8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12b3 expref: 11 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.515639:0:28853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x10a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826420.515644:0:28853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10a:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826420.515650:0:28853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8fb1ffc/0x22153cd396b82c64 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.515683:0:28853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b82a8f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12b3 expref: 11 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.515699:0:28853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b82a8f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12b3 expref: 11 pid: 8545 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826420.515712:0:28853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aa86940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28853:1874670585268864:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826420.515770:0:28853:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf396cf180 going to sleep for 11 seconds 00000100:00100000:1.0:1787826420.519026:0:28853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aa86940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28853:1874670585268864:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826420.519067:0:28853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a8fb1ffc/0x22153cd396b82c64 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826420.520813:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826420.520858:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826420.521066:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563935616 00000100:00100000:2.0:1787826420.521077:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563935616 00000100:00100000:2.0:1787826420.521154:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2178 00000100:00100000:2.0:1787826420.521167:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05578f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563935616:12345-192.168.203.39@tcp:16:lfs.0 00000100:00100000:2.0:1787826420.521319:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05578f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563935616:12345-192.168.203.39@tcp:16:lfs.0 Request processed in 153us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826420.521333:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2178 00000100:00100000:1.0:1787826420.522761:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563935744 00000100:00100000:1.0:1787826420.522780:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563935744 00010000:00010000:1.0:1787826420.522839:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b82a8f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12b3 expref: 12 pid: 8545 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826420.522899:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1227 00000100:00100000:1.0:1787826420.522909:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05578000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563935744:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826420.522928:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826420.522934:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b82a8f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x10a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12b3 expref: 12 pid: 8545 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.522954:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b82a8f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12b3 expref: 12 pid: 8545 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.522985:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004da8c6f7/0x22153cd396b82a8f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12b3 expref: 12 pid: 8545 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.523006:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10a:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826420.523011:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10a:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826420.523017:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a8fb1ffc/0x22153cd396b82c64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.523029:0:10340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8fb1ffc/0x22153cd396b82c64 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x10a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.523071:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826420.523131:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05578000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2403:x1874670563935744:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 223us (2272us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826420.523141:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1227 00010000:00010000:0.0:1787826420.523581:0:28853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a8fb1ffc/0x22153cd396b82c64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.523594:0:28853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8fb1ffc/0x22153cd396b82c64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.523606:0:28853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8fb1ffc/0x22153cd396b82c64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.523616:0:28853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8fb1ffc/0x22153cd396b82c64 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.523636:0:28853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787826420.523879:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3646:x1874670585268736:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8345us (8651us total) trans 21474837015 rc 0/0 00000100:00100000:0.0:1787826420.523888:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2177 00000004:00080000:3.0:1787826420.524036:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3aa870c0/2, rc 0, transno 21474837015 00000100:00100000:3.0:1787826420.524045:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aa870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585268736:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1787826420.524315:0:7460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826420.524326:0:7460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8fb1ffc/0x22153cd396b82c64 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.524338:0:7460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46ac00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:1.0:1787826420.524343:0:7460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8fb1ffc/0x22153cd396b82c64 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.524361:0:7460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8fb1ffc/0x22153cd396b82c64 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.524383:0:7460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8fb1ffc/0x22153cd396b82c64 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.524392:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8fb1ffc/0x22153cd396b82c64 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.524419:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826420.524421:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826420.524423:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826420.532437:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826420.532659:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563935872 00000100:00100000:2.0:1787826420.532674:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563935872 00000100:00100000:2.0:1787826420.532864:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2179 00000100:00100000:2.0:1787826420.532881:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0557a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563935872:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:2.0:1787826420.532951:0:30696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000159f1fa4/0x22153cd396b82c6b lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.532977:0:30696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826420.532982:0:30696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826420.532991:0:30696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000159f1fa4/0x22153cd396b82c6b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.533009:0:30696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000159f1fa4/0x22153cd396b82c6b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.533045:0:30696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000159f1fa4/0x22153cd396b82c6b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.533054:0:30696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000159f1fa4/0x22153cd396b82c6b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.533064:0:30696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000159f1fa4/0x22153cd396b82c6b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.533073:0:30696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835800 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826420.533078:0:30696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000159f1fa4/0x22153cd396b82c6b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.533088:0:30696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000159f1fa4/0x22153cd396b82c6b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.533106:0:30696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000159f1fa4/0x22153cd396b82c6b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.533115:0:30696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000159f1fa4/0x22153cd396b82c6b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826420.533217:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0557a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563935872:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 341us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826420.533226:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2179 00000100:00100000:3.0:1787826420.536132:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826420.536272:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563936128 00000100:00100000:1.0:1787826420.536286:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563936128 00000100:00100000:1.0:1787826420.536591:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3905 00000100:00100000:1.0:1787826420.536604:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01dfc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:55638:x1874670563936128:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:1.0:1787826420.536681:0:32404:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826420.536719:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82c25 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x36:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1338 expref: 33 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.536743:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x36:0x0].0x0 (ffff90cf04f8b400) 00010000:00010000:1.0:1787826420.536853:0:32404:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826420.536904:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b82c72 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.536921:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b82c72 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.536933:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b82c72 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826420.537094:0:32404:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d51417dd reply state 000000003146722d transno 8589935087 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b82c72 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.537108:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b82c72 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.537114:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x36:0x0].0x0 (ffff90cf04f8b500) 00010000:00010000:1.0:1787826420.537117:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826420.537120:0:32404:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826420.537526:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01dfc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:55638:x1874670563936128:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 922us (1409us total) trans 8589935087 rc 0/0 00000100:00100000:1.0:1787826420.537535:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3905 00000100:00100000:0.0:1787826420.540706:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826420.540894:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563936256 00000100:00100000:1.0:1787826420.540907:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563936256 00000100:00100000:1.0:1787826420.540982:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3906 00000100:00100000:1.0:1787826420.540995:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05579680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:55638:x1874670563936256:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826420.541026:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826420.541055:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b82c79 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1362 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.541143:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b82c79 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x36:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1362 expref: 35 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.541175:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b82c79 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x36:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1362 expref: 35 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.541205:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x36:0x0].0x0 (ffff90cf04f8b500) 00010000:00010000:1.0:1787826420.541209:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826420.541215:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46aa00, rc 0) 00000100:00100000:1.0:1787826420.541313:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05579680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:55638:x1874670563936256:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 321us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826420.543186:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3906 00000100:00100000:2.0:1787826420.544436:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826420.544896:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563936384 00000100:00100000:3.0:1787826420.544910:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563936384 00000100:00100000:3.0:1787826420.545020:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2180 00000100:00100000:3.0:1787826420.545033:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:55638:x1874670563936384:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826420.545057:0:14864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826420.545082:0:14864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b82c80 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1369 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.545123:0:14864:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008c800962/0x22153cd396b82c2c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab133f expref: 12 pid: 28853 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.545141:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826420.545157:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826420.545164:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b82c80 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1369 expref: 12 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.545214:0:14864:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008c800962/0x22153cd396b82c2c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab133f expref: 12 pid: 28853 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.545229:0:14864:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008c800962/0x22153cd396b82c2c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab133f expref: 12 pid: 28853 timeout: 1466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826420.545246:0:14864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01dffc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14864:1874670585268992:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826420.545455:0:14864:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf371d10c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826420.548558:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826420.548905:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563936512 00000100:00100000:1.0:1787826420.548918:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563936512 00010000:00010000:1.0:1787826420.548988:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008c800962/0x22153cd396b82c2c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab133f expref: 13 pid: 28853 timeout: 1466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826420.549035:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1228 00000100:00100000:1.0:1787826420.549047:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf185db050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2403:x1874670563936512:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826420.549065:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826420.549092:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008c800962/0x22153cd396b82c2c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x10b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab133f expref: 13 pid: 28853 timeout: 1466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.549108:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008c800962/0x22153cd396b82c2c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x10b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab133f expref: 13 pid: 28853 timeout: 1466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.549143:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826420.549160:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826420.549168:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b82c80 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1369 expref: 13 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.549187:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b82c80 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x10b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1369 expref: 13 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.549239:0:6505:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b82c80 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x10b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1369 expref: 13 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826420.549257:0:6505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aa86940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1874670585269120:192.168.203.39@tcp:105: 00000100:00100000:1.0:1787826420.549370:0:6505:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf07f5e240 going to sleep for 11 seconds 00010000:00010000:2.0:1787826420.550344:0:14864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c800962/0x22153cd396b82c2c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x10b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab133f expref: 13 pid: 28853 timeout: 1466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826420.550367:0:14864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01dffc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14864:1874670585268992:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826420.550400:0:14864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b82c80 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1369 expref: 12 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.550415:0:14864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401e00, rc 0) 00000100:00100000:2.0:1787826420.550780:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:55638:x1874670563936384:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 5747us (6349us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826420.550790:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2180 00000100:00100000:1.0:1787826420.554571:0:6505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aa86940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1874670585269120:192.168.203.39@tcp:105: 00010000:00010000:1.0:1787826420.554610:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826420.554687:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf185db050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2403:x1874670563936512:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5641us (6144us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826420.554701:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1228 00000100:00100000:0.0:1787826420.554929:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826420.556185:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563936640 00000100:00100000:2.0:1787826420.556200:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563936640 00000100:00100000:2.0:1787826420.556346:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2181 00000100:00100000:2.0:1787826420.556359:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05578b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2402:x1874670563936640:12345-192.168.203.39@tcp:2:lfs.0 00002000:00010000:2.0:1787826420.556629:0:8437:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x10b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787826420.556635:0:8437:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x10b:0x0] updating lvb mtime from disk: 0 -> 1787826412 00002000:00010000:2.0:1787826420.556637:0:8437:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x10b:0x0] updating lvb atime from disk: 0 -> 1787826412 00002000:00010000:2.0:1787826420.556639:0:8437:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x10b:0x0] updating lvb ctime from disk: 0 -> 1787826421 00002000:00010000:2.0:1787826420.556642:0:8437:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x10b:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1787826420.556712:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05578b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2402:x1874670563936640:12345-192.168.203.39@tcp:2:lfs.0 Request processed in 355us (1783us total) trans 21474837016 rc 0/0 00000100:00100000:2.0:1787826420.556721:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2181 00000100:00100000:0.0:1787826420.559856:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826420.559950:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563936896 00000100:00100000:3.0:1787826420.559963:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563936896 00000100:00100000:3.0:1787826420.560045:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3907 00000100:00100000:3.0:1787826420.560057:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce055792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:55638:x1874670563936896:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:3.0:1787826420.560134:0:9966:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826420.560188:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82c10 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab132a expref: 35 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.560215:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826420.560222:0:9966:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826420.560300:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b82c87 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.560434:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b82c87 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.560448:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b82c87 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826420.560640:0:9966:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000028ff9b06 reply state 0000000025974b5d transno 8589935088 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b82c87 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.560656:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b82c87 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.560662:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826420.560665:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826420.560669:0:9966:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826420.560783:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce055792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55638:x1874670563936896:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 727us (942us total) trans 8589935088 rc 0/0 00000100:00100000:3.0:1787826420.560792:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3907 00000100:00100000:0.0:1787826420.563572:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826420.563682:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563937024 00000100:00100000:2.0:1787826420.563695:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563937024 00000100:00100000:2.0:1787826420.563805:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2182 00000100:00100000:2.0:1787826420.563819:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce055783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:55638:x1874670563937024:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826420.563843:0:8545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826420.563868:0:8545:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c800962/0x22153cd396b82c8e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1370 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.563910:0:8545:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001a5fe178/0x22153cd396b82c5d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab135b expref: 15 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.563921:0:8545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826420.563927:0:8545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826420.563933:0:8545:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c800962/0x22153cd396b82c8e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1370 expref: 15 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.563977:0:8545:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001a5fe178/0x22153cd396b82c5d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab135b expref: 15 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.563991:0:8545:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001a5fe178/0x22153cd396b82c5d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab135b expref: 15 pid: 8436 timeout: 1466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826420.564010:0:8545:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0300f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8545:1874670585269248:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826420.564114:0:8545:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf1850c840 going to sleep for 11 seconds 00000100:00100000:2.0:1787826420.566815:0:8545:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0300f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8545:1874670585269248:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826420.566870:0:8545:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008c800962/0x22153cd396b82c8e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1370 expref: 15 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.566898:0:8545:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834800, rc 0) 00000100:00100000:2.0:1787826420.566980:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce055783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:55638:x1874670563937024:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 3163us (3523us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826420.566992:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2182 00000100:00100000:3.0:1787826420.568021:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826420.568121:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563937152 00000100:00100000:1.0:1787826420.568132:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563937152 00010000:00010000:1.0:1787826420.568186:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001a5fe178/0x22153cd396b82c5d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab135b expref: 15 pid: 8436 timeout: 1466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826420.568232:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1229 00000100:00100000:1.0:1787826420.568243:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01dfcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2403:x1874670563937152:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826420.568262:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826420.568290:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001a5fe178/0x22153cd396b82c5d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x10b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab135b expref: 15 pid: 8436 timeout: 1466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.568313:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001a5fe178/0x22153cd396b82c5d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab135b expref: 15 pid: 8436 timeout: 1466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.568357:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a5fe178/0x22153cd396b82c5d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x10b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab135b expref: 15 pid: 8436 timeout: 1466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.568379:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826420.568384:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826420.568393:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008c800962/0x22153cd396b82c8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1370 expref: 14 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.568405:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c800962/0x22153cd396b82c8e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1370 expref: 14 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.568451:0:6503:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008c800962/0x22153cd396b82c8e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1370 expref: 14 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826420.568467:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aa86940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6503:1874670585269376:192.168.203.39@tcp:105: 00000100:00100000:1.0:1787826420.568596:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3780 going to sleep for 11 seconds 00000100:00100000:0.0:1787826420.571565:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aa86940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6503:1874670585269376:192.168.203.39@tcp:105: 00010000:00010000:0.0:1787826420.571604:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826420.571674:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01dfcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2403:x1874670563937152:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3430us (3658us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826420.571688:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1229 00000100:00100000:3.0:1787826420.575285:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826420.575730:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563937280 00000100:00100000:0.0:1787826420.575746:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563937280 00000100:00100000:0.0:1787826420.575827:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2183 00000100:00100000:0.0:1787826420.575839:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01dfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2403:x1874670563937280:12345-192.168.203.39@tcp:2:lfs.0 00002000:00010000:0.0:1787826420.576049:0:8435:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x10b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787826420.576054:0:8435:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x10b:0x0] updating lvb mtime from disk: 1787826412 -> 1787826412 00002000:00010000:0.0:1787826420.576057:0:8435:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x10b:0x0] updating lvb atime from disk: 1787826412 -> 1787826412 00002000:00010000:0.0:1787826420.576060:0:8435:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x10b:0x0] updating lvb ctime from disk: 1787826420 -> 1787826421 00002000:00010000:0.0:1787826420.576064:0:8435:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x10b:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1787826420.576140:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01dfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2403:x1874670563937280:12345-192.168.203.39@tcp:2:lfs.0 Request processed in 303us (873us total) trans 17179869675 rc 0/0 00000100:00100000:0.0:1787826420.576162:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2183 00000100:00100000:3.0:1787826420.583525:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826420.583804:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563937536 00000100:00100000:1.0:1787826420.583818:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563937536 00000100:00100000:1.0:1787826420.583898:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1195 00000100:00100000:1.0:1787826420.583910:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eea7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55638:x1874670563937536:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:1.0:1787826420.584022:0:14257:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000405:0x1d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82c3a lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1346 expref: 36 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.584076:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82c95 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.584093:0:14257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82b68 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12f2 expref: 36 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.584102:0:14257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b82bb5 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1307 expref: 36 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.584112:0:14257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82c95 lrc: 5/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.584166:0:14257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b82bb5 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1307 expref: 36 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.584182:0:14257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b82bb5 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1307 expref: 36 pid: 9966 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826420.584199:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aa84000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585269504:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826420.584307:0:14257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82b68 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12f2 expref: 36 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.584316:0:14257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82b68 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12f2 expref: 36 pid: 6520 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826420.584325:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aa86940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585269632:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826420.584352:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787826420.588381:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826420.588840:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563937792 00000100:00100000:0.0:1787826420.588855:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563937792 00000100:00100000:0.0:1787826420.588935:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1196 00000100:00100000:0.0:1787826420.588946:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01dfe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:42220:x1874670563937792:12345-192.168.203.39@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787826420.589386:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01dfe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:42220:x1874670563937792:12345-192.168.203.39@tcp:35:ldlm_bl.0 Request processed in 439us (1019us total) trans 8589935089 rc 0/0 00000100:00100000:0.0:1787826420.589394:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1196 00000100:00100000:1.0:1787826420.590690:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aa84000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585269504:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826420.590707:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aa86940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585269632:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826420.590748:0:14257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82c95 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826420.593540:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826420.593648:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563937920 00000100:00100000:2.0:1787826420.593660:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563937920 00010000:00010000:2.0:1787826420.593711:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82b68 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12f2 expref: 38 pid: 6520 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826420.593918:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1230 00000100:00100000:2.0:1787826420.593931:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0557a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:2404:x1874670563937920:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826420.593950:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826420.593958:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82b68 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12f2 expref: 38 pid: 6520 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.593972:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82b68 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12f2 expref: 38 pid: 6520 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.594006:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82b68 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab12f2 expref: 38 pid: 6520 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.594026:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826420.594032:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82c95 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.594042:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82c95 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.594048:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826420.594105:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0557a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:2404:x1874670563937920:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 177us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826420.594112:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1230 00000100:00100000:3.0:1787826420.594336:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826420.595722:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563938048 00000100:00100000:0.0:1787826420.595737:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563938048 00010000:00010000:0.0:1787826420.595872:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b82bb5 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1307 expref: 37 pid: 9966 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826420.595910:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1231 00000100:00100000:0.0:1787826420.595921:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01dfd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:2404:x1874670563938048:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826420.595938:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826420.595946:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b82bb5 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1307 expref: 37 pid: 9966 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.595962:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b82bb5 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1307 expref: 37 pid: 9966 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.595988:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b82bb5 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1307 expref: 37 pid: 9966 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.596005:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826420.596011:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82c95 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.596021:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82c95 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.596030:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82c95 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.596064:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826420.596117:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01dfd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:2404:x1874670563938048:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 199us (1798us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826420.596125:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1231 00010000:00010000:0.0:1787826420.596168:0:14257:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82c95 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.596176:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82c95 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.596202:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b82c9c lrc: 3/0,1 mode: --/EX res: [0x200000405:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.596213:0:14257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b82c79 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x36:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1362 expref: 35 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.596221:0:14257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b82c9c lrc: 4/0,1 mode: --/EX res: [0x200000405:0x36:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.596258:0:14257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b82c79 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x36:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1362 expref: 35 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.596274:0:14257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b82c79 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x36:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1362 expref: 35 pid: 6520 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826420.596289:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce05579a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585269760:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826420.596468:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce057f6540 going to sleep for 11 seconds 00000100:00100000:1.0:1787826420.599914:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826420.600365:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563938176 00000100:00100000:2.0:1787826420.600380:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563938176 00010000:00010000:2.0:1787826420.600435:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b82c79 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x36:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1362 expref: 36 pid: 6520 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826420.600508:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1232 00000100:00100000:2.0:1787826420.600517:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa86940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:2404:x1874670563938176:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826420.600533:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826420.600539:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b82c79 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x36:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1362 expref: 36 pid: 6520 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.600552:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b82c79 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x36:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1362 expref: 36 pid: 6520 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.600583:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x36:0x0].0x0 (ffff90cf04f8b500) 00010000:00010000:2.0:1787826420.600589:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b82c9c lrc: 3/0,1 mode: --/EX res: [0x200000405:0x36:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.600600:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b82c9c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x36:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.600608:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b82c9c lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x36:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.600632:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826420.600698:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa86940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:2404:x1874670563938176:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 181us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826420.600706:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1232 00010000:00010000:0.0:1787826420.600845:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b82c79 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x36:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1362 expref: 35 pid: 6520 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826420.600866:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce05579a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585269760:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826420.600955:0:14257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b82c9c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x36:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.600966:0:14257:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b82c9c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x36:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.600972:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b82c9c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x36:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826420.602021:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce05579a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585269888:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1787826420.602098:0:14257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826420.602138:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce057f66c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826420.602212:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585269888 00000100:00100000:1.0:1787826420.602222:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585269888 00000100:00100000:1.0:1787826420.602278:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1472 00000100:00100000:1.0:1787826420.602288:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0557b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:14257:x1874670585269888:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1787826420.602413:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0557b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:14257:x1874670585269888:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 127us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826420.602421:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1472 00000100:00100000:0.0:1787826420.602574:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce05579a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585269888:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1787826420.602780:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce05579a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585270016:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1787826420.602805:0:14257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826420.602825:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce057f66c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826420.602936:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585270016 00000100:00100000:3.0:1787826420.602941:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585270016 00000100:00100000:3.0:1787826420.602985:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1473 00000100:00100000:3.0:1787826420.602993:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0557b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+10:14257:x1874670585270016:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1787826420.603086:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0557b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+10:14257:x1874670585270016:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 94us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826420.603095:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1473 00000100:00100000:2.0:1787826420.603223:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce05579a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585270016:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:2.0:1787826420.603382:0:14257:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589935090 00000100:00100000:2.0:1787826420.603448:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0300f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585270144:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1787826420.603555:0:14257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826420.603578:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10aba0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826420.603990:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585270144 00000100:00100000:0.0:1787826420.603997:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585270144 00000100:00100000:0.0:1787826420.604086:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1474 00000100:00100000:0.0:1787826420.604095:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a1a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:14257:x1874670585270144:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1787826420.604270:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a1a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+11:14257:x1874670585270144:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 175us (714us total) trans 21474837017 rc 0/0 00000100:00100000:0.0:1787826420.604277:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1474 00000100:00100000:2.0:1787826420.604373:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0300f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585270144:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:2.0:1787826420.604451:0:14257:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589935091 00010000:00010000:2.0:1787826420.604508:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b82c9c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x36:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.604520:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b82c9c lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x36:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.604533:0:14257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b82c9c lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x36:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.604541:0:14257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165e400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826420.604547:0:14257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b82c9c lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x36:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.604557:0:14257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b82c9c lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x36:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.604579:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x36:0x0].0x0 (ffff90cf04f8b500) 00010000:00010000:2.0:1787826420.604583:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787826420.604588:0:14257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b82c9c lrc: 2/0,0 mode: --/EX res: [0x200000405:0x36:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.604595:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b82c9c lrc: 0/0,0 mode: --/EX res: [0x200000405:0x36:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.604614:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82c95 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.604621:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82c95 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.604627:0:14257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82c95 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.604632:0:14257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46a600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826420.604635:0:14257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82c95 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.604646:0:14257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82c95 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.604655:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826420.604658:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787826420.604662:0:14257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82c95 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.604668:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b82c95 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.604681:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826420.604683:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787826420.604691:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82c3a lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1346 expref: 37 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826420.604963:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eea7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55638:x1874670563937536:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 21053us (21503us total) trans 8589935092 rc 0/0 00000100:00100000:2.0:1787826420.604973:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1195 00000020:00080000:2.0:1787826420.604977:0:14257:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1787826420.608229:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826420.608550:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563938304 00000100:00100000:2.0:1787826420.608733:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563938304 00000100:00100000:2.0:1787826420.609020:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3908 00000100:00100000:2.0:1787826420.609037:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55638:x1874670563938304:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826420.609073:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826420.609100:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82ca3 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1377 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.609193:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82ca3 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1377 expref: 37 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.609210:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82ca3 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1377 expref: 37 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.609230:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826420.609233:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826420.609238:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834600, rc 0) 00000100:00100000:2.0:1787826420.609318:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:55638:x1874670563938304:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 288us (1104us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826420.609405:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3908 00000100:00100000:1.0:1787826420.612907:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826420.613144:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563938560 00000100:00100000:0.0:1787826420.613166:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563938560 00000100:00100000:0.0:1787826420.613234:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1197 00000100:00100000:0.0:1787826420.613247:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:55638:x1874670563938560:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:0.0:1787826420.613722:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:55638:x1874670563938560:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 475us (828us total) trans 8589935093 rc 0/0 00000100:00100000:0.0:1787826420.613731:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1197 00000100:00100000:1.0:1787826420.618729:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826420.619180:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563938816 00000100:00100000:2.0:1787826420.619192:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563938816 00000100:00100000:2.0:1787826420.619345:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1198 00000100:00100000:2.0:1787826420.620328:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:55638:x1874670563938816:12345-192.168.203.39@tcp:35:lfs.0 00000004:00080000:2.0:1787826420.621385:0:14257:0:(mdd_object.c:4014:mdd_close()) Object [0x200000405:0x36:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:2.0:1787826420.621966:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82caa lrc: 3/0,1 mode: --/PW res: [0x200000405:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.621988:0:14257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82caa lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.622003:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82caa lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.622014:0:14257:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82caa lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.622023:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82caa lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.622030:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82caa lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.622054:0:14257:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787826420.622829:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826420.622839:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82caa lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.622848:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834a00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:1.0:1787826420.622852:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82caa lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.622861:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82caa lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.622882:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x36:0x0].0x0 (ffff90cf04f8b500) 00010000:00010000:1.0:1787826420.622885:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787826420.622890:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82caa lrc: 1/0,0 mode: --/PW res: [0x200000405:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.622896:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82caa lrc: 0/0,0 mode: --/PW res: [0x200000405:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.622917:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826420.622919:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826420.622921:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826420.623605:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+39:55638:x1874670563938816:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 1878us (3476us total) trans 8589935094 rc 0/0 00000100:00100000:2.0:1787826420.625653:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1198 00000100:00100000:1.0:1787826420.655307:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826420.655669:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563938944 00000100:00100000:3.0:1787826420.655682:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563938944 00000100:00100000:3.0:1787826420.655798:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3909 00000100:00100000:3.0:1787826420.655811:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+39:55640:x1874670563938944:12345-192.168.203.39@tcp:101:getfattr.0 00010000:00010000:3.0:1787826420.655844:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826420.655876:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b82cb1 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab137e expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.655965:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b82cb8 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.655982:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b82cb8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.655996:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b82cb8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.656011:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b82cbf lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.656019:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b82cbf lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.656025:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b82cbf lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.656122:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b82cc6 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.656137:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b82cc6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.656143:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b82cc6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826420.656209:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:3.0:1787826420.656215:0:32404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826420.656238:0:32404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b82cc6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.656251:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b82cc6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.656262:0:32404:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b82cb8 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.656268:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b82cb8 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.656276:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b82cb8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.656282:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b82cb8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.656287:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826420.656292:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b82cb8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.656299:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b82cb8 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.656317:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf06894400) 00010000:00010000:3.0:1787826420.656320:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826420.656325:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b82cb8 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.656332:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b82cb8 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.656360:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b82cbf lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.656365:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b82cbf lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.656371:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b82cbf lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.656376:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826420.656379:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b82cbf lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.656385:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b82cbf lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.656392:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf06894e00) 00010000:00010000:3.0:1787826420.656394:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826420.656396:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b82cbf lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.656402:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b82cbf lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.656442:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b82cb1 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab137e expref: 41 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.656458:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b82cc6 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab137e expref: 40 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.656466:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826420.656468:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826420.656521:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401000, rc 0) 00000100:00100000:3.0:1787826420.656613:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55640:x1874670563938944:12345-192.168.203.39@tcp:101:getfattr.0 Request processed in 804us (1318us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826420.656622:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3909 00000100:00100000:0.0:1787826420.697929:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826420.698430:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563939072 00000100:00100000:2.0:1787826420.698446:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563939072 00000100:00100000:2.0:1787826420.698952:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3910 00000100:00100000:2.0:1787826420.698965:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0557a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55644:x1874670563939072:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:2.0:1787826420.699068:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b82ccd lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.699090:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b82ccd lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.699105:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b82ccd lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.699120:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82cd4 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.699127:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82cd4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.699133:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82cd4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.699255:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82cdb lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.699265:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82cdb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.699273:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82cdb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826420.699390:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:2.0:1787826420.699395:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826420.699413:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82cdb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.699430:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b82ccd lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.699438:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b82ccd lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.699445:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b82ccd lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.699452:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b82ccd lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.699458:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826420.699462:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b82ccd lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.699507:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b82ccd lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.699524:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf39e67400) 00010000:00010000:2.0:1787826420.699527:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826420.699532:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b82ccd lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.699539:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b82ccd lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.700829:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82cd4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.700851:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82cd4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.700858:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82cd4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.700865:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826420.700870:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82cd4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.700878:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82cd4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.700894:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf39e67f00) 00010000:00010000:2.0:1787826420.700897:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826420.700901:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82cd4 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.700908:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82cd4 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.700939:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82cdb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.700945:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82cdb lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.700951:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82cdb lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.700955:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826420.700958:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82cdb lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.700963:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82cdb lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.700970:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826420.700972:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826420.700975:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82cdb lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.700981:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82cdb lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826420.701105:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0557a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55644:x1874670563939072:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 2136us (3187us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826420.701118:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3910 00000100:00100000:1.0:1787826420.732979:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826420.736876:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563939328 00000100:00100000:2.0:1787826420.736900:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563939328 00000100:00100000:0.0:1787826420.743589:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3911 00000100:00100000:0.0:1787826420.743610:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03987c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55646:x1874670563939328:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826420.743639:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826420.743669:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b82ce2 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1385 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.743866:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b82ce9 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.743886:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b82ce9 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.743901:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b82ce9 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826420.743913:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:0.0:1787826420.744044:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b82ce2 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1385 expref: 43 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.744066:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b82ce9 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1385 expref: 42 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.744076:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826420.744080:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787826420.744083:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165ec00, rc 0) 00000100:00100000:0.0:1787826420.744195:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03987c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+42:55646:x1874670563939328:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 590us (11232us total) trans 8589935095 rc 0/0 00000100:00100000:0.0:1787826420.744204:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3911 00000100:00100000:3.0:1787826420.751739:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826420.751856:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563939584 00000100:00100000:2.0:1787826420.751870:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563939584 00000100:00100000:2.0:1787826420.752031:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3912 00000100:00100000:2.0:1787826420.752043:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01dfcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+42:55646:x1874670563939584:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826420.752079:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826420.752107:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82cf7 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab138c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.752266:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82cfe lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.752286:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b82cc6 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab137e expref: 43 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.752296:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82cfe lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.752355:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b82cc6 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab137e expref: 43 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.752371:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b82cc6 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab137e expref: 43 pid: 32404 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826420.752388:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03a19a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1874670585270272:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826420.752523:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10aba0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826420.758217:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03a19a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1874670585270272:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826420.758264:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82cfe lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826420.761238:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826420.761357:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563939712 00000100:00100000:2.0:1787826420.761370:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563939712 00010000:00010000:2.0:1787826420.761426:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b82cc6 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab137e expref: 44 pid: 32404 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826420.761503:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1233 00000100:00100000:2.0:1787826420.761515:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01dfd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:2404:x1874670563939712:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826420.761536:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826420.761544:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b82cc6 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab137e expref: 44 pid: 32404 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.761559:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b82cc6 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab137e expref: 44 pid: 32404 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.762089:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b82cc6 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab137e expref: 44 pid: 32404 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.762113:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826420.762121:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82cfe lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.762132:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82cfe lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.762143:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82cfe lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.762251:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826420.762342:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01dfd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:2404:x1874670563939712:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 828us (1119us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826420.762353:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1233 00010000:00010000:1.0:1787826420.763675:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82cfe lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.763695:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82cfe lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826420.763729:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:1.0:1787826420.764025:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82cf7 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab138c expref: 44 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.764051:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82cfe lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab138c expref: 43 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.764061:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826420.764064:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787826420.764068:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834400, rc 0) 00000100:00100000:1.0:1787826420.764218:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01dfcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55646:x1874670563939584:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 12176us (12492us total) trans 8589935096 rc 0/0 00000100:00100000:1.0:1787826420.764228:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3912 00000100:00100000:3.0:1787826420.766954:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826420.767076:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563939840 00000100:00100000:0.0:1787826420.767092:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563939840 00000100:00100000:0.0:1787826420.767278:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1199 00000100:00100000:0.0:1787826420.767294:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01dfc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55646:x1874670563939840:12345-192.168.203.39@tcp:33:lfs.0 00000100:00100000:0.0:1787826420.767550:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01dfc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55646:x1874670563939840:12345-192.168.203.39@tcp:33:lfs.0 Request processed in 261us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826420.767558:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1199 00000100:00100000:0.0:1787826420.771718:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826420.775066:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563940096 00000100:00100000:3.0:1787826420.775087:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563940096 00000100:00100000:2.0:1787826420.776315:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1200 00000100:00100000:2.0:1787826420.776340:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0557ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55646:x1874670563940096:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:2.0:1787826420.777704:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0557ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55646:x1874670563940096:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 1357us (5989us total) trans 8589935097 rc 0/0 00000100:00100000:2.0:1787826420.777718:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1200 00000100:00100000:3.0:1787826420.784783:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826420.784911:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563940352 00000100:00100000:1.0:1787826420.784924:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563940352 00000100:00100000:1.0:1787826420.785012:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3913 00000100:00100000:1.0:1787826420.785024:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01dfe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55646:x1874670563940352:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826420.785057:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826420.785062:0:32404:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:1.0:1787826420.785101:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82cfe lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab138c expref: 44 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.785133:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b82ce9 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1385 expref: 43 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.785153:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826420.785160:0:32404:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826420.785180:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b82d0c lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1393 expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.785313:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b82d13 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.785340:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b82d13 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.785352:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b82d13 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826420.785370:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:1.0:1787826420.785895:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b82d0c lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1393 expref: 45 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.785915:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b82d13 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1393 expref: 44 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.785924:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826420.785927:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787826420.785930:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46b400, rc 0) 00000100:00100000:1.0:1787826420.786230:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01dfe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55646:x1874670563940352:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1206us (1460us total) trans 8589935098 rc 0/0 00000100:00100000:1.0:1787826420.786240:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3913 00000100:00100000:3.0:1787826420.798612:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826420.798707:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563940608 00000100:00100000:0.0:1787826420.798721:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563940608 00000100:00100000:0.0:1787826420.798801:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1201 00000100:00100000:0.0:1787826420.798812:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eea6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55646:x1874670563940608:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:0.0:1787826420.798925:0:6522:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000405:0x1d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b82d13 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1393 expref: 44 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.798983:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b82d21 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.799000:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82ca3 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1377 expref: 44 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.799010:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b82d21 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.799058:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82ca3 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1377 expref: 44 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.799073:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82ca3 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1377 expref: 44 pid: 6519 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826420.799091:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce05579e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585270400:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826420.799207:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce057f6000 going to sleep for 11 seconds 00000100:00100000:3.0:1787826420.809106:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826420.809253:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce05579e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585270400:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826420.809297:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b82d21 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826420.812088:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563940736 00000100:00100000:1.0:1787826420.812109:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563940736 00010000:00010000:1.0:1787826420.812187:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82ca3 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1377 expref: 45 pid: 6519 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826420.812243:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1234 00000100:00100000:1.0:1787826420.812254:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01dfda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+45:2403:x1874670563940736:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826420.812274:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826420.812283:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82ca3 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1377 expref: 45 pid: 6519 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.812301:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82ca3 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1377 expref: 45 pid: 6519 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.812335:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82ca3 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1377 expref: 45 pid: 6519 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.812355:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826420.812361:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b82d21 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.812371:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b82d21 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.812380:0:10340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b82d21 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826420.812436:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826420.812565:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01dfda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:2403:x1874670563940736:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 312us (3477us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826420.812575:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1234 00010000:00010000:3.0:1787826420.812769:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b82d21 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.812780:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b82d21 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.813031:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b82d21 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.813041:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b82d21 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.813049:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b82d21 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.813055:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165fc00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826420.813060:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b82d21 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.813069:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b82d21 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.813081:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826420.813084:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787826420.813089:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b82d21 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.813096:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b82d21 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.813110:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826420.813113:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787826420.813118:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b82d13 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1393 expref: 43 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826420.813287:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eea6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55646:x1874670563940608:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 14476us (14690us total) trans 8589935099 rc -22/-22 00000100:00100000:3.0:1787826420.813297:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1201 00000100:00100000:2.0:1787826420.816168:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826420.817455:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563940864 00000100:00100000:0.0:1787826420.817485:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563940864 00000100:00100000:0.0:1787826420.817628:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3914 00000100:00100000:0.0:1787826420.817640:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a19a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55646:x1874670563940864:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826420.817680:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826420.817714:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b82d28 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab139a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.817964:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b82d28 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab139a expref: 44 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.817983:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b82d28 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab139a expref: 44 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.818020:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826420.818023:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826420.818037:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165ec00, rc 0) 00000100:00100000:0.0:1787826420.818138:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a19a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55646:x1874670563940864:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 497us (1991us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826420.818155:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3914 00000100:00100000:3.0:1787826420.823525:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826420.823611:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563941120 00000100:00100000:0.0:1787826420.823625:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563941120 00000100:00100000:0.0:1787826420.823708:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3915 00000100:00100000:0.0:1787826420.823721:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01dfe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55646:x1874670563941120:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826420.823751:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826420.824455:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b82d2f lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab13a1 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.828760:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b82d36 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.829960:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b82d36 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.829990:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b82d36 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826420.830407:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x37:0x0]: returning size 0 00010000:00010000:0.0:1787826420.830546:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b82d2f lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13a1 expref: 47 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.830584:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b82d36 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13a1 expref: 46 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.830594:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x37:0x0].0x0 (ffff90cf3abcb700) 00010000:00010000:0.0:1787826420.830598:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826420.830602:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165e600, rc 0) 00000100:00100000:0.0:1787826420.830704:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01dfe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+46:55646:x1874670563941120:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 6985us (7245us total) trans 8589935100 rc 0/0 00000100:00100000:0.0:1787826420.830716:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3915 00000100:00100000:0.0:1787826420.836109:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826420.836198:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563941376 00000100:00100000:2.0:1787826420.836211:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563941376 00000100:00100000:2.0:1787826420.836290:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3916 00000100:00100000:2.0:1787826420.836303:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05579e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+46:55646:x1874670563941376:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826420.836348:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826420.836378:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82d44 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab13a8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.836572:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b82d4b lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.836593:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b82d4b lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.836607:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b82d4b lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826420.836623:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:2.0:1787826420.836767:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82d44 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13a8 expref: 49 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.836786:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b82d4b lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13a8 expref: 48 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.836797:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826420.836800:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787826420.836805:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835c00, rc 0) 00000100:00100000:2.0:1787826420.836887:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05579e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55646:x1874670563941376:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 585us (794us total) trans 8589935101 rc 0/0 00000100:00100000:2.0:1787826420.836895:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3916 00000100:00100000:2.0:1787826420.841259:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826420.841381:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563941632 00000100:00100000:0.0:1787826420.841395:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563941632 00000100:00100000:0.0:1787826420.841634:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1202 00000100:00100000:0.0:1787826420.841648:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a1a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55646:x1874670563941632:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:0.0:1787826420.841761:0:6521:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000405:0x1d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b82d4b lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13a8 expref: 48 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.841839:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b82d59 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.841870:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b82d28 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab139a expref: 48 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.841881:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b82d59 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.841933:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b82d28 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab139a expref: 48 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.841950:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b82d28 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab139a expref: 48 pid: 6520 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826420.841969:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0557ad00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1874670585270528:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826420.842110:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce057f69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826420.844762:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0557ad00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1874670585270528:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826420.844807:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b82d59 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826420.847600:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826420.847874:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563941760 00000100:00100000:3.0:1787826420.847888:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563941760 00010000:00010000:3.0:1787826420.847952:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b82d28 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab139a expref: 49 pid: 6520 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826420.848077:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1235 00000100:00100000:3.0:1787826420.848090:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf185d8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:2403:x1874670563941760:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826420.848114:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826420.848123:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b82d28 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab139a expref: 49 pid: 6520 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.848139:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b82d28 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab139a expref: 49 pid: 6520 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.848181:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b82d28 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab139a expref: 49 pid: 6520 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.848203:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826420.848209:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b82d59 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.848220:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b82d59 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.848229:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b82d59 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.848260:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826420.848349:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf185d8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:2403:x1874670563941760:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 261us (951us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826420.848357:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1235 00010000:00010000:0.0:1787826420.850897:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b82d59 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.850920:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b82d59 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.850963:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b82d60 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.850985:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b82d36 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13a1 expref: 47 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.850997:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b82d60 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x37:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.851062:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b82d36 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13a1 expref: 47 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.851082:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b82d36 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13a1 expref: 47 pid: 16564 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826420.851102:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0557ad00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1874670585270656:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826420.851267:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce057f69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826420.863605:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0557ad00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1874670585270656:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826420.863651:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b82d60 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x37:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826420.863843:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826420.863945:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563941888 00000100:00100000:3.0:1787826420.863954:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563941888 00010000:00010000:3.0:1787826420.864007:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b82d36 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13a1 expref: 48 pid: 16564 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826420.864058:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1236 00000100:00100000:3.0:1787826420.864069:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a1a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:2403:x1874670563941888:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826420.864088:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826420.864097:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b82d36 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13a1 expref: 48 pid: 16564 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.864110:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b82d36 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13a1 expref: 48 pid: 16564 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.864209:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b82d36 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13a1 expref: 48 pid: 16564 timeout: 1466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.864230:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x37:0x0].0x0 (ffff90cf3abcb700) 00010000:00010000:3.0:1787826420.864236:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b82d60 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x37:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.864247:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b82d60 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x37:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.864256:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b82d60 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x37:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826420.864278:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826420.864345:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a1a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+47:2403:x1874670563941888:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 278us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826420.864354:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1236 00010000:00010000:0.0:1787826420.865004:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b82d60 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x37:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.865015:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b82d60 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x37:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826420.866284:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0557ad00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6521:1874670585270784:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787826420.866365:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826420.866694:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce057f69c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826420.866937:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585270784 00000100:00100000:3.0:1787826420.866946:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585270784 00000100:00100000:3.0:1787826420.867116:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1475 00000100:00100000:3.0:1787826420.867128:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05579a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:6521:x1874670585270784:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787826420.867270:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05579a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:6521:x1874670585270784:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 144us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826420.867278:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1475 00000100:00100000:0.0:1787826420.867357:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0557ad00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6521:1874670585270784:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787826420.867446:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589935102 00000001:00080000:0.0:1787826420.867553:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589935103 00010000:00010000:0.0:1787826420.867573:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b82d60 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x37:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.867584:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b82d60 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x37:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.867593:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b82d60 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x37:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.867600:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165fe00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826420.867605:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b82d60 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x37:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.867613:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b82d60 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x37:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.867633:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x37:0x0].0x0 (ffff90cf3abcb700) 00010000:00010000:0.0:1787826420.867636:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787826420.867641:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b82d60 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x37:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.867648:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b82d60 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x37:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.867682:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b82d59 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.867688:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b82d59 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.867695:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b82d59 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.867706:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165f600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826420.867709:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b82d59 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.867715:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b82d59 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.867722:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826420.867724:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787826420.867727:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b82d59 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.867732:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b82d59 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.867744:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826420.867747:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787826420.867754:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b82d4b lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13a8 expref: 49 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826420.868055:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a1a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55646:x1874670563941632:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 26410us (26811us total) trans 8589935104 rc 0/0 00000100:00100000:0.0:1787826420.868065:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1202 00000020:00080000:0.0:1787826420.868069:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1787826420.877126:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826420.879009:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563942016 00000100:00100000:1.0:1787826420.879023:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563942016 00000100:00100000:0.0:1787826420.879259:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3917 00000100:00100000:0.0:1787826420.879269:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55646:x1874670563942016:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826420.879296:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826420.879317:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b82d67 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab13af expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.879512:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b82d67 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13af expref: 49 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.879529:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b82d67 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13af expref: 49 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.879612:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826420.879616:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826420.879620:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165e400, rc 0) 00000100:00100000:0.0:1787826420.879696:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:55646:x1874670563942016:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 427us (2580us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826420.879703:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3917 00000100:00100000:1.0:1787826420.883224:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826420.883333:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563942272 00000100:00100000:3.0:1787826420.883343:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563942272 00000100:00100000:3.0:1787826420.883411:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1203 00000100:00100000:3.0:1787826420.883421:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce039861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:55646:x1874670563942272:12345-192.168.203.39@tcp:35:lfs.0 00000004:00080000:2.0:1787826420.884248:0:6522:0:(mdd_object.c:4014:mdd_close()) Object [0x200000405:0x37:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787826420.884305:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].30, 64 off10592 00000004:00080000:2.0:1787826420.884317:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1366895844442ns, next at 1367895841628ns, rc = 0 00000001:00080000:2.0:1787826420.884323:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589935105 00010000:00010000:2.0:1787826420.884374:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82d6e lrc: 3/0,1 mode: --/PW res: [0x200000405:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.884390:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82d6e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.884401:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82d6e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.884409:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82d6e lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.884417:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82d6e lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.884422:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82d6e lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.884446:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787826420.884670:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826420.884678:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82d6e lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.884686:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835800 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826420.884690:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82d6e lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.884699:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82d6e lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.884713:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x37:0x0].0x0 (ffff90cf39e67f00) 00010000:00010000:0.0:1787826420.884716:0:8451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787826420.884730:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82d6e lrc: 1/0,0 mode: --/PW res: [0x200000405:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.884741:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82d6e lrc: 0/0,0 mode: --/PW res: [0x200000405:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826420.884761:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826420.884763:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826420.884765:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826420.884870:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce039861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+51:55646:x1874670563942272:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 1450us (1654us total) trans 8589935106 rc 0/0 00000100:00100000:2.0:1787826420.884879:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1203 00000020:00080000:2.0:1787826420.884883:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787826420.893399:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826420.894326:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563942528 00000100:00100000:0.0:1787826420.894338:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563942528 00000100:00100000:0.0:1787826420.894402:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1204 00000100:00100000:0.0:1787826420.894413:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+51:55646:x1874670563942528:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:0.0:1787826420.894646:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+52:55646:x1874670563942528:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 234us (1256us total) trans 8589935107 rc 0/0 00000100:00100000:0.0:1787826420.894655:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1204 00000100:00100000:0.0:1787826420.945115:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826420.948797:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563942656 00000100:00100000:2.0:1787826420.948812:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563942656 00000100:00100000:2.0:1787826420.948886:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3918 00000100:00100000:2.0:1787826420.948896:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0557ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+52:55648:x1874670563942656:12345-192.168.203.39@tcp:101:getfattr.0 00010000:00010000:2.0:1787826420.949009:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826420.949033:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82d75 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab13b6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.949101:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82d7c lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.949115:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82d7c lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.949128:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82d7c lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.949160:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82d83 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.949169:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82d83 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.949175:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82d83 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.949250:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b82d8a lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.949260:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b82d8a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.949268:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b82d8a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826420.949305:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:2.0:1787826420.949310:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826420.949329:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b82d8a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.949341:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b82d8a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.949350:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82d7c lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.949357:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82d7c lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.949367:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82d7c lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.949374:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82d7c lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.949380:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826420.949385:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82d7c lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.949392:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82d7c lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.949403:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf39e67400) 00010000:00010000:2.0:1787826420.949406:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826420.949411:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82d7c lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.949418:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82d7c lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.949432:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82d83 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.949439:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82d83 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.949445:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82d83 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.949453:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826420.949458:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82d83 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.949464:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82d83 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.949509:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf39e67f00) 00010000:00010000:2.0:1787826420.949512:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826420.949515:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82d83 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.949521:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82d83 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.949626:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82d75 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13b6 expref: 54 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.949644:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b82d8a lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13b6 expref: 53 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.949652:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826420.949655:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826420.949657:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835a00, rc 0) 00000100:00100000:2.0:1787826420.949858:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0557ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55648:x1874670563942656:12345-192.168.203.39@tcp:101:getfattr.0 Request processed in 961us (4750us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826420.949866:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3918 00000100:00100000:1.0:1787826420.959982:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826420.961111:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563942784 00000100:00100000:2.0:1787826420.961123:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563942784 00000100:00100000:2.0:1787826420.961200:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2184 00000100:00100000:2.0:1787826420.961209:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03986580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2402:x1874670563942784:12345-192.168.203.39@tcp:101:getfattr.0 00010000:00010000:2.0:1787826420.961227:0:30694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826420.961245:0:30694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000382351a4/0x22153cd396b82d91 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab13bd expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826420.961307:0:30694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f82f840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:30694:1874670585270912:192.168.203.39@tcp:106: 00000100:00100000:2.0:1787826420.961405:0:30694:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10aba6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826420.973944:0:30694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f82f840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:30694:1874670585270912:192.168.203.39@tcp:106: 00010000:00010000:2.0:1787826420.974009:0:30694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000382351a4/0x22153cd396b82d91 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13bd expref: 13 pid: 30694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.974043:0:30694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000382351a4/0x22153cd396b82d91 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13bd expref: 13 pid: 30694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826420.974062:0:30694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834c00, rc 0) 00000100:00100000:2.0:1787826420.974257:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03986580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2402:x1874670563942784:12345-192.168.203.39@tcp:101:getfattr.0 Request processed in 13047us (14283us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826420.974283:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2184 00000100:00100000:0.0:1787826421.019061:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826421.019212:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563942912 00000100:00100000:1.0:1787826421.019227:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563942912 00000100:00100000:1.0:1787826421.019338:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3919 00000100:00100000:1.0:1787826421.019350:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0557b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55652:x1874670563942912:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:1.0:1787826421.019458:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b82d98 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.019532:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b82d98 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.019547:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b82d98 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.019564:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b82d9f lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.019571:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b82d9f lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.019577:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b82d9f lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.019795:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82da6 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.019807:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82da6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.019815:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82da6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826421.019864:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:1.0:1787826421.019869:0:16564:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826421.019886:0:16564:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82da6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.019900:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b82d98 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.019911:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b82d98 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.019920:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b82d98 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.019926:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46bc00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826421.019931:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b82d98 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.019939:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b82d98 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.019953:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf04f8b400) 00010000:00010000:1.0:1787826421.019957:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826421.019962:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b82d98 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.019969:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b82d98 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.019989:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b82d9f lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.019996:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b82d9f lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.020001:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b82d9f lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.020007:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46aa00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826421.020010:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b82d9f lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.020017:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b82d9f lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.020024:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf04f8b900) 00010000:00010000:1.0:1787826421.020026:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826421.020029:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b82d9f lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.020035:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b82d9f lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.020047:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82da6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.020053:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82da6 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.020059:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82da6 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.020064:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46ae00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826421.020068:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82da6 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.020074:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82da6 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.020082:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826421.020084:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826421.020088:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82da6 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.020094:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b82da6 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826421.020265:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0557b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55652:x1874670563942912:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 914us (1217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826421.020275:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3919 00000100:00080000:3.0:1787826421.020332:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787826421.053003:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826421.053135:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563943168 00000100:00100000:2.0:1787826421.053158:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563943168 00000100:00100000:2.0:1787826421.053247:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3920 00000100:00100000:2.0:1787826421.053259:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03984f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55654:x1874670563943168:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826421.053288:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826421.053324:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82dad lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab13c4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.053534:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82db4 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.053553:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82db4 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.053567:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82db4 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826421.053581:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:2.0:1787826421.053732:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82dad lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13c4 expref: 56 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.053755:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82db4 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13c4 expref: 55 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.053766:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826421.053770:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787826421.053775:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834400, rc 0) 00000100:00100000:2.0:1787826421.053860:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03984f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+55:55654:x1874670563943168:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 603us (873us total) trans 8589935108 rc 0/0 00000100:00100000:2.0:1787826421.053870:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3920 00000100:00100000:3.0:1787826421.059114:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826421.059231:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563943296 00000100:00100000:1.0:1787826421.059244:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563943296 00000100:00100000:1.0:1787826421.059339:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2185 00000100:00100000:1.0:1787826421.059352:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01dfcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563943296:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826421.059375:0:30695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826421.059398:0:30695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006d542d7/0x22153cd396b82dc2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab13cb expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826421.059511:0:30695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03985680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:30695:1874670585271040:192.168.203.39@tcp:106: 00010000:00010000:0.0:1787826421.059921:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826421.059976:0:30695:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3780 going to sleep for 11 seconds 00000100:00080000:3.0:1787826421.060820:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826421.070668:0:30695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03985680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:30695:1874670585271040:192.168.203.39@tcp:106: 00010000:00010000:2.0:1787826421.070726:0:30695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000006d542d7/0x22153cd396b82dc2 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13cb expref: 13 pid: 30695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.070757:0:30695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006d542d7/0x22153cd396b82dc2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13cb expref: 13 pid: 30695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.070776:0:30695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46aa00, rc 0) 00000100:00100000:2.0:1787826421.070860:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01dfcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563943296:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 11509us (11760us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826421.070870:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2185 00000100:00100000:0.0:1787826421.077018:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826421.077274:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563943552 00000100:00100000:2.0:1787826421.077286:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563943552 00000100:00100000:2.0:1787826421.077369:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3921 00000100:00100000:2.0:1787826421.077382:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05578000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+55:55654:x1874670563943552:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826421.077417:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826421.077443:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82dc9 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab13d2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.077648:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82dd0 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.077671:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b82d8a lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13b6 expref: 56 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.077681:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82dd0 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.077728:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b82d8a lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13b6 expref: 56 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.077745:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b82d8a lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13b6 expref: 56 pid: 6520 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826421.077768:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f82f840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1874670585271168:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826421.077882:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10aba0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826421.082342:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f82f840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1874670585271168:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826421.082387:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82dd0 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826421.088236:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826421.088618:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563943680 00000100:00100000:2.0:1787826421.088632:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563943680 00010000:00010000:2.0:1787826421.088694:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b82d8a lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13b6 expref: 57 pid: 6520 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826421.088748:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1237 00000100:00100000:2.0:1787826421.088769:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0557a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+57:2403:x1874670563943680:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826421.088788:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826421.088796:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b82d8a lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13b6 expref: 57 pid: 6520 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.088812:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b82d8a lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13b6 expref: 57 pid: 6520 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.088842:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b82d8a lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13b6 expref: 57 pid: 6520 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.088865:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826421.088871:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82dd0 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.088883:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82dd0 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.088893:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82dd0 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.088935:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826421.089011:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0557a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+56:2403:x1874670563943680:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 252us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826421.089020:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1237 00010000:00010000:0.0:1787826421.089253:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82dd0 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.089263:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82dd0 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826421.089292:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:0.0:1787826421.089529:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82dc9 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13d2 expref: 57 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.089555:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82dd0 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13d2 expref: 56 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.089563:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826421.089566:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787826421.089569:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834600, rc 0) 00000100:00100000:0.0:1787826421.089603:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05578000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+56:55654:x1874670563943552:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 12224us (12603us total) trans 8589935109 rc 0/0 00000100:00100000:0.0:1787826421.089611:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3921 00000100:00100000:3.0:1787826421.100994:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826421.101106:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563943936 00000100:00100000:2.0:1787826421.101120:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563943936 00000100:00100000:2.0:1787826421.101207:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3922 00000100:00100000:2.0:1787826421.101220:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01dfd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+56:55654:x1874670563943936:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826421.101259:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826421.101291:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b82dde lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab13d9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.102099:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82de5 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x38:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.102117:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82de5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.102130:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82de5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826421.102154:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x38:0x0]: returning size 0 00010000:00010000:2.0:1787826421.102213:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b82dde lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13d9 expref: 59 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.102240:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82de5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13d9 expref: 58 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.102250:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x38:0x0].0x0 (ffff90cf39e67f00) 00010000:00010000:2.0:1787826421.102253:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826421.102257:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834a00, rc 0) 00000100:00100000:2.0:1787826421.102691:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01dfd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:55654:x1874670563943936:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1470us (1710us total) trans 8589935110 rc 0/0 00000100:00100000:2.0:1787826421.102700:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3922 00000100:00100000:3.0:1787826421.106358:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826421.106958:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563944192 00000100:00100000:0.0:1787826421.106971:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563944192 00000100:00100000:0.0:1787826421.107058:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3923 00000100:00100000:0.0:1787826421.107069:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01dfd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:55654:x1874670563944192:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826421.107104:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826421.107133:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b82df3 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x38:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab13e0 expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.107303:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b82dfa lrc: 3/0,1 mode: --/EX res: [0x200000405:0x38:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.107590:0:9966:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82de5 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13d9 expref: 59 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.107602:0:9966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b82dfa lrc: 4/0,1 mode: --/EX res: [0x200000405:0x38:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.107656:0:9966:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82de5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13d9 expref: 59 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.107675:0:9966:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82de5 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13d9 expref: 59 pid: 6520 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826421.107694:0:9966:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0b430f00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9966:1874670585271296:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826421.108199:0:9966:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce057f6480 going to sleep for 11 seconds 00000100:00100000:0.0:1787826421.114105:0:9966:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0b430f00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9966:1874670585271296:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826421.114181:0:9966:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b82dfa lrc: 3/0,1 mode: --/EX res: [0x200000405:0x38:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826421.123975:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826421.124546:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563944320 00000100:00100000:0.0:1787826421.124561:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563944320 00010000:00010000:0.0:1787826421.124626:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82de5 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13d9 expref: 60 pid: 6520 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826421.124678:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1238 00000100:00100000:0.0:1787826421.124691:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01dfda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:2404:x1874670563944320:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826421.124710:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826421.124718:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82de5 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13d9 expref: 60 pid: 6520 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.124735:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82de5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13d9 expref: 60 pid: 6520 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.124767:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82de5 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13d9 expref: 60 pid: 6520 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.124791:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x38:0x0].0x0 (ffff90cf39e67f00) 00010000:00010000:0.0:1787826421.124798:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b82dfa lrc: 3/0,1 mode: --/EX res: [0x200000405:0x38:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.124809:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b82dfa lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x38:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.124818:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b82dfa lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x38:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.124869:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826421.125198:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01dfda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:2404:x1874670563944320:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 507us (1240us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826421.125208:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1238 00010000:00010000:1.0:1787826421.125293:0:9966:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b82dfa lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x38:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.125304:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b82dfa lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x38:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826421.125342:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x38:0x0]: returning size 0 00000004:00080000:1.0:1787826421.125602:0:9966:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x10c:0x0], index 1: 0 00010000:00010000:1.0:1787826421.125755:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b82dfa lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x38:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.125765:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b82dfa lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x38:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.125773:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b82dfa lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x38:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.125780:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165fa00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826421.125785:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b82dfa lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x38:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.125794:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b82dfa lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x38:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.125808:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x38:0x0].0x0 (ffff90cf39e67f00) 00010000:00010000:1.0:1787826421.125812:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826421.125817:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b82dfa lrc: 2/0,0 mode: --/EX res: [0x200000405:0x38:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.125824:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b82dfa lrc: 0/0,0 mode: --/EX res: [0x200000405:0x38:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.125893:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b82df3 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x38:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13e0 expref: 59 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.125905:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x38:0x0].0x0 (ffff90cf39e67f00) 00010000:00010000:1.0:1787826421.125907:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787826421.125910:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b82df3 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x38:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13e0 expref: 59 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.125927:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165ea00, rc 0) 00000100:00100000:1.0:1787826421.125979:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01dfd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:55654:x1874670563944192:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 18911us (19646us total) trans 8589935111 rc 301/301 00000100:00100000:1.0:1787826421.125989:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3923 00000100:00100000:1.0:1787826421.129977:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826421.130129:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563944576 00000100:00100000:2.0:1787826421.130150:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563944576 00000100:00100000:2.0:1787826421.130254:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1205 00000100:00100000:2.0:1787826421.130267:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce039852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:55654:x1874670563944576:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:2.0:1787826421.130686:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce039852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55654:x1874670563944576:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 421us (722us total) trans 8589935112 rc 0/0 00000100:00100000:2.0:1787826421.130693:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1205 00000100:00100000:3.0:1787826421.132871:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826421.132984:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563944704 00000100:00100000:1.0:1787826421.132998:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563944704 00000100:00100000:1.0:1787826421.133085:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3924 00000100:00100000:1.0:1787826421.133098:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01dfc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55654:x1874670563944704:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826421.133133:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826421.133171:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82e08 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab13e7 expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.133299:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82e0f lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.133336:0:32404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82dd0 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13d2 expref: 60 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.133347:0:32404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82e0f lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.133393:0:32404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82dd0 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13d2 expref: 60 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.133409:0:32404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82dd0 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13d2 expref: 60 pid: 6518 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826421.133427:0:32404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03987840 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:32404:1874670585271424:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826421.133559:0:32404:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787826421.141736:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826421.141970:0:32404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03987840 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:32404:1874670585271424:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826421.142008:0:32404:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82e0f lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826421.142684:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563944832 00000100:00100000:2.0:1787826421.142697:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563944832 00010000:00010000:2.0:1787826421.142770:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82dd0 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13d2 expref: 61 pid: 6518 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826421.143223:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1239 00000100:00100000:2.0:1787826421.143239:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01dff840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+61:2404:x1874670563944832:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826421.143262:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826421.143272:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82dd0 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13d2 expref: 61 pid: 6518 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.143287:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82dd0 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13d2 expref: 61 pid: 6518 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.143317:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82dd0 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13d2 expref: 61 pid: 6518 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.143718:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826421.143725:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82e0f lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.143739:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82e0f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.143749:0:10340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82e0f lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.143785:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826421.143818:0:32404:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82e0f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.143829:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82e0f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826421.143899:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:1.0:1787826421.143905:0:32404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826421.143932:0:32404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82e0f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.143978:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82e08 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13e7 expref: 61 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826421.143993:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01dff840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:2404:x1874670563944832:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 756us (2271us total) trans 0 rc 0/0 00010000:00010000:1.0:1787826421.143999:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82e0f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13e7 expref: 60 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826421.144010:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1239 00010000:00010000:1.0:1787826421.144012:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826421.144018:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826421.144020:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46ba00, rc 0) 00000100:00100000:1.0:1787826421.144062:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01dfc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55654:x1874670563944704:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 10967us (11204us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826421.144071:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3924 00000100:00100000:1.0:1787826421.149014:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826421.149102:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563944960 00000100:00100000:3.0:1787826421.149116:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563944960 00000100:00100000:3.0:1787826421.149210:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2186 00000100:00100000:3.0:1787826421.149223:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03987840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563944960:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826421.149251:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826421.149279:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000482bb568/0x22153cd396b82e16 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab13ee expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826421.149527:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01dff0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1874670585271552:192.168.203.39@tcp:106: 00000100:00100000:3.0:1787826421.149764:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf371d10c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826421.161759:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01dff0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1874670585271552:192.168.203.39@tcp:106: 00010000:00010000:3.0:1787826421.161834:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000482bb568/0x22153cd396b82e16 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13ee expref: 13 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.161867:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000482bb568/0x22153cd396b82e16 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13ee expref: 13 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.161884:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400200, rc 0) 00000100:00100000:3.0:1787826421.161981:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03987840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563944960:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 12759us (12981us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826421.161993:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2186 00000100:00100000:1.0:1787826421.173389:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826421.173634:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563945088 00000100:00100000:3.0:1787826421.173758:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563945088 00000100:00100000:3.0:1787826421.173910:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3925 00000100:00100000:3.0:1787826421.173922:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03985680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55654:x1874670563945088:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826421.173950:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826421.173982:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b82e1d lrc: 2/0,0 mode: --/CR res: [0x200000405:0x38:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab13f5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.174089:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b82e24 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x38:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.174107:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b82e24 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x38:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.174121:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b82e24 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x38:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826421.174191:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x38:0x0]: returning size 0 00000004:00200000:3.0:1787826421.174198:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826421.174222:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b82e24 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x38:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.174256:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b82e1d lrc: 0/0,0 mode: --/CR res: [0x200000405:0x38:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13f5 expref: 61 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.174279:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b82e24 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x38:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13f5 expref: 60 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.174289:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x38:0x0].0x0 (ffff90cf06894400) 00010000:00010000:3.0:1787826421.174293:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787826421.174297:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401a00, rc 0) 00000100:00100000:3.0:1787826421.174383:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03985680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:55654:x1874670563945088:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 463us (1010us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826421.174392:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3925 00000100:00100000:1.0:1787826421.186370:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826421.187057:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563945216 00000100:00100000:0.0:1787826421.187072:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563945216 00000100:00100000:0.0:1787826421.192670:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2187 00000100:00100000:0.0:1787826421.192707:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2404:x1874670563945216:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826421.192734:0:30398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826421.192764:0:30398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000952ff42d/0x22153cd396b82e2b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x10c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab13fc expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826421.192988:0:30398:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826421.193022:0:30398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10c:0x0].0x0 since=1367s v=(0 0) 00010000:00010000:0.0:1787826421.193027:0:30398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826421.193040:0:30398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000952ff42d/0x22153cd396b82e2b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13fc expref: 16 pid: 30398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.193069:0:30398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000952ff42d/0x22153cd396b82e2b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13fc expref: 16 pid: 30398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.193098:0:30398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165e200, rc 0) 00000100:00100000:0.0:1787826421.193251:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2404:x1874670563945216:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 563us (6898us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826421.193260:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2187 00000100:00080000:3.0:1787826421.193401:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787826421.202646:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826421.202926:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563945472 00000100:00100000:2.0:1787826421.202940:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563945472 00000100:00100000:2.0:1787826421.203028:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3926 00000100:00100000:2.0:1787826421.203041:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b430f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:55654:x1874670563945472:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826421.203071:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826421.203102:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82e32 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1403 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.203260:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82e39 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.203281:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82e39 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.203297:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82e39 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826421.203314:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:2.0:1787826421.203746:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82e32 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1403 expref: 63 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.203770:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82e39 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1403 expref: 62 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.203780:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826421.203783:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787826421.203787:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834a00, rc 0) 00000100:00100000:2.0:1787826421.203945:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b430f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+62:55654:x1874670563945472:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 905us (1324us total) trans 8589935113 rc 0/0 00000100:00100000:2.0:1787826421.203954:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3926 00000100:00100000:1.0:1787826421.215840:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826421.216020:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563945600 00000100:00100000:2.0:1787826421.216034:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563945600 00000100:00100000:2.0:1787826421.216116:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2188 00000100:00100000:2.0:1787826421.216128:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563945600:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826421.216162:0:8545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826421.216187:0:8545:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c6f0c33/0x22153cd396b82e47 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab140a expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826421.216268:0:8545:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f82f840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8545:1874670585271680:192.168.203.39@tcp:106: 00000100:00100000:2.0:1787826421.216390:0:8545:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10aba6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826421.224307:0:8545:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f82f840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8545:1874670585271680:192.168.203.39@tcp:106: 00010000:00010000:2.0:1787826421.224371:0:8545:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005c6f0c33/0x22153cd396b82e47 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab140a expref: 13 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.224403:0:8545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c6f0c33/0x22153cd396b82e47 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab140a expref: 13 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.224419:0:8545:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834600, rc 0) 00000100:00100000:2.0:1787826421.225237:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563945600:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 9102us (9406us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826421.225250:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2188 00000100:00100000:0.0:1787826421.238160:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826421.239961:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563945728 00000100:00100000:1.0:1787826421.239980:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563945728 00000100:00100000:1.0:1787826421.240079:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2189 00000100:00100000:1.0:1787826421.240092:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b431680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2401:x1874670563945728:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826421.240117:0:30696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826421.240152:0:30696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065f23c08/0x22153cd396b82e4e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1411 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826421.240243:0:30696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f8c2940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:30696:1874670585271808:192.168.203.39@tcp:106: 00000100:00100000:1.0:1787826421.240367:0:30696:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826421.251057:0:30696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f8c2940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:30696:1874670585271808:192.168.203.39@tcp:106: 00010000:00010000:2.0:1787826421.251119:0:30696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065f23c08/0x22153cd396b82e4e lrc: 1/0,0 mode: --/PR res: [0x280000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1411 expref: 13 pid: 30696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.251165:0:30696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065f23c08/0x22153cd396b82e4e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1411 expref: 13 pid: 30696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.251183:0:30696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46a800, rc 0) 00000100:00100000:2.0:1787826421.251267:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b431680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2401:x1874670563945728:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 11175us (13135us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826421.251278:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2189 00000100:00100000:3.0:1787826421.256657:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826421.259166:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563945856 00000100:00100000:2.0:1787826421.259187:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563945856 00000100:00100000:2.0:1787826421.259284:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2190 00000100:00100000:2.0:1787826421.259297:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01dff0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2402:x1874670563945856:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:2.0:1787826421.259370:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005c6f0c33/0x22153cd396b82e55 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.259398:0:14864:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b82c80 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1369 expref: 12 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.259408:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x10b:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787826421.259414:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10b:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826421.259419:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c6f0c33/0x22153cd396b82e55 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.259466:0:14864:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b82c80 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1369 expref: 12 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.259507:0:14864:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b82c80 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1369 expref: 12 pid: 14864 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826421.259525:0:14864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f82f840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14864:1874670585271936:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826421.259662:0:14864:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10aba6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826421.271652:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826421.274547:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563945984 00000100:00100000:1.0:1787826421.274570:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563945984 00010000:00010000:1.0:1787826421.274657:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b82c80 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1369 expref: 13 pid: 14864 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826421.274718:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1240 00000100:00100000:1.0:1787826421.274730:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b4321c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2403:x1874670563945984:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826421.274755:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826421.274786:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b82c80 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x10b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1369 expref: 13 pid: 14864 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.275026:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b82c80 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x10b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1369 expref: 13 pid: 14864 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.275072:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10b:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826421.275077:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10b:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826421.275085:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005c6f0c33/0x22153cd396b82e55 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x10b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.275098:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c6f0c33/0x22153cd396b82e55 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x10b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.275128:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826421.275236:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b4321c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2403:x1874670563945984:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 506us (3598us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826421.275247:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1240 00010000:00010000:2.0:1787826421.275411:0:14864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b82c80 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1369 expref: 12 pid: 14864 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826421.275431:0:14864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f82f840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14864:1874670585271936:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826421.275465:0:14864:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005c6f0c33/0x22153cd396b82e55 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x10b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.275540:0:14864:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005c6f0c33/0x22153cd396b82e55 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x10b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.275549:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c6f0c33/0x22153cd396b82e55 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x10b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.275581:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005c6f0c33/0x22153cd396b82e55 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x10b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.275590:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c6f0c33/0x22153cd396b82e55 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x10b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.275600:0:14864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c6f0c33/0x22153cd396b82e55 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.275609:0:14864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834600 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826421.275614:0:14864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c6f0c33/0x22153cd396b82e55 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.275624:0:14864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c6f0c33/0x22153cd396b82e55 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x10b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.275639:0:14864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c6f0c33/0x22153cd396b82e55 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x10b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.275648:0:14864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c6f0c33/0x22153cd396b82e55 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x10b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826421.275719:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01dff0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2402:x1874670563945856:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 16423us (19076us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826421.275729:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2190 00000100:00100000:3.0:1787826421.282785:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826421.283033:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563946112 00000100:00100000:0.0:1787826421.283046:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563946112 00000100:00100000:0.0:1787826421.283123:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2191 00000100:00100000:0.0:1787826421.283135:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01dfe580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2401:x1874670563946112:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826421.283169:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826421.283197:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002972f1b9/0x22153cd396b82e5c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x10b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1418 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826421.283232:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10b:0x0] initial LVB size: 0, mtime: 0x6a9010ec, atime: 0x6a9010ec, ctime: 0x6a9010f5, blocks: 0x0 00010000:00010000:0.0:1787826421.283259:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10b:0x0].0x0 since=1367s v=(0 0) 00010000:00010000:0.0:1787826421.283264:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826421.283275:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002972f1b9/0x22153cd396b82e5c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1418 expref: 12 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.283303:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002972f1b9/0x22153cd396b82e5c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1418 expref: 12 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.283319:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165ea00, rc 0) 00000100:00100000:0.0:1787826421.283404:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01dfe580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2401:x1874670563946112:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 270us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826421.283412:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2191 00000100:00100000:0.0:1787826421.336359:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826421.338023:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563946240 00000100:00100000:1.0:1787826421.338045:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563946240 00000100:00100000:1.0:1787826421.338157:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3927 00000100:00100000:1.0:1787826421.338170:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f877480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+62:55654:x1874670563946240:12345-192.168.203.39@tcp:44:lfs.0 00000001:00080000:0.0:1787826421.341590:0:34481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935113 is committed 00000004:00080000:0.0:1787826421.341624:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 30 committed 00010000:00010000:1.0:1787826421.341776:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b82c72 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.341792:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b82c72 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.341801:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b82c72 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.341809:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46ac00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826421.341815:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b82c72 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.341825:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b82c72 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.341847:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x36:0x0].0x0 (ffff90cf04f8b500) 00010000:00010000:1.0:1787826421.341850:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826421.341857:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b82c72 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.341865:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b82c72 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.341901:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b82c87 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.341907:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b82c87 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.341914:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b82c87 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.341920:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826421.341923:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b82c87 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.341930:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b82c87 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.341939:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826421.341942:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826421.341945:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b82c87 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.341956:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b82c87 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826421.348833:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01dfed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585272064:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787826421.348938:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826421.349223:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585272064 00000100:00100000:3.0:1787826421.349234:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585272064 00000100:00100000:3.0:1787826421.349368:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2192 00000100:00100000:3.0:1787826421.349380:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3644:x1874670585272064:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787826421.349416:0:30398:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:267 count 1 00010000:00010000:3.0:1787826421.349465:0:30398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d612c5b/0x22153cd396b82e63 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.349523:0:30398:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008c800962/0x22153cd396b82c8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1370 expref: 15 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.349545:0:30398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x10b:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787826421.349551:0:30398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10b:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826421.349557:0:30398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d612c5b/0x22153cd396b82e63 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787826421.349593:0:34481:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90cf1850c6c0 refcount 2 committed 0 result 0 batchid 4294969341 00010000:00010000:3.0:1787826421.349600:0:30398:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008c800962/0x22153cd396b82c8e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1370 expref: 15 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787826421.349604:0:34481:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cf1f111600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90cf1850c840 00000020:00080000:0.0:1787826421.349613:0:34481:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cf1f111400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90ce05b83c00 00010000:00010000:3.0:1787826421.349630:0:30398:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008c800962/0x22153cd396b82c8e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1370 expref: 15 pid: 8545 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787826421.349642:0:34481:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969340 batchid updated 00000020:00080000:0.0:1787826421.349665:0:34512:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969341 committed batchid 4294969340 00000020:00080000:0.0:1787826421.349756:0:34512:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969340 00000100:00100000:3.0:1787826421.349918:0:30398:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01dffc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:30398:1874670585272192:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826421.349953:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f877480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:55654:x1874670563946240:12345-192.168.203.39@tcp:44:lfs.0 Request processed in 11784us (13608us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826421.349966:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3927 00000100:00100000:3.0:1787826421.349984:0:30398:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf371d10c0 going to sleep for 11 seconds 00000100:00080000:2.0:1787826421.350356:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826421.357704:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826421.357822:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563946368 00000100:00100000:0.0:1787826421.357835:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563946368 00010000:00010000:0.0:1787826421.357897:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008c800962/0x22153cd396b82c8e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1370 expref: 16 pid: 8545 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826421.357958:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1241 00000100:00100000:0.0:1787826421.357970:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3abc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2403:x1874670563946368:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826421.357989:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826421.358007:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008c800962/0x22153cd396b82c8e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x10b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1370 expref: 16 pid: 8545 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.358023:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008c800962/0x22153cd396b82c8e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x10b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1370 expref: 16 pid: 8545 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.358058:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10b:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826421.358063:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10b:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826421.358070:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006d612c5b/0x22153cd396b82e63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.358083:0:10341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d612c5b/0x22153cd396b82e63 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x10b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.358111:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826421.358205:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3abc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2403:x1874670563946368:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 234us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826421.358214:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1241 00010000:00010000:3.0:1787826421.358554:0:30398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c800962/0x22153cd396b82c8e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1370 expref: 15 pid: 8545 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826421.358583:0:30398:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01dffc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:30398:1874670585272192:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826421.358610:0:30398:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006d612c5b/0x22153cd396b82e63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.358622:0:30398:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006d612c5b/0x22153cd396b82e63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.358629:0:30398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006d612c5b/0x22153cd396b82e63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.358657:0:30398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d612c5b/0x22153cd396b82e63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.358667:0:30398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006d612c5b/0x22153cd396b82e63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.358687:0:30398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787826421.358918:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3644:x1874670585272064:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9538us (9980us total) trans 17179869676 rc 0/0 00000100:00100000:3.0:1787826421.358927:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2192 00000004:00080000:2.0:1787826421.359155:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce01dfed00/2, rc 0, transno 17179869676 00000100:00100000:2.0:1787826421.359164:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01dfed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585272064:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1787826421.359353:0:7460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826421.359363:0:7460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006d612c5b/0x22153cd396b82e63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.359381:0:7460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400000 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826421.359386:0:7460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006d612c5b/0x22153cd396b82e63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.359399:0:7460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006d612c5b/0x22153cd396b82e63 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.359420:0:7460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006d612c5b/0x22153cd396b82e63 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.359429:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d612c5b/0x22153cd396b82e63 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.359453:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826421.359455:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826421.359457:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826421.367434:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826421.367684:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563946496 00000100:00100000:3.0:1787826421.367699:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563946496 00000100:00100000:3.0:1787826421.367890:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2193 00000100:00100000:3.0:1787826421.367908:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f934f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2401:x1874670563946496:12345-192.168.203.39@tcp:16:lfs.0 00000100:00100000:3.0:1787826421.368667:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f934f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2401:x1874670563946496:12345-192.168.203.39@tcp:16:lfs.0 Request processed in 751us (1233us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826421.368678:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2193 00000100:00100000:1.0:1787826421.401885:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826421.405138:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563946624 00000100:00100000:2.0:1787826421.405170:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563946624 00000100:00100000:3.0:1787826421.405393:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2194 00000100:00100000:3.0:1787826421.405407:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f936940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2401:x1874670563946624:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:3.0:1787826421.405496:0:30694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000482bb568/0x22153cd396b82e6a lrc: 3/1,0 mode: --/PR res: [0x280000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.405524:0:30694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826421.405787:0:30694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826421.405798:0:30694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000482bb568/0x22153cd396b82e6a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.405821:0:30694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000482bb568/0x22153cd396b82e6a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.405859:0:30694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000482bb568/0x22153cd396b82e6a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.405869:0:30694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000482bb568/0x22153cd396b82e6a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.405878:0:30694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000482bb568/0x22153cd396b82e6a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.405885:0:30694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400200 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826421.405891:0:30694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000482bb568/0x22153cd396b82e6a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.405901:0:30694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000482bb568/0x22153cd396b82e6a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.405922:0:30694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000482bb568/0x22153cd396b82e6a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.405931:0:30694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000482bb568/0x22153cd396b82e6a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826421.406062:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f936940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2401:x1874670563946624:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 656us (4192us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826421.406072:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2194 00000100:00100000:0.0:1787826421.411446:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826421.411624:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563946880 00000100:00100000:1.0:1787826421.411807:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563946880 00000100:00100000:1.0:1787826421.411895:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3928 00000100:00100000:1.0:1787826421.411908:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f877c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:55654:x1874670563946880:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:1.0:1787826421.411983:0:32404:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826421.412021:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b82e24 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x38:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13f5 expref: 33 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.412046:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x38:0x0].0x0 (ffff90cf06894400) 00010000:00010000:1.0:1787826421.412062:0:32404:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826421.412111:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b82e71 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x38:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.412127:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b82e71 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.412149:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b82e71 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826421.412319:0:32404:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c583cca4 reply state 000000003ad83fa5 transno 8589935114 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b82e71 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.413132:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b82e71 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.413151:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x38:0x0].0x0 (ffff90cf04f8b500) 00010000:00010000:1.0:1787826421.413154:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826421.413158:0:32404:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826421.414982:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f877c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:55654:x1874670563946880:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 1408us (2853us total) trans 8589935114 rc 0/0 00000100:00100000:1.0:1787826421.415002:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3928 00000100:00100000:3.0:1787826421.427455:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826421.427592:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563947008 00000100:00100000:0.0:1787826421.427606:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563947008 00000100:00100000:0.0:1787826421.427706:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3929 00000100:00100000:0.0:1787826421.427718:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01dffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:55654:x1874670563947008:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826421.427755:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826421.427784:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b82e78 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x38:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab141f expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.427879:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b82e78 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x38:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab141f expref: 35 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.427898:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b82e78 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x38:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab141f expref: 35 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.427922:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x38:0x0].0x0 (ffff90cf04f8b500) 00010000:00010000:0.0:1787826421.427926:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826421.427930:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165fe00, rc 0) 00000100:00100000:0.0:1787826421.428011:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01dffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:55654:x1874670563947008:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 294us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826421.428019:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3929 00000100:00100000:0.0:1787826421.434727:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826421.436016:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563947136 00000100:00100000:3.0:1787826421.436033:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563947136 00000100:00100000:3.0:1787826421.436770:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2195 00000100:00100000:3.0:1787826421.436785:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f875680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:55654:x1874670563947136:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826421.436808:0:30695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826421.436833:0:30695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000482bb568/0x22153cd396b82e7f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1426 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.436874:0:30695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000952ff42d/0x22153cd396b82e2b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13fc expref: 16 pid: 30398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.436891:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826421.436896:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826421.436901:0:30695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000482bb568/0x22153cd396b82e7f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1426 expref: 16 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.436946:0:30695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000952ff42d/0x22153cd396b82e2b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13fc expref: 16 pid: 30398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.436963:0:30695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000952ff42d/0x22153cd396b82e2b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13fc expref: 16 pid: 30398 timeout: 1467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826421.436980:0:30695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01dfde00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:30695:1874670585272320:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826421.437097:0:30695:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf371d19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826421.447059:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826421.447223:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563947264 00000100:00100000:0.0:1787826421.447235:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563947264 00010000:00010000:0.0:1787826421.447289:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000952ff42d/0x22153cd396b82e2b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13fc expref: 17 pid: 30398 timeout: 1467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826421.447409:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1242 00000100:00100000:0.0:1787826421.447421:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf185da450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+17:2404:x1874670563947264:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826421.447441:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826421.447489:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000952ff42d/0x22153cd396b82e2b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x10c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13fc expref: 17 pid: 30398 timeout: 1467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.447507:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000952ff42d/0x22153cd396b82e2b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x10c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13fc expref: 17 pid: 30398 timeout: 1467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.447543:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826421.447548:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826421.447557:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000482bb568/0x22153cd396b82e7f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1426 expref: 17 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.447569:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000482bb568/0x22153cd396b82e7f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x10c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1426 expref: 17 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.447618:0:6503:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000482bb568/0x22153cd396b82e7f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x10c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1426 expref: 17 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826421.447635:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f876940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6503:1874670585272448:192.168.203.39@tcp:105: 00000100:00100000:0.0:1787826421.447859:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce057f6480 going to sleep for 11 seconds 00010000:00010000:3.0:1787826421.449920:0:30695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000952ff42d/0x22153cd396b82e2b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x10c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13fc expref: 17 pid: 30398 timeout: 1467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826421.449947:0:30695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01dfde00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:30695:1874670585272320:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826421.449991:0:30695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000482bb568/0x22153cd396b82e7f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1426 expref: 16 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.450010:0:30695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400200, rc 0) 00000100:00100000:3.0:1787826421.450104:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f875680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:55654:x1874670563947136:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 13322us (15391us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826421.450119:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2195 00000100:00100000:1.0:1787826421.457927:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826421.458047:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f876940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6503:1874670585272448:192.168.203.39@tcp:105: 00010000:00010000:0.0:1787826421.458088:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826421.458177:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf185da450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2404:x1874670563947264:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 10756us (11129us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826421.458191:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1242 00000100:00100000:0.0:1787826421.458310:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563947392 00000100:00100000:0.0:1787826421.460586:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563947392 00000100:00100000:0.0:1787826421.460751:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2196 00000100:00100000:0.0:1787826421.460764:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f9352c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2401:x1874670563947392:12345-192.168.203.39@tcp:2:lfs.0 00002000:00010000:0.0:1787826421.461008:0:8437:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x10c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787826421.461014:0:8437:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x10c:0x0] updating lvb mtime from disk: 0 -> 1787826412 00002000:00010000:0.0:1787826421.461017:0:8437:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x10c:0x0] updating lvb atime from disk: 0 -> 1787826412 00002000:00010000:0.0:1787826421.461019:0:8437:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x10c:0x0] updating lvb ctime from disk: 0 -> 1787826421 00002000:00010000:0.0:1787826421.461022:0:8437:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x10c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1787826421.461102:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f9352c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2401:x1874670563947392:12345-192.168.203.39@tcp:2:lfs.0 Request processed in 340us (3188us total) trans 17179869677 rc 0/0 00000100:00100000:0.0:1787826421.461112:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2196 00000100:00100000:3.0:1787826421.469388:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826421.469560:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563947648 00000100:00100000:2.0:1787826421.469575:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563947648 00000100:00100000:2.0:1787826421.469663:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3930 00000100:00100000:2.0:1787826421.469675:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01dfde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:55654:x1874670563947648:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:2.0:1787826421.469748:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826421.469795:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b82e0f lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13e7 expref: 35 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.469820:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826421.469827:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826421.469896:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82e86 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.469915:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82e86 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.469928:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82e86 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826421.470083:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003dcefb70 reply state 000000002249a630 transno 8589935115 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82e86 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.470098:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82e86 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.470105:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826421.470108:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826421.470111:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826421.470241:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01dfde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55654:x1874670563947648:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 567us (869us total) trans 8589935115 rc 0/0 00000100:00100000:2.0:1787826421.470250:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3930 00000100:00100000:1.0:1787826421.489060:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826421.489462:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563947776 00000100:00100000:3.0:1787826421.489509:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563947776 00000100:00100000:3.0:1787826421.489585:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2197 00000100:00100000:3.0:1787826421.489596:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03976940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:55654:x1874670563947776:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826421.489621:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826421.489646:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a816990/0x22153cd396b82e8d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab142d expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.489704:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002972f1b9/0x22153cd396b82e5c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1418 expref: 13 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.489715:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826421.489720:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826421.489727:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a816990/0x22153cd396b82e8d lrc: 4/0,0 mode: --/PW res: [0x280000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab142d expref: 13 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.489775:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002972f1b9/0x22153cd396b82e5c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1418 expref: 13 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.489792:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002972f1b9/0x22153cd396b82e5c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1418 expref: 13 pid: 8437 timeout: 1467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826421.489812:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01dfda40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1874670585272576:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826421.489920:0:8435:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf371d19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826421.500539:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01dfda40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1874670585272576:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826421.500592:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003a816990/0x22153cd396b82e8d lrc: 3/0,0 mode: --/PW res: [0x280000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab142d expref: 13 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.500622:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401400, rc 0) 00000100:00100000:3.0:1787826421.500714:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03976940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:55654:x1874670563947776:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 11118us (11667us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826421.500725:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2197 00000100:00100000:3.0:1787826421.512333:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826421.517314:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563947904 00000100:00100000:2.0:1787826421.517338:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563947904 00010000:00010000:2.0:1787826421.517400:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002972f1b9/0x22153cd396b82e5c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1418 expref: 13 pid: 8437 timeout: 1467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826421.517464:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1243 00000100:00100000:2.0:1787826421.517498:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01dfda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2404:x1874670563947904:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826421.517517:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826421.517544:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002972f1b9/0x22153cd396b82e5c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x10b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1418 expref: 13 pid: 8437 timeout: 1467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.517566:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002972f1b9/0x22153cd396b82e5c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1418 expref: 13 pid: 8437 timeout: 1467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.517594:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002972f1b9/0x22153cd396b82e5c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x10b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1418 expref: 13 pid: 8437 timeout: 1467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.517611:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826421.517617:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826421.517625:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003a816990/0x22153cd396b82e8d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab142d expref: 12 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.517636:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a816990/0x22153cd396b82e8d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab142d expref: 12 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.517701:0:6504:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003a816990/0x22153cd396b82e8d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab142d expref: 12 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826421.517720:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f82f840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6504:1874670585272704:192.168.203.39@tcp:105: 00000100:00100000:2.0:1787826421.518634:0:6504:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10abab40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826421.524239:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826421.524452:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563948032 00000100:00100000:3.0:1787826421.524465:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563948032 00000100:00100000:3.0:1787826421.524560:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2198 00000100:00100000:3.0:1787826421.524571:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136d4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2404:x1874670563948032:12345-192.168.203.39@tcp:2:lfs.0 00002000:00010000:3.0:1787826421.524787:0:28853:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x10b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787826421.524791:0:28853:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x10b:0x0] updating lvb mtime from disk: 1787826412 -> 1787826412 00002000:00010000:3.0:1787826421.524794:0:28853:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x10b:0x0] updating lvb atime from disk: 1787826412 -> 1787826412 00002000:00010000:3.0:1787826421.524796:0:28853:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x10b:0x0] updating lvb ctime from disk: 1787826421 -> 1787826422 00002000:00010000:3.0:1787826421.524799:0:28853:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x10b:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1787826421.524873:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136d4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563948032:12345-192.168.203.39@tcp:2:lfs.0 Request processed in 303us (651us total) trans 21474837018 rc 0/0 00000100:00100000:3.0:1787826421.524882:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2198 00000100:00100000:3.0:1787826421.524944:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f82f840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6504:1874670585272704:192.168.203.39@tcp:105: 00010000:00010000:3.0:1787826421.524972:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826421.524997:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01dfda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2404:x1874670563947904:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 7501us (12695us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826421.525007:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1243 00000100:00100000:3.0:1787826421.532928:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826421.538003:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563948288 00000100:00100000:3.0:1787826421.538026:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563948288 00000100:00100000:3.0:1787826421.538115:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1206 00000100:00100000:3.0:1787826421.538128:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eea1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55654:x1874670563948288:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:3.0:1787826421.538249:0:14257:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000405:0x1d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82e39 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1403 expref: 36 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.538302:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b82e94 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.540437:0:14257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b82d67 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13af expref: 36 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.540458:0:14257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82db4 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13c4 expref: 36 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.540484:0:14257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b82e94 lrc: 5/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.540537:0:14257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82db4 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13c4 expref: 36 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.540557:0:14257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82db4 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13c4 expref: 36 pid: 6519 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826421.540583:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01dff840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585272832:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826421.545128:0:14257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b82d67 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13af expref: 36 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.545167:0:14257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b82d67 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13af expref: 36 pid: 32404 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826421.545188:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aa86940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585272960:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826421.547975:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826421.548030:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563948544 00000100:00100000:1.0:1787826421.548040:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563948544 00000100:00100000:1.0:1787826421.548103:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1207 00000100:00100000:1.0:1787826421.548114:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:49796:x1874670563948544:12345-192.168.203.39@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787826421.548263:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf371d19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826421.548301:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01dff840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585272832:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826421.548384:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826421.548409:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563948672 00000100:00100000:3.0:1787826421.548413:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563948672 00010000:00010000:3.0:1787826421.548443:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b82d67 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13af expref: 38 pid: 32404 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826421.548489:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1244 00000100:00100000:3.0:1787826421.548497:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9ac780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:2403:x1874670563948672:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826421.548514:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826421.548522:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b82d67 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13af expref: 38 pid: 32404 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.548535:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b82d67 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13af expref: 38 pid: 32404 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.548571:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826421.548577:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b82e94 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.548587:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b82e94 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.548594:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826421.550193:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+39:49796:x1874670563948544:12345-192.168.203.39@tcp:35:ldlm_bl.0 Request processed in 2068us (2219us total) trans 8589935116 rc 0/0 00000100:00100000:1.0:1787826421.550206:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1207 00000100:00100000:3.0:1787826421.550402:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9ac780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:2403:x1874670563948672:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 154us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826421.550412:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1244 00010000:00010000:3.0:1787826421.550505:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b82d67 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13af expref: 37 pid: 32404 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826421.550526:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aa86940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585272960:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826421.550562:0:14257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b82e94 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826421.560017:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826421.560315:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563948800 00000100:00100000:3.0:1787826421.560329:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563948800 00010000:00010000:3.0:1787826421.560379:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82db4 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13c4 expref: 37 pid: 6519 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826421.560421:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1245 00000100:00100000:3.0:1787826421.560431:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa86940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:2404:x1874670563948800:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826421.560453:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826421.560460:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82db4 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13c4 expref: 37 pid: 6519 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.560495:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82db4 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13c4 expref: 37 pid: 6519 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.560523:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b82db4 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab13c4 expref: 37 pid: 6519 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.560538:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826421.560544:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b82e94 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.560555:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b82e94 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.560564:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b82e94 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.560593:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826421.560659:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa86940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:2404:x1874670563948800:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 228us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826421.560667:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1245 00010000:00010000:3.0:1787826421.560859:0:14257:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b82e94 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.560868:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b82e94 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.560899:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b82e9b lrc: 3/0,1 mode: --/EX res: [0x200000405:0x38:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.560913:0:14257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b82e78 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x38:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab141f expref: 35 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.560921:0:14257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b82e9b lrc: 4/0,1 mode: --/EX res: [0x200000405:0x38:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.560958:0:14257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b82e78 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x38:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab141f expref: 35 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.560972:0:14257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b82e78 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x38:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab141f expref: 35 pid: 16564 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826421.560987:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01dff840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585273088:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826421.561047:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf371d19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826421.570535:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01dff840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585273088:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826421.570576:0:14257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b82e9b lrc: 3/0,1 mode: --/EX res: [0x200000405:0x38:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826421.580079:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826421.581576:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563948928 00000100:00100000:3.0:1787826421.581591:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563948928 00010000:00010000:3.0:1787826421.581659:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b82e78 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x38:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab141f expref: 36 pid: 16564 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826421.581712:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1246 00000100:00100000:3.0:1787826421.581726:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f876940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:2404:x1874670563948928:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826421.581746:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826421.581754:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b82e78 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x38:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab141f expref: 36 pid: 16564 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.581931:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b82e78 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x38:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab141f expref: 36 pid: 16564 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.581988:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b82e78 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x38:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab141f expref: 36 pid: 16564 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.582008:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x38:0x0].0x0 (ffff90cf04f8b500) 00010000:00010000:3.0:1787826421.582014:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b82e9b lrc: 3/0,1 mode: --/EX res: [0x200000405:0x38:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.582024:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b82e9b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x38:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.582034:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b82e9b lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x38:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.582065:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826421.582150:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f876940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:2404:x1874670563948928:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 413us (2070us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826421.582160:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1246 00010000:00010000:3.0:1787826421.582293:0:14257:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b82e9b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x38:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.582304:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b82e9b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x38:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826421.583249:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01dff840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585273216:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1787826421.584537:0:14257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826421.584588:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf371d1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826421.584879:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585273216 00000100:00100000:0.0:1787826421.584890:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585273216 00000100:00100000:0.0:1787826421.584983:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1476 00000100:00100000:0.0:1787826421.584995:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+11:14257:x1874670585273216:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1787826421.585129:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+11:14257:x1874670585273216:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 136us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826421.585148:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1476 00000100:00080000:0.0:1787826421.585174:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826421.587436:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01dff840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585273216:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1787826421.587820:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01dff840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585273344:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1787826421.587898:0:14257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826421.591250:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf371d1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826421.594515:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585273344 00000100:00100000:0.0:1787826421.594535:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585273344 00000100:00100000:0.0:1787826421.594615:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1477 00000100:00100000:0.0:1787826421.594626:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8af840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:14257:x1874670585273344:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1787826421.594903:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8af840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:14257:x1874670585273344:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 278us (7003us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826421.594912:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1477 00000100:00100000:0.0:1787826421.594988:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01dff840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585273344:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:0.0:1787826421.595203:0:14257:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589935117 00000100:00100000:0.0:1787826421.595309:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f876580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585273472:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1787826421.595809:0:14257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826421.595840:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3ab4c600 going to sleep for 11 seconds 00000100:00100000:0.0:1787826421.595867:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585273472 00000100:00100000:0.0:1787826421.595873:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585273472 00000100:00100000:0.0:1787826421.595910:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1478 00000100:00100000:0.0:1787826421.595918:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f875e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+11:14257:x1874670585273472:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1787826421.596055:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f875e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+12:14257:x1874670585273472:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 137us (246us total) trans 17179869678 rc 0/0 00000100:00100000:0.0:1787826421.596062:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1478 00000100:00100000:0.0:1787826421.596101:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f876580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585273472:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:0.0:1787826421.596189:0:14257:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589935118 00010000:00010000:0.0:1787826421.596224:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b82e9b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x38:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.596236:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b82e9b lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x38:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.596245:0:14257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b82e9b lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x38:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.596253:0:14257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826421.596258:0:14257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b82e9b lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x38:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.596267:0:14257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b82e9b lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x38:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.596288:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x38:0x0].0x0 (ffff90cf04f8b500) 00010000:00010000:0.0:1787826421.596291:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787826421.596297:0:14257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b82e9b lrc: 2/0,0 mode: --/EX res: [0x200000405:0x38:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.596304:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b82e9b lrc: 0/0,0 mode: --/EX res: [0x200000405:0x38:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.597545:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b82e94 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.597561:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b82e94 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.597569:0:14257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b82e94 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.597575:0:14257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826421.597579:0:14257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b82e94 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.597587:0:14257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b82e94 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.597603:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826421.597606:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787826421.597611:0:14257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b82e94 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.597618:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b82e94 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.597637:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826421.597640:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787826421.598391:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82e39 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1403 expref: 37 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826421.598601:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eea1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55654:x1874670563948288:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 60473us (65682us total) trans 8589935119 rc 0/0 00000100:00100000:0.0:1787826421.598612:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1206 00000020:00080000:0.0:1787826421.598619:0:14257:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1787826421.604671:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826421.604722:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563949056 00000100:00100000:2.0:1787826421.604734:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563949056 00000100:00100000:2.0:1787826421.605041:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3931 00000100:00100000:2.0:1787826421.605052:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55654:x1874670563949056:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826421.605088:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826421.605116:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82ea2 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1434 expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.605208:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82ea2 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1434 expref: 37 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.605228:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82ea2 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1434 expref: 37 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.605251:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826421.605255:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826421.605260:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834c00, rc 0) 00000100:00100000:2.0:1787826421.605344:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:55654:x1874670563949056:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 294us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826421.605351:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3931 00000100:00100000:3.0:1787826421.624882:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826421.626074:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563949312 00000100:00100000:1.0:1787826421.626094:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563949312 00000100:00100000:1.0:1787826421.626497:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1208 00000100:00100000:1.0:1787826421.626510:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:55654:x1874670563949312:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:1.0:1787826421.627605:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:55654:x1874670563949312:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 1090us (2726us total) trans 8589935120 rc 0/0 00000100:00100000:1.0:1787826421.627618:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1208 00000100:00100000:2.0:1787826421.631978:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826421.632024:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563949568 00000100:00100000:2.0:1787826421.632034:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563949568 00000100:00100000:2.0:1787826421.632094:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1209 00000100:00100000:2.0:1787826421.632107:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f82f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:55654:x1874670563949568:12345-192.168.203.39@tcp:35:lfs.0 00000004:00080000:2.0:1787826421.632639:0:14257:0:(mdd_object.c:4014:mdd_close()) Object [0x200000405:0x38:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:2.0:1787826421.632745:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82ea9 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x38:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.632778:0:14257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82ea9 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.632798:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82ea9 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.632808:0:14257:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82ea9 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.632815:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82ea9 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.632822:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82ea9 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.632846:0:14257:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787826421.632950:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f82f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+39:55654:x1874670563949568:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 844us (985us total) trans 8589935121 rc 0/0 00000100:00100000:2.0:1787826421.632959:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1209 00010000:00010000:2.0:1787826421.632996:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826421.633003:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82ea9 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.633010:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835800 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826421.633015:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82ea9 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.633024:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82ea9 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.633038:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x38:0x0].0x0 (ffff90cf04f8b500) 00010000:00010000:2.0:1787826421.633041:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787826421.633046:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82ea9 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.633053:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82ea9 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.633066:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826421.633067:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826421.633069:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826421.653188:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826421.655505:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563949696 00000100:00100000:3.0:1787826421.655525:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563949696 00000100:00100000:3.0:1787826421.655625:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3932 00000100:00100000:3.0:1787826421.655637:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+39:55656:x1874670563949696:12345-192.168.203.39@tcp:101:getfattr.0 00010000:00010000:3.0:1787826421.655684:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826421.655720:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b82eb0 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab143b expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.655835:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b82eb7 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.655854:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b82eb7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.655870:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b82eb7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.655886:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b82ebe lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.655894:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b82ebe lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.655900:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b82ebe lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.656009:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b82ec5 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.656019:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b82ec5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.656026:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b82ec5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826421.656081:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:3.0:1787826421.656087:0:32404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826421.656113:0:32404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b82ec5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.656127:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b82ec5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.656150:0:32404:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b82eb7 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.656157:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b82eb7 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.656163:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b82eb7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.656175:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b82eb7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.656181:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826421.656186:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b82eb7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.656194:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b82eb7 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.656207:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:3.0:1787826421.656212:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826421.656217:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b82eb7 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.656224:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b82eb7 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.656240:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b82ebe lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.656247:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b82ebe lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.656253:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b82ebe lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.656258:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826421.656261:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b82ebe lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.656270:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b82ebe lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.656278:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf06894c00) 00010000:00010000:3.0:1787826421.656280:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826421.656283:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b82ebe lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.656289:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b82ebe lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.656337:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b82eb0 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab143b expref: 41 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.656356:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b82ec5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab143b expref: 40 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.656364:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826421.656366:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826421.656369:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400c00, rc 0) 00000100:00100000:3.0:1787826421.656461:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55656:x1874670563949696:12345-192.168.203.39@tcp:101:getfattr.0 Request processed in 826us (3289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826421.656496:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3932 00000100:00100000:3.0:1787826421.727639:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826421.727841:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563949824 00000100:00100000:0.0:1787826421.727852:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563949824 00000100:00100000:0.0:1787826421.727918:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3933 00000100:00100000:0.0:1787826421.727929:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecaf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55660:x1874670563949824:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:0.0:1787826421.728001:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b82ecc lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.728018:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b82ecc lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.728029:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b82ecc lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.728043:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b82ed3 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.728051:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b82ed3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.728057:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b82ed3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.728151:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b82eda lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.728161:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b82eda lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.728168:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b82eda lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826421.728208:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:0.0:1787826421.728212:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826421.728224:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b82eda lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.728237:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b82ecc lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.728245:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b82ecc lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.728251:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b82ecc lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.728257:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b82ecc lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.728263:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165ec00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826421.728268:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b82ecc lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.728274:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b82ecc lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.728285:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90ce036cac00) 00010000:00010000:0.0:1787826421.728288:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826421.728292:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b82ecc lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.728298:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b82ecc lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.728313:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b82ed3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.728319:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b82ed3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.728324:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b82ed3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.728328:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165fc00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826421.728330:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b82ed3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.728334:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b82ed3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.728340:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90ce036ca300) 00010000:00010000:0.0:1787826421.728342:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826421.728344:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b82ed3 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.728349:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b82ed3 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.728358:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b82eda lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.728367:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b82eda lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.728373:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b82eda lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.728377:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165fe00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826421.728380:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b82eda lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.728385:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b82eda lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.728391:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826421.728393:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826421.728396:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b82eda lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.728401:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b82eda lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826421.728463:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecaf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55660:x1874670563949824:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 535us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826421.728489:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3933 00000100:00100000:1.0:1787826421.767056:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826421.767092:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563950080 00000100:00100000:1.0:1787826421.767101:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563950080 00000100:00100000:1.0:1787826421.767165:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3934 00000100:00100000:1.0:1787826421.767174:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb96d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55662:x1874670563950080:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826421.767200:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826421.767222:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b82ee1 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1442 expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.767354:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b82ee8 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.767369:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b82ee8 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.767380:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b82ee8 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826421.767391:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:1.0:1787826421.767507:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b82ee1 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1442 expref: 43 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.770870:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b82ee8 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1442 expref: 42 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.770886:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826421.770890:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787826421.770894:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46aa00, rc 0) 00000100:00100000:1.0:1787826421.770964:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb96d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+42:55662:x1874670563950080:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 3789us (3915us total) trans 8589935122 rc 0/0 00000100:00100000:1.0:1787826421.770975:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3934 00000100:00100000:3.0:1787826421.790936:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826421.790992:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563950336 00000100:00100000:3.0:1787826421.791001:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563950336 00000100:00100000:3.0:1787826421.791052:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3935 00000100:00100000:3.0:1787826421.791062:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf39605050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+42:55662:x1874670563950336:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826421.791086:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826421.791111:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b82ef6 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1449 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.793728:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b82efd lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.793753:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b82ec5 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab143b expref: 43 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.793762:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b82efd lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.793799:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b82ec5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab143b expref: 43 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.795251:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b82ec5 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab143b expref: 43 pid: 32404 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826421.795273:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf1ecaf480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1874670585273600:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826421.795531:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf371d1780 going to sleep for 11 seconds 00000100:00100000:3.0:1787826421.801486:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf1ecaf480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1874670585273600:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826421.801516:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b82efd lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826421.803843:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826421.803882:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563950464 00000100:00100000:3.0:1787826421.803891:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563950464 00010000:00010000:3.0:1787826421.803930:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b82ec5 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab143b expref: 44 pid: 32404 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826421.803964:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1247 00000100:00100000:3.0:1787826421.803972:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecaf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:2403:x1874670563950464:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826421.803986:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826421.803992:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b82ec5 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab143b expref: 44 pid: 32404 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.804004:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b82ec5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab143b expref: 44 pid: 32404 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.804027:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b82ec5 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab143b expref: 44 pid: 32404 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.804040:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826421.804045:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b82efd lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.804055:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b82efd lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.804063:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b82efd lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.804086:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826421.804132:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecaf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:2403:x1874670563950464:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 160us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826421.804590:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1247 00010000:00010000:3.0:1787826421.804621:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b82efd lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.804629:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b82efd lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826421.804650:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:3.0:1787826421.804774:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b82ef6 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1449 expref: 44 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.804790:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b82efd lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1449 expref: 43 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.804797:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826421.804799:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787826421.804802:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401000, rc 0) 00000100:00100000:3.0:1787826421.804842:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf39605050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55662:x1874670563950336:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 13780us (13916us total) trans 8589935123 rc 0/0 00000100:00100000:3.0:1787826421.804850:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3935 00000100:00100000:2.0:1787826421.819250:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826421.820297:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563950592 00000100:00100000:0.0:1787826421.820309:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563950592 00000100:00100000:0.0:1787826421.820374:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1210 00000100:00100000:0.0:1787826421.820384:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03890780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55662:x1874670563950592:12345-192.168.203.39@tcp:33:lfs.0 00000100:00100000:0.0:1787826421.820545:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03890780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55662:x1874670563950592:12345-192.168.203.39@tcp:33:lfs.0 Request processed in 161us (1311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826421.820554:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1210 00000100:00100000:0.0:1787826421.827296:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826421.827567:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563950848 00000100:00100000:3.0:1787826421.827576:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563950848 00000100:00100000:3.0:1787826421.827634:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1211 00000100:00100000:3.0:1787826421.827645:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f874f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55662:x1874670563950848:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:3.0:1787826421.827939:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f874f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55662:x1874670563950848:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 294us (647us total) trans 8589935124 rc 0/0 00000100:00100000:3.0:1787826421.827948:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1211 00000100:00100000:0.0:1787826421.832880:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826421.833045:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563951104 00000100:00100000:3.0:1787826421.833054:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563951104 00000100:00100000:3.0:1787826421.833112:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3936 00000100:00100000:3.0:1787826421.833122:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f877840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55662:x1874670563951104:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826421.833167:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826421.833171:0:16564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:3.0:1787826421.833206:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b82efd lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1449 expref: 44 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.833229:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b82ee8 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1442 expref: 43 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.833243:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826421.833248:0:16564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826421.833262:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b82f0b lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1450 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.833372:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b82f12 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.833386:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b82f12 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.833396:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b82f12 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826421.833407:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:3.0:1787826421.833533:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b82f0b lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1450 expref: 45 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.833553:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b82f12 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1450 expref: 44 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.833560:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826421.833563:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787826421.833566:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400c00, rc 0) 00000100:00100000:3.0:1787826421.833625:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f877840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55662:x1874670563951104:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 503us (754us total) trans 8589935125 rc 0/0 00000100:00100000:3.0:1787826421.833633:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3936 00000100:00100000:0.0:1787826421.836414:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826421.838644:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563951360 00000100:00100000:2.0:1787826421.838659:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563951360 00000100:00100000:2.0:1787826421.838805:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1212 00000100:00100000:2.0:1787826421.838816:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eea0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55662:x1874670563951360:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:2.0:1787826421.838881:0:6521:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000405:0x1d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b82f12 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1450 expref: 44 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.838919:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82f20 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.838932:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82ea2 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1434 expref: 44 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.838941:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82f20 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.838970:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82ea2 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1434 expref: 44 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.838985:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82ea2 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1434 expref: 44 pid: 9966 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826421.839005:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03893840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1874670585273728:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826421.839248:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3aaf50c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826421.843649:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826421.843905:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03893840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1874670585273728:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826421.843922:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563951488 00000100:00100000:1.0:1787826421.843930:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563951488 00010000:00010000:2.0:1787826421.843933:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82f20 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.843968:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82ea2 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1434 expref: 45 pid: 9966 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826421.844001:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1248 00000100:00100000:1.0:1787826421.844012:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecacf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+45:2403:x1874670563951488:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826421.844028:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826421.844036:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82ea2 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1434 expref: 45 pid: 9966 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.844048:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82ea2 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1434 expref: 45 pid: 9966 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.844074:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82ea2 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1434 expref: 45 pid: 9966 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.844090:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826421.844094:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82f20 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.844105:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82f20 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.844113:0:10340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82f20 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.844162:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826421.844202:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82f20 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.844212:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82f20 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826421.844220:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecacf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:2403:x1874670563951488:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 209us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826421.844229:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1248 00010000:00010000:2.0:1787826421.844382:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82f20 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.844391:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82f20 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.844398:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82f20 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.844404:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826421.844408:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82f20 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.844416:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82f20 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.844426:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826421.844429:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787826421.844433:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82f20 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.844439:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82f20 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.844448:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826421.844451:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787826421.844456:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b82f12 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1450 expref: 43 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826421.844580:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eea0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55662:x1874670563951360:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 5766us (8172us total) trans 8589935126 rc -22/-22 00000100:00100000:2.0:1787826421.844590:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1212 00000100:00100000:3.0:1787826421.855469:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826421.855597:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563951616 00000100:00100000:1.0:1787826421.855607:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563951616 00000100:00100000:1.0:1787826421.855709:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3937 00000100:00100000:1.0:1787826421.855720:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55662:x1874670563951616:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826421.855744:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826421.855764:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b82f27 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1457 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.855831:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b82f27 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1457 expref: 44 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.855846:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b82f27 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1457 expref: 44 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.855863:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826421.855866:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826421.855870:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46bc00, rc 0) 00000100:00100000:1.0:1787826421.855933:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55662:x1874670563951616:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 215us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826421.855940:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3937 00000100:00100000:0.0:1787826421.864354:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826421.864682:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563951872 00000100:00100000:1.0:1787826421.864692:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563951872 00000100:00100000:1.0:1787826421.864755:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3938 00000100:00100000:1.0:1787826421.864765:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55662:x1874670563951872:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826421.864785:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826421.864808:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b82f2e lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab145e expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.865282:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82f35 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x39:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.865297:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82f35 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.865308:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82f35 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826421.865319:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x39:0x0]: returning size 0 00010000:00010000:1.0:1787826421.865362:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b82f2e lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab145e expref: 47 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.865384:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82f35 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab145e expref: 46 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826421.865393:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x39:0x0].0x0 (ffff90cf04f8b400) 00010000:00010000:1.0:1787826421.865396:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826421.865399:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46a400, rc 0) 00000100:00100000:1.0:1787826421.865466:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+46:55662:x1874670563951872:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 702us (1120us total) trans 8589935127 rc 0/0 00000100:00100000:1.0:1787826421.865531:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3938 00000100:00100000:0.0:1787826421.877530:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826421.877661:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563952128 00000100:00100000:3.0:1787826421.877670:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563952128 00000100:00100000:3.0:1787826421.877728:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3939 00000100:00100000:3.0:1787826421.877739:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f876d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+46:55662:x1874670563952128:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826421.877762:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826421.877782:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b82f43 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1465 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.877883:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b82f4a lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.877898:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b82f4a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.877911:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b82f4a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826421.877926:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:3.0:1787826421.878018:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b82f43 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1465 expref: 49 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.878037:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b82f4a lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1465 expref: 48 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.878046:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826421.878049:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787826421.878053:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401000, rc 0) 00000100:00100000:3.0:1787826421.878114:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f876d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55662:x1874670563952128:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 377us (594us total) trans 8589935128 rc 0/0 00000100:00100000:3.0:1787826421.878122:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3939 00000100:00100000:0.0:1787826421.882074:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826421.882166:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563952384 00000100:00100000:3.0:1787826421.882176:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563952384 00000100:00100000:3.0:1787826421.882233:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1213 00000100:00100000:3.0:1787826421.882242:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f874780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55662:x1874670563952384:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:3.0:1787826421.882311:0:6522:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000405:0x1d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b82f4a lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1465 expref: 48 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.882351:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b82f58 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.882365:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b82f27 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1457 expref: 48 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.882380:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b82f58 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.882411:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b82f27 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1457 expref: 48 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.882424:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b82f27 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1457 expref: 48 pid: 6519 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826421.882440:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf1ecae580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585273856:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826421.883080:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf371d1600 going to sleep for 11 seconds 00000100:00100000:2.0:1787826421.887609:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826421.887699:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563952512 00000100:00100000:0.0:1787826421.887707:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563952512 00010000:00010000:0.0:1787826421.887747:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b82f27 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1457 expref: 49 pid: 6519 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826421.887793:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1249 00000100:00100000:0.0:1787826421.887801:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf181ff450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:2403:x1874670563952512:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826421.887815:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826421.887821:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b82f27 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1457 expref: 49 pid: 6519 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.887833:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b82f27 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1457 expref: 49 pid: 6519 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.887854:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826421.887859:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b82f58 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.887869:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b82f58 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.887881:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b82f58 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.887898:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826421.887952:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf181ff450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:2403:x1874670563952512:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 151us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826421.887960:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1249 00010000:00010000:3.0:1787826421.888522:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b82f27 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1457 expref: 48 pid: 6519 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826421.888539:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf1ecae580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585273856:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826421.888559:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b82f58 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.888567:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b82f58 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.888573:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b82f58 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.888593:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b82f5f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x39:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.888604:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82f35 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab145e expref: 47 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.888611:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b82f5f lrc: 4/0,1 mode: --/EX res: [0x200000405:0x39:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.888636:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82f35 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab145e expref: 47 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.888648:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82f35 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab145e expref: 47 pid: 9966 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826421.888661:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf1ecae580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585273984:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826421.888725:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf371d1600 going to sleep for 11 seconds 00000100:00100000:2.0:1787826421.898046:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826421.898287:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf1ecae580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585273984:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826421.898327:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b82f5f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x39:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826421.898455:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563952640 00000100:00100000:0.0:1787826421.898462:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563952640 00010000:00010000:0.0:1787826421.898533:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82f35 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab145e expref: 48 pid: 9966 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826421.898569:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1250 00000100:00100000:0.0:1787826421.898578:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03890780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:2403:x1874670563952640:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826421.898591:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826421.898598:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82f35 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab145e expref: 48 pid: 9966 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.898610:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82f35 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab145e expref: 48 pid: 9966 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.898633:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b82f35 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab145e expref: 48 pid: 9966 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.898649:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x39:0x0].0x0 (ffff90cf04f8b400) 00010000:00010000:0.0:1787826421.898654:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b82f5f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x39:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.898665:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b82f5f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x39:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.898673:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b82f5f lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x39:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826421.898701:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826421.898743:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03890780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+47:2403:x1874670563952640:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 166us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826421.898751:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1250 00010000:00010000:2.0:1787826421.899081:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b82f5f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x39:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.899089:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b82f5f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x39:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826421.899380:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03893840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1874670585274112:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787826421.899423:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826421.899451:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3aaf5e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787826421.899613:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585274112 00000100:00100000:0.0:1787826421.899619:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585274112 00000100:00100000:0.0:1787826421.899657:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1479 00000100:00100000:0.0:1787826421.899665:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03892940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+12:6522:x1874670585274112:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787826421.899746:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03892940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+12:6522:x1874670585274112:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 82us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826421.899753:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1479 00000100:00100000:2.0:1787826421.899882:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03893840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1874670585274112:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787826421.899923:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589935129 00000001:00080000:2.0:1787826421.899964:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589935130 00010000:00010000:2.0:1787826421.899980:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b82f5f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x39:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.899987:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b82f5f lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x39:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.899994:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b82f5f lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x39:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.900000:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401e00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826421.900004:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b82f5f lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x39:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.900011:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b82f5f lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x39:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.900022:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x39:0x0].0x0 (ffff90cf04f8b400) 00010000:00010000:2.0:1787826421.900025:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787826421.900029:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b82f5f lrc: 2/0,0 mode: --/EX res: [0x200000405:0x39:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.900034:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b82f5f lrc: 0/0,0 mode: --/EX res: [0x200000405:0x39:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.900050:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b82f58 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.900056:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b82f58 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.900061:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b82f58 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.900066:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826421.900069:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b82f58 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.900074:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b82f58 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.900080:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826421.900082:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787826421.900085:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b82f58 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.900090:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b82f58 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.900100:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826421.900102:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787826421.900107:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b82f4a lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1465 expref: 49 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826421.900194:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f874780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55662:x1874670563952384:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 17952us (18128us total) trans 8589935131 rc 0/0 00000100:00100000:2.0:1787826421.900203:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1213 00000020:00080000:2.0:1787826421.900207:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1787826421.921738:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826421.921831:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563952768 00000100:00100000:3.0:1787826421.921840:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563952768 00000100:00100000:3.0:1787826421.921928:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3940 00000100:00100000:3.0:1787826421.921937:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f876940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55662:x1874670563952768:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826421.921958:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826421.921976:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b82f66 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab146c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.922025:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b82f66 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab146c expref: 49 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.922043:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b82f66 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab146c expref: 49 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.922059:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826421.922062:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826421.922065:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400800, rc 0) 00000100:00100000:3.0:1787826421.922118:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f876940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:55662:x1874670563952768:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 182us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826421.922125:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3940 00000100:00100000:0.0:1787826421.937709:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826421.943053:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563953024 00000100:00100000:2.0:1787826421.943067:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563953024 00000100:00100000:3.0:1787826421.952920:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1214 00000100:00100000:3.0:1787826421.952932:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:55662:x1874670563953024:12345-192.168.203.39@tcp:35:lfs.0 00000004:00080000:3.0:1787826421.953212:0:6521:0:(mdd_object.c:4014:mdd_close()) Object [0x200000405:0x39:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787826421.953264:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].30, 64 off10568 00000004:00080000:3.0:1787826421.953275:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1367964802631ns, next at 1368964800284ns, rc = 0 00000001:00080000:3.0:1787826421.953281:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589935132 00010000:00010000:3.0:1787826421.953769:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b82f6d lrc: 3/0,1 mode: --/PW res: [0x200000405:0x39:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.953787:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b82f6d lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.953800:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b82f6d lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.953809:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b82f6d lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.953820:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b82f6d lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.953826:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b82f6d lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826421.953907:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787826421.954014:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+51:55662:x1874670563953024:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 1082us (16313us total) trans 8589935133 rc 0/0 00000100:00100000:3.0:1787826421.954023:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1214 00000020:00080000:3.0:1787826421.954028:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787826421.955695:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826421.955708:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b82f6d lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.955719:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400400 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826421.955724:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b82f6d lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.955734:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b82f6d lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.955814:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x39:0x0].0x0 (ffff90cf06894e00) 00010000:00010000:2.0:1787826421.955818:0:8451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787826421.955823:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b82f6d lrc: 1/0,0 mode: --/PW res: [0x200000405:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.955830:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b82f6d lrc: 0/0,0 mode: --/PW res: [0x200000405:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.955853:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826421.955855:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826421.955857:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826421.962878:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826421.962966:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563953280 00000100:00100000:0.0:1787826421.962975:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563953280 00000100:00100000:0.0:1787826421.963027:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1215 00000100:00100000:0.0:1787826421.963037:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03893840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+51:55662:x1874670563953280:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:0.0:1787826421.963505:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03893840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+52:55662:x1874670563953280:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 468us (636us total) trans 8589935134 rc 0/0 00000100:00100000:0.0:1787826421.963514:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1215 00000100:00100000:1.0:1787826421.983686:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826421.991257:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563953408 00000100:00100000:2.0:1787826421.991272:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563953408 00000100:00100000:2.0:1787826421.991352:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3941 00000100:00100000:2.0:1787826421.991363:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb94b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+52:55664:x1874670563953408:12345-192.168.203.39@tcp:101:getfattr.0 00010000:00010000:2.0:1787826421.991388:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826421.991411:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82f74 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1473 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.991488:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82f7b lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.991501:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82f7b lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.991514:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82f7b lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.991527:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b82f82 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.991534:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b82f82 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.991540:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b82f82 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.991608:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82f89 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.991617:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82f89 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.991624:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82f89 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826421.991663:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:2.0:1787826421.991667:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826421.991685:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82f89 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.991696:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82f89 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.991704:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82f7b lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.991711:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82f7b lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.991721:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82f7b lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.991727:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82f7b lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.991732:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826421.991735:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82f7b lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.991741:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82f7b lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.991753:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf39e67300) 00010000:00010000:2.0:1787826421.991756:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826421.991760:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82f7b lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.991766:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b82f7b lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.991779:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b82f82 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.991784:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b82f82 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.991790:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b82f82 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.991795:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826421.991798:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b82f82 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.991803:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b82f82 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.991809:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf39e67700) 00010000:00010000:2.0:1787826421.991811:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826421.991813:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b82f82 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.991818:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b82f82 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.991846:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b82f74 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1473 expref: 54 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.991860:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82f89 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1473 expref: 53 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826421.991866:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826421.991869:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826421.991871:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834a00, rc 0) 00000100:00100000:2.0:1787826421.992020:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb94b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55664:x1874670563953408:12345-192.168.203.39@tcp:101:getfattr.0 Request processed in 658us (8343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826421.992028:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3941 00000100:00100000:1.0:1787826422.000230:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826422.000321:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563953536 00000100:00100000:2.0:1787826422.000329:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563953536 00000100:00100000:2.0:1787826422.000387:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2199 00000100:00100000:2.0:1787826422.000396:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb952c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2403:x1874670563953536:12345-192.168.203.39@tcp:101:getfattr.0 00010000:00010000:2.0:1787826422.000414:0:30696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826422.000432:0:30696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000159f1fa4/0x22153cd396b82f90 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab147a expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826422.000519:0:30696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03891680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:30696:1874670585274240:192.168.203.39@tcp:106: 00000100:00100000:2.0:1787826422.000596:0:30696:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf117b0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787826422.002796:0:30696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03891680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:30696:1874670585274240:192.168.203.39@tcp:106: 00010000:00010000:2.0:1787826422.002832:0:30696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000159f1fa4/0x22153cd396b82f90 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab147a expref: 17 pid: 30696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.002854:0:30696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000159f1fa4/0x22153cd396b82f90 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab147a expref: 17 pid: 30696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.002867:0:30696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835800, rc 0) 00000100:00100000:2.0:1787826422.002921:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb952c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2403:x1874670563953536:12345-192.168.203.39@tcp:101:getfattr.0 Request processed in 2526us (2699us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826422.002931:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2199 00000100:00100000:1.0:1787826422.048309:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826422.048435:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563953664 00000100:00100000:3.0:1787826422.048443:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563953664 00000100:00100000:3.0:1787826422.048536:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3942 00000100:00100000:3.0:1787826422.048546:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb95680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55668:x1874670563953664:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:3.0:1787826422.048613:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b82f97 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.048629:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b82f97 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.048640:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b82f97 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.048652:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b82f9e lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.048659:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b82f9e lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.048669:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b82f9e lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.048738:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b82fa5 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.048759:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b82fa5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.048766:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b82fa5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826422.048803:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:3.0:1787826422.048808:0:32404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826422.048819:0:32404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b82fa5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.048832:0:32404:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b82f97 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.048839:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b82f97 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.048846:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b82f97 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.048854:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b82f97 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.048860:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826422.048864:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b82f97 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.048873:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b82f97 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.048886:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf06894c00) 00010000:00010000:3.0:1787826422.048889:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826422.048893:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b82f97 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.048900:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b82f97 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.048920:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b82f9e lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.048927:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b82f9e lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.048934:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b82f9e lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.048939:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826422.048942:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b82f9e lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.048949:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b82f9e lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.048956:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf06894300) 00010000:00010000:3.0:1787826422.048959:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826422.048962:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b82f9e lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.048987:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b82f9e lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.048999:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b82fa5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.049005:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b82fa5 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.049012:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b82fa5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.049017:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826422.049021:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b82fa5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.049027:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b82fa5 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.049034:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826422.049037:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826422.049040:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b82fa5 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.049047:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b82fa5 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826422.049112:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb95680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55668:x1874670563953664:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 566us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826422.049121:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3942 00000100:00100000:1.0:1787826422.065860:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826422.068454:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563953920 00000100:00100000:0.0:1787826422.068467:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563953920 00000100:00100000:1.0:1787826422.081118:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3943 00000100:00100000:1.0:1787826422.081133:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb96580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55670:x1874670563953920:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826422.081164:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826422.081186:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b82fac lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1481 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.081298:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b82fb3 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.081312:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b82fb3 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.081324:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b82fb3 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826422.081335:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:1.0:1787826422.081431:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b82fac lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1481 expref: 56 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.081448:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b82fb3 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1481 expref: 55 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.081456:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826422.081459:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787826422.081462:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46b000, rc 0) 00000100:00100000:1.0:1787826422.081565:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb96580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+55:55670:x1874670563953920:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 434us (15715us total) trans 8589935135 rc 0/0 00000100:00100000:1.0:1787826422.081573:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3943 00010000:00010000:0.0:1787826422.084863:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826422.093412:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826422.093512:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563954048 00000100:00100000:0.0:1787826422.093522:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563954048 00000100:00100000:0.0:1787826422.093584:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2200 00000100:00100000:0.0:1787826422.093595:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03891680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2401:x1874670563954048:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826422.093612:0:14864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826422.093630:0:14864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b49a3b43/0x22153cd396b82fc1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1488 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826422.093687:0:14864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f877480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14864:1874670585274368:192.168.203.39@tcp:106: 00000100:00100000:0.0:1787826422.093933:0:14864:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf078fea80 going to sleep for 11 seconds 00000100:00100000:2.0:1787826422.103994:0:14864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f877480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14864:1874670585274368:192.168.203.39@tcp:106: 00010000:00010000:2.0:1787826422.104036:0:14864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b49a3b43/0x22153cd396b82fc1 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1488 expref: 17 pid: 14864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.104064:0:14864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b49a3b43/0x22153cd396b82fc1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1488 expref: 17 pid: 14864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.104085:0:14864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165fa00, rc 0) 00000100:00100000:2.0:1787826422.104159:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03891680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2401:x1874670563954048:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 10566us (10757us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826422.104167:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2200 00000100:00100000:1.0:1787826422.110073:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826422.110423:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563954304 00000100:00100000:3.0:1787826422.110437:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563954304 00000100:00100000:3.0:1787826422.110729:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3944 00000100:00100000:3.0:1787826422.110743:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+55:55670:x1874670563954304:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826422.110795:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826422.110821:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b82fc8 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab148f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.110955:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b82fcf lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.110972:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82f89 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1473 expref: 56 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.110982:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b82fcf lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.111022:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82f89 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1473 expref: 56 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.111036:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82f89 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1473 expref: 56 pid: 6519 timeout: 1468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826422.111052:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf1ecae580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1874670585274496:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826422.111159:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf371d1600 going to sleep for 11 seconds 00000100:00100000:3.0:1787826422.115825:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826422.115929:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563954432 00000100:00100000:1.0:1787826422.115941:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563954432 00010000:00010000:1.0:1787826422.115993:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82f89 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1473 expref: 57 pid: 6519 timeout: 1468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826422.116044:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1251 00000100:00100000:1.0:1787826422.116053:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecac780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+57:2404:x1874670563954432:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826422.116071:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826422.116079:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82f89 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1473 expref: 57 pid: 6519 timeout: 1468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.116094:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82f89 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1473 expref: 57 pid: 6519 timeout: 1468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.116125:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826422.116132:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b82fcf lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.116151:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b82fcf lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.116161:0:10340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b82fcf lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.116185:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826422.116252:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecac780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+57:2404:x1874670563954432:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 199us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826422.116261:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1251 00010000:00010000:0.0:1787826422.116891:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b82f89 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1473 expref: 56 pid: 6519 timeout: 1468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826422.116914:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf1ecae580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1874670585274496:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826422.116939:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b82fcf lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.116949:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b82fcf lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.116956:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b82fcf lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826422.116982:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:0.0:1787826422.117146:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b82fc8 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab148f expref: 57 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.117169:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b82fcf lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab148f expref: 56 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.117178:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826422.117181:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787826422.117184:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400600, rc 0) 00000100:00100000:0.0:1787826422.117293:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+56:55670:x1874670563954304:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 6553us (7235us total) trans 8589935136 rc 0/0 00000100:00100000:0.0:1787826422.117302:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3944 00000100:00100000:3.0:1787826422.125034:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826422.126079:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563954688 00000100:00100000:1.0:1787826422.126094:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563954688 00000100:00100000:1.0:1787826422.126195:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3945 00000100:00100000:1.0:1787826422.126206:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+56:55670:x1874670563954688:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826422.126237:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826422.126266:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b82fdd lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1496 expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.126987:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b82fe4 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.127007:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b82fe4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.127020:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b82fe4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826422.127032:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x3a:0x0]: returning size 0 00010000:00010000:1.0:1787826422.127080:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b82fdd lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1496 expref: 59 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.127117:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b82fe4 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1496 expref: 58 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.127127:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3a:0x0].0x0 (ffff90cf04f8bd00) 00010000:00010000:1.0:1787826422.127130:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826422.127144:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46b200, rc 0) 00000100:00100000:1.0:1787826422.127233:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:55670:x1874670563954688:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1028us (2210us total) trans 8589935137 rc 0/0 00000100:00100000:1.0:1787826422.127241:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3945 00000100:00100000:0.0:1787826422.132550:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826422.132687:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563954944 00000100:00100000:3.0:1787826422.132702:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563954944 00000100:00100000:3.0:1787826422.132785:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3946 00000100:00100000:3.0:1787826422.132798:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f877c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:55670:x1874670563954944:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826422.132834:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826422.132862:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b82ff2 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab149d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.133026:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b82ff9 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.133045:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b82fe4 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1496 expref: 59 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.133056:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b82ff9 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x3a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.133104:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b82fe4 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1496 expref: 59 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.133120:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b82fe4 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1496 expref: 59 pid: 9966 timeout: 1468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826422.133149:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf1ecaf0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1874670585274624:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826422.133367:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf371d1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826422.137238:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826422.137379:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf1ecaf0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1874670585274624:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826422.137416:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b82ff9 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x3a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826422.137576:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563955072 00000100:00100000:1.0:1787826422.137586:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563955072 00010000:00010000:1.0:1787826422.137636:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b82fe4 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1496 expref: 60 pid: 9966 timeout: 1468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826422.137685:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1252 00000100:00100000:1.0:1787826422.137699:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8761c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:2402:x1874670563955072:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826422.137723:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826422.137732:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b82fe4 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1496 expref: 60 pid: 9966 timeout: 1468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.137746:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b82fe4 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1496 expref: 60 pid: 9966 timeout: 1468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.137792:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b82fe4 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1496 expref: 60 pid: 9966 timeout: 1468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.137814:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3a:0x0].0x0 (ffff90cf04f8bd00) 00010000:00010000:1.0:1787826422.137820:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b82ff9 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x3a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.137831:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b82ff9 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.137840:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b82ff9 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x3a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.137873:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826422.137955:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8761c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:2402:x1874670563955072:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 259us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826422.137965:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1252 00010000:00010000:3.0:1787826422.138033:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b82ff9 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.138042:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b82ff9 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826422.138067:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x3a:0x0]: returning size 0 00000004:00080000:3.0:1787826422.138294:0:6518:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x10c:0x0], index 0: 0 00010000:00010000:3.0:1787826422.138437:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b82ff9 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.138446:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b82ff9 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x3a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.138453:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b82ff9 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x3a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.138460:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826422.138465:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b82ff9 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x3a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.138544:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b82ff9 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x3a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.138556:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3a:0x0].0x0 (ffff90cf04f8bd00) 00010000:00010000:3.0:1787826422.138559:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826422.138563:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b82ff9 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x3a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.138570:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b82ff9 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x3a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.138631:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b82ff2 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x3a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab149d expref: 59 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.138644:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3a:0x0].0x0 (ffff90cf04f8bd00) 00010000:00010000:3.0:1787826422.138646:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787826422.138650:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b82ff2 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x3a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab149d expref: 59 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.138667:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401600, rc 0) 00000100:00100000:3.0:1787826422.138707:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f877c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:55670:x1874670563954944:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 5913us (6174us total) trans 8589935138 rc 301/301 00000100:00100000:3.0:1787826422.138717:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3946 00000100:00100000:2.0:1787826422.142814:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826422.152193:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563955328 00000100:00100000:3.0:1787826422.152220:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563955328 00000100:00100000:2.0:1787826422.152513:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1216 00000100:00100000:2.0:1787826422.152758:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03892d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:55670:x1874670563955328:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:2.0:1787826422.153208:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03892d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55670:x1874670563955328:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 455us (10408us total) trans 8589935139 rc 0/0 00000100:00100000:2.0:1787826422.153218:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1216 00000100:00100000:2.0:1787826422.162087:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826422.163195:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563955456 00000100:00100000:3.0:1787826422.163215:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563955456 00000100:00100000:3.0:1787826422.163333:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3947 00000100:00100000:3.0:1787826422.163346:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03893480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55670:x1874670563955456:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826422.163380:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826422.163411:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b83007 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab14a4 expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.163576:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b8300e lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.163595:0:8247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b82fcf lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab148f expref: 60 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.163611:0:8247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b8300e lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.163660:0:8247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b82fcf lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab148f expref: 60 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.163676:0:8247:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b82fcf lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab148f expref: 60 pid: 6520 timeout: 1468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826422.163697:0:8247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf1ecaf0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8247:1874670585274752:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826422.163826:0:8247:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf371d1780 going to sleep for 11 seconds 00000100:00100000:3.0:1787826422.168956:0:8247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf1ecaf0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8247:1874670585274752:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826422.168997:0:8247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b8300e lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826422.170022:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826422.171027:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563955584 00000100:00100000:3.0:1787826422.171041:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563955584 00010000:00010000:3.0:1787826422.171101:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b82fcf lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab148f expref: 61 pid: 6520 timeout: 1468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826422.171225:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1253 00000100:00100000:3.0:1787826422.171239:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03891a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+61:2403:x1874670563955584:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826422.171259:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826422.171267:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b82fcf lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab148f expref: 61 pid: 6520 timeout: 1468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.171288:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b82fcf lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab148f expref: 61 pid: 6520 timeout: 1468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.171332:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b82fcf lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab148f expref: 61 pid: 6520 timeout: 1468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.171354:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826422.171360:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b8300e lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.171372:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b8300e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.171381:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b8300e lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.171419:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826422.171561:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03891a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:2403:x1874670563955584:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 325us (1545us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826422.171569:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1253 00010000:00010000:2.0:1787826422.172387:0:8247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b8300e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.172403:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b8300e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826422.172508:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:2.0:1787826422.172514:0:8247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826422.172540:0:8247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b8300e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.172587:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b83007 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14a4 expref: 60 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.172614:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b8300e lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14a4 expref: 59 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.172624:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826422.172627:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826422.172631:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401800, rc 0) 00000100:00100000:2.0:1787826422.172688:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03893480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55670:x1874670563955456:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 9344us (10617us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826422.172697:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3947 00000100:00100000:2.0:1787826422.181987:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826422.182083:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563955712 00000100:00100000:0.0:1787826422.182098:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563955712 00000100:00100000:0.0:1787826422.182228:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2201 00000100:00100000:0.0:1787826422.182243:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2404:x1874670563955712:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826422.182268:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826422.182294:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d39501d2/0x22153cd396b83015 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab14ab expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826422.182391:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f877480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1874670585274880:192.168.203.39@tcp:106: 00000100:00100000:0.0:1787826422.182571:0:8437:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf078fea80 going to sleep for 11 seconds 00000100:00100000:2.0:1787826422.188826:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f877480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1874670585274880:192.168.203.39@tcp:106: 00010000:00010000:2.0:1787826422.188879:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d39501d2/0x22153cd396b83015 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14ab expref: 17 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.188908:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d39501d2/0x22153cd396b83015 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14ab expref: 17 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.188923:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165e600, rc 0) 00000100:00100000:2.0:1787826422.189221:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2404:x1874670563955712:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 6979us (7250us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826422.189232:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2201 00000100:00100000:1.0:1787826422.196628:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826422.196730:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563955840 00000100:00100000:0.0:1787826422.196743:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563955840 00000100:00100000:0.0:1787826422.196815:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3948 00000100:00100000:0.0:1787826422.196827:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb95a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55670:x1874670563955840:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826422.196853:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826422.196882:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b8301c lrc: 2/0,0 mode: --/CR res: [0x200000405:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab14b2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.196975:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b83023 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.197004:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b83023 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x3a:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.197020:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b83023 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x3a:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826422.197400:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x3a:0x0]: returning size 0 00000004:00200000:0.0:1787826422.197406:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826422.197433:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b83023 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x3a:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.197469:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b8301c lrc: 0/0,0 mode: --/CR res: [0x200000405:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14b2 expref: 61 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.197652:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b83023 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x3a:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14b2 expref: 60 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.197663:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3a:0x0].0x0 (ffff90ce036ca300) 00010000:00010000:0.0:1787826422.197665:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787826422.197670:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165e400, rc 0) 00000100:00100000:0.0:1787826422.197766:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb95a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:55670:x1874670563955840:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 941us (1152us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826422.197775:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3948 00000100:00100000:0.0:1787826422.200299:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826422.200589:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563955968 00000100:00100000:1.0:1787826422.200604:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563955968 00000100:00100000:1.0:1787826422.200684:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2202 00000100:00100000:1.0:1787826422.200696:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f874f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2403:x1874670563955968:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826422.200719:0:30398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826422.200749:0:30398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8fb1ffc/0x22153cd396b8302a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x10c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab14b9 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826422.200784:0:30398:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826422.200808:0:30398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10c:0x0].0x0 since=1368s v=(0 0) 00010000:00010000:1.0:1787826422.200813:0:30398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826422.200825:0:30398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8fb1ffc/0x22153cd396b8302a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14b9 expref: 14 pid: 30398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.200846:0:30398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a8fb1ffc/0x22153cd396b8302a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14b9 expref: 14 pid: 30398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.200863:0:30398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46ac00, rc 0) 00000100:00100000:1.0:1787826422.200942:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f874f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2403:x1874670563955968:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 248us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826422.200954:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2202 00000100:00100000:2.0:1787826422.209396:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826422.209751:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563956224 00000100:00100000:3.0:1787826422.209765:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563956224 00000100:00100000:3.0:1787826422.209846:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3949 00000100:00100000:3.0:1787826422.209859:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:55670:x1874670563956224:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826422.209890:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826422.209919:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b83031 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab14c0 expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.210232:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b83038 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.210253:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b83038 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.210267:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b83038 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826422.210284:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:0.0:1787826422.214020:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b83031 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14c0 expref: 63 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.214059:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b83038 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14c0 expref: 62 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.214071:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826422.214075:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787826422.214079:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400400, rc 0) 00000100:00100000:0.0:1787826422.214272:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+62:55670:x1874670563956224:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 4413us (4890us total) trans 8589935140 rc 0/0 00000100:00100000:0.0:1787826422.214282:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3949 00000100:00100000:0.0:1787826422.220465:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826422.220589:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563956352 00000100:00100000:3.0:1787826422.220603:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563956352 00000100:00100000:3.0:1787826422.220723:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2203 00000100:00100000:3.0:1787826422.220736:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f877480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2404:x1874670563956352:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826422.220761:0:28853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826422.220784:0:28853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008343e43a/0x22153cd396b83046 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab14c7 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826422.220865:0:28853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf1ecaf0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28853:1874670585275008:192.168.203.39@tcp:106: 00000100:00100000:3.0:1787826422.220976:0:28853:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf371d1780 going to sleep for 11 seconds 00000100:00100000:3.0:1787826422.227292:0:28853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf1ecaf0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28853:1874670585275008:192.168.203.39@tcp:106: 00010000:00010000:3.0:1787826422.227347:0:28853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008343e43a/0x22153cd396b83046 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14c7 expref: 17 pid: 28853 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.227380:0:28853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008343e43a/0x22153cd396b83046 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14c7 expref: 17 pid: 28853 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.227404:0:28853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401000, rc 0) 00000100:00100000:3.0:1787826422.227553:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f877480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2404:x1874670563956352:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 6818us (7101us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826422.227565:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2203 00000100:00100000:2.0:1787826422.232744:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826422.232838:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563956480 00000100:00100000:3.0:1787826422.232851:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563956480 00000100:00100000:3.0:1787826422.232925:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2204 00000100:00100000:3.0:1787826422.232938:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2403:x1874670563956480:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826422.232963:0:30694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826422.232986:0:30694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008343e43a/0x22153cd396b8304d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab14ce expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826422.233090:0:30694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf1ecaf0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:30694:1874670585275136:192.168.203.39@tcp:106: 00000100:00100000:3.0:1787826422.233217:0:30694:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf371d1780 going to sleep for 11 seconds 00000100:00100000:3.0:1787826422.238261:0:30694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf1ecaf0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:30694:1874670585275136:192.168.203.39@tcp:106: 00010000:00010000:3.0:1787826422.238332:0:30694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008343e43a/0x22153cd396b8304d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14ce expref: 17 pid: 30694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.238361:0:30694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008343e43a/0x22153cd396b8304d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14ce expref: 17 pid: 30694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.238376:0:30694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401000, rc 0) 00000100:00100000:3.0:1787826422.238456:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2403:x1874670563956480:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 5520us (5727us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826422.238468:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2204 00000100:00100000:0.0:1787826422.251948:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826422.252278:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563956608 00000100:00100000:3.0:1787826422.252291:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563956608 00000100:00100000:3.0:1787826422.252590:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2205 00000100:00100000:3.0:1787826422.252604:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03985a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2404:x1874670563956608:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:3.0:1787826422.252667:0:30695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008343e43a/0x22153cd396b83054 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.252693:0:30695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000482bb568/0x22153cd396b82e7f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1426 expref: 16 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.252704:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x10c:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787826422.252710:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826422.252716:0:30695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008343e43a/0x22153cd396b83054 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.252767:0:30695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000482bb568/0x22153cd396b82e7f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1426 expref: 16 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.252794:0:30695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000482bb568/0x22153cd396b82e7f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1426 expref: 16 pid: 30695 timeout: 1468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826422.252813:0:30695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf1ecaf0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:30695:1874670585275264:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826422.252942:0:30695:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf371d1780 going to sleep for 11 seconds 00000100:00100000:3.0:1787826422.256822:0:30695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf1ecaf0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:30695:1874670585275264:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826422.256868:0:30695:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008343e43a/0x22153cd396b83054 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826422.258942:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826422.259954:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563956736 00000100:00100000:2.0:1787826422.259973:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563956736 00010000:00010000:2.0:1787826422.260156:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000482bb568/0x22153cd396b82e7f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1426 expref: 17 pid: 30695 timeout: 1468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826422.260276:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1254 00000100:00100000:2.0:1787826422.260288:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03986d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+17:2404:x1874670563956736:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826422.260323:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826422.260358:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000482bb568/0x22153cd396b82e7f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x10c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1426 expref: 17 pid: 30695 timeout: 1468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.260374:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000482bb568/0x22153cd396b82e7f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1426 expref: 17 pid: 30695 timeout: 1468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.260410:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000482bb568/0x22153cd396b82e7f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1426 expref: 17 pid: 30695 timeout: 1468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.260435:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826422.260441:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826422.260448:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008343e43a/0x22153cd396b83054 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.260459:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008343e43a/0x22153cd396b83054 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.260602:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826422.260689:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03986d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2404:x1874670563956736:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 402us (1760us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826422.260700:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1254 00010000:00010000:0.0:1787826422.260983:0:30695:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008343e43a/0x22153cd396b83054 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x10c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.260995:0:30695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008343e43a/0x22153cd396b83054 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x10c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.261031:0:30695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008343e43a/0x22153cd396b83054 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x10c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.261040:0:30695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008343e43a/0x22153cd396b83054 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x10c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.261061:0:30695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008343e43a/0x22153cd396b83054 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.261068:0:30695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401000 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826422.261073:0:30695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008343e43a/0x22153cd396b83054 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.261082:0:30695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008343e43a/0x22153cd396b83054 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x10c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.261097:0:30695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008343e43a/0x22153cd396b83054 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x10c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.261105:0:30695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008343e43a/0x22153cd396b83054 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x10c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826422.261179:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03985a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2404:x1874670563956608:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 8578us (9246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826422.261188:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2205 00000100:00100000:0.0:1787826422.265655:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826422.266216:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563956864 00000100:00100000:3.0:1787826422.266230:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563956864 00000100:00100000:3.0:1787826422.266327:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2206 00000100:00100000:3.0:1787826422.266340:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03984780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2402:x1874670563956864:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826422.266365:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826422.266394:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d747c98/0x22153cd396b8305b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x10c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab14d5 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826422.266429:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10c:0x0] initial LVB size: 0, mtime: 0x6a9010ec, atime: 0x6a9010ec, ctime: 0x6a9010f5, blocks: 0x0 00010000:00010000:3.0:1787826422.266455:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10c:0x0].0x0 since=1368s v=(0 0) 00010000:00010000:3.0:1787826422.266462:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826422.266505:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d747c98/0x22153cd396b8305b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14d5 expref: 16 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.266528:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004d747c98/0x22153cd396b8305b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14d5 expref: 16 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.266545:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401200, rc 0) 00000100:00100000:3.0:1787826422.266623:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03984780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2402:x1874670563956864:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 286us (986us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826422.266633:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2206 00000100:00100000:0.0:1787826422.325888:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826422.325999:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563956992 00000100:00100000:3.0:1787826422.326013:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563956992 00000100:00100000:3.0:1787826422.326099:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3950 00000100:00100000:3.0:1787826422.326112:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03986940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+62:55670:x1874670563956992:12345-192.168.203.39@tcp:44:lfs.0 00000001:00080000:3.0:1787826422.328930:0:34481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935140 is committed 00000004:00080000:3.0:1787826422.328975:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 31 committed 00000020:00080000:3.0:1787826422.329026:0:34481:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90ce057f6cc0 refcount 2 committed 0 result 0 batchid 4294969342 00000020:00080000:3.0:1787826422.329033:0:34481:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cf39612e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90ce057f69c0 00000020:00080000:3.0:1787826422.329037:0:34481:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cf39612200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90cf26c05800 00000020:00080000:3.0:1787826422.329066:0:34481:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969341 batchid updated 00000100:00100000:3.0:1787826422.329282:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03986940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:55670:x1874670563956992:12345-192.168.203.39@tcp:44:lfs.0 Request processed in 3165us (3403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826422.329294:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3950 00000100:00100000:3.0:1787826422.329616:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3fb96940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585275392:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787826422.329695:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826422.329876:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585275392 00000100:00100000:1.0:1787826422.329886:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585275392 00000100:00100000:1.0:1787826422.329946:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2207 00000100:00100000:1.0:1787826422.329957:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecaf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3645:x1874670585275392:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787826422.329990:0:30398:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:267 count 1 00010000:00010000:1.0:1787826422.330024:0:30398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a5fe178/0x22153cd396b83062 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.330047:0:30398:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003a816990/0x22153cd396b82e8d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab142d expref: 13 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.330057:0:30398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x10b:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787826422.330062:0:30398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10b:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826422.330068:0:30398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a5fe178/0x22153cd396b83062 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.330100:0:30398:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003a816990/0x22153cd396b82e8d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab142d expref: 13 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.330118:0:30398:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003a816990/0x22153cd396b82e8d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab142d expref: 13 pid: 8435 timeout: 1468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826422.330132:0:30398:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3fb94f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:30398:1874670585275520:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826422.330202:0:30398:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce01ef9d80 going to sleep for 11 seconds 00000020:00080000:2.0:1787826422.330272:0:34512:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969342 committed batchid 4294969341 00000020:00080000:2.0:1787826422.330363:0:34512:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969341 00000100:00100000:1.0:1787826422.333632:0:30398:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3fb94f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:30398:1874670585275520:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826422.333634:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b82e71 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.333654:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b82e71 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.333664:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b82e71 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.333673:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46b400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826422.333679:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b82e71 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.333682:0:30398:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001a5fe178/0x22153cd396b83062 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.333691:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b82e71 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.333957:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x38:0x0].0x0 (ffff90cf04f8b500) 00010000:00010000:0.0:1787826422.333963:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826422.333970:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b82e71 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.333977:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b82e71 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.334019:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82e86 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.334026:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82e86 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.334032:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82e86 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.334037:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826422.334040:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82e86 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.334052:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82e86 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.334061:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826422.334064:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826422.334067:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82e86 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.334072:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b82e86 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826422.335128:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826422.335177:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826422.335916:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563957120 00000100:00100000:3.0:1787826422.335930:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563957120 00010000:00010000:3.0:1787826422.335986:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003a816990/0x22153cd396b82e8d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab142d expref: 14 pid: 8435 timeout: 1468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826422.336046:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1255 00000100:00100000:3.0:1787826422.336058:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03987c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563957120:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826422.336076:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826422.336084:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003a816990/0x22153cd396b82e8d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x10b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab142d expref: 14 pid: 8435 timeout: 1468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.336099:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003a816990/0x22153cd396b82e8d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab142d expref: 14 pid: 8435 timeout: 1468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.336152:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a816990/0x22153cd396b82e8d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab142d expref: 14 pid: 8435 timeout: 1468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.336173:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10b:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826422.336178:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10b:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826422.336186:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001a5fe178/0x22153cd396b83062 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.336198:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a5fe178/0x22153cd396b83062 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x10b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.336234:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826422.336307:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03987c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2404:x1874670563957120:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 250us (1189us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826422.336315:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1255 00010000:00010000:3.0:1787826422.336352:0:30398:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001a5fe178/0x22153cd396b83062 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.336362:0:30398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a5fe178/0x22153cd396b83062 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.336374:0:30398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a5fe178/0x22153cd396b83062 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.337028:0:30398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a5fe178/0x22153cd396b83062 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.337063:0:30398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787826422.337294:0:7460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826422.337306:0:7460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a5fe178/0x22153cd396b83062 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826422.337318:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecaf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3645:x1874670585275392:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7359us (7619us total) trans 21474837019 rc 0/0 00010000:00010000:2.0:1787826422.337321:0:7460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46a600 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826422.337329:0:7460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a5fe178/0x22153cd396b83062 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826422.337333:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2207 00010000:00010000:2.0:1787826422.337346:0:7460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a5fe178/0x22153cd396b83062 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.337386:0:7460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a5fe178/0x22153cd396b83062 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.337396:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a5fe178/0x22153cd396b83062 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.337427:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826422.337429:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826422.337431:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787826422.337516:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3fb96940/2, rc 0, transno 21474837019 00000100:00100000:2.0:1787826422.337525:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3fb96940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585275392:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787826422.341123:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563957248 00000100:00100000:1.0:1787826422.341156:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563957248 00000100:00100000:1.0:1787826422.341257:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2208 00000100:00100000:1.0:1787826422.341270:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03984f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2403:x1874670563957248:12345-192.168.203.39@tcp:16:lfs.0 00000100:00100000:1.0:1787826422.342150:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03984f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2403:x1874670563957248:12345-192.168.203.39@tcp:16:lfs.0 Request processed in 867us (6956us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826422.342163:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2208 00000100:00100000:2.0:1787826422.358922:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826422.359163:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563957376 00000100:00100000:1.0:1787826422.359178:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563957376 00000100:00100000:1.0:1787826422.359251:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2209 00000100:00100000:1.0:1787826422.359263:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2404:x1874670563957376:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:1.0:1787826422.359864:0:30696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000816b8b1f/0x22153cd396b83069 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.359889:0:30696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826422.359895:0:30696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826422.359902:0:30696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000816b8b1f/0x22153cd396b83069 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.359919:0:30696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000816b8b1f/0x22153cd396b83069 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.359960:0:30696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000816b8b1f/0x22153cd396b83069 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.359970:0:30696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000816b8b1f/0x22153cd396b83069 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.359980:0:30696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000816b8b1f/0x22153cd396b83069 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.359988:0:30696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46ae00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:1.0:1787826422.359993:0:30696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000816b8b1f/0x22153cd396b83069 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.360004:0:30696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000816b8b1f/0x22153cd396b83069 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.360025:0:30696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000816b8b1f/0x22153cd396b83069 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.360035:0:30696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000816b8b1f/0x22153cd396b83069 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826422.360167:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2404:x1874670563957376:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 903us (1257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826422.360180:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2209 00000100:00100000:3.0:1787826422.365850:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826422.368028:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563957632 00000100:00100000:2.0:1787826422.368051:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563957632 00000100:00100000:2.0:1787826422.371714:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3951 00000100:00100000:2.0:1787826422.371753:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:55670:x1874670563957632:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:2.0:1787826422.371837:0:8247:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826422.371881:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b83023 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x3a:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14b2 expref: 33 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.371905:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3a:0x0].0x0 (ffff90ce036ca300) 00010000:00010000:2.0:1787826422.371917:0:8247:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826422.371963:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b83070 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.371981:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b83070 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.372007:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b83070 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826422.372206:0:8247:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000244d8c59 reply state 000000009979b702 transno 8589935141 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b83070 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.372220:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b83070 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.372226:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3a:0x0].0x0 (ffff90cf39e67300) 00010000:00010000:2.0:1787826422.372229:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826422.372232:0:8247:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826422.372415:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:55670:x1874670563957632:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 680us (6579us total) trans 8589935141 rc 0/0 00000100:00100000:2.0:1787826422.372428:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3951 00000100:00100000:0.0:1787826422.378260:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826422.379895:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563957760 00000100:00100000:3.0:1787826422.379911:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563957760 00000100:00100000:3.0:1787826422.379998:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3952 00000100:00100000:3.0:1787826422.380275:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03985680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:55670:x1874670563957760:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826422.380461:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826422.380642:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b83077 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab14dc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.380933:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b83077 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x3a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14dc expref: 35 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.380953:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b83077 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x3a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14dc expref: 35 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.380976:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3a:0x0].0x0 (ffff90cf39e67300) 00010000:00010000:3.0:1787826422.380980:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826422.380985:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401400, rc 0) 00000100:00100000:3.0:1787826422.381161:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03985680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:55670:x1874670563957760:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1152us (2914us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826422.381170:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3952 00000100:00100000:0.0:1787826422.387247:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826422.387603:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563957888 00000100:00100000:2.0:1787826422.387617:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563957888 00000100:00100000:2.0:1787826422.387704:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2210 00000100:00100000:2.0:1787826422.387717:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce039861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:55670:x1874670563957888:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826422.387743:0:14864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826422.387766:0:14864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b8307e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab14e3 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.387812:0:14864:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a8fb1ffc/0x22153cd396b8302a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14b9 expref: 14 pid: 30398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.387824:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826422.387829:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826422.387835:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b8307e lrc: 4/0,0 mode: --/PW res: [0x280000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14e3 expref: 14 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.387881:0:14864:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a8fb1ffc/0x22153cd396b8302a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14b9 expref: 14 pid: 30398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.387898:0:14864:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a8fb1ffc/0x22153cd396b8302a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14b9 expref: 14 pid: 30398 timeout: 1468 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826422.387917:0:14864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fde1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14864:1874670585275648:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826422.388033:0:14864:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf1850cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787826422.396034:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826422.396226:0:14864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fde1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14864:1874670585275648:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826422.396273:0:14864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b8307e lrc: 3/0,0 mode: --/PW res: [0x280000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14e3 expref: 14 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.396322:0:14864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834a00, rc 0) 00000100:00100000:0.0:1787826422.396418:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce039861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:55670:x1874670563957888:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 8702us (9186us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826422.396429:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2210 00000100:00100000:3.0:1787826422.398944:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563958016 00000100:00100000:3.0:1787826422.398963:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563958016 00010000:00010000:0.0:1787826422.399185:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a8fb1ffc/0x22153cd396b8302a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14b9 expref: 14 pid: 30398 timeout: 1468 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826422.399303:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1256 00000100:00100000:0.0:1787826422.399332:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf181fec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563958016:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826422.399364:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826422.399395:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a8fb1ffc/0x22153cd396b8302a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x10c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14b9 expref: 14 pid: 30398 timeout: 1468 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.399412:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a8fb1ffc/0x22153cd396b8302a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14b9 expref: 14 pid: 30398 timeout: 1468 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.399444:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8fb1ffc/0x22153cd396b8302a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x10c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14b9 expref: 14 pid: 30398 timeout: 1468 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.399467:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826422.399513:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826422.399522:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b8307e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14e3 expref: 13 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.399535:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b8307e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14e3 expref: 13 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.399587:0:6504:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b8307e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14e3 expref: 13 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826422.399618:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce039852c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6504:1874670585275776:192.168.203.39@tcp:105: 00000100:00100000:0.0:1787826422.399787:0:6504:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf078fea80 going to sleep for 11 seconds 00000100:00100000:0.0:1787826422.404282:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826422.404384:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563958144 00000100:00100000:3.0:1787826422.404397:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563958144 00000100:00100000:3.0:1787826422.404467:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2211 00000100:00100000:3.0:1787826422.404501:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01dfda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2403:x1874670563958144:12345-192.168.203.39@tcp:2:lfs.0 00002000:00010000:3.0:1787826422.404734:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x10c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787826422.404738:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x10c:0x0] updating lvb mtime from disk: 0 -> 1787826412 00002000:00010000:3.0:1787826422.404741:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x10c:0x0] updating lvb atime from disk: 0 -> 1787826412 00002000:00010000:3.0:1787826422.404743:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x10c:0x0] updating lvb ctime from disk: 0 -> 1787826422 00002000:00010000:3.0:1787826422.404746:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x10c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1787826422.404822:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01dfda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2403:x1874670563958144:12345-192.168.203.39@tcp:2:lfs.0 Request processed in 323us (554us total) trans 21474837020 rc 0/0 00000100:00100000:3.0:1787826422.404832:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2211 00000100:00100000:1.0:1787826422.405176:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce039852c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6504:1874670585275776:192.168.203.39@tcp:105: 00010000:00010000:1.0:1787826422.405207:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826422.405253:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf181fec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563958016:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5924us (9234us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826422.405263:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1256 00000100:00100000:3.0:1787826422.411084:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826422.415779:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563958400 00000100:00100000:0.0:1787826422.415804:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563958400 00000100:00100000:1.0:1787826422.416038:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3953 00000100:00100000:1.0:1787826422.416054:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:55670:x1874670563958400:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:1.0:1787826422.416163:0:32404:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826422.416205:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b8300e lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14a4 expref: 35 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.416234:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826422.416240:0:32404:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826422.416328:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b83085 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.416347:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b83085 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.416369:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b83085 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826422.416593:0:32404:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a0a25069 reply state 00000000de6451d4 transno 8589935142 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b83085 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.416856:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b83085 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.416865:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826422.416868:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826422.416871:0:32404:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826422.417059:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55670:x1874670563958400:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 1007us (5989us total) trans 8589935142 rc 0/0 00000100:00100000:1.0:1787826422.417070:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3953 00000100:00100000:2.0:1787826422.429065:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826422.434244:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563958528 00000100:00100000:3.0:1787826422.434268:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563958528 00000100:00100000:2.0:1787826422.434637:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2212 00000100:00100000:2.0:1787826422.434651:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fde580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:55670:x1874670563958528:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826422.434675:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826422.434700:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e0a1cce/0x22153cd396b8308c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab14ea expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.434743:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004d747c98/0x22153cd396b8305b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14d5 expref: 17 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.434755:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826422.434760:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826422.434766:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e0a1cce/0x22153cd396b8308c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14ea expref: 17 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.434814:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004d747c98/0x22153cd396b8305b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14d5 expref: 17 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.434830:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004d747c98/0x22153cd396b8305b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14d5 expref: 17 pid: 8436 timeout: 1468 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826422.434848:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fdda40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1874670585275904:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826422.434972:0:8435:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf1850cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787826422.448671:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fdda40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1874670585275904:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826422.448696:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00010000:00010000:0.0:1787826422.448724:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001e0a1cce/0x22153cd396b8308c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14ea expref: 17 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.448752:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835000, rc 0) 00000100:00100000:0.0:1787826422.448843:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fde580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+17:55670:x1874670563958528:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 14194us (19792us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826422.448855:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2212 00000100:00100000:3.0:1787826422.448964:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563958656 00000100:00100000:3.0:1787826422.448972:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563958656 00010000:00010000:3.0:1787826422.449022:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004d747c98/0x22153cd396b8305b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14d5 expref: 17 pid: 8436 timeout: 1468 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826422.449064:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1257 00000100:00100000:3.0:1787826422.449074:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+17:2404:x1874670563958656:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826422.449092:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826422.449120:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004d747c98/0x22153cd396b8305b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x10c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14d5 expref: 17 pid: 8436 timeout: 1468 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.449154:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004d747c98/0x22153cd396b8305b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14d5 expref: 17 pid: 8436 timeout: 1468 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.449185:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d747c98/0x22153cd396b8305b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x10c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14d5 expref: 17 pid: 8436 timeout: 1468 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.449204:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826422.449210:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826422.449218:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001e0a1cce/0x22153cd396b8308c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14ea expref: 16 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.449230:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e0a1cce/0x22153cd396b8308c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14ea expref: 16 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.449277:0:6505:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001e0a1cce/0x22153cd396b8308c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14ea expref: 16 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826422.449296:0:6505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf1ecae580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1874670585276032:192.168.203.39@tcp:105: 00000100:00100000:3.0:1787826422.449468:0:6505:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf371d19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826422.455181:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826422.455670:0:6505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf1ecae580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1874670585276032:192.168.203.39@tcp:105: 00010000:00010000:0.0:1787826422.455702:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826422.455720:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563958784 00000100:00100000:1.0:1787826422.455730:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563958784 00000100:00100000:0.0:1787826422.455780:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+17:2404:x1874670563958656:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6705us (7085us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826422.455793:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1257 00000100:00100000:1.0:1787826422.455805:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2213 00000100:00100000:1.0:1787826422.455818:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+16:2403:x1874670563958784:12345-192.168.203.39@tcp:2:lfs.0 00002000:00010000:1.0:1787826422.456034:0:28853:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x10c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787826422.456039:0:28853:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x10c:0x0] updating lvb mtime from disk: 1787826412 -> 1787826412 00002000:00010000:1.0:1787826422.456042:0:28853:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x10c:0x0] updating lvb atime from disk: 1787826412 -> 1787826412 00002000:00010000:1.0:1787826422.456044:0:28853:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x10c:0x0] updating lvb ctime from disk: 1787826421 -> 1787826423 00002000:00010000:1.0:1787826422.456046:0:28853:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x10c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1787826422.456077:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+17:2403:x1874670563958784:12345-192.168.203.39@tcp:2:lfs.0 Request processed in 261us (910us total) trans 17179869679 rc 0/0 00000100:00100000:1.0:1787826422.456085:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2213 00000001:00080000:0.0:1787826422.462892:0:27651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179869679 is committed 00000001:00080000:0.0:1787826422.462914:0:27651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179869678 is committed 00000100:00100000:1.0:1787826422.470882:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826422.471051:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563959040 00000100:00100000:2.0:1787826422.471066:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563959040 00000100:00100000:2.0:1787826422.471194:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1217 00000100:00100000:2.0:1787826422.471207:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eea1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55670:x1874670563959040:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:2.0:1787826422.471313:0:14257:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000405:0x1d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b83038 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14c0 expref: 36 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.471375:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b83093 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.471391:0:14257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b82f66 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab146c expref: 36 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.471400:0:14257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b82fb3 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1481 expref: 36 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.471410:0:14257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b83093 lrc: 5/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.471454:0:14257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b82fb3 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1481 expref: 36 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.471468:0:14257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b82fb3 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1481 expref: 36 pid: 16564 timeout: 1468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826422.471518:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fdc3c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585276160:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826422.471656:0:14257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b82f66 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab146c expref: 36 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.471673:0:14257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b82f66 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab146c expref: 36 pid: 6520 timeout: 1468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826422.471684:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fdc780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585276288:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826422.471712:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf1850c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826422.478437:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826422.478538:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fdc3c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585276160:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826422.478549:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826422.478562:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fdc780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585276288:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826422.478611:0:14257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b83093 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826422.478748:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563959424 00000100:00100000:1.0:1787826422.478766:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563959424 00010000:00010000:1.0:1787826422.478817:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b82f66 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab146c expref: 37 pid: 6520 timeout: 1468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826422.478857:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563959296 00000100:00100000:3.0:1787826422.478863:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563959296 00000100:00100000:1.0:1787826422.478878:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1258 00000100:00100000:1.0:1787826422.478892:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:2404:x1874670563959424:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826422.478913:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787826422.478915:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1218 00000100:00100000:3.0:1787826422.478928:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:42220:x1874670563959296:12345-192.168.203.39@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787826422.479209:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+39:42220:x1874670563959296:12345-192.168.203.39@tcp:35:ldlm_bl.0 Request processed in 283us (788us total) trans 8589935143 rc 0/0 00000100:00100000:3.0:1787826422.479219:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1218 00010000:00010000:1.0:1787826422.479576:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b82f66 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab146c expref: 38 pid: 6520 timeout: 1468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.479592:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b82f66 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab146c expref: 38 pid: 6520 timeout: 1468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.479620:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b82f66 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab146c expref: 38 pid: 6520 timeout: 1468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.479638:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826422.479644:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b83093 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.479655:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b83093 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.479663:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826422.479696:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:2404:x1874670563959424:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 808us (1151us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826422.479704:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1258 00000100:00100000:2.0:1787826422.482440:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826422.483710:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563959552 00000100:00100000:1.0:1787826422.483728:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563959552 00010000:00010000:1.0:1787826422.483789:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b82fb3 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1481 expref: 37 pid: 16564 timeout: 1468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826422.483853:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1259 00000100:00100000:1.0:1787826422.483864:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:2404:x1874670563959552:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826422.483886:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826422.483895:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b82fb3 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1481 expref: 37 pid: 16564 timeout: 1468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.483911:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b82fb3 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1481 expref: 37 pid: 16564 timeout: 1468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.483950:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b82fb3 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1481 expref: 37 pid: 16564 timeout: 1468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.483976:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826422.483983:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b83093 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.483994:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b83093 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.484004:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b83093 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.484048:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826422.484129:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:2404:x1874670563959552:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 266us (1703us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826422.484146:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1259 00010000:00010000:2.0:1787826422.484557:0:14257:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b83093 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.484567:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b83093 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.484597:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8309a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.484739:0:14257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b83077 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x3a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14dc expref: 35 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.484750:0:14257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8309a lrc: 4/0,1 mode: --/EX res: [0x200000405:0x3a:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.484801:0:14257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b83077 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x3a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14dc expref: 35 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.484819:0:14257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b83077 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x3a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14dc expref: 35 pid: 6520 timeout: 1468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826422.484842:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fdc3c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585276416:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826422.484921:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf1850c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826422.490861:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fdc3c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585276416:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826422.490904:0:14257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8309a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x3a:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826422.492650:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826422.493536:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563959680 00000100:00100000:3.0:1787826422.493553:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563959680 00010000:00010000:3.0:1787826422.493624:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b83077 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x3a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14dc expref: 36 pid: 6520 timeout: 1468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826422.493681:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1260 00000100:00100000:3.0:1787826422.493692:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:2403:x1874670563959680:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826422.493714:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826422.493724:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b83077 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x3a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14dc expref: 36 pid: 6520 timeout: 1468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.493741:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b83077 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x3a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14dc expref: 36 pid: 6520 timeout: 1468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.493779:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b83077 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x3a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14dc expref: 36 pid: 6520 timeout: 1468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.493799:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3a:0x0].0x0 (ffff90cf39e67300) 00010000:00010000:3.0:1787826422.493806:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8309a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x3a:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.493817:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8309a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3a:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.493827:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8309a lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x3a:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.493874:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826422.493958:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:2403:x1874670563959680:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 267us (1324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826422.493966:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1260 00010000:00010000:0.0:1787826422.494104:0:14257:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8309a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.494115:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8309a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826422.494667:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01dff480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585276544:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1787826422.494748:0:14257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826422.494990:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf078fea80 going to sleep for 11 seconds 00000100:00100000:1.0:1787826422.498454:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585276544 00000100:00100000:1.0:1787826422.498697:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585276544 00000100:00100000:1.0:1787826422.498817:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1480 00000100:00100000:1.0:1787826422.498841:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01dfc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:14257:x1874670585276544:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1787826422.499192:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01dfc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:14257:x1874670585276544:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 362us (4442us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826422.499201:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1480 00000100:00100000:2.0:1787826422.499288:0:14257:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869678 gen 2 00000004:00080000:2.0:1787826422.499296:0:14257:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869666 committed transno 17179869678 00000004:00080000:2.0:1787826422.499978:0:14257:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3f934780, transno 17179869668 00000004:00080000:2.0:1787826422.500042:0:14257:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869670 committed transno 17179869678 00000004:00080000:2.0:1787826422.500072:0:14257:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3f934b40, transno 17179869672 00000004:00080000:2.0:1787826422.501856:0:14257:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869674 committed transno 17179869678 00000004:00080000:2.0:1787826422.501903:0:14257:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce01dfed00, transno 17179869676 00000004:00080000:2.0:1787826422.501911:0:14257:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869678 committed transno 17179869678 00000100:00100000:2.0:1787826422.501937:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01dff480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585276544:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1787826422.509844:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fde1c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585276672:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1787826422.509952:0:14257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826422.510047:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf1850c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826422.511295:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585276672 00000100:00100000:3.0:1787826422.511579:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585276672 00000100:00100000:3.0:1787826422.511750:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1481 00000100:00100000:3.0:1787826422.511763:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+12:14257:x1874670585276672:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1787826422.512009:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+12:14257:x1874670585276672:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 248us (2057us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826422.512020:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1481 00000100:00100000:2.0:1787826422.512110:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fde1c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585276672:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:2.0:1787826422.513177:0:14257:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589935144 00000100:00100000:2.0:1787826422.513321:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fde1c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585276800:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1787826422.513410:0:14257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826422.513444:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3ab4c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826422.513592:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585276800 00000100:00100000:1.0:1787826422.513610:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585276800 00000100:00100000:1.0:1787826422.513666:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1482 00000100:00100000:1.0:1787826422.513678:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+12:14257:x1874670585276800:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1787826422.513861:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+13:14257:x1874670585276800:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 184us (450us total) trans 21474837021 rc 0/0 00000100:00100000:1.0:1787826422.513870:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1482 00000100:00100000:2.0:1787826422.514184:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fde1c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585276800:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:2.0:1787826422.514265:0:14257:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589935145 00010000:00010000:2.0:1787826422.514297:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8309a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.514313:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8309a lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x3a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.514322:0:14257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8309a lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x3a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.514328:0:14257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826422.514333:0:14257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8309a lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x3a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.514340:0:14257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8309a lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x3a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.514427:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3a:0x0].0x0 (ffff90cf39e67300) 00010000:00010000:2.0:1787826422.514430:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787826422.514436:0:14257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8309a lrc: 2/0,0 mode: --/EX res: [0x200000405:0x3a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.514443:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b8309a lrc: 0/0,0 mode: --/EX res: [0x200000405:0x3a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.514462:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b83093 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.514468:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b83093 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.514744:0:14257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b83093 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.514750:0:14257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826422.514754:0:14257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b83093 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.514760:0:14257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b83093 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.514769:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826422.514772:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787826422.514776:0:14257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b83093 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.514782:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b83093 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.514797:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826422.514800:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787826422.514808:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b83038 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14c0 expref: 37 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826422.514966:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eea1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55670:x1874670563959040:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 43761us (44098us total) trans 8589935146 rc 0/0 00000100:00100000:2.0:1787826422.514977:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1217 00000020:00080000:2.0:1787826422.514982:0:14257:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1787826422.519229:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826422.519805:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563959808 00000100:00100000:3.0:1787826422.519820:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563959808 00000100:00100000:3.0:1787826422.519952:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3954 00000100:00100000:3.0:1787826422.519964:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55670:x1874670563959808:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826422.520001:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826422.520031:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b830a1 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab14f1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.520112:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b830a1 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14f1 expref: 37 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.520142:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b830a1 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14f1 expref: 37 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.520167:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826422.520171:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826422.520176:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401400, rc 0) 00000100:00100000:3.0:1787826422.520261:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:55670:x1874670563959808:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 299us (1054us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826422.520270:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3954 00000100:00100000:0.0:1787826422.525211:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826422.525788:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563960064 00000100:00100000:3.0:1787826422.525803:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563960064 00000100:00100000:3.0:1787826422.525887:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1219 00000100:00100000:3.0:1787826422.525900:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01dfcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:55670:x1874670563960064:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:3.0:1787826422.526244:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01dfcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:55670:x1874670563960064:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 346us (1051us total) trans 8589935147 rc 0/0 00000100:00100000:3.0:1787826422.526253:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1219 00000100:00100000:2.0:1787826422.534948:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826422.537865:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563960320 00000100:00100000:0.0:1787826422.537886:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563960320 00000100:00100000:0.0:1787826422.538034:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1220 00000100:00100000:0.0:1787826422.538048:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:55670:x1874670563960320:12345-192.168.203.39@tcp:35:lfs.0 00000004:00080000:0.0:1787826422.538336:0:14257:0:(mdd_object.c:4014:mdd_close()) Object [0x200000405:0x3a:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:0.0:1787826422.538455:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b830a8 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.538512:0:14257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b830a8 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.538527:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b830a8 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.538537:0:14257:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b830a8 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.538544:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b830a8 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.538552:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b830a8 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.538574:0:14257:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787826422.538723:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+39:55670:x1874670563960320:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 676us (3787us total) trans 8589935148 rc 0/0 00000100:00100000:0.0:1787826422.538731:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1220 00010000:00010000:2.0:1787826422.540099:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826422.540115:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b830a8 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.540125:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165e200 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826422.540130:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b830a8 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.540150:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b830a8 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.540173:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3a:0x0].0x0 (ffff90cf39e67300) 00010000:00010000:2.0:1787826422.540176:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787826422.540180:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b830a8 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.540186:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b830a8 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.540207:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826422.540209:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826422.540210:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826422.592932:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826422.593313:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563960448 00000100:00100000:2.0:1787826422.593327:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563960448 00000100:00100000:2.0:1787826422.593463:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3955 00000100:00100000:2.0:1787826422.593494:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01dfe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+39:55672:x1874670563960448:12345-192.168.203.39@tcp:101:getfattr.0 00010000:00010000:2.0:1787826422.593527:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826422.593558:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b830af lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab14f8 expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.593659:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b830b6 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.593676:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b830b6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.593691:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b830b6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.593706:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b830bd lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.593712:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b830bd lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.593718:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b830bd lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.593809:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b830c4 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.593819:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b830c4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.593826:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b830c4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826422.593874:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:2.0:1787826422.593879:0:8247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826422.593903:0:8247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b830c4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.593917:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b830c4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.593927:0:8247:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b830b6 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.593933:0:8247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b830b6 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.593945:0:8247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b830b6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.593952:0:8247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b830b6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.593959:0:8247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826422.593965:0:8247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b830b6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.593974:0:8247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b830b6 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.593988:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf39e67700) 00010000:00010000:2.0:1787826422.593991:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826422.593997:0:8247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b830b6 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.594004:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b830b6 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.594022:0:8247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b830bd lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.594028:0:8247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b830bd lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.594034:0:8247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b830bd lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.594039:0:8247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826422.594043:0:8247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b830bd lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.594049:0:8247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b830bd lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.594057:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf39e67400) 00010000:00010000:2.0:1787826422.594059:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826422.594062:0:8247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b830bd lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.594068:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b830bd lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.594104:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b830af lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14f8 expref: 41 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.594121:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b830c4 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14f8 expref: 40 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.594128:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826422.594145:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826422.594149:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835c00, rc 0) 00000100:00100000:2.0:1787826422.594255:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01dfe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55672:x1874670563960448:12345-192.168.203.39@tcp:101:getfattr.0 Request processed in 782us (1799us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826422.594263:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3955 00000100:00100000:1.0:1787826422.642466:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826422.643183:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563960576 00000100:00100000:3.0:1787826422.643199:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563960576 00000100:00100000:3.0:1787826422.643287:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3956 00000100:00100000:3.0:1787826422.643299:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb94f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55676:x1874670563960576:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:3.0:1787826422.643415:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b830cb lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.643437:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b830cb lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.643451:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b830cb lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.643465:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b830d2 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.643502:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b830d2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.643511:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b830d2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.643608:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b830d9 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.643619:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b830d9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.643628:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b830d9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826422.643680:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:3.0:1787826422.643685:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826422.643701:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b830d9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.643719:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b830cb lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.643726:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b830cb lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.643733:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b830cb lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.643741:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b830cb lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.643748:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826422.643753:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b830cb lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.644017:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b830cb lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.644035:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf2f6bd800) 00010000:00010000:3.0:1787826422.644038:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826422.644043:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b830cb lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.644050:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b830cb lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.644076:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b830d2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.644083:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b830d2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.644089:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b830d2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.644094:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826422.644097:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b830d2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.644103:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b830d2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.644110:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf2f6bdc00) 00010000:00010000:3.0:1787826422.644113:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826422.644116:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b830d2 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.644127:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b830d2 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.644148:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b830d9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.644154:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b830d9 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.644160:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b830d9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.644164:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401e00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826422.644167:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b830d9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.644173:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b830d9 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.644180:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826422.644182:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826422.644185:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b830d9 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.644190:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b830d9 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826422.644447:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb94f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55676:x1874670563960576:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 1145us (1992us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826422.644457:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3956 00000100:00100000:1.0:1787826422.668283:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826422.668639:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563960832 00000100:00100000:2.0:1787826422.668654:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563960832 00000100:00100000:2.0:1787826422.668736:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3957 00000100:00100000:2.0:1787826422.668747:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55678:x1874670563960832:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826422.668787:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826422.668815:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b830e0 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab14ff expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.669128:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b830e7 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.669156:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b830e7 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.669171:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b830e7 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826422.669183:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:2.0:1787826422.669595:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b830e0 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14ff expref: 43 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.669621:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b830e7 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14ff expref: 42 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.669631:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826422.669635:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787826422.669639:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835a00, rc 0) 00000100:00100000:2.0:1787826422.669866:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+42:55678:x1874670563960832:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1118us (1597us total) trans 8589935149 rc 0/0 00000100:00100000:2.0:1787826422.669953:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3957 00000100:00100000:2.0:1787826422.679573:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826422.680014:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563961088 00000100:00100000:3.0:1787826422.680027:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563961088 00000100:00100000:3.0:1787826422.680103:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3958 00000100:00100000:3.0:1787826422.680125:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+42:55678:x1874670563961088:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826422.680167:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826422.680360:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b830f5 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1506 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.680530:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b830fc lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.680550:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b830c4 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14f8 expref: 43 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.680846:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b830fc lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.680894:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b830c4 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14f8 expref: 43 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.680922:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b830c4 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14f8 expref: 43 pid: 8247 timeout: 1468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826422.680941:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf1ecaf480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1874670585276928:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826422.681042:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf371d1780 going to sleep for 11 seconds 00000100:00100000:1.0:1787826422.687759:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826422.687994:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf1ecaf480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1874670585276928:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826422.688027:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b830fc lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826422.688359:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563961216 00000100:00100000:0.0:1787826422.688369:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563961216 00010000:00010000:0.0:1787826422.688418:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b830c4 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14f8 expref: 44 pid: 8247 timeout: 1468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826422.688463:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1261 00000100:00100000:0.0:1787826422.688525:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb961c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:2403:x1874670563961216:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826422.688545:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826422.688554:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b830c4 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14f8 expref: 44 pid: 8247 timeout: 1468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.688568:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b830c4 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14f8 expref: 44 pid: 8247 timeout: 1468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.688692:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b830c4 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14f8 expref: 44 pid: 8247 timeout: 1468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.688712:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826422.688719:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b830fc lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.688730:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b830fc lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.688853:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b830fc lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.688885:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826422.688958:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb961c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:2403:x1874670563961216:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 484us (1221us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826422.688967:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1261 00010000:00010000:3.0:1787826422.689562:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b830fc lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.689575:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b830fc lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826422.689613:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:3.0:1787826422.689903:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b830f5 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1506 expref: 44 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.689923:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b830fc lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1506 expref: 43 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.689931:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826422.689934:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787826422.689937:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400c00, rc 0) 00000100:00100000:3.0:1787826422.689990:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55678:x1874670563961088:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 9878us (10432us total) trans 8589935150 rc 0/0 00000100:00100000:3.0:1787826422.689998:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3958 00000100:00100000:1.0:1787826422.693386:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826422.693525:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563961344 00000100:00100000:2.0:1787826422.693538:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563961344 00000100:00100000:2.0:1787826422.693619:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1221 00000100:00100000:2.0:1787826422.693631:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55678:x1874670563961344:12345-192.168.203.39@tcp:33:lfs.0 00000100:00100000:2.0:1787826422.693838:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55678:x1874670563961344:12345-192.168.203.39@tcp:33:lfs.0 Request processed in 209us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826422.693848:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1221 00000100:00100000:0.0:1787826422.696421:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826422.696567:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563961600 00000100:00100000:2.0:1787826422.696587:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563961600 00000100:00100000:2.0:1787826422.696655:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1222 00000100:00100000:2.0:1787826422.696667:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01dfe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55678:x1874670563961600:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:2.0:1787826422.696918:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01dfe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55678:x1874670563961600:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 252us (509us total) trans 8589935151 rc 0/0 00000100:00100000:2.0:1787826422.696925:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1222 00000100:00100000:1.0:1787826422.702591:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826422.702727:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563961856 00000100:00100000:2.0:1787826422.702740:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563961856 00000100:00100000:2.0:1787826422.702831:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3959 00000100:00100000:2.0:1787826422.702843:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb97c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55678:x1874670563961856:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826422.703059:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826422.703064:0:8247:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:2.0:1787826422.703107:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b830fc lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1506 expref: 44 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.703145:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b830e7 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14ff expref: 43 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.703158:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826422.703165:0:8247:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826422.703183:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8310a lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab150d expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.703928:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83111 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.703948:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83111 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.703961:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83111 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826422.703979:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:2.0:1787826422.704129:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8310a lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab150d expref: 45 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.704161:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83111 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab150d expref: 44 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.704171:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826422.704175:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787826422.704177:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835800, rc 0) 00000100:00100000:2.0:1787826422.704267:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb97c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55678:x1874670563961856:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1426us (1691us total) trans 8589935152 rc 0/0 00000100:00100000:2.0:1787826422.704277:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3959 00000100:00100000:1.0:1787826422.720286:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826422.725601:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563962112 00000100:00100000:2.0:1787826422.725623:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563962112 00000100:00100000:2.0:1787826422.725725:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1223 00000100:00100000:2.0:1787826422.725740:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eea1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55678:x1874670563962112:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:2.0:1787826422.725842:0:6522:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000405:0x1d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83111 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab150d expref: 44 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.727704:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b8311f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.727737:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b830a1 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14f1 expref: 44 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.727747:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b8311f lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.727808:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b830a1 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14f1 expref: 44 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.727828:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b830a1 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14f1 expref: 44 pid: 6518 timeout: 1468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826422.727847:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf1ecaf480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585277056:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826422.728640:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf371d1600 going to sleep for 11 seconds 00000100:00100000:3.0:1787826422.736653:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf1ecaf480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585277056:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826422.736695:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b8311f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826422.739461:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826422.740401:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563962240 00000100:00100000:0.0:1787826422.740418:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563962240 00010000:00010000:0.0:1787826422.740521:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b830a1 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14f1 expref: 45 pid: 6518 timeout: 1468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826422.740579:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1262 00000100:00100000:0.0:1787826422.740589:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb970c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+45:2403:x1874670563962240:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826422.740609:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826422.740618:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b830a1 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14f1 expref: 45 pid: 6518 timeout: 1468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.740810:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b830a1 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14f1 expref: 45 pid: 6518 timeout: 1468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.740850:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b830a1 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14f1 expref: 45 pid: 6518 timeout: 1468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.740876:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826422.740883:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b8311f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.740893:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b8311f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.740902:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b8311f lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.740941:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826422.741106:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb970c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:2403:x1874670563962240:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 517us (1659us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826422.741116:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1262 00010000:00010000:3.0:1787826422.744011:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b8311f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.744034:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b8311f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.744318:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b8311f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.744329:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b8311f lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.744337:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b8311f lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.744345:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401e00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826422.744352:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b8311f lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.744360:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b8311f lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.744383:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826422.744387:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787826422.744393:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b8311f lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.744400:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b8311f lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.744416:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826422.744418:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787826422.744430:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83111 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab150d expref: 43 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826422.744672:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eea1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55678:x1874670563962112:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 18933us (24400us total) trans 8589935153 rc -22/-22 00000100:00100000:3.0:1787826422.744686:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1223 00000100:00100000:0.0:1787826422.750241:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826422.750377:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563962368 00000100:00100000:1.0:1787826422.750391:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563962368 00000100:00100000:1.0:1787826422.750512:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3960 00000100:00100000:1.0:1787826422.750525:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01dfd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55678:x1874670563962368:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826422.750557:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826422.750587:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b83126 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1514 expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.750662:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b83126 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1514 expref: 44 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.750681:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b83126 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1514 expref: 44 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.750704:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826422.750708:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826422.750713:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46a400, rc 0) 00000100:00100000:1.0:1787826422.750791:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01dfd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55678:x1874670563962368:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 268us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826422.750800:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3960 00000100:00100000:2.0:1787826422.755028:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826422.755234:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563962624 00000100:00100000:1.0:1787826422.755246:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563962624 00000100:00100000:1.0:1787826422.755529:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3961 00000100:00100000:1.0:1787826422.755542:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55678:x1874670563962624:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826422.755572:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826422.755603:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b8312d lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab151b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.756225:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b83134 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.756246:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b83134 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.756259:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b83134 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826422.756274:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x3b:0x0]: returning size 0 00010000:00010000:1.0:1787826422.756419:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b8312d lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab151b expref: 47 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.756449:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b83134 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab151b expref: 46 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.756460:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3b:0x0].0x0 (ffff90cf3ab61b00) 00010000:00010000:1.0:1787826422.756464:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826422.756468:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46a600, rc 0) 00000100:00100000:1.0:1787826422.756676:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+46:55678:x1874670563962624:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1135us (1664us total) trans 8589935154 rc 0/0 00000100:00100000:1.0:1787826422.756685:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3961 00000100:00100000:2.0:1787826422.769837:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826422.773798:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563962880 00000100:00100000:3.0:1787826422.773822:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563962880 00000100:00100000:3.0:1787826422.773910:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3962 00000100:00100000:3.0:1787826422.773922:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+46:55678:x1874670563962880:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826422.773953:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826422.773981:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b83142 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1522 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.774127:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b83149 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.774157:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b83149 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.774171:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b83149 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826422.774186:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:3.0:1787826422.774547:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b83142 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1522 expref: 49 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.774571:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b83149 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1522 expref: 48 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.774582:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826422.774585:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787826422.774589:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401200, rc 0) 00000100:00100000:3.0:1787826422.774689:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55678:x1874670563962880:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 768us (4866us total) trans 8589935155 rc 0/0 00000100:00100000:3.0:1787826422.774699:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3962 00000100:00100000:2.0:1787826422.777345:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826422.777496:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563963136 00000100:00100000:3.0:1787826422.777508:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563963136 00000100:00100000:3.0:1787826422.777579:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1224 00000100:00100000:3.0:1787826422.777591:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55678:x1874670563963136:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:3.0:1787826422.777692:0:6521:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000405:0x1d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b83149 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1522 expref: 48 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.777743:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b83157 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.777771:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b83126 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1514 expref: 48 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.777781:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b83157 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.777825:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b83126 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1514 expref: 48 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.777841:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b83126 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1514 expref: 48 pid: 32404 timeout: 1468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826422.777858:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf1ecaf480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1874670585277184:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826422.777966:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf371d1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787826422.780723:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826422.780777:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563963264 00000100:00100000:3.0:1787826422.780789:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563963264 00010000:00010000:3.0:1787826422.780842:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b83126 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1514 expref: 49 pid: 32404 timeout: 1468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826422.780885:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1263 00000100:00100000:3.0:1787826422.780895:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf181ff050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:2403:x1874670563963264:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826422.780915:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826422.780924:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b83126 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1514 expref: 49 pid: 32404 timeout: 1468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.780939:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b83126 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1514 expref: 49 pid: 32404 timeout: 1468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.780971:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826422.780978:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b83157 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.780990:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b83157 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.780998:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b83157 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.781023:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826422.781081:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf181ff050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:2403:x1874670563963264:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 187us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826422.781090:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1263 00010000:00010000:0.0:1787826422.781540:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b83126 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1514 expref: 48 pid: 32404 timeout: 1468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826422.781563:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf1ecaf480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1874670585277184:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826422.781588:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b83157 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.781599:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b83157 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.781606:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b83157 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.781635:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b8315e lrc: 3/0,1 mode: --/EX res: [0x200000405:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.781648:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b83134 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab151b expref: 47 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.781657:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b8315e lrc: 4/0,1 mode: --/EX res: [0x200000405:0x3b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.781695:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b83134 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab151b expref: 47 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.781709:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b83134 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab151b expref: 47 pid: 6519 timeout: 1468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826422.781725:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01dfd2c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1874670585277312:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826422.781810:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f67e300 going to sleep for 11 seconds 00000100:00100000:0.0:1787826422.788653:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01dfd2c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1874670585277312:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826422.788693:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b8315e lrc: 3/0,1 mode: --/EX res: [0x200000405:0x3b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826422.788772:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826422.788902:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563963392 00000100:00100000:0.0:1787826422.788911:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563963392 00010000:00010000:0.0:1787826422.788953:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b83134 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab151b expref: 48 pid: 6519 timeout: 1468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826422.788999:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1264 00000100:00100000:0.0:1787826422.789011:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecacf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:2404:x1874670563963392:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826422.789031:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826422.789040:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b83134 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab151b expref: 48 pid: 6519 timeout: 1468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.789052:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b83134 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab151b expref: 48 pid: 6519 timeout: 1468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.789080:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b83134 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab151b expref: 48 pid: 6519 timeout: 1468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.789099:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3b:0x0].0x0 (ffff90cf3ab61b00) 00010000:00010000:0.0:1787826422.789106:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b8315e lrc: 3/0,1 mode: --/EX res: [0x200000405:0x3b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.789117:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b8315e lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.789126:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b8315e lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x3b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.789172:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826422.790259:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b8315e lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.790276:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b8315e lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826422.790713:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3fb95e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6521:1874670585277440:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787826422.790792:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826422.790851:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585277440 00000100:00100000:1.0:1787826422.790857:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585277440 00000100:00100000:1.0:1787826422.790917:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1483 00000100:00100000:1.0:1787826422.790927:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb96d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+13:6521:x1874670585277440:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787826422.791024:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb96d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+13:6521:x1874670585277440:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 98us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826422.791034:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1483 00000100:00100000:1.0:1787826422.791065:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf11b3e840 going to sleep for 11 seconds 00000100:00100000:1.0:1787826422.791092:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3fb95e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6521:1874670585277440:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787826422.791156:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589935156 00000001:00080000:1.0:1787826422.791207:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589935157 00010000:00010000:1.0:1787826422.791226:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b8315e lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.791235:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b8315e lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x3b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.791244:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b8315e lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x3b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.791251:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165fa00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826422.791256:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b8315e lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x3b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.791265:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b8315e lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x3b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.791281:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3b:0x0].0x0 (ffff90cf3ab61b00) 00010000:00010000:1.0:1787826422.791284:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787826422.791289:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b8315e lrc: 2/0,0 mode: --/EX res: [0x200000405:0x3b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.791295:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b8315e lrc: 0/0,0 mode: --/EX res: [0x200000405:0x3b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.791315:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b83157 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.791323:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b83157 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.791334:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b83157 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.791339:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826422.791342:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b83157 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.791349:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b83157 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.791357:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826422.791360:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787826422.791363:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b83157 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.791369:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b83157 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.791381:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826422.791384:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787826422.791391:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b83149 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1522 expref: 50 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826422.794050:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecacf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:2404:x1874670563963392:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5022us (5261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826422.794071:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1264 00000100:00100000:1.0:1787826422.796462:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55678:x1874670563963136:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 18853us (19112us total) trans 8589935158 rc 0/0 00000100:00100000:1.0:1787826422.796500:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1224 00000020:00080000:1.0:1787826422.796510:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1787826422.803109:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826422.803224:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563963520 00000100:00100000:2.0:1787826422.803239:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563963520 00000100:00100000:2.0:1787826422.803326:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3963 00000100:00100000:2.0:1787826422.803337:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55678:x1874670563963520:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826422.803369:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826422.803401:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b83165 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1529 expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.803746:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b83165 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1529 expref: 49 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.803766:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b83165 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1529 expref: 49 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.803791:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826422.803795:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826422.803799:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834600, rc 0) 00000100:00100000:2.0:1787826422.803911:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:55678:x1874670563963520:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 576us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826422.803920:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3963 00000100:00100000:2.0:1787826422.809810:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826422.809909:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563963776 00000100:00100000:3.0:1787826422.809922:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563963776 00000100:00100000:3.0:1787826422.810091:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1225 00000100:00100000:3.0:1787826422.810103:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:55678:x1874670563963776:12345-192.168.203.39@tcp:35:lfs.0 00000004:00080000:3.0:1787826422.810861:0:6522:0:(mdd_object.c:4014:mdd_close()) Object [0x200000405:0x3b:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787826422.810942:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].31, 64 off10656 00000004:00080000:3.0:1787826422.810957:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1368822485224ns, next at 1369822482282ns, rc = 0 00000001:00080000:3.0:1787826422.810966:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589935159 00010000:00010000:3.0:1787826422.811015:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b8316c lrc: 3/0,1 mode: --/PW res: [0x200000405:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.811035:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b8316c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.811049:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b8316c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.811059:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b8316c lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.811067:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b8316c lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.811074:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b8316c lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.811096:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787826422.811232:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+51:55678:x1874670563963776:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 1128us (1436us total) trans 8589935160 rc 0/0 00000100:00100000:3.0:1787826422.811243:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1225 00000020:00080000:3.0:1787826422.811250:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787826422.811348:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826422.811357:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b8316c lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.811371:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400000 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826422.811376:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b8316c lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.811386:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b8316c lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.811402:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3b:0x0].0x0 (ffff90cf2f6bdc00) 00010000:00010000:0.0:1787826422.811406:0:8451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787826422.811411:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b8316c lrc: 1/0,0 mode: --/PW res: [0x200000405:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.811418:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b8316c lrc: 0/0,0 mode: --/PW res: [0x200000405:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.811440:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826422.811442:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826422.811443:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826422.813844:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826422.813996:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563964032 00000100:00100000:0.0:1787826422.814008:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563964032 00000100:00100000:0.0:1787826422.814076:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1226 00000100:00100000:0.0:1787826422.814088:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb95e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+51:55678:x1874670563964032:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:0.0:1787826422.814691:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb95e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+52:55678:x1874670563964032:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 601us (856us total) trans 8589935161 rc 0/0 00000100:00100000:0.0:1787826422.814701:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1226 00000100:00100000:1.0:1787826422.844297:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826422.845690:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563964160 00000100:00100000:3.0:1787826422.845708:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563964160 00000100:00100000:2.0:1787826422.845879:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3964 00000100:00100000:2.0:1787826422.845892:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+52:55680:x1874670563964160:12345-192.168.203.39@tcp:101:getfattr.0 00010000:00010000:2.0:1787826422.845929:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826422.845960:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b83173 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1530 expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.846045:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8317a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.846064:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8317a lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.846079:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8317a lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.846096:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b83181 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.846103:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b83181 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.846111:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b83181 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.846218:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83188 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.846228:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83188 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.846235:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83188 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826422.846294:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:2.0:1787826422.846299:0:32404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826422.847416:0:32404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83188 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.847443:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83188 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.847457:0:32404:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8317a lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.847464:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8317a lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.847655:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8317a lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.847794:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8317a lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.847802:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826422.847806:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8317a lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.847815:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8317a lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.847833:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf39e67700) 00010000:00010000:2.0:1787826422.847837:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826422.847843:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8317a lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.847855:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8317a lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.847875:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b83181 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.847881:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b83181 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.847888:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b83181 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.847893:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826422.847896:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b83181 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.847902:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b83181 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.847910:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf39e67400) 00010000:00010000:2.0:1787826422.847912:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826422.847916:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b83181 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.847922:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b83181 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.847985:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b83173 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1530 expref: 54 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.848013:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83188 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1530 expref: 53 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.848021:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826422.848023:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826422.848026:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835800, rc 0) 00000100:00100000:2.0:1787826422.849332:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55680:x1874670563964160:12345-192.168.203.39@tcp:101:getfattr.0 Request processed in 3428us (5038us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826422.849348:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3964 00000100:00100000:2.0:1787826422.856069:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826422.858545:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563964288 00000100:00100000:3.0:1787826422.858566:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563964288 00000100:00100000:3.0:1787826422.858665:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2214 00000100:00100000:3.0:1787826422.858679:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2402:x1874670563964288:12345-192.168.203.39@tcp:101:getfattr.0 00010000:00010000:3.0:1787826422.858703:0:30694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826422.858727:0:30694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b8318f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1537 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826422.858812:0:30694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf1ecaf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:30694:1874670585277568:192.168.203.39@tcp:106: 00000100:00100000:3.0:1787826422.858932:0:30694:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf117b0b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787826422.862737:0:30694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf1ecaf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:30694:1874670585277568:192.168.203.39@tcp:106: 00010000:00010000:3.0:1787826422.862792:0:30694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b8318f lrc: 1/0,0 mode: --/PR res: [0x280000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1537 expref: 15 pid: 30694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.862825:0:30694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b8318f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1537 expref: 15 pid: 30694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.862843:0:30694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401e00, rc 0) 00000100:00100000:3.0:1787826422.862933:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2402:x1874670563964288:12345-192.168.203.39@tcp:101:getfattr.0 Request processed in 4255us (6877us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826422.862943:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2214 00000100:00100000:2.0:1787826422.900440:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826422.900815:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563964416 00000100:00100000:1.0:1787826422.900830:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563964416 00000100:00100000:1.0:1787826422.901101:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3965 00000100:00100000:1.0:1787826422.901115:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55684:x1874670563964416:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:1.0:1787826422.901231:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b83196 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.901252:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b83196 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.901268:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b83196 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.901284:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b8319d lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.901292:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b8319d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.901298:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b8319d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.901401:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b831a4 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.901411:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b831a4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.901419:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b831a4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826422.901467:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:1.0:1787826422.901522:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826422.901540:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b831a4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.901556:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b83196 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.901563:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b83196 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.901570:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b83196 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.901577:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b83196 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.901584:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46b200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826422.901588:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b83196 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.901596:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b83196 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.901609:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf3ab61b00) 00010000:00010000:1.0:1787826422.901612:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826422.901617:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b83196 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.901624:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b83196 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.901647:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b8319d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.901658:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b8319d lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.901664:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b8319d lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.901669:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46a800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826422.901672:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b8319d lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.901678:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b8319d lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.901686:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf3ab61500) 00010000:00010000:1.0:1787826422.901688:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826422.901691:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b8319d lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.901698:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b8319d lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.901718:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b831a4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.901725:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b831a4 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.901731:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b831a4 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.901736:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46ba00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826422.901740:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b831a4 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.901746:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b831a4 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.901753:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826422.901756:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826422.901758:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b831a4 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.901764:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b831a4 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826422.903595:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55684:x1874670563964416:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 2465us (3152us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826422.903614:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3965 00000100:00100000:2.0:1787826422.946846:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826422.952733:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563964672 00000100:00100000:0.0:1787826422.952755:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563964672 00000100:00100000:0.0:1787826422.952857:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3966 00000100:00100000:0.0:1787826422.952870:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55686:x1874670563964672:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826422.952897:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826422.952928:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b831ab lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab153e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.953087:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b831b2 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.953105:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b831b2 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.953119:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b831b2 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826422.953141:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:0.0:1787826422.953279:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b831ab lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab153e expref: 56 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.953303:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b831b2 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab153e expref: 55 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826422.953313:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826422.953316:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787826422.953321:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165e000, rc 0) 00000100:00100000:0.0:1787826422.953414:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+55:55686:x1874670563964672:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 545us (6583us total) trans 8589935162 rc 0/0 00000100:00100000:0.0:1787826422.953422:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3966 00000100:00100000:0.0:1787826422.957689:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826422.957880:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563964800 00000100:00100000:3.0:1787826422.957893:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563964800 00000100:00100000:3.0:1787826422.957964:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2215 00000100:00100000:3.0:1787826422.957975:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01dfd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563964800:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826422.957998:0:30695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826422.958021:0:30695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b831c0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1545 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826422.958094:0:30695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf1ecaf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:30695:1874670585277696:192.168.203.39@tcp:106: 00000100:00100000:3.0:1787826422.958227:0:30695:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf117b0b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787826422.961091:0:30695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf1ecaf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:30695:1874670585277696:192.168.203.39@tcp:106: 00010000:00010000:3.0:1787826422.961155:0:30695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b831c0 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1545 expref: 15 pid: 30695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.961187:0:30695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b831c0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1545 expref: 15 pid: 30695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826422.961204:0:30695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401e00, rc 0) 00000100:00100000:3.0:1787826422.961287:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01dfd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563964800:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 3311us (3614us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826422.961296:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2215 00000100:00100000:2.0:1787826422.972393:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826422.976115:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563965056 00000100:00100000:1.0:1787826422.976147:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563965056 00000100:00100000:1.0:1787826422.976287:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3967 00000100:00100000:1.0:1787826422.976301:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+55:55686:x1874670563965056:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826422.976334:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826422.976361:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b831c7 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab154c expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.976515:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b831ce lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.976545:0:8247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83188 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1530 expref: 56 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.976563:0:8247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b831ce lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.976608:0:8247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83188 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1530 expref: 56 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.976624:0:8247:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83188 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1530 expref: 56 pid: 32404 timeout: 1468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826422.976641:0:8247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3fb970c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8247:1874670585277824:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826422.976769:0:8247:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf078ff780 going to sleep for 11 seconds 00000100:00100000:0.0:1787826422.982875:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826422.984580:0:8247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3fb970c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8247:1874670585277824:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826422.984620:0:8247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b831ce lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826422.986950:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563965184 00000100:00100000:2.0:1787826422.987877:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563965184 00010000:00010000:2.0:1787826422.987950:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83188 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1530 expref: 57 pid: 32404 timeout: 1468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826422.988020:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1265 00000100:00100000:2.0:1787826422.988033:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01dfc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+57:2404:x1874670563965184:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826422.988064:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826422.988073:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83188 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1530 expref: 57 pid: 32404 timeout: 1468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.988090:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83188 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1530 expref: 57 pid: 32404 timeout: 1468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.988121:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83188 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1530 expref: 57 pid: 32404 timeout: 1468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.988151:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826422.988159:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b831ce lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.988170:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b831ce lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.988179:0:10340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b831ce lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826422.988216:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826422.988301:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01dfc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+56:2404:x1874670563965184:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 271us (5439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826422.988311:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1265 00010000:00010000:1.0:1787826422.989889:0:8247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b831ce lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.989908:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b831ce lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826422.989942:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:1.0:1787826422.990156:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b831c7 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab154c expref: 57 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.990191:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b831ce lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab154c expref: 56 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826422.990208:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826422.990211:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787826422.990216:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46a800, rc 0) 00000100:00100000:1.0:1787826422.990297:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+56:55686:x1874670563965056:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 13999us (17918us total) trans 8589935163 rc 0/0 00000100:00100000:1.0:1787826422.990307:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3967 00000100:00100000:2.0:1787826423.004326:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826423.004466:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563965440 00000100:00100000:1.0:1787826423.004495:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563965440 00000100:00100000:1.0:1787826423.004638:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3968 00000100:00100000:1.0:1787826423.004650:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+56:55686:x1874670563965440:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826423.004682:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826423.004713:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b831dc lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1553 expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.006247:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b831e3 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.006271:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b831e3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.006288:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b831e3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826423.006302:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x3c:0x0]: returning size 0 00010000:00010000:1.0:1787826423.006367:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b831dc lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1553 expref: 59 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.006402:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b831e3 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1553 expref: 58 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.006412:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3c:0x0].0x0 (ffff90cf3ab61b00) 00010000:00010000:1.0:1787826423.006415:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826423.006419:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46b200, rc 0) 00000100:00100000:1.0:1787826423.006692:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:55686:x1874670563965440:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 2043us (2381us total) trans 8589935164 rc 0/0 00000100:00100000:1.0:1787826423.006702:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3968 00000100:00080000:0.0:1787826423.007250:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787826423.010971:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826423.011888:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563965696 00000100:00100000:1.0:1787826423.011904:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563965696 00000100:00100000:1.0:1787826423.012092:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3969 00000100:00100000:1.0:1787826423.012106:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:55686:x1874670563965696:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826423.012151:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826423.012180:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b831f1 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab155a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.012344:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b831f8 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.012362:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b831e3 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1553 expref: 59 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.012372:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b831f8 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x3c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.012415:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b831e3 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1553 expref: 59 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.012432:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b831e3 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1553 expref: 59 pid: 32404 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826423.012450:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3fb970c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1874670585277952:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826423.012597:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf078ff780 going to sleep for 11 seconds 00000100:00100000:3.0:1787826423.015365:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826423.015725:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563965824 00000100:00100000:0.0:1787826423.015737:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563965824 00010000:00010000:0.0:1787826423.015790:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b831e3 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1553 expref: 60 pid: 32404 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826423.015841:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1266 00000100:00100000:0.0:1787826423.015864:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecae580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:2403:x1874670563965824:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826423.015884:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826423.015892:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b831e3 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1553 expref: 60 pid: 32404 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.015908:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b831e3 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1553 expref: 60 pid: 32404 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.015937:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3c:0x0].0x0 (ffff90cf3ab61b00) 00010000:00010000:0.0:1787826423.015944:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b831f8 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x3c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.015955:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b831f8 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.015964:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b831f8 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x3c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.015988:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826423.016061:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecae580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:2403:x1874670563965824:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 210us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826423.016071:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1266 00010000:00010000:1.0:1787826423.016545:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b831e3 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1553 expref: 59 pid: 32404 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826423.016567:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3fb970c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1874670585277952:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826423.016597:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b831f8 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.016608:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b831f8 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.016615:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b831f8 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826423.016636:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x3c:0x0]: returning size 0 00000004:00080000:1.0:1787826423.016870:0:6519:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x10d:0x0], index 1: 0 00010000:00010000:1.0:1787826423.017004:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b831f8 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.017013:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b831f8 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x3c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.017020:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b831f8 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x3c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.017027:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46b400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826423.017032:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b831f8 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x3c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.017040:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b831f8 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x3c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.017054:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3c:0x0].0x0 (ffff90cf3ab61b00) 00010000:00010000:1.0:1787826423.017058:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826423.017062:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b831f8 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x3c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.017068:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b831f8 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x3c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.017124:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b831f1 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x3c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab155a expref: 59 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.017146:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3c:0x0].0x0 (ffff90cf3ab61b00) 00010000:00010000:1.0:1787826423.017149:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787826423.017153:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b831f1 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x3c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab155a expref: 59 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.017168:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46ba00, rc 0) 00000100:00100000:1.0:1787826423.017227:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:55686:x1874670563965696:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 5124us (6271us total) trans 8589935165 rc 301/301 00000100:00100000:1.0:1787826423.017235:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3969 00000100:00100000:3.0:1787826423.022215:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826423.022443:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563966080 00000100:00100000:0.0:1787826423.022456:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563966080 00000100:00100000:0.0:1787826423.022711:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1227 00000100:00100000:0.0:1787826423.022724:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:55686:x1874670563966080:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:0.0:1787826423.023111:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55686:x1874670563966080:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 384us (906us total) trans 8589935166 rc 0/0 00000100:00100000:0.0:1787826423.023121:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1227 00000100:00100000:2.0:1787826423.026231:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826423.026355:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563966208 00000100:00100000:1.0:1787826423.026368:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563966208 00000100:00100000:1.0:1787826423.026446:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3970 00000100:00100000:1.0:1787826423.026458:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55686:x1874670563966208:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826423.026647:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826423.026680:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b83206 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1561 expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.026997:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b8320d lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.027016:0:9966:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b831ce lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab154c expref: 60 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.027028:0:9966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b8320d lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.027071:0:9966:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b831ce lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab154c expref: 60 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.027088:0:9966:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b831ce lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab154c expref: 60 pid: 8247 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826423.027104:0:9966:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3fb970c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9966:1874670585278080:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826423.027228:0:9966:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf078ff780 going to sleep for 11 seconds 00000100:00100000:1.0:1787826423.030140:0:9966:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3fb970c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9966:1874670585278080:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826423.030184:0:9966:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b8320d lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826423.031633:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826423.032069:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563966336 00000100:00100000:0.0:1787826423.032081:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563966336 00010000:00010000:0.0:1787826423.032147:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b831ce lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab154c expref: 61 pid: 8247 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826423.032192:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1267 00000100:00100000:0.0:1787826423.032203:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+61:2404:x1874670563966336:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826423.032226:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826423.032235:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b831ce lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab154c expref: 61 pid: 8247 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.032250:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b831ce lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab154c expref: 61 pid: 8247 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.032280:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b831ce lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab154c expref: 61 pid: 8247 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.032312:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826423.032319:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b8320d lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.032335:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b8320d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.032344:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b8320d lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.032383:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826423.032575:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:2404:x1874670563966336:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 373us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826423.032584:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1267 00010000:00010000:1.0:1787826423.032878:0:9966:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b8320d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.032889:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b8320d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826423.032965:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:1.0:1787826423.032971:0:9966:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826423.032999:0:9966:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b8320d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.033041:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b83206 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1561 expref: 60 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.033060:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b8320d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1561 expref: 59 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.033069:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826423.033071:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826423.033075:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46b400, rc 0) 00000100:00100000:1.0:1787826423.033112:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55686:x1874670563966208:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 6657us (6897us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826423.033121:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3970 00000100:00100000:2.0:1787826423.038395:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826423.038632:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563966464 00000100:00100000:3.0:1787826423.038646:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563966464 00000100:00100000:3.0:1787826423.038749:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2216 00000100:00100000:3.0:1787826423.038771:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf2f792050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563966464:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826423.038795:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826423.038820:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b83214 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1568 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826423.039145:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fdde00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1874670585278208:192.168.203.39@tcp:106: 00000100:00080000:2.0:1787826423.039300:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826423.039362:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf117b0b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787826423.042747:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fdde00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1874670585278208:192.168.203.39@tcp:106: 00010000:00010000:3.0:1787826423.042801:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b83214 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1568 expref: 15 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.042834:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9767cf8/0x22153cd396b83214 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1568 expref: 15 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.042850:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401e00, rc 0) 00000100:00100000:3.0:1787826423.042926:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf2f792050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563966464:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 4166us (4544us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826423.042937:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2216 00000100:00100000:0.0:1787826423.044607:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01dfde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585278720:0@lo:400:kworker.0 00000100:00100000:0.0:1787826423.044683:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826423.044860:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01dffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e3c550b8-2c3c-46c3-ad36-671c284167ea:3644:1874670585278592:0@lo:400:kworker.0 00000100:00100000:3.0:1787826423.044965:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce044d2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585278336:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826423.045016:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01dff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874670585279232:0@lo:400:kworker.0 00000100:00100000:2.0:1787826423.047720:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3fb970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585278464:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787826423.047923:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826423.047988:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01dfcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585279104:0@lo:400:kworker.0 00000100:00100000:1.0:1787826423.048018:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826423.048040:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01dfd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874670585279616:0@lo:400:kworker.0 00000100:00100000:1.0:1787826423.048067:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826423.048088:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01dfed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874670585280128:0@lo:400:kworker.0 00000100:00100000:1.0:1787826423.048112:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826423.048179:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585278720 00000100:00100000:1.0:1787826423.048189:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585278720 00000100:00100000:1.0:1787826423.048248:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1484 00000100:00100000:1.0:1787826423.048258:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a1b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3645:x1874670585278720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826423.048587:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a1b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3645:x1874670585278720:12345-0@lo:400:kworker.0 Request processed in 329us (3903us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826423.048596:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1484 00000100:00100000:1.0:1787826423.048653:0:34488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585278592 00000100:00100000:1.0:1787826423.048657:0:34488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585278592 00000100:00100000:1.0:1787826423.048685:0:34488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787826423.048691:0:34488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf2f427050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3c550b8-2c3c-46c3-ad36-671c284167ea+24:3644:x1874670585278592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826423.049253:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585279616 00000100:00100000:3.0:1787826423.049261:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585279616 00000100:00100000:1.0:1787826423.049659:0:34488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf2f427050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3c550b8-2c3c-46c3-ad36-671c284167ea+24:3644:x1874670585278592:12345-0@lo:400:kworker.0 Request processed in 965us (1735us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826423.049668:0:34488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787826423.049724:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585279104 00000100:00100000:1.0:1787826423.049729:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585279104 00000100:00100000:1.0:1787826423.049777:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 938 00000100:00100000:1.0:1787826423.049785:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb97840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3644:x1874670585279104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826423.049824:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb97840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3644:x1874670585279104:12345-0@lo:400:kworker.0 Request processed in 41us (1805us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826423.049830:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 938 00000100:00100000:1.0:1787826423.049848:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585280128 00000100:00100000:1.0:1787826423.049852:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585280128 00000100:00100000:1.0:1787826423.049879:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1590 00000100:00100000:1.0:1787826423.049886:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874670585279616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826423.049922:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874670585279616:12345-0@lo:400:kworker.0 Request processed in 36us (1853us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826423.049929:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1590 00000100:00100000:1.0:1787826423.049946:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1591 00000100:00100000:1.0:1787826423.049953:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f875680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874670585280128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826423.049981:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f875680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874670585280128:12345-0@lo:400:kworker.0 Request processed in 30us (1868us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826423.049987:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1591 00000100:00100000:1.0:1787826423.050040:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01dffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e3c550b8-2c3c-46c3-ad36-671c284167ea:3644:1874670585278592:0@lo:400:kworker.0 00000100:00100000:1.0:1787826423.050056:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01dfcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585279104:0@lo:400:kworker.0 00000100:00100000:1.0:1787826423.050068:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01dfd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874670585279616:0@lo:400:kworker.0 00000100:00100000:1.0:1787826423.050079:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01dfed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874670585280128:0@lo:400:kworker.0 00000100:00100000:3.0:1787826423.050404:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826423.050449:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01dff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874670585278848:0@lo:400:kworker.0 00000100:00100000:3.0:1787826423.050507:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826423.050526:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01dfe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874670585279360:0@lo:400:kworker.0 00000100:00100000:3.0:1787826423.050549:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826423.050567:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01dfe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585279872:0@lo:400:kworker.0 00000100:00100000:3.0:1787826423.050592:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826423.050616:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585279872 00000100:00100000:3.0:1787826423.050622:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585279872 00000100:00100000:3.0:1787826423.050658:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 939 00000100:00100000:3.0:1787826423.050666:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fde580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3646:x1874670585279872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826423.051090:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fde580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3646:x1874670585279872:12345-0@lo:400:kworker.0 Request processed in 423us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826423.051098:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 939 00000100:00100000:3.0:1787826423.051123:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585278848 00000100:00100000:3.0:1787826423.051154:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585278848 00000100:00100000:3.0:1787826423.051182:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585279360 00000100:00100000:3.0:1787826423.051185:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585279360 00000100:00100000:3.0:1787826423.051205:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1592 00000100:00100000:3.0:1787826423.051212:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874670585278848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826423.051249:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874670585278848:12345-0@lo:400:kworker.0 Request processed in 37us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826423.051256:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1592 00000100:00100000:3.0:1787826423.051268:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1593 00000100:00100000:3.0:1787826423.051273:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874670585279360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826423.051580:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874670585279360:12345-0@lo:400:kworker.0 Request processed in 305us (1028us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826423.051587:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1593 00000100:00100000:3.0:1787826423.051631:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01dfe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585279872:0@lo:400:kworker.0 00000100:00100000:3.0:1787826423.051663:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01dff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874670585278848:0@lo:400:kworker.0 00000100:00100000:3.0:1787826423.051675:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01dfe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874670585279360:0@lo:400:kworker.0 00000100:00100000:1.0:1787826423.051931:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585278336 00000100:00100000:1.0:1787826423.051938:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585278336 00000100:00100000:1.0:1787826423.051998:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1485 00000100:00100000:1.0:1787826423.052007:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3646:x1874670585278336:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787826423.052042:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445871616 avail 1299632128 00000100:00100000:1.0:1787826423.052097:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3646:x1874670585278336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (1694us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826423.052104:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1485 00000100:00100000:3.0:1787826423.052435:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce044d2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585278336:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1787826423.052619:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787826423.052626:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787826423.052630:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787826423.052773:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826423.052894:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563966592 00000100:00100000:3.0:1787826423.052901:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563966592 00000100:00100000:3.0:1787826423.052950:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3971 00000100:00100000:3.0:1787826423.052973:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f874f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55686:x1874670563966592:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826423.052988:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826423.053023:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b8321b lrc: 2/0,0 mode: --/CR res: [0x200000405:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab156f expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.053116:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b83222 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.053145:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b83222 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x3c:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.053161:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b83222 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x3c:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826423.053221:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x3c:0x0]: returning size 0 00000004:00200000:3.0:1787826423.053227:0:32404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826423.053250:0:32404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b83222 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x3c:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.053283:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b8321b lrc: 0/0,0 mode: --/CR res: [0x200000405:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab156f expref: 61 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.053903:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b83222 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x3c:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab156f expref: 60 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.053916:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3c:0x0].0x0 (ffff90cf2f6bd800) 00010000:00010000:3.0:1787826423.053920:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787826423.053925:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401200, rc 0) 00000100:00100000:3.0:1787826423.054013:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f874f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:55686:x1874670563966592:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1041us (1242us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826423.054021:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3971 00000100:00100000:0.0:1787826423.054455:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826423.054599:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01dfcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585279744:0@lo:400:kworker.0 00000100:00100000:0.0:1787826423.054643:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826423.054674:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585279744 00000100:00100000:0.0:1787826423.054680:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585279744 00000100:00100000:0.0:1787826423.054738:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1486 00000100:00100000:0.0:1787826423.054747:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a19680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874670585279744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826423.054796:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a19680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874670585279744:12345-0@lo:400:kworker.0 Request processed in 50us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826423.054803:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1486 00000100:00100000:0.0:1787826423.054871:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967718 gen 2 00000004:00080000:0.0:1787826423.054879:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967718 committed transno 4294967718 00000100:00100000:0.0:1787826423.054937:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01dfcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585279744:0@lo:400:kworker.0 00000100:00100000:0.0:1787826423.054983:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01dfde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585278720:0@lo:400:kworker.0 00000100:00100000:2.0:1787826423.055122:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826423.055175:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01dfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585278976:0@lo:400:kworker.0 00000100:00100000:2.0:1787826423.055204:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826423.055228:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01dfda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1874670585279488:0@lo:400:kworker.0 00000100:00100000:2.0:1787826423.055254:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826423.055265:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585278464 00000100:00100000:0.0:1787826423.055300:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585278464 00000100:00100000:0.0:1787826423.055342:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1487 00000100:00100000:0.0:1787826423.055349:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874670585278464:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787826423.055382:0:7796:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446182912 avail 1299943424 00000100:00100000:0.0:1787826423.055423:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874670585278464:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826423.055429:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1487 00000100:00100000:2.0:1787826423.055702:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01dff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585280000:0@lo:400:kworker.0 00000100:00100000:2.0:1787826423.055735:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826423.055778:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3fb970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585278464:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787826423.055811:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585279232 00000100:00100000:2.0:1787826423.055811:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585278976 00000100:00100000:2.0:1787826423.055816:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585278976 00000100:00100000:1.0:1787826423.055819:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585279232 00000100:00100000:3.0:1787826423.055847:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585279488 00000100:00100000:3.0:1787826423.055852:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585279488 00000100:00100000:2.0:1787826423.055871:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585280000 00000100:00100000:2.0:1787826423.055875:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585280000 00000100:00100000:1.0:1787826423.055976:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1594 00000100:00100000:1.0:1787826423.055986:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a1b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874670585279232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826423.056034:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a1b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874670585279232:12345-0@lo:400:kworker.0 Request processed in 49us (1580us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826423.056042:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1594 00000100:00100000:0.0:1787826423.056151:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01dff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874670585279232:0@lo:400:kworker.0 00000100:00100000:3.0:1787826423.056267:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1595 00000100:00100000:3.0:1787826423.056278:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874670585279488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826423.056285:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 940 00000100:00100000:2.0:1787826423.056296:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3647:x1874670585278976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826423.056434:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874670585279488:12345-0@lo:400:kworker.0 Request processed in 159us (1179us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826423.056441:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1595 00000100:00100000:2.0:1787826423.056516:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3647:x1874670585278976:12345-0@lo:400:kworker.0 Request processed in 223us (1310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826423.056594:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 940 00000100:00100000:2.0:1787826423.056610:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 941 00000100:00100000:2.0:1787826423.056618:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3647:x1874670585280000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787826423.056654:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3647:x1874670585280000:12345-0@lo:400:kworker.0 Request processed in 38us (919us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826423.056662:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 941 00000100:00080000:2.0:1787826423.056698:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787826423.056704:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787826423.056706:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826423.056730:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01dfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585278976:0@lo:400:kworker.0 00000100:00100000:2.0:1787826423.056742:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01dfda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1874670585279488:0@lo:400:kworker.0 00000100:00100000:2.0:1787826423.056751:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01dff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585280000:0@lo:400:kworker.0 00000100:00100000:2.0:1787826423.059789:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826423.059967:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563966720 00000100:00100000:0.0:1787826423.059980:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563966720 00000100:00100000:0.0:1787826423.060071:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2217 00000100:00100000:0.0:1787826423.060083:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2401:x1874670563966720:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826423.060106:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826423.060145:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d39501d2/0x22153cd396b83229 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x10d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1576 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787826423.060178:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787826423.060204:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10d:0x0].0x0 since=1369s v=(0 0) 00010000:00010000:0.0:1787826423.060210:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826423.060223:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d39501d2/0x22153cd396b83229 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1576 expref: 10 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.060246:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d39501d2/0x22153cd396b83229 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1576 expref: 10 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.060264:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165e600, rc 0) 00000100:00100000:0.0:1787826423.060343:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2401:x1874670563966720:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 260us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826423.060351:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2217 00000100:00080000:2.0:1787826423.060679:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826423.063936:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826423.064523:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563966976 00000100:00100000:3.0:1787826423.064538:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563966976 00000100:00100000:3.0:1787826423.064616:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3972 00000100:00100000:3.0:1787826423.064627:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:55686:x1874670563966976:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826423.064654:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826423.064681:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b83230 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab157d expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.064836:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b83237 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.064855:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b83237 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.064869:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b83237 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826423.064885:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:2.0:1787826423.065299:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b83230 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab157d expref: 63 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.065449:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b83237 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab157d expref: 62 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.065460:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826423.065463:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787826423.065468:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401a00, rc 0) 00000100:00100000:2.0:1787826423.065630:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+62:55686:x1874670563966976:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1003us (1707us total) trans 8589935167 rc 0/0 00000100:00100000:2.0:1787826423.065638:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3972 00000100:00100000:1.0:1787826423.068868:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826423.068974:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563967104 00000100:00100000:3.0:1787826423.068987:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563967104 00000100:00100000:3.0:1787826423.069056:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2218 00000100:00100000:3.0:1787826423.069068:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f877480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2403:x1874670563967104:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826423.069090:0:30398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826423.069112:0:30398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d612c5b/0x22153cd396b83245 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1584 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826423.069195:0:30398:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fdcf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:30398:1874670585280256:192.168.203.39@tcp:106: 00000100:00100000:3.0:1787826423.069529:0:30398:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf117b0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787826423.072536:0:30398:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fdcf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:30398:1874670585280256:192.168.203.39@tcp:106: 00010000:00010000:1.0:1787826423.072586:0:30398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006d612c5b/0x22153cd396b83245 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1584 expref: 15 pid: 30398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.072613:0:30398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d612c5b/0x22153cd396b83245 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1584 expref: 15 pid: 30398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.072628:0:30398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400000, rc 0) 00000100:00100000:1.0:1787826423.072694:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f877480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2403:x1874670563967104:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 3627us (3839us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826423.072705:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2218 00000100:00100000:2.0:1787826423.076553:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826423.076653:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563967232 00000100:00100000:1.0:1787826423.076665:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563967232 00000100:00100000:1.0:1787826423.076853:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2219 00000100:00100000:1.0:1787826423.076869:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2401:x1874670563967232:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826423.076894:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826423.076917:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bacf1a1a/0x22153cd396b8324c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab158b expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826423.077116:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f874780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1874670585280384:192.168.203.39@tcp:106: 00000100:00100000:1.0:1787826423.077375:0:8435:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf078ff780 going to sleep for 11 seconds 00000100:00100000:1.0:1787826423.080421:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f874780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1874670585280384:192.168.203.39@tcp:106: 00010000:00010000:1.0:1787826423.080509:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bacf1a1a/0x22153cd396b8324c lrc: 1/0,0 mode: --/PR res: [0x280000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab158b expref: 15 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.080540:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bacf1a1a/0x22153cd396b8324c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab158b expref: 15 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.080556:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46b200, rc 0) 00000100:00100000:1.0:1787826423.080629:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2401:x1874670563967232:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 3763us (4089us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826423.080640:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2219 00000100:00100000:3.0:1787826423.086468:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826423.087460:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563967360 00000100:00100000:2.0:1787826423.087513:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563967360 00000100:00100000:2.0:1787826423.087664:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2220 00000100:00100000:2.0:1787826423.087677:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563967360:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:2.0:1787826423.087748:0:30696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000159f1fa4/0x22153cd396b83253 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.087927:0:30696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b8307e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14e3 expref: 14 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.087938:0:30696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x10c:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787826423.087944:0:30696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826423.087950:0:30696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000159f1fa4/0x22153cd396b83253 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.088121:0:30696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b8307e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14e3 expref: 14 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.088148:0:30696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b8307e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14e3 expref: 14 pid: 14864 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826423.088167:0:30696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce04f043c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:30696:1874670585280512:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826423.088293:0:30696:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3ab4c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826423.092152:0:30696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce04f043c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:30696:1874670585280512:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826423.092195:0:30696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000159f1fa4/0x22153cd396b83253 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826423.092274:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826423.092467:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563967488 00000100:00100000:3.0:1787826423.092511:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563967488 00010000:00010000:3.0:1787826423.092559:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b8307e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14e3 expref: 15 pid: 14864 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826423.092601:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1268 00000100:00100000:3.0:1787826423.092612:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f07c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2404:x1874670563967488:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826423.092632:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826423.092662:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b8307e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x10c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14e3 expref: 15 pid: 14864 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.092677:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b8307e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14e3 expref: 15 pid: 14864 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.092871:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008398d30b/0x22153cd396b8307e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14e3 expref: 15 pid: 14864 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.092900:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826423.092905:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826423.092911:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000159f1fa4/0x22153cd396b83253 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.092924:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000159f1fa4/0x22153cd396b83253 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.093076:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826423.093154:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f07c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563967488:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 543us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826423.093164:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1268 00010000:00010000:1.0:1787826423.093428:0:30696:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000159f1fa4/0x22153cd396b83253 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x10c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.093438:0:30696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000159f1fa4/0x22153cd396b83253 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x10c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.093467:0:30696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000159f1fa4/0x22153cd396b83253 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x10c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.093501:0:30696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000159f1fa4/0x22153cd396b83253 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x10c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.093509:0:30696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000159f1fa4/0x22153cd396b83253 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.093518:0:30696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835800 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:1.0:1787826423.093523:0:30696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000159f1fa4/0x22153cd396b83253 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.093532:0:30696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000159f1fa4/0x22153cd396b83253 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x10c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.093547:0:30696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000159f1fa4/0x22153cd396b83253 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x10c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.093555:0:30696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000159f1fa4/0x22153cd396b83253 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x10c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826423.093612:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2404:x1874670563967360:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 5937us (7161us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826423.093621:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2220 00000100:00100000:3.0:1787826423.098678:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826423.098824:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563967616 00000100:00100000:2.0:1787826423.098837:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563967616 00000100:00100000:2.0:1787826423.098937:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2221 00000100:00100000:2.0:1787826423.098950:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2402:x1874670563967616:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826423.098987:0:30695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826423.099013:0:30695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c800962/0x22153cd396b8325a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x10c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1592 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787826423.099045:0:30695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10c:0x0] initial LVB size: 0, mtime: 0x6a9010ec, atime: 0x6a9010ec, ctime: 0x6a9010f6, blocks: 0x0 00010000:00010000:2.0:1787826423.099072:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10c:0x0].0x0 since=1369s v=(0 0) 00010000:00010000:2.0:1787826423.099077:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826423.099088:0:30695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c800962/0x22153cd396b8325a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1592 expref: 14 pid: 30695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.099114:0:30695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008c800962/0x22153cd396b8325a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1592 expref: 14 pid: 30695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.099138:0:30695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834800, rc 0) 00000100:00100000:2.0:1787826423.099265:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2402:x1874670563967616:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 317us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826423.099273:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2221 00010000:00010000:1.0:1787826423.107991:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826423.153564:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826423.153729:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563967744 00000100:00100000:0.0:1787826423.153742:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563967744 00000100:00100000:0.0:1787826423.153824:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3973 00000100:00100000:0.0:1787826423.153836:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+62:55686:x1874670563967744:12345-192.168.203.39@tcp:44:lfs.0 00000001:00080000:1.0:1787826423.157176:0:34481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935167 is committed 00010000:00010000:2.0:1787826423.157363:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b83070 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.157378:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b83070 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.157386:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b83070 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.157394:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826423.157399:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b83070 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.157409:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b83070 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.157430:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3a:0x0].0x0 (ffff90cf39e67300) 00010000:00010000:2.0:1787826423.157433:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826423.157439:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b83070 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.157451:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b83070 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.157504:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b83085 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.157511:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b83085 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.157517:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b83085 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.157522:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46ae00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826423.157525:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b83085 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.157530:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b83085 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.157538:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826423.157540:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826423.157543:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b83085 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.157549:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b83085 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787826423.157684:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 31 committed 00000020:00080000:1.0:1787826423.157735:0:34481:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90cf1850cd80 refcount 2 committed 0 result 0 batchid 4294969343 00000020:00080000:1.0:1787826423.157741:0:34481:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cf1f111c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90cf078fea80 00000020:00080000:1.0:1787826423.157745:0:34481:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cf1f111200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90ce0372a200 00000020:00080000:1.0:1787826423.157773:0:34481:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969342 batchid updated 00000020:00080000:2.0:1787826423.157855:0:34512:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969343 committed batchid 4294969342 00000100:00100000:1.0:1787826423.160532:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787826423.160574:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fdda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585280640:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787826423.160680:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826423.161540:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585280640 00000100:00100000:3.0:1787826423.161555:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585280640 00000100:00100000:3.0:1787826423.161633:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2222 00000100:00100000:3.0:1787826423.161644:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f874780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874670585280640:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787826423.161685:0:8437:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:268 count 1 00010000:00010000:3.0:1787826423.161721:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a816990/0x22153cd396b83261 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.161752:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001e0a1cce/0x22153cd396b8308c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14ea expref: 9 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.161763:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x10c:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787826423.161769:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826423.161774:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a816990/0x22153cd396b83261 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.161823:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001e0a1cce/0x22153cd396b8308c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14ea expref: 9 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.161840:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001e0a1cce/0x22153cd396b8308c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14ea expref: 9 pid: 8435 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826423.161855:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fdf0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1874670585280768:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826423.161955:0:8437:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf117b0a80 going to sleep for 11 seconds 00000020:00080000:2.0:1787826423.162305:0:34512:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969342 00000100:00100000:1.0:1787826423.164176:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fdf0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1874670585280768:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826423.164223:0:8437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003a816990/0x22153cd396b83261 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826423.164751:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:55686:x1874670563967744:12345-192.168.203.39@tcp:44:lfs.0 Request processed in 10912us (11197us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826423.164764:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3973 00000100:00100000:2.0:1787826423.167043:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826423.167788:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563967872 00000100:00100000:1.0:1787826423.167804:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563967872 00010000:00010000:1.0:1787826423.167921:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001e0a1cce/0x22153cd396b8308c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14ea expref: 10 pid: 8435 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826423.168083:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1269 00000100:00100000:1.0:1787826423.168097:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f05680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563967872:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826423.168253:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826423.168261:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001e0a1cce/0x22153cd396b8308c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x10c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14ea expref: 10 pid: 8435 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.168279:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001e0a1cce/0x22153cd396b8308c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14ea expref: 10 pid: 8435 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.168315:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e0a1cce/0x22153cd396b8308c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab14ea expref: 10 pid: 8435 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.168337:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826423.168343:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826423.168350:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003a816990/0x22153cd396b83261 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.168361:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a816990/0x22153cd396b83261 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.168404:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826423.168502:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f05680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563967872:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 408us (1470us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826423.168511:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1269 00010000:00010000:3.0:1787826423.168595:0:8437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003a816990/0x22153cd396b83261 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.168617:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a816990/0x22153cd396b83261 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.168629:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a816990/0x22153cd396b83261 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.169238:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a816990/0x22153cd396b83261 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.169270:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787826423.169313:0:7460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826423.169323:0:7460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a816990/0x22153cd396b83261 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.169333:0:7460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401400 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826423.169339:0:7460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a816990/0x22153cd396b83261 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.169351:0:7460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a816990/0x22153cd396b83261 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.169375:0:7460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a816990/0x22153cd396b83261 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.169385:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a816990/0x22153cd396b83261 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.169406:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826423.169410:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826423.169412:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826423.169561:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f874780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1874670585280640:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7918us (8880us total) trans 17179869680 rc 0/0 00000100:00100000:3.0:1787826423.169572:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2222 00000004:00080000:1.0:1787826423.169685:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce01fdda40/2, rc 0, transno 17179869680 00000100:00100000:1.0:1787826423.169693:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fdda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585280640:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787826423.171964:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826423.172050:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563968000 00000100:00100000:1.0:1787826423.172063:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563968000 00000100:00100000:1.0:1787826423.172150:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2223 00000100:00100000:1.0:1787826423.172163:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a18780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670563968000:12345-192.168.203.39@tcp:16:lfs.0 00000100:00100000:1.0:1787826423.172356:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a18780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670563968000:12345-192.168.203.39@tcp:16:lfs.0 Request processed in 194us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826423.172365:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2223 00000100:00100000:2.0:1787826423.185913:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826423.186896:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563968128 00000100:00100000:0.0:1787826423.186912:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563968128 00000100:00100000:1.0:1787826423.187119:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2224 00000100:00100000:1.0:1787826423.187141:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f05e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563968128:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:1.0:1787826423.187212:0:8545:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a8fb1ffc/0x22153cd396b83268 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.187234:0:8545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826423.187240:0:8545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826423.187248:0:8545:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8fb1ffc/0x22153cd396b83268 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.187265:0:8545:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8fb1ffc/0x22153cd396b83268 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.187299:0:8545:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a8fb1ffc/0x22153cd396b83268 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.187318:0:8545:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8fb1ffc/0x22153cd396b83268 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.187329:0:8545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8fb1ffc/0x22153cd396b83268 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.187337:0:8545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46ac00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:1.0:1787826423.187342:0:8545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8fb1ffc/0x22153cd396b83268 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.187357:0:8545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8fb1ffc/0x22153cd396b83268 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.187374:0:8545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8fb1ffc/0x22153cd396b83268 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.187384:0:8545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8fb1ffc/0x22153cd396b83268 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826423.187529:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f05e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563968128:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 398us (1632us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826423.187539:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2224 00000100:00100000:2.0:1787826423.190864:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826423.191147:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563968384 00000100:00100000:3.0:1787826423.191160:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563968384 00000100:00100000:3.0:1787826423.191241:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3974 00000100:00100000:3.0:1787826423.191252:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f05a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:55686:x1874670563968384:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:3.0:1787826423.191959:0:16564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826423.192011:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b83222 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x3c:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab156f expref: 33 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.192035:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3c:0x0].0x0 (ffff90cf2f6bd800) 00010000:00010000:3.0:1787826423.192061:0:16564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826423.192196:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8326f lrc: 3/0,1 mode: --/PW res: [0x200000405:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.192214:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8326f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.192226:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8326f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826423.192465:0:16564:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000840d6d76 reply state 00000000fb05d395 transno 8589935168 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8326f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.192517:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8326f lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.192525:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3c:0x0].0x0 (ffff90cf39e67300) 00010000:00010000:2.0:1787826423.192527:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826423.192531:0:16564:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826423.192674:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f05a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:55686:x1874670563968384:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 1423us (1824us total) trans 8589935168 rc 0/0 00000100:00100000:2.0:1787826423.192683:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3974 00000100:00100000:0.0:1787826423.199284:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826423.200617:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563968512 00000100:00100000:1.0:1787826423.200634:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563968512 00000100:00100000:1.0:1787826423.200721:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3975 00000100:00100000:1.0:1787826423.200736:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:55686:x1874670563968512:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826423.200768:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826423.200796:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b83276 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1599 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.200876:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b83276 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x3c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1599 expref: 35 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.200895:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b83276 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x3c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1599 expref: 35 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.200924:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3c:0x0].0x0 (ffff90cf39e67300) 00010000:00010000:1.0:1787826423.200928:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826423.200931:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46ac00, rc 0) 00000100:00100000:1.0:1787826423.201018:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:55686:x1874670563968512:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 286us (1751us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826423.201026:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3975 00000100:00100000:0.0:1787826423.206583:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826423.207661:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563968640 00000100:00100000:2.0:1787826423.207678:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563968640 00000100:00100000:2.0:1787826423.207767:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2225 00000100:00100000:2.0:1787826423.207780:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a19e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:55686:x1874670563968640:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826423.207805:0:14864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826423.207831:0:14864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002904bac2/0x22153cd396b8327d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab15a0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.207874:0:14864:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d39501d2/0x22153cd396b83229 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1576 expref: 10 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.207885:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826423.207891:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826423.207897:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002904bac2/0x22153cd396b8327d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15a0 expref: 10 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.207949:0:14864:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d39501d2/0x22153cd396b83229 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1576 expref: 10 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.207965:0:14864:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d39501d2/0x22153cd396b83229 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1576 expref: 10 pid: 8437 timeout: 1469 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826423.207982:0:14864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce04f070c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14864:1874670585280896:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826423.208100:0:14864:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3ab4ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826423.216603:0:14864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce04f070c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14864:1874670585280896:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826423.216653:0:14864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002904bac2/0x22153cd396b8327d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15a0 expref: 10 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.216680:0:14864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835a00, rc 0) 00000100:00100000:0.0:1787826423.216755:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a19e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:55686:x1874670563968640:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 8977us (10186us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826423.216766:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2225 00000100:00100000:0.0:1787826423.220185:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826423.220355:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563968768 00000100:00100000:2.0:1787826423.220368:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563968768 00010000:00010000:2.0:1787826423.220425:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d39501d2/0x22153cd396b83229 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1576 expref: 10 pid: 8437 timeout: 1469 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826423.220516:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1270 00000100:00100000:2.0:1787826423.220528:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf181fc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670563968768:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826423.220552:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826423.220582:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d39501d2/0x22153cd396b83229 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x10d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1576 expref: 10 pid: 8437 timeout: 1469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.220599:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d39501d2/0x22153cd396b83229 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1576 expref: 10 pid: 8437 timeout: 1469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.220629:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d39501d2/0x22153cd396b83229 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x10d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1576 expref: 10 pid: 8437 timeout: 1469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.220653:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826423.220658:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826423.220667:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002904bac2/0x22153cd396b8327d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15a0 expref: 9 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.220679:0:10340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002904bac2/0x22153cd396b8327d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15a0 expref: 9 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.220730:0:10340:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002904bac2/0x22153cd396b8327d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15a0 expref: 9 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826423.220748:0:10340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce04f052c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10340:1874670585281024:192.168.203.39@tcp:105: 00000100:00100000:2.0:1787826423.220944:0:10340:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3ab4c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826423.226021:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826423.226087:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563968896 00000100:00100000:3.0:1787826423.226100:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563968896 00000100:00100000:1.0:1787826423.226158:0:10340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce04f052c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10340:1874670585281024:192.168.203.39@tcp:105: 00010000:00010000:1.0:1787826423.226206:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826423.226221:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2226 00000100:00100000:3.0:1787826423.226232:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f070c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563968896:12345-192.168.203.39@tcp:2:lfs.0 00000100:00100000:1.0:1787826423.226279:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf181fc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670563968768:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5753us (6109us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826423.226289:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1270 00002000:00010000:3.0:1787826423.226469:0:30695:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x10d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787826423.226507:0:30695:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x10d:0x0] updating lvb mtime from disk: 0 -> 1787826412 00002000:00010000:3.0:1787826423.226509:0:30695:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x10d:0x0] updating lvb atime from disk: 0 -> 1787826412 00002000:00010000:3.0:1787826423.226511:0:30695:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x10d:0x0] updating lvb ctime from disk: 0 -> 1787826423 00002000:00010000:3.0:1787826423.226514:0:30695:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x10d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1787826423.226827:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f070c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563968896:12345-192.168.203.39@tcp:2:lfs.0 Request processed in 595us (818us total) trans 17179869681 rc 0/0 00000100:00100000:3.0:1787826423.226834:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2226 00000100:00100000:2.0:1787826423.230647:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826423.230777:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563969152 00000100:00100000:1.0:1787826423.230789:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563969152 00000100:00100000:1.0:1787826423.231047:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3976 00000100:00100000:1.0:1787826423.231061:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:55686:x1874670563969152:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:1.0:1787826423.231150:0:32404:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826423.231188:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b8320d lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1561 expref: 35 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.231315:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826423.231322:0:32404:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826423.231390:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b83284 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.231408:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b83284 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.231421:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b83284 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826423.231684:0:32404:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000056a9a27c reply state 00000000d90343c7 transno 8589935169 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b83284 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.231700:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b83284 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.231706:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826423.231710:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826423.231713:0:32404:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826423.231827:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55686:x1874670563969152:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 769us (1194us total) trans 8589935169 rc 0/0 00000100:00100000:1.0:1787826423.231836:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3976 00000100:00100000:0.0:1787826423.234298:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826423.234400:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563969280 00000100:00100000:1.0:1787826423.234411:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563969280 00000100:00100000:1.0:1787826423.234573:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2227 00000100:00100000:1.0:1787826423.234586:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a1ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:55686:x1874670563969280:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826423.234606:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826423.234629:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000381c17db/0x22153cd396b8328b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab15a7 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.234668:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008c800962/0x22153cd396b8325a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1592 expref: 15 pid: 30695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.234679:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826423.234685:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826423.234691:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000381c17db/0x22153cd396b8328b lrc: 4/0,0 mode: --/PW res: [0x280000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15a7 expref: 15 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.234734:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008c800962/0x22153cd396b8325a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1592 expref: 15 pid: 30695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.234750:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008c800962/0x22153cd396b8325a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1592 expref: 15 pid: 30695 timeout: 1469 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826423.234767:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f8743c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1874670585281152:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826423.234871:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf078ff000 going to sleep for 11 seconds 00000100:00100000:0.0:1787826423.238273:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826423.238396:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f8743c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1874670585281152:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826423.238440:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000381c17db/0x22153cd396b8328b lrc: 3/0,0 mode: --/PW res: [0x280000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15a7 expref: 15 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.238464:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46a400, rc 0) 00000100:00100000:1.0:1787826423.238547:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a1ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:55686:x1874670563969280:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 3963us (4261us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826423.238558:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2227 00000100:00100000:3.0:1787826423.239199:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563969408 00000100:00100000:3.0:1787826423.239210:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563969408 00010000:00010000:3.0:1787826423.239254:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008c800962/0x22153cd396b8325a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1592 expref: 15 pid: 30695 timeout: 1469 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826423.239298:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1271 00000100:00100000:3.0:1787826423.239316:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a18000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2404:x1874670563969408:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826423.239334:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826423.239364:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008c800962/0x22153cd396b8325a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x10c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1592 expref: 15 pid: 30695 timeout: 1469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.239379:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008c800962/0x22153cd396b8325a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1592 expref: 15 pid: 30695 timeout: 1469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.239409:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c800962/0x22153cd396b8325a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x10c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1592 expref: 15 pid: 30695 timeout: 1469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.239427:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826423.239432:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826423.239440:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000381c17db/0x22153cd396b8328b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15a7 expref: 14 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.239450:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000381c17db/0x22153cd396b8328b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15a7 expref: 14 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.239688:0:6505:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000381c17db/0x22153cd396b8328b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15a7 expref: 14 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826423.239712:0:6505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fdf0c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1874670585281280:192.168.203.39@tcp:105: 00000100:00100000:3.0:1787826423.239797:0:6505:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf117b0b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787826423.242413:0:6505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fdf0c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1874670585281280:192.168.203.39@tcp:105: 00010000:00010000:3.0:1787826423.242446:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826423.242545:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a18000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670563969408:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3230us (4284us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826423.242559:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1271 00000100:00100000:1.0:1787826423.249725:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826423.249877:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563969536 00000100:00100000:3.0:1787826423.249890:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563969536 00000100:00100000:3.0:1787826423.250003:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2228 00000100:00100000:3.0:1787826423.250015:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8743c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2402:x1874670563969536:12345-192.168.203.39@tcp:2:lfs.0 00002000:00010000:3.0:1787826423.250250:0:28853:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x10c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787826423.250255:0:28853:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x10c:0x0] updating lvb mtime from disk: 1787826412 -> 1787826412 00002000:00010000:3.0:1787826423.250258:0:28853:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x10c:0x0] updating lvb atime from disk: 1787826412 -> 1787826412 00002000:00010000:3.0:1787826423.250261:0:28853:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x10c:0x0] updating lvb ctime from disk: 1787826422 -> 1787826423 00002000:00010000:3.0:1787826423.250263:0:28853:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x10c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1787826423.250392:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8743c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2402:x1874670563969536:12345-192.168.203.39@tcp:2:lfs.0 Request processed in 379us (682us total) trans 21474837022 rc 0/0 00000100:00100000:3.0:1787826423.250403:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2228 00000001:00080000:0.0:1787826423.254466:0:26205:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474837022 is committed 00000001:00080000:0.0:1787826423.254513:0:26205:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474837021 is committed 00000100:00100000:0.0:1787826423.260183:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826423.264691:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563969792 00000100:00100000:1.0:1787826423.264722:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563969792 00000100:00100000:1.0:1787826423.264831:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1228 00000100:00100000:1.0:1787826423.265025:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eea3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55686:x1874670563969792:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:1.0:1787826423.265157:0:6521:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000405:0x1d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b83237 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab157d expref: 36 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.265225:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b83292 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.265241:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b83165 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1529 expref: 36 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.265250:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b831b2 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab153e expref: 36 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.265258:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b83292 lrc: 5/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.265302:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b831b2 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab153e expref: 36 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.265318:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b831b2 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab153e expref: 36 pid: 6520 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826423.265335:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f876580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1874670585281408:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826423.265464:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b83165 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1529 expref: 36 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.265508:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b83165 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1529 expref: 36 pid: 8247 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826423.265523:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f8761c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1874670585281536:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826423.265552:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf078ff000 going to sleep for 11 seconds 00000100:00100000:1.0:1787826423.269621:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f876580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1874670585281408:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826423.269643:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f8761c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1874670585281536:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826423.269677:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b83292 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826423.270585:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826423.270695:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563970048 00000100:00100000:3.0:1787826423.270706:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563970048 00000100:00100000:3.0:1787826423.270830:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1229 00000100:00100000:3.0:1787826423.270855:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a18b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:42220:x1874670563970048:12345-192.168.203.39@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787826423.271204:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a18b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:42220:x1874670563970048:12345-192.168.203.39@tcp:35:ldlm_bl.0 Request processed in 362us (625us total) trans 8589935170 rc 0/0 00000100:00100000:3.0:1787826423.271212:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1229 00000100:00100000:2.0:1787826423.279278:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826423.279397:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563970176 00000100:00100000:1.0:1787826423.279410:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563970176 00010000:00010000:1.0:1787826423.279467:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b83165 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1529 expref: 38 pid: 8247 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826423.279552:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1272 00000100:00100000:1.0:1787826423.279565:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f07c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:2403:x1874670563970176:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826423.279589:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826423.279599:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b83165 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1529 expref: 38 pid: 8247 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.279614:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b83165 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1529 expref: 38 pid: 8247 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.279646:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b83165 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1529 expref: 38 pid: 8247 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.279668:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826423.279676:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b83292 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.279686:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b83292 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.279693:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826423.279775:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f07c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:2403:x1874670563970176:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 212us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826423.279784:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1272 00000100:00100000:1.0:1787826423.281036:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826423.282018:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563970304 00000100:00100000:3.0:1787826423.282032:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563970304 00010000:00010000:3.0:1787826423.282091:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b831b2 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab153e expref: 37 pid: 6520 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826423.282152:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1273 00000100:00100000:3.0:1787826423.282465:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8761c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:2403:x1874670563970304:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826423.282523:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826423.282533:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b831b2 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab153e expref: 37 pid: 6520 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.282552:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b831b2 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab153e expref: 37 pid: 6520 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.282581:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b831b2 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab153e expref: 37 pid: 6520 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.282600:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826423.282605:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b83292 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.282616:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b83292 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.282628:0:10340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b83292 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.282661:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826423.282928:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8761c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:2403:x1874670563970304:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 764us (1897us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826423.282939:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1273 00010000:00010000:1.0:1787826423.285205:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b83292 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.285230:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b83292 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.285271:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b83299 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.285293:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b83276 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x3c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1599 expref: 35 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.285303:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b83299 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x3c:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.285358:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b83276 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x3c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1599 expref: 35 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.285379:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b83276 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x3c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1599 expref: 35 pid: 6520 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826423.285405:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f876580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1874670585281664:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826423.285544:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf078ff000 going to sleep for 11 seconds 00000100:00100000:1.0:1787826423.289873:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826423.289906:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f876580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1874670585281664:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826423.289944:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b83299 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x3c:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826423.290017:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563970432 00000100:00100000:3.0:1787826423.290025:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563970432 00010000:00010000:3.0:1787826423.290073:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b83276 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x3c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1599 expref: 36 pid: 6520 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826423.290115:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1274 00000100:00100000:3.0:1787826423.290134:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce044d1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:2403:x1874670563970432:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826423.290156:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826423.290176:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b83276 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x3c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1599 expref: 36 pid: 6520 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.290191:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b83276 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x3c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1599 expref: 36 pid: 6520 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.290219:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b83276 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x3c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1599 expref: 36 pid: 6520 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.290238:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3c:0x0].0x0 (ffff90cf39e67300) 00010000:00010000:3.0:1787826423.290243:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b83299 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x3c:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.290253:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b83299 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3c:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.290267:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b83299 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x3c:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.290297:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826423.290374:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce044d1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:2403:x1874670563970432:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 250us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826423.290383:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1274 00010000:00010000:0.0:1787826423.290504:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b83299 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.290512:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b83299 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826423.290879:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03a18f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6521:1874670585281792:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787826423.290940:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826423.290984:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f67eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826423.291055:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585281792 00000100:00100000:1.0:1787826423.291061:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585281792 00000100:00100000:1.0:1787826423.291109:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1488 00000100:00100000:1.0:1787826423.291118:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a19a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6521:x1874670585281792:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787826423.291228:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a19a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6521:x1874670585281792:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 111us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826423.291235:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1488 00000100:00100000:3.0:1787826423.292586:0:6521:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474837021 gen 2 00000004:00080000:3.0:1787826423.292600:0:6521:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3f8c3c00, transno 21474837007 00000004:00080000:3.0:1787826423.292621:0:6521:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837009 committed transno 21474837021 00000004:00080000:3.0:1787826423.292671:0:6521:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3f8770c0, transno 21474837011 00000004:00080000:3.0:1787826423.292676:0:6521:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837013 committed transno 21474837021 00000004:00080000:3.0:1787826423.292687:0:6521:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3aa870c0, transno 21474837015 00000004:00080000:3.0:1787826423.292692:0:6521:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837017 committed transno 21474837021 00000004:00080000:3.0:1787826423.292703:0:6521:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3fb96940, transno 21474837019 00000004:00080000:3.0:1787826423.292707:0:6521:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837021 committed transno 21474837021 00000100:00100000:3.0:1787826423.292737:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03a18f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6521:1874670585281792:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787826423.292819:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fde1c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6521:1874670585281920:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787826423.292880:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826423.292908:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a139c0 going to sleep for 11 seconds 00000004:00080000:1.0:1787826423.293144:0:34500:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 4 done 00000100:00100000:0.0:1787826423.297739:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585281920 00000100:00100000:0.0:1787826423.297754:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585281920 00000100:00100000:0.0:1787826423.297822:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1489 00000100:00100000:0.0:1787826423.297832:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6521:x1874670585281920:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787826423.297984:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6521:x1874670585281920:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 153us (5102us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826423.297992:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1489 00000100:00100000:3.0:1787826423.298134:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fde1c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6521:1874670585281920:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787826423.298382:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589935171 00000100:00100000:3.0:1787826423.298519:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fde1c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6521:1874670585282048:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787826423.298590:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826423.298627:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce057f6780 going to sleep for 11 seconds 00000100:00100000:0.0:1787826423.298747:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585282048 00000100:00100000:0.0:1787826423.298756:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585282048 00000100:00100000:0.0:1787826423.298830:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1490 00000100:00100000:0.0:1787826423.298843:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6521:x1874670585282048:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787826423.299005:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6521:x1874670585282048:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 167us (414us total) trans 17179869682 rc 0/0 00000100:00100000:0.0:1787826423.299012:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1490 00000100:00100000:3.0:1787826423.299290:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fde1c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6521:1874670585282048:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787826423.299538:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589935172 00010000:00010000:3.0:1787826423.299593:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b83299 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.299605:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b83299 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x3c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.299614:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b83299 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x3c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.299621:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46bc00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826423.299627:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b83299 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x3c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.299636:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b83299 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x3c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.299657:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3c:0x0].0x0 (ffff90cf39e67300) 00010000:00010000:3.0:1787826423.299660:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787826423.299666:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b83299 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x3c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.299672:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b83299 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x3c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.299688:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b83292 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.299694:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b83292 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.299699:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b83292 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.299704:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46aa00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826423.299707:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b83292 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.299712:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b83292 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.299720:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826423.299722:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787826423.299725:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b83292 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.299731:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b83292 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.299744:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826423.299747:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787826423.299754:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b83237 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab157d expref: 37 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826423.299936:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eea3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55686:x1874670563969792:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 35093us (39767us total) trans 8589935173 rc 0/0 00000100:00100000:3.0:1787826423.299949:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1228 00000020:00080000:3.0:1787826423.299965:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1787826423.321574:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826423.325050:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563970560 00000100:00100000:0.0:1787826423.325064:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563970560 00000100:00100000:0.0:1787826423.325123:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3977 00000100:00100000:0.0:1787826423.325145:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb95e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55686:x1874670563970560:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826423.325170:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826423.325189:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b832a0 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab15ae expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.325249:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b832a0 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15ae expref: 37 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.325263:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b832a0 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15ae expref: 37 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.325281:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826423.325284:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826423.325288:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165f600, rc 0) 00000100:00100000:0.0:1787826423.325356:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb95e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:55686:x1874670563970560:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 213us (4059us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826423.325363:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3977 00000100:00100000:2.0:1787826423.336749:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826423.336994:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563970816 00000100:00100000:3.0:1787826423.337008:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563970816 00000100:00100000:3.0:1787826423.337092:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1230 00000100:00100000:3.0:1787826423.337104:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f05680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:55686:x1874670563970816:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:3.0:1787826423.337441:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f05680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:55686:x1874670563970816:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 337us (705us total) trans 8589935174 rc 0/0 00000100:00100000:3.0:1787826423.337451:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1230 00000100:00100000:3.0:1787826423.345041:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826423.348101:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563971072 00000100:00100000:0.0:1787826423.348123:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563971072 00000100:00100000:1.0:1787826423.348676:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1231 00000100:00100000:1.0:1787826423.348690:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:55686:x1874670563971072:12345-192.168.203.39@tcp:35:lfs.0 00000004:00080000:1.0:1787826423.351340:0:6521:0:(mdd_object.c:4014:mdd_close()) Object [0x200000405:0x3c:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:1.0:1787826423.351627:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b832a7 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.351649:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b832a7 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.351663:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b832a7 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.351674:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b832a7 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.351687:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b832a7 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.351693:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b832a7 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.351721:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787826423.351872:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+39:55686:x1874670563971072:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 3179us (6840us total) trans 8589935175 rc 0/0 00000100:00100000:1.0:1787826423.351884:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1231 00010000:00010000:2.0:1787826423.356522:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826423.356545:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b832a7 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.356559:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46bc00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826423.356565:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b832a7 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.356576:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b832a7 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.356600:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3c:0x0].0x0 (ffff90cf39e67300) 00010000:00010000:2.0:1787826423.356603:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787826423.356608:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b832a7 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.356614:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b832a7 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.356640:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826423.356642:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826423.356644:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826423.373322:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826423.373432:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563971200 00000100:00100000:2.0:1787826423.373446:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563971200 00000100:00100000:2.0:1787826423.373554:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3978 00000100:00100000:2.0:1787826423.373566:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb96940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+39:55689:x1874670563971200:12345-192.168.203.39@tcp:101:getfattr.0 00010000:00010000:2.0:1787826423.373598:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826423.373627:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b832ae lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab15b5 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.373714:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b832b5 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.373732:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b832b5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.373746:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b832b5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.373760:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b832bc lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.373768:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b832bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.373774:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b832bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.373867:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b832c3 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.373879:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b832c3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.373886:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b832c3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826423.373933:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:2.0:1787826423.373939:0:16564:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826423.373975:0:16564:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b832c3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.373988:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b832c3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.373997:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b832b5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.374004:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b832b5 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.374017:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b832b5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.374024:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826423.374029:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b832b5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.374037:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b832b5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.374054:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf39e67c00) 00010000:00010000:2.0:1787826423.374057:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826423.374062:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b832b5 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.374068:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b832b5 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.374080:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b832bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.374086:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b832bc lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.374092:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b832bc lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.374096:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826423.374098:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b832bc lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.374107:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b832bc lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.374114:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf39e67a00) 00010000:00010000:2.0:1787826423.374117:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826423.374119:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b832bc lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.374134:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b832bc lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.374172:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b832ae lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15b5 expref: 41 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.374188:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b832c3 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15b5 expref: 40 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.374195:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826423.374198:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826423.374200:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834400, rc 0) 00000100:00100000:2.0:1787826423.374280:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb96940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55689:x1874670563971200:12345-192.168.203.39@tcp:101:getfattr.0 Request processed in 715us (988us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826423.374289:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3978 00000100:00100000:0.0:1787826423.412912:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826423.413015:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563971328 00000100:00100000:1.0:1787826423.413028:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563971328 00000100:00100000:1.0:1787826423.413102:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3979 00000100:00100000:1.0:1787826423.413113:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55693:x1874670563971328:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:1.0:1787826423.413228:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b832ca lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.413249:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b832ca lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.413264:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b832ca lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.413282:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b832d1 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.413289:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b832d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.413301:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b832d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.413397:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b832d8 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.413407:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b832d8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.413416:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b832d8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826423.413467:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:1.0:1787826423.413512:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826423.413528:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b832d8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.413545:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b832ca lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.413552:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b832ca lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.413559:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b832ca lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.413567:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b832ca lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.413574:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46ac00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826423.413578:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b832ca lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.413589:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b832ca lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.413603:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf3ab61500) 00010000:00010000:1.0:1787826423.413607:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826423.413612:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b832ca lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.413619:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b832ca lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.413642:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b832d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.413649:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b832d1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.413655:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b832d1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.413660:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46b000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826423.413663:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b832d1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.413670:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b832d1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.413677:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf3ab61400) 00010000:00010000:1.0:1787826423.413680:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826423.413683:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b832d1 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.413694:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b832d1 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.413706:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b832d8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.413712:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b832d8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.413718:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b832d8 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.413724:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46b400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826423.413727:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b832d8 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.413733:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b832d8 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.413741:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826423.413743:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826423.413746:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b832d8 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.413752:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b832d8 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826423.413838:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55693:x1874670563971328:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 726us (941us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826423.413847:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3979 00000100:00100000:0.0:1787826423.435925:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826423.436234:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563971584 00000100:00100000:1.0:1787826423.436248:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563971584 00000100:00100000:1.0:1787826423.436450:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3980 00000100:00100000:1.0:1787826423.436463:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55695:x1874670563971584:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826423.436541:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826423.436570:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b832df lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab15bc expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.436706:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b832e6 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.436725:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b832e6 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.436739:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b832e6 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826423.436752:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:1.0:1787826423.437041:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b832df lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15bc expref: 43 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.437067:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b832e6 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15bc expref: 42 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.437077:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826423.437081:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787826423.437084:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46b000, rc 0) 00000100:00100000:1.0:1787826423.437179:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+42:55695:x1874670563971584:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 719us (1270us total) trans 8589935176 rc 0/0 00000100:00100000:1.0:1787826423.437192:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3980 00000100:00100000:2.0:1787826423.442385:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826423.442495:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563971840 00000100:00100000:1.0:1787826423.442509:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563971840 00000100:00100000:1.0:1787826423.442579:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3981 00000100:00100000:1.0:1787826423.442591:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+42:55695:x1874670563971840:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826423.442626:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826423.442653:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b832f4 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab15c3 expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.442989:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b832fb lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.443010:0:8247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b832c3 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15b5 expref: 43 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.443021:0:8247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b832fb lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.443064:0:8247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b832c3 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15b5 expref: 43 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.443080:0:8247:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b832c3 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15b5 expref: 43 pid: 16564 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826423.443097:0:8247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01dfc3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8247:1874670585282176:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826423.443227:0:8247:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf078ff6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826423.446063:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826423.446111:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563971968 00000100:00100000:3.0:1787826423.446121:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563971968 00010000:00010000:3.0:1787826423.446183:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b832c3 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15b5 expref: 44 pid: 16564 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826423.446229:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1275 00000100:00100000:3.0:1787826423.446241:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecada40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:2403:x1874670563971968:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826423.446259:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826423.446268:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b832c3 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15b5 expref: 44 pid: 16564 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.446284:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b832c3 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15b5 expref: 44 pid: 16564 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.446320:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826423.446327:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b832fb lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.446337:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b832fb lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.446346:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b832fb lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.446375:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826423.446434:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecada40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:2403:x1874670563971968:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 194us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826423.446442:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1275 00010000:00010000:1.0:1787826423.447991:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b832c3 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15b5 expref: 43 pid: 16564 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826423.448023:0:8247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01dfc3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8247:1874670585282176:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826423.448056:0:8247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b832fb lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.448067:0:8247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b832fb lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.448074:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b832fb lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826423.448108:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:1.0:1787826423.448332:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b832f4 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15c3 expref: 44 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.448350:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b832fb lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15c3 expref: 43 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.448361:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826423.448365:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787826423.448368:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46ae00, rc 0) 00000100:00100000:1.0:1787826423.448447:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55695:x1874670563971840:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 5857us (6078us total) trans 8589935177 rc 0/0 00000100:00100000:1.0:1787826423.448458:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3981 00000100:00100000:3.0:1787826423.452167:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826423.452259:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563972096 00000100:00100000:0.0:1787826423.452272:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563972096 00000100:00100000:0.0:1787826423.452521:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1232 00000100:00100000:0.0:1787826423.452534:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecacf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55695:x1874670563972096:12345-192.168.203.39@tcp:33:lfs.0 00000100:00100000:0.0:1787826423.452768:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecacf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55695:x1874670563972096:12345-192.168.203.39@tcp:33:lfs.0 Request processed in 227us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826423.452777:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1232 00000100:00100000:3.0:1787826423.454891:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826423.455487:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563972352 00000100:00100000:2.0:1787826423.455501:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563972352 00000100:00100000:2.0:1787826423.455560:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1233 00000100:00100000:2.0:1787826423.455571:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55695:x1874670563972352:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:2.0:1787826423.455989:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55695:x1874670563972352:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 419us (1109us total) trans 8589935178 rc 0/0 00000100:00100000:2.0:1787826423.455998:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1233 00000100:00100000:3.0:1787826423.458343:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826423.458807:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563972608 00000100:00100000:2.0:1787826423.458821:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563972608 00000100:00100000:2.0:1787826423.458898:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3982 00000100:00100000:2.0:1787826423.458911:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecaf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55695:x1874670563972608:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826423.458946:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826423.458950:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:2.0:1787826423.458988:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b832fb lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15c3 expref: 44 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.459017:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b832e6 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15bc expref: 43 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.459030:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826423.459037:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826423.459055:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83309 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab15ca expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.459201:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83310 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.459218:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83310 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.459228:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83310 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826423.459246:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:2.0:1787826423.459619:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83309 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15ca expref: 45 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.459637:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83310 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15ca expref: 44 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.459646:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826423.459649:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787826423.459652:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835800, rc 0) 00000100:00100000:2.0:1787826423.459738:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecaf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55695:x1874670563972608:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 829us (1406us total) trans 8589935179 rc 0/0 00000100:00100000:2.0:1787826423.459747:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3982 00000100:00100000:3.0:1787826423.462350:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826423.462673:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563972864 00000100:00100000:0.0:1787826423.462688:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563972864 00000100:00100000:0.0:1787826423.462755:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1234 00000100:00100000:0.0:1787826423.462765:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eea2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55695:x1874670563972864:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:0.0:1787826423.462859:0:6522:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000405:0x1d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83310 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15ca expref: 44 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.462906:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b8331e lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.462920:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b832a0 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15ae expref: 44 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.462931:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b8331e lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.462976:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b832a0 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15ae expref: 44 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.462996:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b832a0 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15ae expref: 44 pid: 6519 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826423.463012:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03a1a1c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585282304:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826423.463103:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f67e300 going to sleep for 11 seconds 00000100:00100000:0.0:1787826423.466800:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03a1a1c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585282304:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826423.466840:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b8331e lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826423.467441:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826423.468729:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563972992 00000100:00100000:2.0:1787826423.468744:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563972992 00010000:00010000:2.0:1787826423.468859:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b832a0 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15ae expref: 45 pid: 6519 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826423.468950:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1276 00000100:00100000:2.0:1787826423.468962:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+45:2403:x1874670563972992:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826423.468982:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826423.468992:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b832a0 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15ae expref: 45 pid: 6519 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.469007:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b832a0 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15ae expref: 45 pid: 6519 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.469043:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b832a0 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15ae expref: 45 pid: 6519 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.469064:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826423.469070:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b8331e lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.469081:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b8331e lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.469091:0:10340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b8331e lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.469136:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826423.469228:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:2403:x1874670563972992:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 268us (1790us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826423.469237:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1276 00010000:00010000:0.0:1787826423.469319:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b8331e lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.469329:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b8331e lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.469568:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b8331e lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.469577:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b8331e lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.469584:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b8331e lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.469591:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165ee00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826423.469596:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b8331e lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.469610:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b8331e lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.469622:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826423.469625:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787826423.469630:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b8331e lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.469637:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b8331e lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.469649:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826423.469651:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787826423.469656:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83310 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15ca expref: 43 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826423.469828:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eea2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55695:x1874670563972864:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 7063us (7492us total) trans 8589935180 rc -22/-22 00000100:00100000:0.0:1787826423.469839:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1234 00000100:00100000:3.0:1787826423.472682:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826423.472813:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563973120 00000100:00100000:0.0:1787826423.472826:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563973120 00000100:00100000:0.0:1787826423.472897:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3983 00000100:00100000:0.0:1787826423.472908:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55695:x1874670563973120:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826423.472940:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826423.472968:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b83325 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab15d1 expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.473045:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b83325 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15d1 expref: 44 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.473063:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b83325 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15d1 expref: 44 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.473085:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826423.473089:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826423.473093:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165f400, rc 0) 00000100:00100000:0.0:1787826423.473169:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55695:x1874670563973120:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 262us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826423.473177:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3983 00000100:00100000:3.0:1787826423.478165:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826423.478514:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563973376 00000100:00100000:1.0:1787826423.478527:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563973376 00000100:00100000:1.0:1787826423.478599:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3984 00000100:00100000:1.0:1787826423.478610:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55695:x1874670563973376:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826423.478637:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826423.478667:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b8332c lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab15d8 expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.479275:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b83333 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.479295:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b83333 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.479559:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b83333 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826423.479573:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x3d:0x0]: returning size 0 00010000:00010000:1.0:1787826423.479636:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b8332c lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15d8 expref: 47 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.479662:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b83333 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15d8 expref: 46 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.479672:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3d:0x0].0x0 (ffff90cf3ab61500) 00010000:00010000:1.0:1787826423.479676:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826423.479681:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46b400, rc 0) 00000100:00100000:1.0:1787826423.479756:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+46:55695:x1874670563973376:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1148us (1607us total) trans 8589935181 rc 0/0 00000100:00100000:1.0:1787826423.479764:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3984 00000100:00100000:3.0:1787826423.483254:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826423.483397:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563973632 00000100:00100000:1.0:1787826423.483410:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563973632 00000100:00100000:1.0:1787826423.483510:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3985 00000100:00100000:1.0:1787826423.483523:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+46:55695:x1874670563973632:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826423.483554:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826423.483580:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b83341 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab15df expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.483715:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b83348 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.483733:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b83348 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.483746:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b83348 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826423.483760:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:1.0:1787826423.483888:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b83341 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15df expref: 49 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.483910:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b83348 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15df expref: 48 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.483919:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826423.483922:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787826423.483926:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46ba00, rc 0) 00000100:00100000:1.0:1787826423.484010:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55695:x1874670563973632:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 488us (768us total) trans 8589935182 rc 0/0 00000100:00100000:1.0:1787826423.484018:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3985 00000100:00100000:3.0:1787826423.491924:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826423.492215:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563973888 00000100:00100000:2.0:1787826423.492230:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563973888 00000100:00100000:2.0:1787826423.492302:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1235 00000100:00100000:2.0:1787826423.492314:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55695:x1874670563973888:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:2.0:1787826423.492434:0:14257:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000405:0x1d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b83348 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15df expref: 48 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.492528:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83356 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.492544:0:14257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b83325 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15d1 expref: 48 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.492558:0:14257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83356 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.492603:0:14257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b83325 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15d1 expref: 48 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.492619:0:14257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b83325 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15d1 expref: 48 pid: 9966 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826423.492641:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce04f05680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585282432:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826423.492744:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3ab4c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826423.499847:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826423.499922:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce04f05680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585282432:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826423.499941:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563974016 00000100:00100000:1.0:1787826423.499949:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563974016 00010000:00010000:1.0:1787826423.500002:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b83325 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15d1 expref: 49 pid: 9966 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.500028:0:14257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83356 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826423.500052:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1277 00000100:00100000:1.0:1787826423.500064:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf181fe450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:2404:x1874670563974016:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826423.500086:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826423.500095:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b83325 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15d1 expref: 49 pid: 9966 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.500110:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b83325 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15d1 expref: 49 pid: 9966 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.500152:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b83325 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15d1 expref: 49 pid: 9966 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.500173:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826423.500179:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83356 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.500191:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83356 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.500200:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83356 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.500230:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826423.500295:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf181fe450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:2404:x1874670563974016:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 232us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826423.500304:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1277 00010000:00010000:3.0:1787826423.500514:0:14257:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83356 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.500523:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83356 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.500549:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b8335d lrc: 3/0,1 mode: --/EX res: [0x200000405:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.500561:0:14257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b83333 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15d8 expref: 47 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.500744:0:14257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b8335d lrc: 4/0,1 mode: --/EX res: [0x200000405:0x3d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.500794:0:14257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b83333 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15d8 expref: 47 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.500809:0:14257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b83333 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15d8 expref: 47 pid: 32404 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826423.500825:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f8c2940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585282560:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826423.500904:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce057f6780 going to sleep for 11 seconds 00000100:00100000:0.0:1787826423.504468:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826423.504553:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563974144 00000100:00100000:1.0:1787826423.504564:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563974144 00010000:00010000:1.0:1787826423.504616:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b83333 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15d8 expref: 48 pid: 32404 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826423.504655:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f8c2940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585282560:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826423.504669:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1278 00000100:00100000:1.0:1787826423.504680:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a18b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:2403:x1874670563974144:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826423.504687:0:14257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b8335d lrc: 3/0,1 mode: --/EX res: [0x200000405:0x3d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.504696:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826423.504704:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b83333 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15d8 expref: 48 pid: 32404 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.504717:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b83333 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15d8 expref: 48 pid: 32404 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.504745:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b83333 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15d8 expref: 48 pid: 32404 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.504764:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3d:0x0].0x0 (ffff90cf3ab61500) 00010000:00010000:1.0:1787826423.504770:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b8335d lrc: 3/0,1 mode: --/EX res: [0x200000405:0x3d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.504791:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b8335d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.504800:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b8335d lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x3d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.504832:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826423.504896:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a18b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+47:2403:x1874670563974144:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 217us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826423.504906:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1278 00010000:00010000:3.0:1787826423.505167:0:14257:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b8335d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3d:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.505175:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b8335d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3d:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826423.505560:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f8c2940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585282688:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1787826423.505735:0:14257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826423.505781:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce057f6780 going to sleep for 11 seconds 00000100:00100000:1.0:1787826423.506252:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585282688 00000100:00100000:1.0:1787826423.506260:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585282688 00000100:00100000:1.0:1787826423.506420:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1491 00000100:00100000:1.0:1787826423.506430:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14257:x1874670585282688:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1787826423.506601:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14257:x1874670585282688:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 173us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826423.506608:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1491 00000100:00100000:3.0:1787826423.507086:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f8c2940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585282688:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:3.0:1787826423.507180:0:14257:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589935183 00000001:00080000:3.0:1787826423.507279:0:14257:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589935184 00010000:00010000:3.0:1787826423.507303:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b8335d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3d:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.507327:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b8335d lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x3d:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.507335:0:14257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b8335d lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x3d:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.507343:0:14257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826423.507348:0:14257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b8335d lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x3d:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.507358:0:14257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b8335d lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x3d:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.507378:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3d:0x0].0x0 (ffff90cf3ab61500) 00010000:00010000:3.0:1787826423.507382:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787826423.507387:0:14257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b8335d lrc: 2/0,0 mode: --/EX res: [0x200000405:0x3d:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.507394:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b8335d lrc: 0/0,0 mode: --/EX res: [0x200000405:0x3d:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.507420:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83356 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.507426:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83356 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.507432:0:14257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83356 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.507442:0:14257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826423.507446:0:14257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83356 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.507462:0:14257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83356 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.507473:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826423.507475:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787826423.507499:0:14257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83356 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.507505:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83356 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.507519:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826423.507522:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787826423.507529:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b83348 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15df expref: 49 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826423.507657:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55695:x1874670563973888:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 15344us (15746us total) trans 8589935185 rc 0/0 00000100:00100000:3.0:1787826423.507666:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1235 00000020:00080000:3.0:1787826423.507670:0:14257:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1787826423.511395:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826423.511887:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563974272 00000100:00100000:2.0:1787826423.511901:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563974272 00000100:00100000:2.0:1787826423.511973:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3986 00000100:00100000:2.0:1787826423.511984:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55695:x1874670563974272:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826423.512017:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826423.512042:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b83364 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab15e6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.512113:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b83364 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15e6 expref: 49 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.512156:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b83364 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15e6 expref: 49 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.512178:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826423.512182:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826423.512186:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834600, rc 0) 00000100:00100000:2.0:1787826423.512249:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:55695:x1874670563974272:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 267us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826423.512256:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3986 00000100:00100000:2.0:1787826423.516934:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826423.517069:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563974528 00000100:00100000:0.0:1787826423.517080:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563974528 00000100:00100000:0.0:1787826423.517155:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1236 00000100:00100000:0.0:1787826423.517166:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce04f07c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:55695:x1874670563974528:12345-192.168.203.39@tcp:35:lfs.0 00000004:00080000:2.0:1787826423.517899:0:6522:0:(mdd_object.c:4014:mdd_close()) Object [0x200000405:0x3d:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787826423.517974:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].31, 64 off10632 00000004:00080000:2.0:1787826423.517989:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1369529516168ns, next at 1370529512516ns, rc = 0 00000001:00080000:2.0:1787826423.517997:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589935186 00010000:00010000:2.0:1787826423.518049:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b8336b lrc: 3/0,1 mode: --/PW res: [0x200000405:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.518069:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b8336b lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x3d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.518083:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b8336b lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x3d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.518093:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b8336b lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x3d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.518101:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b8336b lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x3d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.518108:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b8336b lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x3d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.518137:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787826423.518249:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce04f07c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+51:55695:x1874670563974528:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 1082us (1327us total) trans 8589935187 rc 0/0 00000100:00100000:2.0:1787826423.518262:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1236 00000020:00080000:2.0:1787826423.518268:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787826423.518835:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826423.518846:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b8336b lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x3d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.518856:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834a00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826423.518861:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b8336b lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x3d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.518870:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b8336b lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x3d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.518886:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3d:0x0].0x0 (ffff90cf39e67c00) 00010000:00010000:0.0:1787826423.518891:0:8451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787826423.518896:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b8336b lrc: 1/0,0 mode: --/PW res: [0x200000405:0x3d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.518902:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b8336b lrc: 0/0,0 mode: --/PW res: [0x200000405:0x3d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.518925:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826423.518927:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826423.518929:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826423.521778:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826423.521907:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563974784 00000100:00100000:3.0:1787826423.521920:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563974784 00000100:00100000:3.0:1787826423.522027:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1237 00000100:00100000:3.0:1787826423.522039:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a1a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+51:55695:x1874670563974784:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:3.0:1787826423.522363:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a1a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+52:55695:x1874670563974784:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 325us (608us total) trans 8589935188 rc 0/0 00000100:00100000:3.0:1787826423.522371:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1237 00000100:00100000:3.0:1787826423.549705:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826423.549794:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563974912 00000100:00100000:0.0:1787826423.549808:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563974912 00000100:00100000:0.0:1787826423.549889:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3987 00000100:00100000:0.0:1787826423.549901:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+52:55697:x1874670563974912:12345-192.168.203.39@tcp:101:getfattr.0 00010000:00010000:0.0:1787826423.549934:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826423.549967:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b83372 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab15ed expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.550064:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b83379 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.550081:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b83379 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.550094:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b83379 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.550108:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b83380 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.550115:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b83380 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.550122:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b83380 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.550237:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b83387 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.550247:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b83387 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.550255:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b83387 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826423.550318:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:0.0:1787826423.550323:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826423.550349:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b83387 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.550362:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b83387 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.550374:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b83379 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.550381:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b83379 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.550388:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b83379 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.550395:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b83379 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.550406:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165ea00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826423.550411:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b83379 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.550420:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b83379 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.550434:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90ce036ca100) 00010000:00010000:0.0:1787826423.550438:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826423.550443:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b83379 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.550449:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b83379 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.550467:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b83380 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.550537:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b83380 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.550543:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b83380 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.550548:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165e400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826423.550551:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b83380 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.550558:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b83380 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.550569:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90ce036ca900) 00010000:00010000:0.0:1787826423.550572:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826423.550575:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b83380 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.550581:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b83380 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.550616:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b83372 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15ed expref: 54 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.550973:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b83387 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15ed expref: 53 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.551036:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826423.551039:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826423.551042:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165fc00, rc 0) 00000100:00100000:0.0:1787826423.551180:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55697:x1874670563974912:12345-192.168.203.39@tcp:101:getfattr.0 Request processed in 1280us (1489us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826423.551190:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3987 00000100:00100000:2.0:1787826423.555820:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce04f05680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585282944:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826423.555921:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826423.555991:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787826423.555999:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03977840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585282816:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787826423.556025:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826423.556172:0:12021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585282944 00000100:00100000:1.0:1787826423.556182:0:12021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585282944 00000100:00100000:1.0:1787826423.556245:0:12021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585282816 00000100:00100000:1.0:1787826423.556248:0:12021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585282816 00000100:00100000:1.0:1787826423.556276:0:12021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 786 00000100:00100000:1.0:1787826423.556299:0:12021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874670585282944:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787826423.556338:0:12021:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 186235712 pending 0 free 3919187968 avail 3687665664 00000100:00100000:1.0:1787826423.556408:0:12021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874670585282944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826423.556416:0:12021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 786 00000100:00100000:1.0:1787826423.556435:0:12021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 787 00000100:00100000:1.0:1787826423.556441:0:12021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874670585282816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787826423.556453:0:12021:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 186235712 pending 0 free 3919187968 avail 3687665664 00000100:00100000:1.0:1787826423.556508:0:12021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874670585282816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826423.556514:0:12021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 787 00000100:00100000:1.0:1787826423.556564:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03977840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585282816:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826423.556594:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce04f05680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585282944:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787826423.557107:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03976940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585283072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787826423.557161:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826423.557497:0:12021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585283072 00000100:00100000:3.0:1787826423.557504:0:12021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585283072 00000100:00100000:3.0:1787826423.557551:0:12021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 788 00000100:00100000:3.0:1787826423.557559:0:12021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3644:x1874670585283072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787826423.557592:0:12021:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 160009024 pending 0 free 3920248832 avail 3688726528 00000100:00100000:3.0:1787826423.557638:0:12021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3644:x1874670585283072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826423.557803:0:12021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 788 00000100:00100000:3.0:1787826423.557850:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03976940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585283072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787826423.557999:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01dfc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585283200:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826423.558033:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826423.558165:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585283200 00000100:00100000:1.0:1787826423.558170:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585283200 00000100:00100000:1.0:1787826423.558206:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 789 00000100:00100000:1.0:1787826423.558214:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874670585283200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787826423.558228:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 160009024 pending 0 free 3920248832 avail 3688726528 00000100:00100000:1.0:1787826423.558268:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874670585283200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826423.558274:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 789 00000100:00100000:1.0:1787826423.558316:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01dfc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585283200:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826423.561740:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826423.563322:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563975040 00000100:00100000:0.0:1787826423.563343:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563975040 00000100:00100000:0.0:1787826423.563805:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2229 00000100:00100000:0.0:1787826423.563821:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2402:x1874670563975040:12345-192.168.203.39@tcp:101:getfattr.0 00010000:00010000:0.0:1787826423.563848:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826423.563874:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003bd432a2/0x22153cd396b8338e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab15f4 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826423.566381:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03a1a580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1874670585283328:192.168.203.39@tcp:106: 00000100:00100000:0.0:1787826423.566540:0:8435:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f67e840 going to sleep for 11 seconds 00000100:00100000:1.0:1787826423.569572:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03a1a580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1874670585283328:192.168.203.39@tcp:106: 00010000:00010000:1.0:1787826423.569638:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003bd432a2/0x22153cd396b8338e lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15f4 expref: 11 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.569672:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003bd432a2/0x22153cd396b8338e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15f4 expref: 11 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.569689:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165ec00, rc 0) 00000100:00100000:1.0:1787826423.569779:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2402:x1874670563975040:12345-192.168.203.39@tcp:101:getfattr.0 Request processed in 5961us (8145us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826423.569789:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2229 00000100:00100000:3.0:1787826423.590834:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826423.591138:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563975168 00000100:00100000:2.0:1787826423.591153:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563975168 00000100:00100000:2.0:1787826423.591330:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3988 00000100:00100000:2.0:1787826423.591344:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03976940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55701:x1874670563975168:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:2.0:1787826423.591510:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b83395 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.591532:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b83395 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.591546:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b83395 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.591562:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b8339c lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.591573:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b8339c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.591579:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b8339c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.591695:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b833a3 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.591719:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b833a3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.591727:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b833a3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826423.591779:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:2.0:1787826423.591784:0:16564:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826423.591801:0:16564:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b833a3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.591816:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b83395 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.591823:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b83395 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.591830:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b83395 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.591837:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826423.591841:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b83395 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.591849:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b83395 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.591863:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf39e67a00) 00010000:00010000:2.0:1787826423.591866:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826423.591870:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b83395 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.591876:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b83395 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.591898:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b8339c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.591919:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b8339c lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.591925:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b8339c lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.591931:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826423.591933:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b8339c lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.591941:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b8339c lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.591949:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf39e67e00) 00010000:00010000:2.0:1787826423.591952:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826423.591955:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b8339c lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.591966:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b8339c lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.591980:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b833a3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.591986:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b833a3 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.591993:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b833a3 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.591997:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826423.592001:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b833a3 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.592007:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b833a3 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.592015:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826423.592018:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826423.592021:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b833a3 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.592028:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b833a3 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826423.592140:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03976940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55701:x1874670563975168:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 798us (1553us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826423.592150:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3988 00000100:00100000:2.0:1787826423.614836:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826423.614939:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563975424 00000100:00100000:3.0:1787826423.614953:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563975424 00000100:00100000:3.0:1787826423.615037:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3989 00000100:00100000:3.0:1787826423.615051:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55703:x1874670563975424:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826423.615078:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826423.615105:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b833aa lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab15fb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.615262:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b833b1 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.615282:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b833b1 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.615296:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b833b1 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826423.615822:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:2.0:1787826423.616085:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b833aa lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15fb expref: 56 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.616109:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b833b1 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15fb expref: 55 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.616120:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826423.616135:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787826423.616140:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401a00, rc 0) 00000100:00100000:2.0:1787826423.616231:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+55:55703:x1874670563975424:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1183us (1412us total) trans 8589935189 rc 0/0 00000100:00100000:2.0:1787826423.616240:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3989 00000100:00100000:3.0:1787826423.625012:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826423.625274:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563975552 00000100:00100000:1.0:1787826423.625286:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563975552 00000100:00100000:1.0:1787826423.625376:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2230 00000100:00100000:1.0:1787826423.625389:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03976d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563975552:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826423.625416:0:30696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826423.625439:0:30696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000951304c9/0x22153cd396b833bf lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1602 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826423.625592:0:30696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01dfc3c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:30696:1874670585283456:192.168.203.39@tcp:106: 00000100:00100000:1.0:1787826423.625697:0:30696:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce01ef9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826423.632998:0:30696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01dfc3c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:30696:1874670585283456:192.168.203.39@tcp:106: 00010000:00010000:1.0:1787826423.633051:0:30696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000951304c9/0x22153cd396b833bf lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1602 expref: 11 pid: 30696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.633083:0:30696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000951304c9/0x22153cd396b833bf lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1602 expref: 11 pid: 30696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.633100:0:30696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46b400, rc 0) 00000100:00100000:1.0:1787826423.633204:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03976d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563975552:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 7816us (8208us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826423.633215:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2230 00000100:00100000:2.0:1787826423.645422:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826423.645630:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563975808 00000100:00100000:0.0:1787826423.645643:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563975808 00000100:00100000:0.0:1787826423.645960:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3990 00000100:00100000:0.0:1787826423.645973:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c87840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+55:55703:x1874670563975808:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826423.646004:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826423.646033:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b833c6 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1609 expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.646188:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b833cd lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.646206:0:9966:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b83387 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15ed expref: 56 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.646216:0:9966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b833cd lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.646256:0:9966:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b83387 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15ed expref: 56 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.646272:0:9966:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b83387 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15ed expref: 56 pid: 6519 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826423.646287:0:9966:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03a1a580 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9966:1874670585283584:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826423.646395:0:9966:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f67e840 going to sleep for 11 seconds 00000100:00100000:3.0:1787826423.653164:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826423.653613:0:9966:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03a1a580 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9966:1874670585283584:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826423.653649:0:9966:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b833cd lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826423.653784:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563975936 00000100:00100000:2.0:1787826423.653792:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563975936 00010000:00010000:2.0:1787826423.653842:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b83387 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15ed expref: 57 pid: 6519 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826423.653885:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1279 00000100:00100000:2.0:1787826423.653896:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03975e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+57:2403:x1874670563975936:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826423.653915:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826423.653922:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b83387 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15ed expref: 57 pid: 6519 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.653935:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b83387 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15ed expref: 57 pid: 6519 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.653968:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b83387 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15ed expref: 57 pid: 6519 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.653988:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826423.653993:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b833cd lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.654004:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b833cd lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.654012:0:10340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b833cd lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.654042:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826423.654113:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03975e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+56:2403:x1874670563975936:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 218us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826423.654122:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1279 00010000:00010000:0.0:1787826423.655135:0:9966:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b833cd lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.655152:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b833cd lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826423.655185:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:0.0:1787826423.655389:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b833c6 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1609 expref: 57 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.655410:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b833cd lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1609 expref: 56 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.655419:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826423.655422:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787826423.655424:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165fe00, rc 0) 00000100:00100000:0.0:1787826423.655736:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c87840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+56:55703:x1874670563975808:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 9765us (10328us total) trans 8589935190 rc 0/0 00000100:00100000:0.0:1787826423.655747:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3990 00000100:00100000:3.0:1787826423.659062:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826423.660077:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563976192 00000100:00100000:0.0:1787826423.660093:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563976192 00000100:00100000:0.0:1787826423.660179:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3991 00000100:00100000:0.0:1787826423.660190:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03976580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+56:55703:x1874670563976192:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826423.660225:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826423.660255:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b833db lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1610 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.661385:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b833e2 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.661407:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b833e2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.661419:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b833e2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826423.661431:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x3e:0x0]: returning size 0 00010000:00010000:0.0:1787826423.662076:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b833db lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1610 expref: 59 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.662109:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b833e2 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1610 expref: 58 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.662121:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3e:0x0].0x0 (ffff90ce036ca900) 00010000:00010000:0.0:1787826423.662136:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826423.662141:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165ec00, rc 0) 00000100:00100000:0.0:1787826423.662235:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03976580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:55703:x1874670563976192:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 2045us (3187us total) trans 8589935191 rc 0/0 00000100:00100000:0.0:1787826423.662245:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3991 00000100:00100000:2.0:1787826423.670237:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826423.670513:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563976448 00000100:00100000:3.0:1787826423.670526:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563976448 00000100:00100000:3.0:1787826423.670597:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3992 00000100:00100000:3.0:1787826423.670610:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:55703:x1874670563976448:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826423.670643:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826423.670672:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b833f0 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1617 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.671004:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b833f7 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.671022:0:16564:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b833e2 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1610 expref: 59 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.671032:0:16564:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b833f7 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x3e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.671075:0:16564:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b833e2 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1610 expref: 59 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.671093:0:16564:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b833e2 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1610 expref: 59 pid: 6519 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826423.671112:0:16564:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce039770c0 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:16564:1874670585283712:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826423.671396:0:16564:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3180 going to sleep for 11 seconds 00000100:00100000:2.0:1787826423.674512:0:16564:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce039770c0 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:16564:1874670585283712:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826423.674553:0:16564:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b833f7 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x3e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826423.675175:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826423.677599:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563976576 00000100:00100000:0.0:1787826423.677623:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563976576 00010000:00010000:0.0:1787826423.677689:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b833e2 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1610 expref: 60 pid: 6519 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826423.677913:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1280 00000100:00100000:0.0:1787826423.677926:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03977c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:2404:x1874670563976576:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826423.677946:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826423.677954:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b833e2 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1610 expref: 60 pid: 6519 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.677970:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b833e2 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1610 expref: 60 pid: 6519 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.677999:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b833e2 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1610 expref: 60 pid: 6519 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.678017:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3e:0x0].0x0 (ffff90ce036ca900) 00010000:00010000:0.0:1787826423.678023:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b833f7 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x3e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.678034:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b833f7 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.678043:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b833f7 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x3e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.678078:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826423.678171:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03977c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:2404:x1874670563976576:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 248us (3000us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826423.678180:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1280 00010000:00010000:2.0:1787826423.678246:0:16564:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b833f7 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.678256:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b833f7 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826423.678280:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x3e:0x0]: returning size 0 00000004:00080000:2.0:1787826423.678534:0:16564:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x10d:0x0], index 0: 0 00010000:00010000:2.0:1787826423.678668:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b833f7 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.678676:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b833f7 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x3e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.678684:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b833f7 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x3e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.678691:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826423.678695:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b833f7 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x3e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.678715:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b833f7 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x3e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.678729:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3e:0x0].0x0 (ffff90ce036ca900) 00010000:00010000:2.0:1787826423.678733:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826423.678738:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b833f7 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x3e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.678743:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b833f7 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x3e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.679150:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b833f0 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x3e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1617 expref: 59 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.679163:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3e:0x0].0x0 (ffff90ce036ca900) 00010000:00010000:2.0:1787826423.679166:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787826423.679170:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b833f0 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x3e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1617 expref: 59 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.679193:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400400, rc 0) 00000100:00100000:2.0:1787826423.679250:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:55703:x1874670563976448:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 8643us (9029us total) trans 8589935192 rc 301/301 00000100:00100000:2.0:1787826423.679258:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3992 00000100:00100000:3.0:1787826423.685842:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826423.687209:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563976832 00000100:00100000:2.0:1787826423.687226:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563976832 00000100:00100000:1.0:1787826423.687409:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1238 00000100:00100000:1.0:1787826423.687424:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce039770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:55703:x1874670563976832:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:1.0:1787826423.687843:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce039770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55703:x1874670563976832:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 421us (2014us total) trans 8589935193 rc 0/0 00000100:00100000:1.0:1787826423.687852:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1238 00000100:00100000:1.0:1787826423.691011:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826423.691227:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563976960 00000100:00100000:2.0:1787826423.691241:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563976960 00000100:00100000:2.0:1787826423.691328:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3993 00000100:00100000:2.0:1787826423.691340:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01dfc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55703:x1874670563976960:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826423.691374:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826423.691403:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83405 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab161e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.691600:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b8340c lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.691620:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b833cd lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1609 expref: 60 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.691631:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b8340c lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.691676:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b833cd lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1609 expref: 60 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.691692:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b833cd lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1609 expref: 60 pid: 9966 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826423.691710:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf41c870c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1874670585283840:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826423.692062:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3ab4c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826423.698408:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826423.700302:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563977088 00000100:00100000:1.0:1787826423.700322:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563977088 00010000:00010000:1.0:1787826423.700393:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b833cd lrc: 5/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1609 expref: 61 pid: 9966 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826423.700451:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1281 00000100:00100000:1.0:1787826423.700463:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c84b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+61:2403:x1874670563977088:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826423.700513:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826423.700522:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b833cd lrc: 5/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1609 expref: 61 pid: 9966 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.700537:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b833cd lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1609 expref: 61 pid: 9966 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.700569:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826423.700575:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b8340c lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.700588:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b8340c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.700597:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b8340c lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.700624:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826423.700721:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c84b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+61:2403:x1874670563977088:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 259us (2328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826423.700731:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1281 00010000:00010000:0.0:1787826423.702752:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b833cd lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1609 expref: 60 pid: 9966 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826423.702786:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf41c870c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1874670585283840:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826423.702817:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b8340c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.702828:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b8340c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.702835:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b8340c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826423.702908:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:0.0:1787826423.702914:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826423.702940:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b8340c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.702985:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83405 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab161e expref: 60 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.703003:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b8340c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab161e expref: 59 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.703014:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826423.703017:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826423.703020:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834a00, rc 0) 00000100:00100000:0.0:1787826423.703097:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01dfc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55703:x1874670563976960:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 11759us (12103us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826423.703106:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3993 00000100:00100000:3.0:1787826423.706914:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826423.707112:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563977216 00000100:00100000:0.0:1787826423.707134:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563977216 00000100:00100000:0.0:1787826423.707207:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2231 00000100:00100000:0.0:1787826423.707217:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03977840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563977216:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826423.707240:0:30694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826423.707263:0:30694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003bd432a2/0x22153cd396b83413 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1625 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826423.707345:0:30694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03a1a580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:30694:1874670585283968:192.168.203.39@tcp:106: 00000100:00100000:0.0:1787826423.707451:0:30694:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f67e180 going to sleep for 11 seconds 00000100:00100000:0.0:1787826423.710934:0:30694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03a1a580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:30694:1874670585283968:192.168.203.39@tcp:106: 00010000:00010000:0.0:1787826423.710990:0:30694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003bd432a2/0x22153cd396b83413 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1625 expref: 11 pid: 30694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.711024:0:30694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003bd432a2/0x22153cd396b83413 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1625 expref: 11 pid: 30694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.711040:0:30694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165ec00, rc 0) 00000100:00100000:0.0:1787826423.711425:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03977840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563977216:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 4207us (4525us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826423.711438:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2231 00000100:00100000:3.0:1787826423.721254:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826423.721893:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563977344 00000100:00100000:0.0:1787826423.721907:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563977344 00000100:00100000:0.0:1787826423.721986:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3994 00000100:00100000:0.0:1787826423.721998:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136d4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55703:x1874670563977344:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826423.722030:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826423.722058:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8341a lrc: 2/0,0 mode: --/CR res: [0x200000405:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab162c expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.722166:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b83421 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.722185:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b83421 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x3e:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.722198:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b83421 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x3e:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826423.722257:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x3e:0x0]: returning size 0 00000004:00200000:0.0:1787826423.722262:0:9966:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826423.722286:0:9966:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b83421 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x3e:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.722320:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8341a lrc: 0/0,0 mode: --/CR res: [0x200000405:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab162c expref: 61 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.722340:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b83421 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x3e:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab162c expref: 60 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.722351:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3e:0x0].0x0 (ffff90ce036ca100) 00010000:00010000:0.0:1787826423.722354:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787826423.722358:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165e400, rc 0) 00000100:00100000:0.0:1787826423.722436:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136d4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:55703:x1874670563977344:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 440us (1197us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826423.722444:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3994 00000100:00100000:3.0:1787826423.731977:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826423.735605:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563977472 00000100:00100000:1.0:1787826423.735627:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563977472 00000100:00100000:1.0:1787826423.735913:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2232 00000100:00100000:1.0:1787826423.735926:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136d43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2402:x1874670563977472:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826423.735951:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826423.735976:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065f23c08/0x22153cd396b83428 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x10d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1633 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826423.736009:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826423.736035:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10d:0x0].0x0 since=1369s v=(0 0) 00010000:00010000:1.0:1787826423.736041:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826423.736051:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065f23c08/0x22153cd396b83428 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1633 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.736072:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065f23c08/0x22153cd396b83428 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1633 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.736087:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46a800, rc 0) 00000100:00100000:1.0:1787826423.736183:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136d43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2402:x1874670563977472:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 260us (4222us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826423.736190:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2232 00000100:00100000:3.0:1787826423.743084:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826423.743366:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563977728 00000100:00100000:0.0:1787826423.743379:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563977728 00000100:00100000:0.0:1787826423.743459:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3995 00000100:00100000:0.0:1787826423.743507:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:55703:x1874670563977728:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826423.743768:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826423.743800:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8342f lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab163a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.743944:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b83436 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.743963:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b83436 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.743978:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b83436 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826423.743993:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:0.0:1787826423.744141:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8342f lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab163a expref: 63 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.744163:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b83436 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab163a expref: 62 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.744174:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826423.744177:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787826423.744181:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165ec00, rc 0) 00000100:00100000:0.0:1787826423.744263:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+62:55703:x1874670563977728:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 795us (1194us total) trans 8589935194 rc 0/0 00000100:00100000:0.0:1787826423.744275:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3995 00000100:00100000:2.0:1787826423.749159:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826423.750382:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563977856 00000100:00100000:1.0:1787826423.750399:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563977856 00000100:00100000:1.0:1787826423.750519:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2233 00000100:00100000:1.0:1787826423.750532:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c87c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670563977856:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826423.750557:0:30398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826423.750581:0:30398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8fb1ffc/0x22153cd396b83444 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1641 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826423.750666:0:30398:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01dff480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:30398:1874670585284096:192.168.203.39@tcp:106: 00000100:00100000:1.0:1787826423.750777:0:30398:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce01ef9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826423.756407:0:30398:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01dff480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:30398:1874670585284096:192.168.203.39@tcp:106: 00010000:00010000:1.0:1787826423.756461:0:30398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a8fb1ffc/0x22153cd396b83444 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1641 expref: 11 pid: 30398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.756527:0:30398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8fb1ffc/0x22153cd396b83444 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1641 expref: 11 pid: 30398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.756544:0:30398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46ac00, rc 0) 00000100:00100000:1.0:1787826423.756612:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c87c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670563977856:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 6080us (7468us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826423.756622:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2233 00000100:00100000:2.0:1787826423.763741:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826423.767488:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563977984 00000100:00100000:1.0:1787826423.767507:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563977984 00000100:00100000:1.0:1787826423.767588:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2234 00000100:00100000:1.0:1787826423.767598:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c86d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563977984:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826423.767621:0:8545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826423.767644:0:8545:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bacf1a1a/0x22153cd396b8344b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1648 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826423.767722:0:8545:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01dff480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8545:1874670585284224:192.168.203.39@tcp:106: 00000100:00100000:1.0:1787826423.767835:0:8545:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce01ef9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826423.774785:0:8545:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01dff480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8545:1874670585284224:192.168.203.39@tcp:106: 00010000:00010000:1.0:1787826423.774842:0:8545:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bacf1a1a/0x22153cd396b8344b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1648 expref: 11 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.774876:0:8545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bacf1a1a/0x22153cd396b8344b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1648 expref: 11 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.774893:0:8545:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46b200, rc 0) 00000100:00100000:1.0:1787826423.775012:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c86d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563977984:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 7412us (11285us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826423.775025:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2234 00000100:00100000:0.0:1787826423.783948:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826423.784059:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563978112 00000100:00100000:2.0:1787826423.784072:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563978112 00000100:00100000:2.0:1787826423.784186:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2235 00000100:00100000:2.0:1787826423.784199:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a1a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563978112:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:2.0:1787826423.784261:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008c800962/0x22153cd396b83452 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.784285:0:14864:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002904bac2/0x22153cd396b8327d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15a0 expref: 10 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.784294:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x10d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826423.784299:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826423.784304:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c800962/0x22153cd396b83452 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.784351:0:14864:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002904bac2/0x22153cd396b8327d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15a0 expref: 10 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.784368:0:14864:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002904bac2/0x22153cd396b8327d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15a0 expref: 10 pid: 14864 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826423.784390:0:14864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf41c870c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14864:1874670585284352:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826423.784621:0:14864:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3ab4ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826423.793060:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826423.793217:0:14864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf41c870c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14864:1874670585284352:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826423.793256:0:14864:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008c800962/0x22153cd396b83452 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826423.795807:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563978240 00000100:00100000:1.0:1787826423.795825:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563978240 00010000:00010000:0.0:1787826423.798611:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002904bac2/0x22153cd396b8327d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15a0 expref: 11 pid: 14864 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826423.798685:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1282 00000100:00100000:0.0:1787826423.798698:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f80b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2404:x1874670563978240:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826423.798720:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826423.798751:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002904bac2/0x22153cd396b8327d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x10d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15a0 expref: 11 pid: 14864 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.798769:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002904bac2/0x22153cd396b8327d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15a0 expref: 11 pid: 14864 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.798802:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002904bac2/0x22153cd396b8327d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15a0 expref: 11 pid: 14864 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.798825:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826423.798831:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826423.798838:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008c800962/0x22153cd396b83452 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.798851:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c800962/0x22153cd396b83452 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.798976:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826423.799068:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f80b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563978240:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 372us (6023us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826423.799078:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1282 00010000:00010000:2.0:1787826423.803664:0:14864:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008c800962/0x22153cd396b83452 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x10d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.803690:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c800962/0x22153cd396b83452 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x10d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.803734:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008c800962/0x22153cd396b83452 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x10d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.803745:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c800962/0x22153cd396b83452 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x10d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.803754:0:14864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c800962/0x22153cd396b83452 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.803762:0:14864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834800 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826423.803767:0:14864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c800962/0x22153cd396b83452 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.803777:0:14864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c800962/0x22153cd396b83452 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x10d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.803809:0:14864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c800962/0x22153cd396b83452 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x10d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.803818:0:14864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c800962/0x22153cd396b83452 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x10d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826423.803998:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a1a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563978112:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 19794us (20058us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826423.804011:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2235 00000100:00100000:2.0:1787826423.813517:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826423.817436:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563978368 00000100:00100000:3.0:1787826423.817457:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563978368 00000100:00100000:3.0:1787826423.817619:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2236 00000100:00100000:3.0:1787826423.817632:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f80b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670563978368:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826423.817657:0:30695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826423.817683:0:30695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd505040/0x22153cd396b83459 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x10d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab164f expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787826423.817721:0:30695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10d:0x0] initial LVB size: 0, mtime: 0x6a9010ec, atime: 0x6a9010ec, ctime: 0x6a9010f7, blocks: 0x0 00010000:00010000:3.0:1787826423.817750:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10d:0x0].0x0 since=1369s v=(0 0) 00010000:00010000:3.0:1787826423.817756:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826423.817768:0:30695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd505040/0x22153cd396b83459 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab164f expref: 10 pid: 30695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.817789:0:30695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fd505040/0x22153cd396b83459 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab164f expref: 10 pid: 30695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.817812:0:30695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401800, rc 0) 00000100:00100000:3.0:1787826423.817905:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f80b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670563978368:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 275us (4404us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826423.817913:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2236 00000100:00100000:0.0:1787826423.887311:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826423.887595:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563978496 00000100:00100000:2.0:1787826423.887615:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563978496 00000100:00100000:2.0:1787826423.887714:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3996 00000100:00100000:2.0:1787826423.887733:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+62:55703:x1874670563978496:12345-192.168.203.39@tcp:44:lfs.0 00000001:00080000:1.0:1787826423.890329:0:34481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935194 is committed 00000004:00080000:1.0:1787826423.890374:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 32 committed 00000020:00080000:1.0:1787826423.890422:0:34481:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90ce057f69c0 refcount 2 committed 0 result 0 batchid 4294969344 00000020:00080000:1.0:1787826423.890428:0:34481:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cf092f4500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90ce057f6cc0 00000020:00080000:1.0:1787826423.890432:0:34481:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cf092f4900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90cf06459600 00000020:00080000:1.0:1787826423.890453:0:34481:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969343 batchid updated 00010000:00010000:3.0:1787826423.890627:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8326f lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.890641:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8326f lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.890649:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8326f lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.890656:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826423.890661:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8326f lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.890670:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8326f lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.890691:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3c:0x0].0x0 (ffff90cf39e67300) 00010000:00010000:3.0:1787826423.890694:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826423.890699:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8326f lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.890707:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8326f lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.890741:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b83284 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.890750:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b83284 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.890756:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b83284 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.890761:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46a600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826423.890764:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b83284 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.890769:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b83284 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.890777:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826423.890779:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826423.890782:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b83284 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.890788:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b83284 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787826423.890995:0:34512:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969344 committed batchid 4294969343 00000100:00100000:3.0:1787826423.891015:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787826423.891039:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f809a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585284480:0@lo:6:osp-syn-0-0.0 00000020:00080000:0.0:1787826423.891089:0:34512:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969343 00000100:00100000:3.0:1787826423.891146:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826423.891223:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585284480 00000100:00100000:3.0:1787826423.891230:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585284480 00000100:00100000:3.0:1787826423.891281:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2237 00000100:00100000:3.0:1787826423.891290:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136d61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874670585284480:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787826423.891318:0:8436:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:268 count 1 00010000:00010000:3.0:1787826423.891342:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b83460 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.891364:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000381c17db/0x22153cd396b8328b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15a7 expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.891372:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x10c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826423.891377:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826423.891381:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b83460 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.891407:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000381c17db/0x22153cd396b8328b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15a7 expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.891421:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000381c17db/0x22153cd396b8328b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15a7 expref: 7 pid: 8436 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826423.891432:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf136d5680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1874670585284608:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826423.898276:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787826423.898862:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:55703:x1874670563978496:12345-192.168.203.39@tcp:44:lfs.0 Request processed in 11131us (11579us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826423.898874:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3996 00000100:00100000:1.0:1787826423.904583:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826423.904662:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826423.904778:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf136d5680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1874670585284608:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826423.904803:0:8436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b83460 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826423.904877:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563978624 00000100:00100000:3.0:1787826423.904884:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563978624 00000100:00100000:3.0:1787826423.904933:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2238 00000100:00100000:3.0:1787826423.904942:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01dff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2403:x1874670563978624:12345-192.168.203.39@tcp:16:lfs.0 00000100:00100000:3.0:1787826423.905042:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01dff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2403:x1874670563978624:12345-192.168.203.39@tcp:16:lfs.0 Request processed in 101us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826423.905050:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2238 00000100:00100000:2.0:1787826423.905271:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563978752 00000100:00100000:2.0:1787826423.905276:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563978752 00010000:00010000:2.0:1787826423.905297:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000381c17db/0x22153cd396b8328b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15a7 expref: 8 pid: 8436 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826423.905342:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1283 00000100:00100000:2.0:1787826423.905350:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01dfda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2403:x1874670563978752:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826423.905363:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826423.905369:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000381c17db/0x22153cd396b8328b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x10c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15a7 expref: 8 pid: 8436 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.905382:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000381c17db/0x22153cd396b8328b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15a7 expref: 8 pid: 8436 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.905404:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000381c17db/0x22153cd396b8328b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15a7 expref: 8 pid: 8436 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.905420:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826423.905425:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826423.905432:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b83460 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.905441:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b83460 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x10c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.905499:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826423.905526:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01dfda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2403:x1874670563978752:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 176us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826423.905532:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1283 00010000:00010000:0.0:1787826423.905725:0:8436:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b83460 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.905734:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b83460 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.905743:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b83460 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.905750:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b83460 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.905776:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787826423.905929:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136d61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1874670585284480:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14639us (14789us total) trans 21474837023 rc 0/0 00000100:00100000:0.0:1787826423.905936:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2237 00000004:00080000:3.0:1787826423.906034:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf3f809a40/2, rc 0, transno 21474837023 00000100:00100000:3.0:1787826423.906041:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f809a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585284480:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1787826423.906581:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826423.906588:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b83460 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.906603:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400c00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826423.906607:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b83460 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.906617:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b83460 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.906633:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b83460 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.906640:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab7f18ae/0x22153cd396b83460 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.906660:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826423.906661:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826423.906663:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826423.933569:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826423.933701:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563978880 00000100:00100000:0.0:1787826423.933710:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563978880 00000100:00100000:0.0:1787826423.933764:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2239 00000100:00100000:0.0:1787826423.933773:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01dfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2401:x1874670563978880:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:0.0:1787826423.933813:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002972f1b9/0x22153cd396b83467 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.933830:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826423.933834:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826423.933840:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002972f1b9/0x22153cd396b83467 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.933853:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002972f1b9/0x22153cd396b83467 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.933877:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002972f1b9/0x22153cd396b83467 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.933885:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002972f1b9/0x22153cd396b83467 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.933899:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002972f1b9/0x22153cd396b83467 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.933906:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165ea00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826423.933910:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002972f1b9/0x22153cd396b83467 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.933919:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002972f1b9/0x22153cd396b83467 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.933933:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002972f1b9/0x22153cd396b83467 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.933941:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002972f1b9/0x22153cd396b83467 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826423.934071:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01dfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2401:x1874670563978880:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 298us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826423.934079:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2239 00000100:00100000:2.0:1787826423.944578:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826423.944705:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563979136 00000100:00100000:0.0:1787826423.944716:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563979136 00000100:00100000:0.0:1787826423.944810:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3997 00000100:00100000:0.0:1787826423.944820:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f809e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:55703:x1874670563979136:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:0.0:1787826423.944871:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826423.944900:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b83421 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x3e:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab162c expref: 33 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.944918:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3e:0x0].0x0 (ffff90ce036ca100) 00010000:00010000:0.0:1787826423.944928:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826423.944961:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b8346e lrc: 3/0,1 mode: --/PW res: [0x200000405:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.944974:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b8346e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.944984:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b8346e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826423.945100:0:6518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000f7d440b reply state 000000002c7e2585 transno 8589935195 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b8346e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.945114:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b8346e lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826423.945134:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3e:0x0].0x0 (ffff90ce036ca800) 00010000:00010000:0.0:1787826423.945137:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826423.945140:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787826423.945245:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f809e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:55703:x1874670563979136:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 426us (677us total) trans 8589935195 rc 0/0 00000100:00100000:0.0:1787826423.945252:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3997 00000100:00100000:3.0:1787826423.949594:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826423.949845:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563979264 00000100:00100000:1.0:1787826423.949854:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563979264 00000100:00100000:1.0:1787826423.950432:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3998 00000100:00100000:1.0:1787826423.950443:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:55703:x1874670563979264:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826423.950509:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826423.950690:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b83475 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1656 expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.950760:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b83475 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x3e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1656 expref: 35 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.950774:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b83475 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x3e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1656 expref: 35 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.950792:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3e:0x0].0x0 (ffff90ce036ca800) 00010000:00010000:1.0:1787826423.950795:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826423.950799:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46b400, rc 0) 00000100:00100000:1.0:1787826423.950861:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:55703:x1874670563979264:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 421us (1276us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826423.950868:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3998 00000100:00100000:1.0:1787826423.952943:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826423.953046:0:34485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563979392 00000100:00100000:2.0:1787826423.953055:0:34485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563979392 00000100:00100000:2.0:1787826423.953112:0:34485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 104 00000100:00100000:2.0:1787826423.953132:0:34485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf2f426c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:307626ff-a376-4faf-93e0-9f55b723d964+10:2403:x1874670563979392:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1787826423.953204:0:34485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf2f426c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:307626ff-a376-4faf-93e0-9f55b723d964+10:2403:x1874670563979392:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 84us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826423.953212:0:34485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 104 00000100:00100000:2.0:1787826423.954156:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826423.954230:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563979520 00000100:00100000:0.0:1787826423.954238:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563979520 00000100:00100000:0.0:1787826423.954304:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1596 00000100:00100000:0.0:1787826423.954323:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f80a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:2404:x1874670563979520:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1787826423.954387:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f80a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:2404:x1874670563979520:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 66us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826423.954393:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1596 00000100:00080000:2.0:1787826423.954616:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787826423.957946:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826423.958052:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563979648 00000100:00100000:1.0:1787826423.958061:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563979648 00000100:00100000:1.0:1787826423.958131:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2240 00000100:00100000:1.0:1787826423.958141:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a18f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:55703:x1874670563979648:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826423.958158:0:30696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826423.958175:0:30696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003eb46645/0x22153cd396b8347c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab165d expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.958206:0:30696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065f23c08/0x22153cd396b83428 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1633 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.958220:0:30696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826423.958225:0:30696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826423.958230:0:30696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003eb46645/0x22153cd396b8347c lrc: 4/0,0 mode: --/PW res: [0x280000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab165d expref: 8 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.958267:0:30696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000065f23c08/0x22153cd396b83428 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1633 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.958280:0:30696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000065f23c08/0x22153cd396b83428 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1633 expref: 8 pid: 8437 timeout: 1469 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826423.958294:0:30696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01dff0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:30696:1874670585284736:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826423.959224:0:30696:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce01ef9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826423.962864:0:30696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01dff0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:30696:1874670585284736:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826423.962901:0:30696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003eb46645/0x22153cd396b8347c lrc: 3/0,0 mode: --/PW res: [0x280000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab165d expref: 8 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.962921:0:30696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46ba00, rc 0) 00000100:00100000:0.0:1787826423.962988:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826423.962989:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a18f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:55703:x1874670563979648:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 4850us (5052us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826423.962998:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2240 00000100:00100000:3.0:1787826423.963440:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563979776 00000100:00100000:3.0:1787826423.963447:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563979776 00010000:00010000:3.0:1787826423.963559:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000065f23c08/0x22153cd396b83428 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1633 expref: 8 pid: 8437 timeout: 1469 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826423.963621:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1284 00000100:00100000:3.0:1787826423.963630:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf181fc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2403:x1874670563979776:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826423.963643:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826423.963664:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000065f23c08/0x22153cd396b83428 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x10d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1633 expref: 8 pid: 8437 timeout: 1469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.963676:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000065f23c08/0x22153cd396b83428 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1633 expref: 8 pid: 8437 timeout: 1469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.963699:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065f23c08/0x22153cd396b83428 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x10d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1633 expref: 8 pid: 8437 timeout: 1469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.963714:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826423.963719:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826423.963725:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003eb46645/0x22153cd396b8347c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab165d expref: 7 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.963735:0:10340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003eb46645/0x22153cd396b8347c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab165d expref: 7 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.963780:0:10340:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003eb46645/0x22153cd396b8347c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab165d expref: 7 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826423.963794:0:10340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf136d5a40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10340:1874670585284864:192.168.203.39@tcp:105: 00000100:00100000:3.0:1787826423.963863:0:10340:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3900 going to sleep for 11 seconds 00000100:00100000:2.0:1787826423.966521:0:10340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf136d5a40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10340:1874670585284864:192.168.203.39@tcp:105: 00010000:00010000:2.0:1787826423.966547:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826423.966588:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf181fc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2403:x1874670563979776:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 2959us (3601us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826423.966598:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1284 00000100:00100000:1.0:1787826423.968340:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826423.968795:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563979904 00000100:00100000:2.0:1787826423.968804:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563979904 00000100:00100000:2.0:1787826423.968856:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2241 00000100:00100000:2.0:1787826423.968866:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01dff0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2403:x1874670563979904:12345-192.168.203.39@tcp:2:lfs.0 00002000:00010000:2.0:1787826423.969021:0:30694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x10d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787826423.969024:0:30694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x10d:0x0] updating lvb mtime from disk: 0 -> 1787826412 00002000:00010000:2.0:1787826423.969027:0:30694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x10d:0x0] updating lvb atime from disk: 0 -> 1787826412 00002000:00010000:2.0:1787826423.969029:0:30694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x10d:0x0] updating lvb ctime from disk: 0 -> 1787826424 00002000:00010000:2.0:1787826423.969031:0:30694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x10d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1787826423.969079:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01dff0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2403:x1874670563979904:12345-192.168.203.39@tcp:2:lfs.0 Request processed in 215us (745us total) trans 21474837024 rc 0/0 00000100:00100000:2.0:1787826423.969087:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2241 00000100:00100000:0.0:1787826423.973589:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826423.973693:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563980160 00000100:00100000:2.0:1787826423.973702:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563980160 00000100:00100000:2.0:1787826423.973868:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3999 00000100:00100000:2.0:1787826423.973878:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a18b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:55703:x1874670563980160:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:2.0:1787826423.973928:0:16564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826423.973955:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b8340c lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab161e expref: 35 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.973980:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826423.973985:0:16564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826423.974031:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b83483 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.974046:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b83483 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.974056:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b83483 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826423.974161:0:16564:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006ab0dc6f reply state 000000009b9fd7d4 transno 8589935196 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b83483 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.974172:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b83483 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.974179:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826423.974181:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826423.974184:0:16564:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826423.974268:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a18b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55703:x1874670563980160:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 391us (689us total) trans 8589935196 rc 0/0 00000100:00100000:2.0:1787826423.974275:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3999 00000100:00100000:0.0:1787826423.977166:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826423.977256:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563980288 00000100:00100000:1.0:1787826423.977265:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563980288 00000100:00100000:1.0:1787826423.977324:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2242 00000100:00100000:1.0:1787826423.977335:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c84b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:55703:x1874670563980288:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826423.977352:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826423.977370:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000421aa0a2/0x22153cd396b8348a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1664 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.977400:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fd505040/0x22153cd396b83459 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab164f expref: 11 pid: 30695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.977410:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826423.977414:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826423.977420:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000421aa0a2/0x22153cd396b8348a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1664 expref: 11 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.977451:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fd505040/0x22153cd396b83459 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab164f expref: 11 pid: 30695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.977464:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fd505040/0x22153cd396b83459 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab164f expref: 11 pid: 30695 timeout: 1469 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826423.977504:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01dfde00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1874670585284992:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826423.977572:0:8437:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce01ef9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787826423.981079:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826423.981170:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563980416 00000100:00100000:2.0:1787826423.981176:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563980416 00000100:00100000:3.0:1787826423.981189:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01dfde00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1874670585284992:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826423.981217:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000421aa0a2/0x22153cd396b8348a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x10d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1664 expref: 12 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.981218:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fd505040/0x22153cd396b83459 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x10d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab164f expref: 12 pid: 30695 timeout: 1469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.981237:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46bc00, rc 0) 00000100:00100000:2.0:1787826423.981259:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1285 00000100:00100000:2.0:1787826423.981267:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01dfcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563980416:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826423.981289:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787826423.981293:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c84b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:55703:x1874670563980288:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 3961us (4137us total) trans 0 rc 0/0 00010000:00010000:2.0:1787826423.981309:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fd505040/0x22153cd396b83459 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x10d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab164f expref: 12 pid: 30695 timeout: 1469 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826423.981312:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2242 00010000:00010000:2.0:1787826423.981322:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fd505040/0x22153cd396b83459 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab164f expref: 12 pid: 30695 timeout: 1469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.981344:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd505040/0x22153cd396b83459 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x10d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab164f expref: 11 pid: 30695 timeout: 1469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.981359:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826423.981363:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826423.981369:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000421aa0a2/0x22153cd396b8348a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1664 expref: 10 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.981380:0:10341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000421aa0a2/0x22153cd396b8348a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1664 expref: 10 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826423.981411:0:10341:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000421aa0a2/0x22153cd396b8348a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1664 expref: 10 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826423.981424:0:10341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f80b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10341:1874670585285120:192.168.203.39@tcp:105: 00000100:00100000:2.0:1787826423.981521:0:10341:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf137f3f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826423.986096:0:10341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f80b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10341:1874670585285120:192.168.203.39@tcp:105: 00010000:00010000:2.0:1787826423.986131:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826423.986188:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01dfcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563980416:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4920us (5118us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826423.986198:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1285 00000100:00100000:1.0:1787826423.990958:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826423.991054:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563980544 00000100:00100000:0.0:1787826423.991064:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563980544 00000100:00100000:0.0:1787826423.991130:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2243 00000100:00100000:0.0:1787826423.991141:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01dfe580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670563980544:12345-192.168.203.39@tcp:2:lfs.0 00002000:00010000:0.0:1787826423.991281:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x10d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787826423.991285:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x10d:0x0] updating lvb mtime from disk: 1787826412 -> 1787826412 00002000:00010000:0.0:1787826423.991287:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x10d:0x0] updating lvb atime from disk: 1787826412 -> 1787826412 00002000:00010000:0.0:1787826423.991290:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x10d:0x0] updating lvb ctime from disk: 1787826423 -> 1787826424 00002000:00010000:0.0:1787826423.991292:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x10d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1787826423.991360:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01dfe580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2403:x1874670563980544:12345-192.168.203.39@tcp:2:lfs.0 Request processed in 221us (412us total) trans 17179869683 rc 0/0 00000100:00100000:0.0:1787826423.991367:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2243 00000100:00100000:1.0:1787826423.994540:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826423.994618:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563980800 00000100:00100000:3.0:1787826423.994627:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563980800 00000100:00100000:3.0:1787826423.994677:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1239 00000100:00100000:3.0:1787826423.994686:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eea1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55703:x1874670563980800:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:3.0:1787826423.994771:0:14257:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000405:0x1d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b83436 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab163a expref: 36 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.994810:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b83491 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.994823:0:14257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b83364 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15e6 expref: 36 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.994832:0:14257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b833b1 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15fb expref: 36 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.994840:0:14257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b83491 lrc: 5/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.994870:0:14257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b833b1 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15fb expref: 36 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.994882:0:14257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b833b1 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15fb expref: 36 pid: 6518 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826423.994895:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf136d6940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585285248:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826423.994964:0:14257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b83364 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15e6 expref: 36 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826423.994973:0:14257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b83364 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15e6 expref: 36 pid: 6520 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826423.994982:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf136d7840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585285376:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826423.995001:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3780 going to sleep for 11 seconds 00000100:00100000:2.0:1787826423.998266:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826423.998319:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826423.998597:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563981184 00000100:00100000:1.0:1787826423.998608:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563981184 00010000:00010000:1.0:1787826423.998647:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b83364 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15e6 expref: 37 pid: 6520 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826423.998693:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1286 00000100:00100000:1.0:1787826423.998703:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f80ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:2403:x1874670563981184:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826423.998718:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826423.998725:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b83364 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15e6 expref: 37 pid: 6520 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.998737:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b83364 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15e6 expref: 37 pid: 6520 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.998773:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826423.998779:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b83491 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.998788:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b83491 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826423.998793:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826423.998843:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f80ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:2403:x1874670563981184:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 142us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826423.998851:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1286 00000100:00100000:3.0:1787826423.999348:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf136d6940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585285248:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826423.999362:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b83364 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15e6 expref: 36 pid: 6520 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826423.999384:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf136d7840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585285376:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826423.999407:0:14257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b83491 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826424.000644:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563981056 00000100:00100000:0.0:1787826424.000654:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563981056 00000100:00100000:0.0:1787826424.000716:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1240 00000100:00100000:0.0:1787826424.000725:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f80b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:42220:x1874670563981056:12345-192.168.203.39@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787826424.000960:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f80b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:42220:x1874670563981056:12345-192.168.203.39@tcp:35:ldlm_bl.0 Request processed in 235us (2703us total) trans 8589935197 rc 0/0 00000100:00100000:0.0:1787826424.000971:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1240 00000100:00100000:2.0:1787826424.006976:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826424.007129:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563981312 00000100:00100000:3.0:1787826424.007139:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563981312 00010000:00010000:3.0:1787826424.007181:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b833b1 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15fb expref: 37 pid: 6518 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826424.007225:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1287 00000100:00100000:3.0:1787826424.007235:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f808b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:2404:x1874670563981312:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826424.007253:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826424.007260:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b833b1 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15fb expref: 37 pid: 6518 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.007274:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b833b1 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15fb expref: 37 pid: 6518 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.007297:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b833b1 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab15fb expref: 37 pid: 6518 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.007325:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826424.007331:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b83491 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.007340:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b83491 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.007349:0:10340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b83491 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.007378:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826424.007434:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f808b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:2404:x1874670563981312:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 200us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826424.007441:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1287 00010000:00010000:2.0:1787826424.007698:0:14257:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b83491 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.007706:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b83491 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.007727:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83498 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.007738:0:14257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b83475 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x3e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1656 expref: 35 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.007756:0:14257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83498 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x3e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.007786:0:14257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b83475 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x3e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1656 expref: 35 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.007798:0:14257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b83475 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x3e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1656 expref: 35 pid: 8247 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826424.007811:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f80a1c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585285504:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826424.007882:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf137f3f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787826424.020506:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f80a1c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585285504:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826424.020537:0:14257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83498 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x3e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826424.020622:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826424.020819:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563981440 00000100:00100000:1.0:1787826424.020826:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563981440 00010000:00010000:1.0:1787826424.020860:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b83475 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x3e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1656 expref: 36 pid: 8247 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826424.020910:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1288 00000100:00100000:1.0:1787826424.020919:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f80a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:2403:x1874670563981440:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826424.020934:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826424.020941:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b83475 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x3e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1656 expref: 36 pid: 8247 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.020952:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b83475 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x3e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1656 expref: 36 pid: 8247 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.020974:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b83475 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x3e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1656 expref: 36 pid: 8247 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.020989:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3e:0x0].0x0 (ffff90ce036ca800) 00010000:00010000:1.0:1787826424.020993:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83498 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x3e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.021002:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83498 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.021010:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83498 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x3e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.021039:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826424.021095:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f80a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:2403:x1874670563981440:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 177us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826424.021103:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1288 00010000:00010000:2.0:1787826424.021756:0:14257:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83498 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.021766:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83498 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826424.022046:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03975e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585285632:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1787826424.022094:0:14257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826424.022118:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3aaf50c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826424.022360:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585285632 00000100:00100000:1.0:1787826424.022366:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585285632 00000100:00100000:1.0:1787826424.022403:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1492 00000100:00100000:1.0:1787826424.022410:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf07dbf450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14257:x1874670585285632:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1787826424.022512:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf07dbf450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14257:x1874670585285632:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 101us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826424.022519:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1492 00000100:00100000:2.0:1787826424.023285:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03975e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585285632:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1787826424.023351:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03975e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585285760:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1787826424.023381:0:14257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826424.023406:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3aaf50c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826424.023596:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585285760 00000100:00100000:1.0:1787826424.023601:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585285760 00000100:00100000:1.0:1787826424.023639:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1493 00000100:00100000:1.0:1787826424.023647:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03977c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14257:x1874670585285760:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1787826424.023718:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03977c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14257:x1874670585285760:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 71us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826424.023725:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1493 00000100:00100000:2.0:1787826424.023859:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03975e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585285760:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:2.0:1787826424.023981:0:14257:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589935198 00000100:00100000:2.0:1787826424.024030:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03975e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585285888:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1787826424.024060:0:14257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826424.024109:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3aaf5480 going to sleep for 11 seconds 00000100:00100000:0.0:1787826424.025402:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585285888 00000100:00100000:0.0:1787826424.025420:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585285888 00000100:00100000:0.0:1787826424.025489:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1494 00000100:00100000:0.0:1787826424.025499:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:14257:x1874670585285888:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1787826424.026149:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:14257:x1874670585285888:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 650us (2086us total) trans 21474837025 rc 0/0 00000100:00100000:0.0:1787826424.026157:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1494 00000100:00100000:2.0:1787826424.026396:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03975e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585285888:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:2.0:1787826424.026556:0:14257:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589935199 00010000:00010000:2.0:1787826424.026590:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83498 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.026600:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83498 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x3e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.026612:0:14257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83498 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x3e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.026619:0:14257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826424.026623:0:14257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83498 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x3e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.026631:0:14257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83498 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x3e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.026856:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3e:0x0].0x0 (ffff90ce036ca800) 00010000:00010000:2.0:1787826424.026859:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787826424.026865:0:14257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83498 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x3e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.026871:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83498 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x3e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.026886:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b83491 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.026893:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b83491 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.026898:0:14257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b83491 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.026903:0:14257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826424.026906:0:14257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b83491 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.026914:0:14257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b83491 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.026922:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826424.026925:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787826424.026928:0:14257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b83491 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.026934:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b83491 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.026946:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826424.026949:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787826424.026955:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b83436 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab163a expref: 37 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826424.027102:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eea1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55703:x1874670563980800:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 32416us (32569us total) trans 8589935200 rc 0/0 00000100:00100000:2.0:1787826424.027111:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1239 00000020:00080000:2.0:1787826424.027115:0:14257:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1787826424.029627:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826424.029946:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563981568 00000100:00100000:0.0:1787826424.029956:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563981568 00000100:00100000:0.0:1787826424.030046:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4000 00000100:00100000:0.0:1787826424.030056:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce039770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55703:x1874670563981568:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826424.030079:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826424.030098:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b8349f lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab166b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.030164:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b8349f lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab166b expref: 37 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.030177:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b8349f lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab166b expref: 37 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.030196:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826424.030199:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826424.030203:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165f600, rc 0) 00000100:00100000:0.0:1787826424.030264:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce039770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:55703:x1874670563981568:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 210us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826424.030272:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4000 00000100:00100000:3.0:1787826424.034685:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826424.035275:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563981824 00000100:00100000:0.0:1787826424.035285:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563981824 00000100:00100000:0.0:1787826424.035528:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1241 00000100:00100000:0.0:1787826424.035539:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:55703:x1874670563981824:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:0.0:1787826424.035844:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:55703:x1874670563981824:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 303us (1376us total) trans 8589935201 rc 0/0 00000100:00100000:0.0:1787826424.035854:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1241 00000100:00100000:1.0:1787826424.038641:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826424.038890:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563982080 00000100:00100000:2.0:1787826424.038899:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563982080 00000100:00100000:2.0:1787826424.038954:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1242 00000100:00100000:2.0:1787826424.038965:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01dfc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:55703:x1874670563982080:12345-192.168.203.39@tcp:35:lfs.0 00000004:00080000:2.0:1787826424.039150:0:14257:0:(mdd_object.c:4014:mdd_close()) Object [0x200000405:0x3e:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:2.0:1787826424.039225:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b834a6 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.039245:0:14257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b834a6 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.039257:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b834a6 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.039265:0:14257:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b834a6 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.039272:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b834a6 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.039278:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b834a6 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.039504:0:14257:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787826424.039592:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01dfc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+39:55703:x1874670563982080:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 628us (957us total) trans 8589935202 rc 0/0 00000100:00100000:2.0:1787826424.039600:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1242 00010000:00010000:0.0:1787826424.040509:0:7460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826424.040520:0:7460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b834a6 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.040883:0:7460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835000 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826424.040888:0:7460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b834a6 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.040897:0:7460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b834a6 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.040913:0:7460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3e:0x0].0x0 (ffff90ce036ca800) 00010000:00010000:0.0:1787826424.040916:0:7460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787826424.040920:0:7460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b834a6 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.040926:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b834a6 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.040943:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826424.040945:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787826424.040948:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826424.082468:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826424.082611:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563982208 00000100:00100000:1.0:1787826424.082621:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563982208 00000100:00100000:1.0:1787826424.082671:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4001 00000100:00100000:1.0:1787826424.082681:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+39:55705:x1874670563982208:12345-192.168.203.39@tcp:101:getfattr.0 00010000:00010000:1.0:1787826424.082702:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826424.082724:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b834ad lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1672 expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.082792:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b834b4 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.082805:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b834b4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.082820:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b834b4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.082832:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b834bb lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.082839:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b834bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.082845:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b834bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.083012:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b834c2 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.083021:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b834c2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.083028:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b834c2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826424.083064:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:1.0:1787826424.083068:0:8247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826424.083085:0:8247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b834c2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.083095:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b834c2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.083104:0:8247:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b834b4 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.083115:0:8247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b834b4 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.083131:0:8247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b834b4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.083138:0:8247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b834b4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.083144:0:8247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46ac00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826424.083148:0:8247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b834b4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.083155:0:8247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b834b4 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.083166:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf04f8b400) 00010000:00010000:1.0:1787826424.083169:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826424.083173:0:8247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b834b4 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.083179:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b834b4 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.083193:0:8247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b834bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.083199:0:8247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b834bb lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.083205:0:8247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b834bb lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.083211:0:8247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46a400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826424.083214:0:8247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b834bb lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.083219:0:8247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b834bb lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.083225:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf04f8bb00) 00010000:00010000:1.0:1787826424.083228:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826424.083230:0:8247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b834bb lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.083236:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b834bb lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.083259:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b834ad lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1672 expref: 41 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.083272:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b834c2 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1672 expref: 40 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.083279:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826424.083281:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826424.083283:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46a600, rc 0) 00000100:00100000:1.0:1787826424.083342:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55705:x1874670563982208:12345-192.168.203.39@tcp:101:getfattr.0 Request processed in 662us (883us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826424.083349:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4001 00000100:00100000:3.0:1787826424.118719:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826424.118868:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563982336 00000100:00100000:1.0:1787826424.118879:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563982336 00000100:00100000:1.0:1787826424.118944:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4002 00000100:00100000:1.0:1787826424.118954:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55709:x1874670563982336:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:1.0:1787826424.119036:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b834c9 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.119054:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b834c9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.119066:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b834c9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.119081:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b834d0 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.119087:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b834d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.119093:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b834d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.119182:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b834d7 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.119190:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b834d7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.119199:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b834d7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826424.119243:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:1.0:1787826424.119247:0:32404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826424.119261:0:32404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b834d7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.119275:0:32404:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b834c9 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.119280:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b834c9 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.119286:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b834c9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.119292:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b834c9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.119297:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46b000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826424.119435:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b834c9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.119443:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b834c9 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.119455:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf04f8b400) 00010000:00010000:1.0:1787826424.119458:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826424.119463:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b834c9 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.119493:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b834c9 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.119513:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b834d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.119519:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b834d0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.119525:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b834d0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.119530:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46a400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826424.119532:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b834d0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.119538:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b834d0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.119544:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf04f8bb00) 00010000:00010000:1.0:1787826424.119547:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826424.119550:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b834d0 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.119555:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b834d0 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.119566:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b834d7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.119572:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b834d7 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.119577:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b834d7 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.119582:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46ac00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826424.119585:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b834d7 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.119594:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b834d7 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.119601:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826424.119603:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826424.119606:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b834d7 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.119612:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b834d7 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826424.119692:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55709:x1874670563982336:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 738us (980us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826424.119700:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4002 00010000:00010000:2.0:1787826424.131867:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826424.164362:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826424.164501:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563982592 00000100:00100000:0.0:1787826424.164510:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563982592 00000100:00100000:0.0:1787826424.164567:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4003 00000100:00100000:0.0:1787826424.164578:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9af840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55711:x1874670563982592:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826424.164597:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826424.164616:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b834de lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1679 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.164726:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b834e5 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.164741:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b834e5 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.164752:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b834e5 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826424.164761:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:0.0:1787826424.164871:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b834de lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1679 expref: 43 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.164891:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b834e5 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1679 expref: 42 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.164898:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826424.164901:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787826424.164904:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165ee00, rc 0) 00000100:00100000:0.0:1787826424.164969:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9af840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+42:55711:x1874670563982592:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 394us (616us total) trans 8589935203 rc 0/0 00000100:00100000:0.0:1787826424.164979:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4003 00000100:00100000:1.0:1787826424.178373:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826424.182063:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563982848 00000100:00100000:0.0:1787826424.182078:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563982848 00000100:00100000:0.0:1787826424.182168:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4004 00000100:00100000:0.0:1787826424.182180:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01dff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+42:55711:x1874670563982848:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826424.182206:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826424.182227:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b834f3 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1680 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.182354:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b834fa lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.182369:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b834c2 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1672 expref: 43 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.182379:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b834fa lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.182426:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b834c2 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1672 expref: 43 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.182441:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b834c2 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1672 expref: 43 pid: 8247 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826424.182455:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf41c870c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1874670585286016:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826424.182628:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f67e180 going to sleep for 11 seconds 00000100:00100000:2.0:1787826424.187892:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826424.187987:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563982976 00000100:00100000:3.0:1787826424.187996:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563982976 00010000:00010000:3.0:1787826424.188037:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b834c2 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1672 expref: 44 pid: 8247 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826424.188087:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1289 00000100:00100000:3.0:1787826424.188097:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:2403:x1874670563982976:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826424.188113:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826424.188119:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b834c2 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1672 expref: 44 pid: 8247 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.188142:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b834c2 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1672 expref: 44 pid: 8247 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.188171:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826424.188175:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b834fa lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.188184:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b834fa lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.188191:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b834fa lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.188210:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826424.188269:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:2403:x1874670563982976:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 173us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826424.188277:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1289 00010000:00010000:0.0:1787826424.188969:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b834c2 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1672 expref: 43 pid: 8247 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826424.188990:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf41c870c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1874670585286016:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826424.189013:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b834fa lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.189023:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b834fa lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.189029:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b834fa lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826424.189053:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:0.0:1787826424.189190:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b834f3 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1680 expref: 44 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.189207:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b834fa lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1680 expref: 43 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.189215:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826424.189217:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787826424.189220:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165e000, rc 0) 00000100:00100000:0.0:1787826424.189267:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01dff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55711:x1874670563982848:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 7089us (10903us total) trans 8589935204 rc 0/0 00000100:00100000:0.0:1787826424.189274:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4004 00000100:00100000:2.0:1787826424.192245:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826424.192413:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563983104 00000100:00100000:0.0:1787826424.192423:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563983104 00000100:00100000:0.0:1787826424.192553:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1243 00000100:00100000:0.0:1787826424.192564:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9ad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55711:x1874670563983104:12345-192.168.203.39@tcp:33:lfs.0 00000100:00100000:0.0:1787826424.192689:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9ad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55711:x1874670563983104:12345-192.168.203.39@tcp:33:lfs.0 Request processed in 129us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826424.192695:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1243 00000100:00100000:2.0:1787826424.194773:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826424.196002:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563983360 00000100:00100000:3.0:1787826424.196012:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563983360 00000100:00100000:3.0:1787826424.196070:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1244 00000100:00100000:3.0:1787826424.196083:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9ada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55711:x1874670563983360:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:3.0:1787826424.196811:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9ada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55711:x1874670563983360:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 729us (2042us total) trans 8589935205 rc 0/0 00000100:00100000:3.0:1787826424.196820:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1244 00000100:00100000:2.0:1787826424.201203:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826424.201272:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563983616 00000100:00100000:0.0:1787826424.201335:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563983616 00000100:00100000:0.0:1787826424.201401:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4005 00000100:00100000:0.0:1787826424.201414:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55711:x1874670563983616:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826424.201439:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826424.201443:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:0.0:1787826424.201578:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b834fa lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1680 expref: 44 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.201602:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b834e5 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1679 expref: 43 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.201612:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826424.201617:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826424.201630:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b83508 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1687 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.201735:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b8350f lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.201747:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b8350f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.201756:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b8350f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826424.201772:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:0.0:1787826424.202374:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b83508 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1687 expref: 45 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.202395:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b8350f lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1687 expref: 44 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.202405:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826424.202409:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787826424.202412:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165f400, rc 0) 00000100:00100000:0.0:1787826424.202542:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55711:x1874670563983616:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1132us (1349us total) trans 8589935206 rc 0/0 00000100:00100000:0.0:1787826424.202549:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4005 00000100:00100000:2.0:1787826424.208637:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826424.209692:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563983872 00000100:00100000:0.0:1787826424.209704:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563983872 00000100:00100000:0.0:1787826424.209772:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1245 00000100:00100000:0.0:1787826424.209784:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eea0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55711:x1874670563983872:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:0.0:1787826424.209856:0:6522:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000405:0x1d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b8350f lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1687 expref: 44 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.209895:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b8351d lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.209908:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b8349f lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab166b expref: 44 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.209922:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b8351d lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.209957:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b8349f lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab166b expref: 44 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.209969:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b8349f lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab166b expref: 44 pid: 6518 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826424.209983:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf41c870c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585286144:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826424.210070:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f67eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787826424.215116:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826424.215219:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563984000 00000100:00100000:3.0:1787826424.215227:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563984000 00010000:00010000:3.0:1787826424.215270:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b8349f lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab166b expref: 45 pid: 6518 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826424.215313:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1290 00000100:00100000:3.0:1787826424.215323:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9af0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+45:2403:x1874670563984000:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826424.215337:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826424.215343:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b8349f lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab166b expref: 45 pid: 6518 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.215357:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b8349f lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab166b expref: 45 pid: 6518 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.215380:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826424.215386:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b8351d lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.215395:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b8351d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.215402:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b8351d lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.215420:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826424.215516:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9af0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+45:2403:x1874670563984000:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 193us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826424.215523:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1290 00010000:00010000:0.0:1787826424.215662:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b8349f lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab166b expref: 44 pid: 6518 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826424.215680:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf41c870c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585286144:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826424.215699:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b8351d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.215709:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b8351d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.215716:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b8351d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.215923:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b8351d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.215930:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b8351d lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.216062:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b8351d lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.216068:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165fa00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826424.216072:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b8351d lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.216080:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b8351d lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.216090:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826424.216093:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787826424.216096:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b8351d lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.216102:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b8351d lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.216112:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826424.216114:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787826424.216119:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b8350f lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1687 expref: 43 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826424.216722:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eea0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55711:x1874670563983872:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 6938us (8093us total) trans 8589935207 rc -22/-22 00000100:00100000:0.0:1787826424.218424:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1245 00000100:00100000:2.0:1787826424.221967:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826424.223161:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563984128 00000100:00100000:1.0:1787826424.223174:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563984128 00000100:00100000:1.0:1787826424.223242:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4006 00000100:00100000:1.0:1787826424.223252:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9acb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55711:x1874670563984128:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826424.223279:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826424.223301:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b83524 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab168e expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.223691:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b83524 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab168e expref: 44 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.223710:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b83524 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab168e expref: 44 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.223737:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826424.223741:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826424.223745:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46a400, rc 0) 00000100:00100000:1.0:1787826424.223804:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9acb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55711:x1874670563984128:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 554us (1848us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826424.223813:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4006 00000100:00100000:2.0:1787826424.231290:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826424.231862:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563984384 00000100:00100000:3.0:1787826424.231872:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563984384 00000100:00100000:2.0:1787826424.232071:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4007 00000100:00100000:2.0:1787826424.232080:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9afc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55711:x1874670563984384:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826424.232096:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826424.232114:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b8352b lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1695 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.235862:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b83532 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.235880:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b83532 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.235891:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b83532 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826424.235902:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x3f:0x0]: returning size 0 00010000:00010000:2.0:1787826424.235948:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b8352b lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1695 expref: 47 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.235973:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b83532 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1695 expref: 46 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.235981:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3f:0x0].0x0 (ffff90cf39e67400) 00010000:00010000:2.0:1787826424.235984:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826424.235987:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834600, rc 0) 00000100:00100000:2.0:1787826424.236050:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9afc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+46:55711:x1874670563984384:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 3970us (4769us total) trans 8589935208 rc 0/0 00000100:00100000:2.0:1787826424.236059:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4007 00000100:00100000:2.0:1787826424.242620:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826424.242705:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563984640 00000100:00100000:0.0:1787826424.242715:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563984640 00000100:00100000:0.0:1787826424.242778:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4008 00000100:00100000:0.0:1787826424.242790:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+46:55711:x1874670563984640:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826424.242813:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826424.242832:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b83540 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab169c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.243083:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b83547 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.243098:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b83547 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.243108:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b83547 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826424.243130:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:1.0:1787826424.243233:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b83540 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab169c expref: 49 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.243255:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b83547 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab169c expref: 48 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.243265:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826424.243268:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787826424.243271:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46b000, rc 0) 00000100:00100000:1.0:1787826424.243344:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55711:x1874670563984640:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 556us (734us total) trans 8589935209 rc 0/0 00000100:00100000:1.0:1787826424.243356:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4008 00000100:00100000:0.0:1787826424.246878:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826424.246944:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563984896 00000100:00100000:3.0:1787826424.246953:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563984896 00000100:00100000:3.0:1787826424.247011:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1246 00000100:00100000:3.0:1787826424.247021:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55711:x1874670563984896:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:3.0:1787826424.247100:0:14257:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000405:0x1d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b83547 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab169c expref: 48 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.247151:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b83555 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.247164:0:14257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b83524 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab168e expref: 48 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.247173:0:14257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b83555 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.247202:0:14257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b83524 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab168e expref: 48 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.247214:0:14257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b83524 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab168e expref: 48 pid: 32404 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826424.247227:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf136d70c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585286272:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826424.247304:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3780 going to sleep for 11 seconds 00000100:00100000:2.0:1787826424.249948:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf136d70c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585286272:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826424.249978:0:14257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b83555 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826424.250147:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826424.250190:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563985024 00000100:00100000:1.0:1787826424.250197:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563985024 00010000:00010000:1.0:1787826424.250237:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b83524 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab168e expref: 49 pid: 32404 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826424.250277:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1291 00000100:00100000:1.0:1787826424.250286:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf181ff850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:2403:x1874670563985024:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826424.250310:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826424.250317:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b83524 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab168e expref: 49 pid: 32404 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.250327:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b83524 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab168e expref: 49 pid: 32404 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.250347:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b83524 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab168e expref: 49 pid: 32404 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.250363:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826424.250367:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b83555 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.250377:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b83555 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.250395:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b83555 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.250425:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826424.250498:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf181ff850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:2403:x1874670563985024:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 212us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826424.250507:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1291 00010000:00010000:2.0:1787826424.250664:0:14257:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b83555 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.250671:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b83555 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.250693:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b8355c lrc: 3/0,1 mode: --/EX res: [0x200000405:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.250704:0:14257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b83532 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1695 expref: 47 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.250712:0:14257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b8355c lrc: 4/0,1 mode: --/EX res: [0x200000405:0x3f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.250740:0:14257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b83532 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1695 expref: 47 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.250753:0:14257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b83532 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1695 expref: 47 pid: 6520 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826424.251030:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a9ae940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585286400:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826424.251091:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10abab40 going to sleep for 11 seconds 00000100:00100000:3.0:1787826424.257301:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826424.257566:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a9ae940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585286400:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826424.257600:0:14257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b8355c lrc: 3/0,1 mode: --/EX res: [0x200000405:0x3f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826424.257674:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563985152 00000100:00100000:1.0:1787826424.257681:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563985152 00010000:00010000:1.0:1787826424.257718:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b83532 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1695 expref: 48 pid: 6520 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826424.257754:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1292 00000100:00100000:1.0:1787826424.257823:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136d70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:2403:x1874670563985152:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826424.257839:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826424.257846:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b83532 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1695 expref: 48 pid: 6520 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.257859:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b83532 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1695 expref: 48 pid: 6520 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.257882:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b83532 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1695 expref: 48 pid: 6520 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.257897:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3f:0x0].0x0 (ffff90cf39e67400) 00010000:00010000:1.0:1787826424.257902:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b8355c lrc: 3/0,1 mode: --/EX res: [0x200000405:0x3f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.257911:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b8355c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.257920:0:10340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b8355c lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x3f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.258624:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826424.258685:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136d70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+47:2403:x1874670563985152:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 863us (1397us total) trans 0 rc 0/0 00010000:00010000:2.0:1787826424.258692:0:14257:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b8355c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826424.258694:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1292 00010000:00010000:2.0:1787826424.258700:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b8355c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826424.258979:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a9ae940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585286528:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1787826424.259027:0:14257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826424.259060:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce05b569c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826424.259368:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585286528 00000100:00100000:1.0:1787826424.259375:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585286528 00000100:00100000:1.0:1787826424.259726:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1495 00000100:00100000:1.0:1787826424.259734:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14257:x1874670585286528:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1787826424.260420:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14257:x1874670585286528:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 684us (1390us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826424.260428:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1495 00000100:00100000:2.0:1787826424.261665:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a9ae940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585286528:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:2.0:1787826424.261747:0:14257:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589935210 00000001:00080000:2.0:1787826424.261892:0:14257:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589935211 00010000:00010000:2.0:1787826424.261914:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b8355c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.261924:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b8355c lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x3f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.261932:0:14257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b8355c lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x3f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.261938:0:14257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826424.261943:0:14257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b8355c lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x3f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.262026:0:14257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b8355c lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x3f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.262046:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3f:0x0].0x0 (ffff90cf39e67400) 00010000:00010000:2.0:1787826424.262050:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787826424.262055:0:14257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b8355c lrc: 2/0,0 mode: --/EX res: [0x200000405:0x3f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.262062:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b8355c lrc: 0/0,0 mode: --/EX res: [0x200000405:0x3f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.262085:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b83555 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.267674:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b83555 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.267687:0:14257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b83555 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.267694:0:14257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826424.267698:0:14257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b83555 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.267708:0:14257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b83555 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.267726:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826424.267730:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787826424.267736:0:14257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b83555 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.267742:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b83555 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.267769:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826424.267771:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787826424.267778:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b83547 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab169c expref: 49 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826424.267922:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55711:x1874670563984896:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 20901us (21053us total) trans 8589935212 rc 0/0 00000100:00100000:2.0:1787826424.267932:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1246 00000020:00080000:2.0:1787826424.267937:0:14257:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1787826424.271736:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826424.271906:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563985280 00000100:00100000:0.0:1787826424.271916:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563985280 00000100:00100000:0.0:1787826424.272118:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4009 00000100:00100000:0.0:1787826424.272142:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55711:x1874670563985280:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826424.272166:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826424.272186:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b83563 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab16a3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.272247:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b83563 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16a3 expref: 49 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.272261:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b83563 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16a3 expref: 49 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.272279:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826424.272282:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826424.272286:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165e000, rc 0) 00000100:00100000:0.0:1787826424.272361:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:55711:x1874670563985280:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 224us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826424.272369:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4009 00000100:00100000:3.0:1787826424.277145:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826424.277233:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563985536 00000100:00100000:0.0:1787826424.277243:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563985536 00000100:00100000:0.0:1787826424.277351:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1247 00000100:00100000:0.0:1787826424.277361:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136d4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:55711:x1874670563985536:12345-192.168.203.39@tcp:35:lfs.0 00000004:00080000:0.0:1787826424.277673:0:6522:0:(mdd_object.c:4014:mdd_close()) Object [0x200000405:0x3f:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787826424.277736:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].32, 64 off10720 00000004:00080000:0.0:1787826424.277747:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1370289274949ns, next at 1371289272434ns, rc = 0 00000001:00080000:0.0:1787826424.277754:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589935213 00010000:00010000:0.0:1787826424.277791:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b8356a lrc: 3/0,1 mode: --/PW res: [0x200000405:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.277806:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b8356a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.277816:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b8356a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.277825:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b8356a lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.277831:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b8356a lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.277838:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b8356a lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.277865:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787826424.277953:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136d4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+51:55711:x1874670563985536:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 585us (822us total) trans 8589935214 rc 0/0 00000100:00100000:0.0:1787826424.277962:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1247 00000020:00080000:0.0:1787826424.277966:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787826424.278076:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826424.278083:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b8356a lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.278089:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165e400 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826424.278093:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b8356a lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.278101:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b8356a lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.278114:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3f:0x0].0x0 (ffff90ce036ca100) 00010000:00010000:2.0:1787826424.278117:0:8451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787826424.278130:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b8356a lrc: 1/0,0 mode: --/PW res: [0x200000405:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.278137:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b8356a lrc: 0/0,0 mode: --/PW res: [0x200000405:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.278153:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826424.278155:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826424.278156:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826424.281592:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826424.281713:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563985792 00000100:00100000:3.0:1787826424.281725:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563985792 00000100:00100000:3.0:1787826424.281844:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1248 00000100:00100000:3.0:1787826424.281855:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9ae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+51:55711:x1874670563985792:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:3.0:1787826424.282090:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9ae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+52:55711:x1874670563985792:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 236us (507us total) trans 8589935215 rc 0/0 00000100:00100000:3.0:1787826424.282099:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1248 00000100:00100000:3.0:1787826424.315071:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826424.315191:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563985920 00000100:00100000:0.0:1787826424.315201:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563985920 00000100:00100000:0.0:1787826424.315259:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4010 00000100:00100000:0.0:1787826424.315269:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+52:55713:x1874670563985920:12345-192.168.203.39@tcp:101:getfattr.0 00010000:00010000:0.0:1787826424.315301:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826424.315328:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b83571 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab16aa expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.315391:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b83578 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.315405:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b83578 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.315415:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b83578 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.315427:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8357f lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.315434:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8357f lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.315440:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8357f lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.315554:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b83586 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.315564:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b83586 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.315571:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b83586 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826424.315615:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:0.0:1787826424.315620:0:16564:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826424.315638:0:16564:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b83586 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.315648:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b83586 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.315656:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b83578 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.315661:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b83578 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.315668:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b83578 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.315673:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165e600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826424.315677:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b83578 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.315683:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b83578 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.315694:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90ce036caf00) 00010000:00010000:0.0:1787826424.315697:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826424.315701:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b83578 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.315708:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b83578 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.315725:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8357f lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.315732:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8357f lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.315738:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8357f lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.315743:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165fe00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826424.315746:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8357f lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.315751:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8357f lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.315759:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90ce036caa00) 00010000:00010000:0.0:1787826424.315761:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826424.315764:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8357f lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.315770:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8357f lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.315798:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b83571 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16aa expref: 54 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.315814:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b83586 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16aa expref: 53 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.315827:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826424.315830:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826424.315832:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165fc00, rc 0) 00000100:00100000:0.0:1787826424.315882:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55713:x1874670563985920:12345-192.168.203.39@tcp:101:getfattr.0 Request processed in 614us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826424.315889:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4010 00000100:00100000:2.0:1787826424.319572:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826424.319918:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563986048 00000100:00100000:0.0:1787826424.319928:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563986048 00000100:00100000:0.0:1787826424.319995:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2244 00000100:00100000:0.0:1787826424.320005:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2404:x1874670563986048:12345-192.168.203.39@tcp:101:getfattr.0 00010000:00010000:0.0:1787826424.320022:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826424.320040:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a06ea081/0x22153cd396b8358d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab16b1 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826424.320095:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fdd2c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1874670585286656:192.168.203.39@tcp:106: 00000100:00100000:0.0:1787826424.320179:0:8435:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f67e840 going to sleep for 11 seconds 00000100:00100000:0.0:1787826424.323941:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fdd2c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1874670585286656:192.168.203.39@tcp:106: 00010000:00010000:0.0:1787826424.323989:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a06ea081/0x22153cd396b8358d lrc: 1/0,0 mode: --/PR res: [0x280000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16b1 expref: 9 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.324015:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a06ea081/0x22153cd396b8358d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16b1 expref: 9 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.324030:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165e400, rc 0) 00000100:00100000:0.0:1787826424.324085:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2404:x1874670563986048:12345-192.168.203.39@tcp:101:getfattr.0 Request processed in 4082us (4522us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826424.324095:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2244 00000100:00100000:3.0:1787826424.350155:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826424.350266:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563986176 00000100:00100000:2.0:1787826424.350277:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563986176 00000100:00100000:2.0:1787826424.350349:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4011 00000100:00100000:2.0:1787826424.350360:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55717:x1874670563986176:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:2.0:1787826424.350433:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b83594 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.350448:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b83594 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.350460:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b83594 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.350741:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b8359b lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.350751:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b8359b lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.350887:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b8359b lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.351032:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b835a2 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.351042:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b835a2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.351051:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b835a2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826424.351090:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:3.0:1787826424.351094:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787826424.351105:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b835a2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.351130:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b83594 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.351137:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b83594 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.351144:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b83594 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.351149:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b83594 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.351155:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826424.351159:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b83594 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.351166:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b83594 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.351176:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf39e67400) 00010000:00010000:3.0:1787826424.351179:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826424.351183:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b83594 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.351189:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b83594 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.351209:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b8359b lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.351214:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b8359b lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.351219:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b8359b lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.351223:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826424.351226:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b8359b lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.351231:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b8359b lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.351237:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf39e67700) 00010000:00010000:3.0:1787826424.351239:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826424.351241:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b8359b lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.351250:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b8359b lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.351260:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b835a2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.351265:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b835a2 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.351270:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b835a2 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.351274:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826424.351277:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b835a2 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.351282:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b835a2 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.351289:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826424.351306:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826424.351309:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b835a2 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.351315:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b835a2 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826424.351391:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55717:x1874670563986176:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 1031us (1244us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826424.351399:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4011 00000100:00100000:2.0:1787826424.386246:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826424.387373:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563986432 00000100:00100000:0.0:1787826424.387388:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563986432 00000100:00100000:0.0:1787826424.387459:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4012 00000100:00100000:0.0:1787826424.387513:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55719:x1874670563986432:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826424.387534:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826424.387555:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b835a9 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab16b8 expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.387668:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b835b0 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.387684:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b835b0 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.387696:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b835b0 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826424.387708:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:0.0:1787826424.387840:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b835a9 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16b8 expref: 56 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.387861:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b835b0 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16b8 expref: 55 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.387869:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826424.387872:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787826424.387876:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165e200, rc 0) 00000100:00100000:0.0:1787826424.387947:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+55:55719:x1874670563986432:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 479us (1712us total) trans 8589935216 rc 0/0 00000100:00100000:0.0:1787826424.387955:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4012 00000100:00100000:2.0:1787826424.393068:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826424.393321:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563986560 00000100:00100000:0.0:1787826424.393330:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563986560 00000100:00100000:0.0:1787826424.393379:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2245 00000100:00100000:0.0:1787826424.393387:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9af0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2403:x1874670563986560:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826424.393405:0:14864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826424.393423:0:14864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a06ea081/0x22153cd396b835be lrc: 2/0,0 mode: --/PR res: [0x280000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab16bf expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826424.393732:0:14864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fdd2c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14864:1874670585286784:192.168.203.39@tcp:106: 00000100:00100000:0.0:1787826424.393821:0:14864:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f67e180 going to sleep for 11 seconds 00000100:00100000:0.0:1787826424.396008:0:14864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fdd2c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14864:1874670585286784:192.168.203.39@tcp:106: 00010000:00010000:0.0:1787826424.396045:0:14864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a06ea081/0x22153cd396b835be lrc: 1/0,0 mode: --/PR res: [0x280000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16bf expref: 9 pid: 14864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.396072:0:14864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a06ea081/0x22153cd396b835be lrc: 0/0,0 mode: --/PR res: [0x280000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16bf expref: 9 pid: 14864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.396087:0:14864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165e400, rc 0) 00000100:00100000:0.0:1787826424.396213:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9af0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2403:x1874670563986560:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 2824us (3152us total) trans 0 rc 301/301 00000100:00100000:0.0:1787826424.396222:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2245 00000100:00100000:2.0:1787826424.401930:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826424.402028:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563986816 00000100:00100000:0.0:1787826424.402037:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563986816 00000100:00100000:0.0:1787826424.402140:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4013 00000100:00100000:0.0:1787826424.402151:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9ad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+55:55719:x1874670563986816:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826424.402172:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826424.402192:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b835c5 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab16c6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.402426:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b835cc lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.402442:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b83586 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16aa expref: 56 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.402451:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b835cc lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.402588:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b83586 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16aa expref: 56 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.402602:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b83586 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16aa expref: 56 pid: 16564 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826424.402617:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fdd2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1874670585286912:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826424.402701:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f67e180 going to sleep for 11 seconds 00000100:00100000:1.0:1787826424.406345:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826424.406442:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fdd2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1874670585286912:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826424.406467:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b835cc lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826424.406940:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563986944 00000100:00100000:3.0:1787826424.406948:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563986944 00010000:00010000:3.0:1787826424.406987:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b83586 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16aa expref: 57 pid: 16564 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826424.407026:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1293 00000100:00100000:3.0:1787826424.407036:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01dfcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+57:2403:x1874670563986944:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826424.407048:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826424.407055:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b83586 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16aa expref: 57 pid: 16564 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.407068:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b83586 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16aa expref: 57 pid: 16564 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.407091:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b83586 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16aa expref: 57 pid: 16564 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.407106:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826424.407111:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b835cc lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.407130:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b835cc lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.407138:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b835cc lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.407167:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826424.407212:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01dfcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+56:2403:x1874670563986944:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 177us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826424.407221:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1293 00010000:00010000:0.0:1787826424.408309:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b835cc lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.408326:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b835cc lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826424.408358:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:0.0:1787826424.409030:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b835c5 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16c6 expref: 57 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.409054:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b835cc lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16c6 expref: 56 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.409063:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826424.409066:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787826424.409070:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165e600, rc 0) 00000100:00100000:0.0:1787826424.409139:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9ad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+56:55719:x1874670563986816:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 6990us (7220us total) trans 8589935217 rc 0/0 00000100:00100000:0.0:1787826424.409148:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4013 00000100:00100000:2.0:1787826424.412770:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826424.412851:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563987200 00000100:00100000:3.0:1787826424.412860:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563987200 00000100:00100000:3.0:1787826424.412958:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4014 00000100:00100000:3.0:1787826424.412969:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9ada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+56:55719:x1874670563987200:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826424.412993:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826424.413017:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b835da lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab16cd expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.413562:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b835e1 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.413577:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b835e1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.413588:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b835e1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826424.413598:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x40:0x0]: returning size 0 00010000:00010000:3.0:1787826424.413642:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b835da lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16cd expref: 59 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.413664:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b835e1 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16cd expref: 58 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.413673:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x40:0x0].0x0 (ffff90cf06894a00) 00010000:00010000:3.0:1787826424.413676:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826424.413679:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400600, rc 0) 00000100:00100000:3.0:1787826424.413742:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9ada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:55719:x1874670563987200:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 775us (981us total) trans 8589935218 rc 0/0 00000100:00100000:3.0:1787826424.413749:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4014 00000100:00100000:2.0:1787826424.418734:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826424.418805:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563987456 00000100:00100000:3.0:1787826424.418814:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563987456 00000100:00100000:3.0:1787826424.418865:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4015 00000100:00100000:3.0:1787826424.418874:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:55719:x1874670563987456:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826424.418896:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826424.418913:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b835ef lrc: 2/0,0 mode: --/CR res: [0x200000405:0x40:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab16d4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.419007:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b835f6 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x40:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.419020:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b835e1 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16cd expref: 59 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.419029:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b835f6 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x40:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.419058:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b835e1 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16cd expref: 59 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.419070:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b835e1 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16cd expref: 59 pid: 8247 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826424.419083:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf079661c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1874670585287040:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826424.419169:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826424.423255:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826424.423360:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf079661c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1874670585287040:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826424.423391:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b835f6 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x40:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826424.423597:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563987584 00000100:00100000:1.0:1787826424.423604:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563987584 00010000:00010000:1.0:1787826424.423638:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b835e1 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16cd expref: 60 pid: 8247 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826424.423678:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1294 00000100:00100000:1.0:1787826424.423687:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:2403:x1874670563987584:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826424.423704:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826424.423710:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b835e1 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16cd expref: 60 pid: 8247 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.423726:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b835e1 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16cd expref: 60 pid: 8247 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.423746:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400600/0x22153cd396b835e1 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16cd expref: 60 pid: 8247 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.423877:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x40:0x0].0x0 (ffff90cf06894a00) 00010000:00010000:1.0:1787826424.423883:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b835f6 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x40:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.423891:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b835f6 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x40:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.423898:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b835f6 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x40:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.423957:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826424.424013:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:2403:x1874670563987584:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 326us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826424.424021:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1294 00010000:00010000:3.0:1787826424.425546:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b835f6 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x40:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.425561:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b835f6 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x40:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826424.425721:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x40:0x0]: returning size 0 00000004:00080000:2.0:1787826424.426197:0:6520:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x10e:0x0], index 1: 0 00010000:00010000:2.0:1787826424.426441:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b835f6 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x40:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.426451:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b835f6 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x40:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.426457:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b835f6 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x40:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.426463:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826424.426467:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b835f6 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x40:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.426616:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b835f6 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x40:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.426633:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x40:0x0].0x0 (ffff90cf06894a00) 00010000:00010000:2.0:1787826424.426637:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826424.426641:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b835f6 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x40:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.426648:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401000/0x22153cd396b835f6 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x40:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.426701:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b835ef lrc: 1/0,0 mode: --/CR res: [0x200000405:0x40:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16d4 expref: 59 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.426712:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x40:0x0].0x0 (ffff90cf06894a00) 00010000:00010000:2.0:1787826424.426714:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787826424.426718:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401600/0x22153cd396b835ef lrc: 0/0,0 mode: --/CR res: [0x200000405:0x40:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16d4 expref: 59 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.426738:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401600, rc 0) 00000100:00100000:2.0:1787826424.426817:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:55719:x1874670563987456:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 7943us (8090us total) trans 8589935219 rc 301/301 00000100:00100000:2.0:1787826424.426826:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4015 00000100:00100000:0.0:1787826424.430211:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826424.430261:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563987840 00000100:00100000:2.0:1787826424.430270:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563987840 00000100:00100000:2.0:1787826424.430461:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1249 00000100:00100000:2.0:1787826424.430510:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:55719:x1874670563987840:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:2.0:1787826424.430797:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55719:x1874670563987840:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 325us (594us total) trans 8589935220 rc 0/0 00000100:00100000:2.0:1787826424.430804:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1249 00000100:00100000:1.0:1787826424.433564:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826424.433743:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563987968 00000100:00100000:2.0:1787826424.433752:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563987968 00000100:00100000:2.0:1787826424.433825:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4016 00000100:00100000:2.0:1787826424.433836:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01dfe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55719:x1874670563987968:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826424.433859:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826424.433882:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83604 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab16db expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.433973:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b8360b lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.433988:0:32404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b835cc lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16c6 expref: 60 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.434001:0:32404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b8360b lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.434035:0:32404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b835cc lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16c6 expref: 60 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.434048:0:32404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b835cc lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16c6 expref: 60 pid: 6519 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826424.434064:0:32404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0300d680 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:32404:1874670585287168:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826424.434155:0:32404:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce05b569c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826424.438823:0:32404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0300d680 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:32404:1874670585287168:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826424.438853:0:32404:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b8360b lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826424.440944:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826424.441254:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563988096 00000100:00100000:3.0:1787826424.441264:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563988096 00010000:00010000:3.0:1787826424.441324:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b835cc lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16c6 expref: 61 pid: 6519 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826424.441368:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1295 00000100:00100000:3.0:1787826424.441378:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01dfed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+61:2404:x1874670563988096:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826424.441393:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826424.441401:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b835cc lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16c6 expref: 61 pid: 6519 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.441413:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b835cc lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16c6 expref: 61 pid: 6519 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.441438:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b835cc lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16c6 expref: 61 pid: 6519 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.441453:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826424.441460:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b8360b lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.441747:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b8360b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.441758:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b8360b lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.441791:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826424.441845:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01dfed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:2404:x1874670563988096:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 468us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826424.441853:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1295 00010000:00010000:2.0:1787826424.441922:0:32404:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b8360b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.441931:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b8360b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826424.441980:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:2.0:1787826424.441984:0:32404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826424.442002:0:32404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b8360b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.442033:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83604 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16db expref: 60 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.442054:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b8360b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16db expref: 59 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.442062:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826424.442064:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826424.442067:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834600, rc 0) 00000100:00100000:2.0:1787826424.442093:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01dfe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55719:x1874670563987968:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 8260us (8542us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826424.442101:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4016 00000100:00100000:3.0:1787826424.445659:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826424.445814:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563988224 00000100:00100000:2.0:1787826424.445824:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563988224 00000100:00100000:2.0:1787826424.445881:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2246 00000100:00100000:2.0:1787826424.445891:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf079661c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2403:x1874670563988224:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826424.445909:0:30694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826424.445926:0:30694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e0a1cce/0x22153cd396b83612 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab16e2 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826424.445982:0:30694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0300d680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:30694:1874670585287296:192.168.203.39@tcp:106: 00000100:00100000:2.0:1787826424.446068:0:30694:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce05b569c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826424.449847:0:30694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0300d680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:30694:1874670585287296:192.168.203.39@tcp:106: 00010000:00010000:2.0:1787826424.449886:0:30694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001e0a1cce/0x22153cd396b83612 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16e2 expref: 9 pid: 30694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.449911:0:30694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e0a1cce/0x22153cd396b83612 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16e2 expref: 9 pid: 30694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.449923:0:30694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835000, rc 0) 00000100:00100000:2.0:1787826424.449985:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf079661c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2403:x1874670563988224:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 4095us (4336us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826424.449994:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2246 00000100:00100000:3.0:1787826424.453572:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826424.453741:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563988352 00000100:00100000:0.0:1787826424.453751:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563988352 00000100:00100000:0.0:1787826424.453818:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4017 00000100:00100000:0.0:1787826424.453828:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf07967840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55719:x1874670563988352:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826424.453849:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826424.453873:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b83619 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab16e9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.453944:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b83620 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x40:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.453957:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b83620 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x40:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.453969:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b83620 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x40:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826424.454010:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x40:0x0]: returning size 0 00000004:00200000:0.0:1787826424.454015:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826424.454034:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b83620 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x40:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.454061:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b83619 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x40:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16e9 expref: 61 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.454080:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b83620 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x40:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16e9 expref: 60 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.454088:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x40:0x0].0x0 (ffff90ce036caf00) 00010000:00010000:0.0:1787826424.454091:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787826424.454094:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165e400, rc 0) 00000100:00100000:0.0:1787826424.454170:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf07967840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:55719:x1874670563988352:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 342us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826424.454177:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4017 00000100:00100000:3.0:1787826424.458031:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826424.458144:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563988480 00000100:00100000:1.0:1787826424.458154:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563988480 00000100:00100000:1.0:1787826424.458209:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2247 00000100:00100000:1.0:1787826424.458217:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf07966d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2402:x1874670563988480:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826424.458234:0:28853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826424.458254:0:28853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a5fe178/0x22153cd396b83627 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x10e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab16f0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826424.458277:0:28853:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826424.458309:0:28853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10e:0x0].0x0 since=1370s v=(0 0) 00010000:00010000:1.0:1787826424.458314:0:28853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826424.458323:0:28853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a5fe178/0x22153cd396b83627 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16f0 expref: 12 pid: 28853 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.458339:0:28853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001a5fe178/0x22153cd396b83627 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16f0 expref: 12 pid: 28853 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.458351:0:28853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46a600, rc 0) 00000100:00100000:1.0:1787826424.458443:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf07966d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2402:x1874670563988480:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 225us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826424.458450:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2247 00000100:00100000:1.0:1787826424.474946:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826424.475091:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563988736 00000100:00100000:3.0:1787826424.475101:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563988736 00000100:00100000:3.0:1787826424.475178:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4018 00000100:00100000:3.0:1787826424.475190:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01dfd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:55719:x1874670563988736:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826424.475208:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826424.475230:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b8362e lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab16f7 expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.475351:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b83635 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.475368:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b83635 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.475383:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b83635 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826424.475397:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:3.0:1787826424.475524:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401a00/0x22153cd396b8362e lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16f7 expref: 63 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.475543:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b83635 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16f7 expref: 62 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.475552:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826424.475555:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787826424.475559:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400200, rc 0) 00000100:00100000:3.0:1787826424.475617:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01dfd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+62:55719:x1874670563988736:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 429us (681us total) trans 8589935221 rc 0/0 00000100:00100000:3.0:1787826424.475625:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4018 00000100:00100000:3.0:1787826424.484281:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826424.484520:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563988864 00000100:00100000:1.0:1787826424.484531:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563988864 00000100:00100000:1.0:1787826424.484583:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2248 00000100:00100000:1.0:1787826424.484594:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf07964780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2403:x1874670563988864:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826424.484612:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826424.484629:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8fb1ffc/0x22153cd396b83643 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab16fe expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826424.484692:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01dfcf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1874670585287424:192.168.203.39@tcp:106: 00000100:00100000:1.0:1787826424.484770:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf087ac540 going to sleep for 11 seconds 00000100:00100000:1.0:1787826424.489747:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01dfcf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1874670585287424:192.168.203.39@tcp:106: 00010000:00010000:1.0:1787826424.489787:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a8fb1ffc/0x22153cd396b83643 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16fe expref: 9 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.489812:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8fb1ffc/0x22153cd396b83643 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16fe expref: 9 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.489825:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46ac00, rc 0) 00000100:00100000:1.0:1787826424.489900:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf07964780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2403:x1874670563988864:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 5307us (5628us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826424.489908:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2248 00000100:00100000:2.0:1787826424.502076:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826424.502193:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563988992 00000100:00100000:1.0:1787826424.502203:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563988992 00000100:00100000:1.0:1787826424.502265:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2249 00000100:00100000:1.0:1787826424.502276:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2402:x1874670563988992:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826424.502293:0:8545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826424.502312:0:8545:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8fb1ffc/0x22153cd396b8364a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1705 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826424.502370:0:8545:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01dfcf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8545:1874670585287552:192.168.203.39@tcp:106: 00000100:00100000:1.0:1787826424.502449:0:8545:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf087ac540 going to sleep for 11 seconds 00000100:00100000:1.0:1787826424.512717:0:8545:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01dfcf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8545:1874670585287552:192.168.203.39@tcp:106: 00010000:00010000:1.0:1787826424.512752:0:8545:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a8fb1ffc/0x22153cd396b8364a lrc: 1/0,0 mode: --/PR res: [0x280000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1705 expref: 9 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.512782:0:8545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8fb1ffc/0x22153cd396b8364a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1705 expref: 9 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.512796:0:8545:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46ac00, rc 0) 00000100:00100000:1.0:1787826424.512855:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2402:x1874670563988992:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 10581us (10792us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826424.512864:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2249 00000100:00100000:3.0:1787826424.522906:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826424.526277:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563989120 00000100:00100000:1.0:1787826424.526293:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563989120 00000100:00100000:0.0:1787826424.528978:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2250 00000100:00100000:0.0:1787826424.528991:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf079643c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2403:x1874670563989120:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:0.0:1787826424.529051:0:30696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ac666fdd/0x22153cd396b83651 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.529072:0:30696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003eb46645/0x22153cd396b8347c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab165d expref: 8 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.529221:0:30696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x10d:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787826424.529226:0:30696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826424.529231:0:30696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac666fdd/0x22153cd396b83651 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.529273:0:30696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003eb46645/0x22153cd396b8347c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab165d expref: 8 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.529288:0:30696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003eb46645/0x22153cd396b8347c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab165d expref: 8 pid: 30696 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826424.529302:0:30696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fdcb40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:30696:1874670585287680:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826424.529639:0:30696:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f67e180 going to sleep for 11 seconds 00000100:00100000:2.0:1787826424.538430:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826424.538542:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563989248 00000100:00100000:3.0:1787826424.538552:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563989248 00010000:00010000:3.0:1787826424.538592:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003eb46645/0x22153cd396b8347c lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab165d expref: 9 pid: 30696 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826424.538634:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1296 00000100:00100000:3.0:1787826424.538645:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670563989248:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826424.538660:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826424.538684:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003eb46645/0x22153cd396b8347c lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x10d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab165d expref: 9 pid: 30696 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.538698:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003eb46645/0x22153cd396b8347c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x10d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab165d expref: 9 pid: 30696 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.538726:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826424.538731:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826424.538737:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ac666fdd/0x22153cd396b83651 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x10d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.538748:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac666fdd/0x22153cd396b83651 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x10d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.538770:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826424.538838:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670563989248:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 194us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826424.538847:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1296 00010000:00010000:0.0:1787826424.539288:0:30696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003eb46645/0x22153cd396b8347c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab165d expref: 8 pid: 30696 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826424.539306:0:30696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fdcb40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:30696:1874670585287680:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826424.539327:0:30696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ac666fdd/0x22153cd396b83651 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x10d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.539344:0:30696:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ac666fdd/0x22153cd396b83651 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x10d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.539352:0:30696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac666fdd/0x22153cd396b83651 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x10d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.539374:0:30696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ac666fdd/0x22153cd396b83651 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x10d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.539383:0:30696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac666fdd/0x22153cd396b83651 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x10d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.539390:0:30696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac666fdd/0x22153cd396b83651 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.539398:0:30696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165fe00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826424.539402:0:30696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac666fdd/0x22153cd396b83651 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.539410:0:30696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac666fdd/0x22153cd396b83651 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x10d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.539423:0:30696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac666fdd/0x22153cd396b83651 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x10d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.539436:0:30696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac666fdd/0x22153cd396b83651 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x10d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826424.539690:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf079643c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2403:x1874670563989120:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 10699us (16791us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826424.539699:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2250 00000100:00100000:2.0:1787826424.551344:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826424.556240:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563989376 00000100:00100000:1.0:1787826424.556256:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563989376 00000100:00100000:1.0:1787826424.556334:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2251 00000100:00100000:1.0:1787826424.556345:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2404:x1874670563989376:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826424.556366:0:30695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826424.556388:0:30695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000951304c9/0x22153cd396b83658 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x10d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab170c expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826424.556415:0:30695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10d:0x0] initial LVB size: 0, mtime: 0x6a9010ec, atime: 0x6a9010ec, ctime: 0x6a9010f8, blocks: 0x0 00010000:00010000:1.0:1787826424.556434:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10d:0x0].0x0 since=1370s v=(0 0) 00010000:00010000:1.0:1787826424.556440:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826424.556450:0:30695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000951304c9/0x22153cd396b83658 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab170c expref: 8 pid: 30695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.556468:0:30695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000951304c9/0x22153cd396b83658 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab170c expref: 8 pid: 30695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.556604:0:30695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46b400, rc 0) 00000100:00100000:1.0:1787826424.556734:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2404:x1874670563989376:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 389us (5397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826424.556741:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2251 00000100:00100000:2.0:1787826424.629144:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826424.629218:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563989504 00000100:00100000:0.0:1787826424.629229:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563989504 00000100:00100000:0.0:1787826424.629287:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4019 00000100:00100000:0.0:1787826424.629298:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+62:55719:x1874670563989504:12345-192.168.203.39@tcp:44:lfs.0 00000001:00080000:1.0:1787826424.631701:0:34481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935221 is committed 00000004:00080000:1.0:1787826424.631736:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 32 committed 00000020:00080000:1.0:1787826424.631779:0:34481:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90cf3aaf50c0 refcount 2 committed 0 result 0 batchid 4294969345 00000020:00080000:1.0:1787826424.631785:0:34481:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cf1f111b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90cf3aaf56c0 00000020:00080000:1.0:1787826424.631788:0:34481:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cf1f111d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90cf39e72e00 00000020:00080000:1.0:1787826424.631808:0:34481:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969344 batchid updated 00000020:00080000:0.0:1787826424.631887:0:34512:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969345 committed batchid 4294969344 00010000:00010000:2.0:1787826424.631948:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b8346e lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787826424.631953:0:34512:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969344 00010000:00010000:2.0:1787826424.631959:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b8346e lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.631966:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b8346e lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.631971:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165ea00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826424.631975:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b8346e lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.631982:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b8346e lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.631998:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3e:0x0].0x0 (ffff90ce036ca800) 00010000:00010000:2.0:1787826424.632001:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826424.632006:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b8346e lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.632015:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b8346e lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.632043:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b83483 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.632050:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b83483 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.632054:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b83483 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.632058:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826424.632061:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b83483 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.632067:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b83483 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.632074:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00000100:00100000:0.0:1787826424.632087:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:55719:x1874670563989504:12345-192.168.203.39@tcp:44:lfs.0 Request processed in 2786us (2947us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826424.632097:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4019 00010000:00010000:2.0:1787826424.632164:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826424.632169:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b83483 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.632175:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b83483 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826424.632913:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf07966940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585287808:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787826424.632966:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826424.633189:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585287808 00000100:00100000:3.0:1787826424.633197:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585287808 00000100:00100000:3.0:1787826424.633249:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2252 00000100:00100000:3.0:1787826424.633259:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3647:x1874670585287808:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787826424.633284:0:28853:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:269 count 1 00010000:00010000:3.0:1787826424.633378:0:28853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e843828/0x22153cd396b8365f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.633467:0:28853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000421aa0a2/0x22153cd396b8348a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1664 expref: 11 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.633557:0:28853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x10d:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787826424.633561:0:28853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826424.633681:0:28853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e843828/0x22153cd396b8365f lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.633714:0:28853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000421aa0a2/0x22153cd396b8348a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1664 expref: 11 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.633727:0:28853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000421aa0a2/0x22153cd396b8348a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1664 expref: 11 pid: 8437 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826424.633738:0:28853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf07965a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28853:1874670585287936:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826424.633844:0:28853:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3180 going to sleep for 11 seconds 00000100:00100000:1.0:1787826424.645503:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826424.649318:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563989632 00000100:00100000:3.0:1787826424.649333:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563989632 00000100:00100000:1.0:1787826424.649822:0:28853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf07965a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28853:1874670585287936:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826424.649850:0:28853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009e843828/0x22153cd396b8365f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826424.649935:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2253 00000100:00100000:3.0:1787826424.649946:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01dfcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563989632:12345-192.168.203.39@tcp:16:lfs.0 00000100:00100000:3.0:1787826424.650050:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01dfcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563989632:12345-192.168.203.39@tcp:16:lfs.0 Request processed in 105us (4557us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826424.650058:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2253 00000100:00100000:0.0:1787826424.665952:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826424.666203:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563989760 00000100:00100000:1.0:1787826424.666213:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563989760 00010000:00010000:1.0:1787826424.666254:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000421aa0a2/0x22153cd396b8348a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1664 expref: 12 pid: 8437 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826424.666313:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1297 00000100:00100000:1.0:1787826424.666324:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563989760:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826424.666339:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826424.666346:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000421aa0a2/0x22153cd396b8348a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x10d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1664 expref: 12 pid: 8437 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.666361:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000421aa0a2/0x22153cd396b8348a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1664 expref: 12 pid: 8437 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.666393:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000421aa0a2/0x22153cd396b8348a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1664 expref: 12 pid: 8437 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.666411:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826424.666416:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826424.666422:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009e843828/0x22153cd396b8365f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.666432:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e843828/0x22153cd396b8365f lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.666467:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826424.666552:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2403:x1874670563989760:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 230us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826424.666559:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1297 00010000:00010000:2.0:1787826424.667315:0:28853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009e843828/0x22153cd396b8365f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.667327:0:28853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e843828/0x22153cd396b8365f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.667339:0:28853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e843828/0x22153cd396b8365f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.667347:0:28853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e843828/0x22153cd396b8365f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.667370:0:28853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787826424.667786:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3647:x1874670585287808:12345-0@lo:6:osp-syn-1-0.0 Request processed in 34526us (34816us total) trans 17179869684 rc 0/0 00000100:00100000:2.0:1787826424.667795:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2252 00010000:00010000:1.0:1787826424.668037:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826424.668045:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e843828/0x22153cd396b8365f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.668053:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401a00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:1.0:1787826424.668058:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e843828/0x22153cd396b8365f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.668069:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e843828/0x22153cd396b8365f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.668096:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e843828/0x22153cd396b8365f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.668104:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e843828/0x22153cd396b8365f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.668132:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826424.668134:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826424.668136:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787826424.670348:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf07966940/2, rc 0, transno 17179869684 00000100:00100000:0.0:1787826424.670365:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf07966940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585287808:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787826424.681161:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826424.681267:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563989888 00000100:00100000:0.0:1787826424.681278:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563989888 00000100:00100000:0.0:1787826424.681403:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2254 00000100:00100000:0.0:1787826424.681424:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf2f791050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2404:x1874670563989888:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:0.0:1787826424.681511:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009a27ec96/0x22153cd396b83666 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.681529:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826424.681534:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826424.681539:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a27ec96/0x22153cd396b83666 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.681554:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a27ec96/0x22153cd396b83666 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.681587:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009a27ec96/0x22153cd396b83666 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.681596:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a27ec96/0x22153cd396b83666 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.681603:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a27ec96/0x22153cd396b83666 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.681610:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165f600 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826424.681614:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a27ec96/0x22153cd396b83666 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.681623:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a27ec96/0x22153cd396b83666 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.681640:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a27ec96/0x22153cd396b83666 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.681647:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a27ec96/0x22153cd396b83666 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826424.681721:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf2f791050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2404:x1874670563989888:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 309us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826424.681729:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2254 00000100:00100000:0.0:1787826424.689796:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826424.689890:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563990144 00000100:00100000:2.0:1787826424.689900:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563990144 00000100:00100000:2.0:1787826424.689956:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4020 00000100:00100000:2.0:1787826424.689966:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fde580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:55719:x1874670563990144:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:2.0:1787826424.690018:0:32404:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826424.690047:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b83620 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x40:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16e9 expref: 33 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.690068:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x40:0x0].0x0 (ffff90ce036caf00) 00010000:00010000:2.0:1787826424.690080:0:32404:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826424.690127:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8366d lrc: 3/0,1 mode: --/PW res: [0x200000405:0x40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.690140:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8366d lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.690154:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8366d lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826424.690276:0:32404:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000771f21f reply state 00000000249e8b8d transno 8589935222 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8366d lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.690290:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8366d lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.690297:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x40:0x0].0x0 (ffff90cf39e67e00) 00010000:00010000:2.0:1787826424.690300:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826424.690303:0:32404:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826424.690406:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fde580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:55719:x1874670563990144:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 440us (619us total) trans 8589935222 rc 0/0 00000100:00100000:2.0:1787826424.690422:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4020 00000100:00100000:3.0:1787826424.698017:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826424.698437:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563990272 00000100:00100000:2.0:1787826424.698448:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563990272 00000100:00100000:2.0:1787826424.698541:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4021 00000100:00100000:2.0:1787826424.698551:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf079661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:55719:x1874670563990272:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826424.698574:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826424.698594:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83674 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x40:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1713 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.698650:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83674 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x40:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1713 expref: 35 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.698664:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83674 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x40:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1713 expref: 35 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.698685:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x40:0x0].0x0 (ffff90cf39e67e00) 00010000:00010000:2.0:1787826424.698688:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826424.698691:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835000, rc 0) 00000100:00100000:2.0:1787826424.698740:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf079661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:55719:x1874670563990272:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 191us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826424.698746:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4021 00000100:00100000:3.0:1787826424.713270:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826424.713965:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563990400 00000100:00100000:2.0:1787826424.713976:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563990400 00000100:00100000:2.0:1787826424.714043:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2255 00000100:00100000:2.0:1787826424.714053:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf07966d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:55719:x1874670563990400:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826424.714072:0:14864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826424.714091:0:14864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b8367b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab171a expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.714133:0:14864:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001a5fe178/0x22153cd396b83627 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16f0 expref: 12 pid: 28853 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.714143:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826424.714147:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826424.714153:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b8367b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab171a expref: 12 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.714188:0:14864:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001a5fe178/0x22153cd396b83627 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16f0 expref: 12 pid: 28853 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.714208:0:14864:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001a5fe178/0x22153cd396b83627 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16f0 expref: 12 pid: 28853 timeout: 1470 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826424.714223:0:14864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0300d2c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14864:1874670585288064:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826424.714558:0:14864:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce05b569c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826424.718167:0:14864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0300d2c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14864:1874670585288064:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826424.718202:0:14864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b8367b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab171a expref: 12 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.718223:0:14864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834a00, rc 0) 00000100:00100000:2.0:1787826424.718329:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf07966d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:55719:x1874670563990400:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 4277us (5070us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826424.718339:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2255 00000100:00100000:0.0:1787826424.719927:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826424.720265:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563990528 00000100:00100000:1.0:1787826424.720274:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563990528 00010000:00010000:1.0:1787826424.720390:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001a5fe178/0x22153cd396b83627 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16f0 expref: 12 pid: 28853 timeout: 1470 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826424.720748:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1298 00000100:00100000:1.0:1787826424.720767:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf181fe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563990528:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826424.720782:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826424.720803:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001a5fe178/0x22153cd396b83627 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x10e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16f0 expref: 12 pid: 28853 timeout: 1470 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.720818:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001a5fe178/0x22153cd396b83627 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16f0 expref: 12 pid: 28853 timeout: 1470 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.720847:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a5fe178/0x22153cd396b83627 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x10e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16f0 expref: 12 pid: 28853 timeout: 1470 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.720864:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826424.720868:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826424.720874:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b8367b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab171a expref: 11 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.720890:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b8367b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab171a expref: 11 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.720927:0:6504:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b8367b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab171a expref: 11 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826424.720943:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01dffc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6504:1874670585288192:192.168.203.39@tcp:105: 00000100:00100000:1.0:1787826424.721023:0:6504:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf087ac540 going to sleep for 11 seconds 00000100:00100000:0.0:1787826424.729168:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826424.729678:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01dffc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6504:1874670585288192:192.168.203.39@tcp:105: 00010000:00010000:3.0:1787826424.729704:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826424.729761:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf181fe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2403:x1874670563990528:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 8995us (9838us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826424.729774:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1298 00000100:00100000:1.0:1787826424.730753:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563990656 00000100:00100000:1.0:1787826424.730764:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563990656 00000100:00100000:1.0:1787826424.730821:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2256 00000100:00100000:1.0:1787826424.730831:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2403:x1874670563990656:12345-192.168.203.39@tcp:2:lfs.0 00002000:00010000:1.0:1787826424.730995:0:30695:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x10e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787826424.730999:0:30695:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x10e:0x0] updating lvb mtime from disk: 0 -> 1787826412 00002000:00010000:1.0:1787826424.731002:0:30695:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x10e:0x0] updating lvb atime from disk: 0 -> 1787826412 00002000:00010000:1.0:1787826424.731004:0:30695:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x10e:0x0] updating lvb ctime from disk: 0 -> 1787826425 00002000:00010000:1.0:1787826424.731007:0:30695:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x10e:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1787826424.731138:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563990656:12345-192.168.203.39@tcp:2:lfs.0 Request processed in 308us (1979us total) trans 17179869685 rc 0/0 00000100:00100000:1.0:1787826424.731146:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2256 00000100:00100000:0.0:1787826424.744450:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826424.744669:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563990912 00000100:00100000:1.0:1787826424.744679:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563990912 00000100:00100000:1.0:1787826424.744738:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4022 00000100:00100000:1.0:1787826424.744749:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:55719:x1874670563990912:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:1.0:1787826424.744802:0:9966:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826424.744828:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b8360b lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16db expref: 35 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.744848:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826424.744854:0:9966:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826424.744900:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b83682 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.744912:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b83682 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.744923:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b83682 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826424.745021:0:9966:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000096013c1c reply state 000000006fc5aab7 transno 8589935223 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b83682 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.745033:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b83682 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.745041:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826424.745044:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826424.745047:0:9966:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787826424.745142:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55719:x1874670563990912:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 394us (701us total) trans 8589935223 rc 0/0 00000100:00100000:1.0:1787826424.745149:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4022 00000100:00100000:2.0:1787826424.750398:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826424.750554:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563991040 00000100:00100000:1.0:1787826424.750564:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563991040 00000100:00100000:1.0:1787826424.750611:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2257 00000100:00100000:1.0:1787826424.750620:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:55719:x1874670563991040:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826424.750637:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826424.750654:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000421aa0a2/0x22153cd396b83689 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1721 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.750683:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000951304c9/0x22153cd396b83658 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab170c expref: 9 pid: 30695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.750693:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826424.750697:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826424.750702:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000421aa0a2/0x22153cd396b83689 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1721 expref: 9 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.750741:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000951304c9/0x22153cd396b83658 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab170c expref: 9 pid: 30695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.750755:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000951304c9/0x22153cd396b83658 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab170c expref: 9 pid: 30695 timeout: 1470 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826424.750775:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01dfcb40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1874670585288320:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826424.750856:0:8437:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf087ac540 going to sleep for 11 seconds 00000100:00100000:0.0:1787826424.756916:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826424.757026:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01dfcb40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1874670585288320:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826424.757056:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000421aa0a2/0x22153cd396b83689 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1721 expref: 9 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.757077:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46bc00, rc 0) 00000100:00100000:1.0:1787826424.757151:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:55719:x1874670563991040:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 6531us (6772us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826424.757160:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2257 00000100:00100000:2.0:1787826424.757354:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563991168 00000100:00100000:2.0:1787826424.757362:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563991168 00010000:00010000:2.0:1787826424.757395:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000951304c9/0x22153cd396b83658 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab170c expref: 9 pid: 30695 timeout: 1470 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826424.757436:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1299 00000100:00100000:2.0:1787826424.757445:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563991168:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826424.757459:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826424.757517:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000951304c9/0x22153cd396b83658 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x10d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab170c expref: 9 pid: 30695 timeout: 1470 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.757532:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000951304c9/0x22153cd396b83658 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab170c expref: 9 pid: 30695 timeout: 1470 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.757556:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000951304c9/0x22153cd396b83658 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x10d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab170c expref: 9 pid: 30695 timeout: 1470 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.757570:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826424.757574:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826424.757580:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000421aa0a2/0x22153cd396b83689 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1721 expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.757590:0:10340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000421aa0a2/0x22153cd396b83689 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1721 expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.757623:0:10340:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000421aa0a2/0x22153cd396b83689 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1721 expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826424.757635:0:10340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0300cb40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10340:1874670585288448:192.168.203.39@tcp:105: 00000100:00100000:2.0:1787826424.757702:0:10340:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce05b569c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826424.765368:0:10340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0300cb40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10340:1874670585288448:192.168.203.39@tcp:105: 00010000:00010000:2.0:1787826424.765393:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826424.765453:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2404:x1874670563991168:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 8008us (8545us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826424.765467:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1299 00000100:00100000:3.0:1787826424.769277:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826424.769510:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563991296 00000100:00100000:1.0:1787826424.769519:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563991296 00000100:00100000:1.0:1787826424.769591:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2258 00000100:00100000:1.0:1787826424.769601:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf07964780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2403:x1874670563991296:12345-192.168.203.39@tcp:2:lfs.0 00002000:00010000:1.0:1787826424.770004:0:30398:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x10d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787826424.770008:0:30398:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x10d:0x0] updating lvb mtime from disk: 1787826412 -> 1787826412 00002000:00010000:1.0:1787826424.770011:0:30398:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x10d:0x0] updating lvb atime from disk: 1787826412 -> 1787826412 00002000:00010000:1.0:1787826424.770014:0:30398:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x10d:0x0] updating lvb ctime from disk: 1787826424 -> 1787826425 00002000:00010000:1.0:1787826424.770016:0:30398:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x10d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1787826424.770082:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf07964780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670563991296:12345-192.168.203.39@tcp:2:lfs.0 Request processed in 482us (814us total) trans 21474837026 rc 0/0 00000100:00100000:1.0:1787826424.770090:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2258 00000100:00100000:3.0:1787826424.775990:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826424.776092:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563991552 00000100:00100000:2.0:1787826424.776102:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563991552 00000100:00100000:2.0:1787826424.776174:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1250 00000100:00100000:2.0:1787826424.776184:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eea3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55719:x1874670563991552:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:2.0:1787826424.776258:0:14257:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000405:0x1d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b83635 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16f7 expref: 36 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.776309:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83690 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.776321:0:14257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b83563 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16a3 expref: 36 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.776329:0:14257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b835b0 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16b8 expref: 36 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.776336:0:14257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83690 lrc: 5/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.776368:0:14257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b835b0 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16b8 expref: 36 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.776383:0:14257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b835b0 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16b8 expref: 36 pid: 9966 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826424.776397:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0300cb40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585288576:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826424.776533:0:14257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b83563 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16a3 expref: 36 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.776542:0:14257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b83563 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16a3 expref: 36 pid: 6519 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826424.776552:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0300de00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585288704:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826424.776585:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce05b56c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787826424.786207:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0300cb40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585288576:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826424.786224:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0300de00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585288704:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826424.786253:0:14257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83690 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826424.790325:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826424.790369:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826424.790510:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563991936 00000100:00100000:1.0:1787826424.790521:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563991936 00010000:00010000:1.0:1787826424.790562:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b83563 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16a3 expref: 37 pid: 6519 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826424.790609:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1300 00000100:00100000:1.0:1787826424.790619:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf07965a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:2404:x1874670563991936:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826424.790632:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826424.790638:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b83563 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16a3 expref: 37 pid: 6519 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.790651:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b83563 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16a3 expref: 37 pid: 6519 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.790673:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b83563 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16a3 expref: 37 pid: 6519 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.790689:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826424.790695:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83690 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.790704:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83690 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.790710:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826424.790763:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf07965a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:2404:x1874670563991936:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 146us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826424.790771:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1300 00000100:00100000:2.0:1787826424.791505:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563991808 00000100:00100000:2.0:1787826424.791513:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563991808 00000100:00100000:2.0:1787826424.791550:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1251 00000100:00100000:2.0:1787826424.791557:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf079643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:42220:x1874670563991808:12345-192.168.203.39@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787826424.791748:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf079643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:42220:x1874670563991808:12345-192.168.203.39@tcp:35:ldlm_bl.0 Request processed in 191us (1434us total) trans 8589935224 rc 0/0 00000100:00100000:2.0:1787826424.791756:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1251 00000100:00100000:3.0:1787826424.794193:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826424.794296:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563992064 00000100:00100000:1.0:1787826424.794307:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563992064 00010000:00010000:1.0:1787826424.794352:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b835b0 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16b8 expref: 37 pid: 9966 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826424.794405:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1301 00000100:00100000:1.0:1787826424.794424:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06305e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:2404:x1874670563992064:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826424.794439:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826424.794446:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b835b0 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16b8 expref: 37 pid: 9966 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.794459:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b835b0 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16b8 expref: 37 pid: 9966 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.794521:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e200/0x22153cd396b835b0 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16b8 expref: 37 pid: 9966 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.794541:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826424.794547:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83690 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.794556:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83690 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.794563:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83690 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.794598:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826424.794645:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06305e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:2404:x1874670563992064:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 227us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826424.794656:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1301 00010000:00010000:2.0:1787826424.795828:0:14257:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83690 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.795841:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83690 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.795871:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b83697 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x40:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.795887:0:14257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83674 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x40:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1713 expref: 35 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.795904:0:14257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b83697 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x40:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.796089:0:14257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83674 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x40:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1713 expref: 35 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.796103:0:14257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83674 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x40:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1713 expref: 35 pid: 6518 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826424.796127:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0300de00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585288832:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826424.796253:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce05b569c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826424.805545:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826424.805578:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563992192 00000100:00100000:3.0:1787826424.805586:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563992192 00010000:00010000:3.0:1787826424.805623:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83674 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x40:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1713 expref: 36 pid: 6518 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826424.805657:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1302 00000100:00100000:3.0:1787826424.805666:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06305a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:2404:x1874670563992192:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826424.805681:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826424.805687:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83674 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x40:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1713 expref: 36 pid: 6518 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.805700:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83674 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x40:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1713 expref: 36 pid: 6518 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.805721:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x40:0x0].0x0 (ffff90cf39e67e00) 00010000:00010000:3.0:1787826424.805727:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b83697 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x40:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.805740:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b83697 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x40:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.805748:0:10340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b83697 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x40:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.805877:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83674 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x40:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1713 expref: 36 pid: 6518 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826424.805893:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0300de00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585288832:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826424.805914:0:14257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b83697 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x40:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826424.806025:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826424.806075:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06305a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:2404:x1874670563992192:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 409us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826424.806082:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1302 00010000:00010000:2.0:1787826424.811093:0:14257:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b83697 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x40:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.811109:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b83697 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x40:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826424.812109:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0300de00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585288960:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1787826424.812187:0:14257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826424.812287:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce05b56d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787826424.812705:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585288960 00000100:00100000:0.0:1787826424.812713:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585288960 00000100:00100000:0.0:1787826424.812797:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1496 00000100:00100000:0.0:1787826424.812806:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:14257:x1874670585288960:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1787826424.812897:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:14257:x1874670585288960:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 92us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826424.812916:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1496 00000100:00100000:2.0:1787826424.812977:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0300de00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585288960:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1787826424.813028:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0300de00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585289088:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1787826424.813055:0:14257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826424.813203:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce05b56d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787826424.813263:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585289088 00000100:00100000:1.0:1787826424.813268:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585289088 00000100:00100000:1.0:1787826424.813315:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1497 00000100:00100000:1.0:1787826424.813323:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:14257:x1874670585289088:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1787826424.813392:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:14257:x1874670585289088:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 69us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826424.813399:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1497 00000100:00100000:2.0:1787826424.813454:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0300de00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585289088:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:2.0:1787826424.813598:0:14257:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589935225 00000100:00100000:2.0:1787826424.813653:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0300de00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585289216:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1787826424.813680:0:14257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826424.813700:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce05b56600 going to sleep for 11 seconds 00000100:00100000:1.0:1787826424.813766:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585289216 00000100:00100000:1.0:1787826424.813770:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585289216 00000100:00100000:1.0:1787826424.813791:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1498 00000100:00100000:1.0:1787826424.813797:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:14257:x1874670585289216:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1787826424.813904:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:14257:x1874670585289216:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 106us (223us total) trans 17179869686 rc 0/0 00000100:00100000:2.0:1787826424.814003:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0300de00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585289216:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:2.0:1787826424.814055:0:14257:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589935226 00010000:00010000:2.0:1787826424.814078:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b83697 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x40:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.814088:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b83697 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x40:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.814095:0:14257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b83697 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x40:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.814101:0:14257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826424.814105:0:14257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b83697 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x40:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.814113:0:14257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b83697 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x40:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.814138:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x40:0x0].0x0 (ffff90cf39e67e00) 00010000:00010000:2.0:1787826424.814141:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787826424.814146:0:14257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b83697 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x40:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.814151:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b83697 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x40:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.814165:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83690 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.814171:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83690 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.814176:0:14257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83690 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.814180:0:14257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826424.814183:0:14257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83690 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.814189:0:14257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83690 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.814197:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826424.814199:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787826424.814202:0:14257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83690 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.814213:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83690 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.814223:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826424.814225:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787826424.814230:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400200/0x22153cd396b83635 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab16f7 expref: 37 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826424.814313:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eea3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55719:x1874670563991552:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 38131us (38333us total) trans 8589935227 rc 0/0 00000100:00100000:2.0:1787826424.814321:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1250 00000020:00080000:2.0:1787826424.814325:0:14257:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1787826424.814392:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1498 00000100:00100000:2.0:1787826424.817459:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826424.817683:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563992320 00000100:00100000:0.0:1787826424.817692:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563992320 00000100:00100000:0.0:1787826424.817744:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4023 00000100:00100000:0.0:1787826424.817755:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55719:x1874670563992320:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826424.817779:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826424.817801:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8369e lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1728 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.817864:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8369e lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1728 expref: 37 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.817880:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8369e lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1728 expref: 37 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.817899:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826424.817902:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826424.817976:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165fe00, rc 0) 00000100:00100000:0.0:1787826424.818034:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:55719:x1874670563992320:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 280us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826424.818041:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4023 00000100:00100000:1.0:1787826424.827216:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826424.827306:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563992576 00000100:00100000:2.0:1787826424.827316:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563992576 00000100:00100000:2.0:1787826424.827368:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1252 00000100:00100000:2.0:1787826424.827378:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01dfcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:55719:x1874670563992576:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:2.0:1787826424.827801:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01dfcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:55719:x1874670563992576:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 422us (593us total) trans 8589935228 rc 0/0 00000100:00100000:2.0:1787826424.827810:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1252 00000100:00100000:3.0:1787826424.839686:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826424.841032:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563992832 00000100:00100000:2.0:1787826424.841046:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563992832 00000100:00100000:2.0:1787826424.841181:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1253 00000100:00100000:2.0:1787826424.841193:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce063052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:55719:x1874670563992832:12345-192.168.203.39@tcp:35:lfs.0 00000004:00080000:2.0:1787826424.841381:0:14257:0:(mdd_object.c:4014:mdd_close()) Object [0x200000405:0x40:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:2.0:1787826424.841461:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b836a5 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x40:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.843039:0:14257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b836a5 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.843059:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b836a5 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.843070:0:14257:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b836a5 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.843076:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b836a5 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.843083:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b836a5 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.843176:0:14257:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787826424.843308:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce063052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+39:55719:x1874670563992832:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 2114us (3832us total) trans 8589935229 rc 0/0 00000100:00100000:2.0:1787826424.843318:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1253 00010000:00010000:0.0:1787826424.845462:0:7460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787826424.845483:0:7460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b836a5 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.845494:0:7460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834800 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826424.845498:0:7460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b836a5 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.845507:0:7460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b836a5 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.845525:0:7460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x40:0x0].0x0 (ffff90cf39e67e00) 00010000:00010000:0.0:1787826424.845528:0:7460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787826424.845533:0:7460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b836a5 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.845540:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b836a5 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.845625:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826424.845629:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826424.845631:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826424.867067:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826424.867148:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563992960 00000100:00100000:0.0:1787826424.867158:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563992960 00000100:00100000:0.0:1787826424.867215:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4024 00000100:00100000:0.0:1787826424.867224:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+39:55721:x1874670563992960:12345-192.168.203.39@tcp:101:getfattr.0 00010000:00010000:0.0:1787826424.867245:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826424.867265:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b836ac lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab172f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.867325:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b836b3 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.867339:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b836b3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.867351:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b836b3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.867363:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b836ba lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.867370:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b836ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.867376:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b836ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.867451:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b836c1 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.867460:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b836c1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.867466:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b836c1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826424.867529:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:0.0:1787826424.867534:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826424.867552:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b836c1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.867563:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b836c1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.867572:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b836b3 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.867578:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b836b3 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.867584:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b836b3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.867590:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b836b3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.867595:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165ee00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826424.867598:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b836b3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.867606:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b836b3 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.867617:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90ce036caa00) 00010000:00010000:0.0:1787826424.867620:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826424.867623:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b836b3 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.867629:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b836b3 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.867640:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b836ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.867646:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b836ba lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.867651:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b836ba lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.867655:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165e600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826424.867658:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b836ba lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.867663:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b836ba lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.867668:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90ce036cab00) 00010000:00010000:0.0:1787826424.867670:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826424.867672:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b836ba lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.867681:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b836ba lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.867716:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b836ac lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab172f expref: 41 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.867729:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b836c1 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab172f expref: 40 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.867735:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826424.867738:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826424.867740:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165fc00, rc 0) 00000100:00100000:0.0:1787826424.868614:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55721:x1874670563992960:12345-192.168.203.39@tcp:101:getfattr.0 Request processed in 1385us (1550us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826424.868622:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4024 00000100:00100000:3.0:1787826424.920917:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826424.924272:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563993088 00000100:00100000:1.0:1787826424.924288:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563993088 00000100:00100000:1.0:1787826424.924402:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4025 00000100:00100000:1.0:1787826424.924412:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06307c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55725:x1874670563993088:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:1.0:1787826424.924500:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b836c8 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.924517:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b836c8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.924527:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b836c8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.924539:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b836cf lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.924545:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b836cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.924551:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b836cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.924620:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b836d6 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.924629:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b836d6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.924636:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b836d6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826424.924674:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:1.0:1787826424.924678:0:8247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826424.924691:0:8247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b836d6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.924703:0:8247:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b836c8 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.924711:0:8247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b836c8 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.924855:0:8247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b836c8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.924865:0:8247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b836c8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.924871:0:8247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46aa00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826424.924874:0:8247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b836c8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.924882:0:8247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b836c8 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.924893:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf3ab61d00) 00010000:00010000:1.0:1787826424.924896:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826424.924900:0:8247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b836c8 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.924906:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b836c8 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.924925:0:8247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b836cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.924930:0:8247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b836cf lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.924935:0:8247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b836cf lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.924940:0:8247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46b400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826424.924943:0:8247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b836cf lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.924948:0:8247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b836cf lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.924955:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf3ab61900) 00010000:00010000:1.0:1787826424.924958:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826424.924960:0:8247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b836cf lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.924965:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b836cf lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.924975:0:8247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b836d6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.924981:0:8247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b836d6 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.924987:0:8247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b836d6 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.924991:0:8247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46ae00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826424.924994:0:8247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b836d6 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.924999:0:8247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b836d6 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.925005:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826424.925007:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826424.925010:0:8247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b836d6 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.925015:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b836d6 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826424.925172:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06307c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55725:x1874670563993088:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 759us (4264us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826424.925180:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4025 00000100:00100000:3.0:1787826424.958968:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826424.959608:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563993344 00000100:00100000:2.0:1787826424.959619:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563993344 00000100:00100000:2.0:1787826424.959684:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4026 00000100:00100000:2.0:1787826424.959693:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06305680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55727:x1874670563993344:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826424.959712:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826424.959733:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b836dd lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1736 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.959893:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b836e4 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.959908:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b836e4 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.959919:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b836e4 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826424.959929:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:2.0:1787826424.960061:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b836dd lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1736 expref: 43 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.960079:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b836e4 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1736 expref: 42 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.960104:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826424.960107:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787826424.960110:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834800, rc 0) 00000100:00100000:2.0:1787826424.960449:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06305680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+42:55727:x1874670563993344:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 755us (1488us total) trans 8589935230 rc 0/0 00000100:00100000:2.0:1787826424.960457:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4026 00000100:00100000:2.0:1787826424.964595:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826424.964881:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563993600 00000100:00100000:1.0:1787826424.964892:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563993600 00000100:00100000:1.0:1787826424.964986:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4027 00000100:00100000:1.0:1787826424.964997:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+42:55727:x1874670563993600:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826424.965019:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826424.965051:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b836f2 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab173d expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.965195:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b836f9 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.965210:0:32404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b836c1 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab172f expref: 43 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.965218:0:32404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b836f9 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.965252:0:32404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b836c1 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab172f expref: 43 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.965265:0:32404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b836c1 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab172f expref: 43 pid: 6519 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826424.965279:0:32404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01dfed00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:32404:1874670585289344:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826424.965368:0:32404:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf087ac540 going to sleep for 11 seconds 00000100:00100000:3.0:1787826424.968852:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826424.968901:0:32404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01dfed00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:32404:1874670585289344:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826424.968930:0:32404:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b836f9 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826424.969003:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563993728 00000100:00100000:0.0:1787826424.969009:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563993728 00010000:00010000:0.0:1787826424.969053:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b836c1 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab172f expref: 44 pid: 6519 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826424.969095:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1303 00000100:00100000:0.0:1787826424.969104:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06306d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:2403:x1874670563993728:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826424.969131:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826424.969140:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b836c1 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab172f expref: 44 pid: 6519 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.969159:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b836c1 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab172f expref: 44 pid: 6519 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.969191:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b836c1 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab172f expref: 44 pid: 6519 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.969208:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826424.969212:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b836f9 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.969220:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b836f9 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.969229:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b836f9 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826424.969253:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826424.969308:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06306d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:2403:x1874670563993728:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 204us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826424.969316:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1303 00010000:00010000:1.0:1787826424.969387:0:32404:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b836f9 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.969394:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b836f9 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826424.969415:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:1.0:1787826424.970294:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b836f2 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab173d expref: 44 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.970312:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b836f9 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab173d expref: 43 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826424.970320:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826424.970323:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787826424.970325:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46b400, rc 0) 00000100:00100000:1.0:1787826424.970371:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55727:x1874670563993600:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 5376us (5783us total) trans 8589935231 rc 0/0 00000100:00100000:1.0:1787826424.970378:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4027 00000100:00100000:3.0:1787826424.976184:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826424.976345:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563993856 00000100:00100000:2.0:1787826424.976355:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563993856 00000100:00100000:2.0:1787826424.976414:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1254 00000100:00100000:2.0:1787826424.976424:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55727:x1874670563993856:12345-192.168.203.39@tcp:33:lfs.0 00000100:00100000:2.0:1787826424.976759:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55727:x1874670563993856:12345-192.168.203.39@tcp:33:lfs.0 Request processed in 335us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826424.976768:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1254 00000100:00100000:3.0:1787826424.978944:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826424.979606:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563994112 00000100:00100000:2.0:1787826424.979616:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563994112 00000100:00100000:2.0:1787826424.979676:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1255 00000100:00100000:2.0:1787826424.979685:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06304b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55727:x1874670563994112:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:2.0:1787826424.979895:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06304b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55727:x1874670563994112:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 209us (957us total) trans 8589935232 rc 0/0 00000100:00100000:2.0:1787826424.979903:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1255 00000100:00100000:0.0:1787826424.989680:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826424.993051:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563994368 00000100:00100000:2.0:1787826424.993066:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563994368 00000100:00100000:2.0:1787826424.993219:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4028 00000100:00100000:2.0:1787826424.993231:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55727:x1874670563994368:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826424.993255:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826424.993258:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:2.0:1787826424.993288:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b836f9 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab173d expref: 44 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.993312:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b836e4 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1736 expref: 43 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.993323:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826424.993329:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826424.993341:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83707 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1744 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.993439:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b8370e lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.993452:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b8370e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.993462:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b8370e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826424.994461:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:2.0:1787826424.994677:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83707 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1744 expref: 45 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.994694:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b8370e lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1744 expref: 44 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826424.994702:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826424.994705:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787826424.994708:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834600, rc 0) 00000100:00100000:2.0:1787826424.995011:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55727:x1874670563994368:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1780us (5338us total) trans 8589935233 rc 0/0 00000100:00100000:2.0:1787826424.995019:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4028 00000100:00100000:1.0:1787826425.003227:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826425.003320:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563994624 00000100:00100000:0.0:1787826425.003330:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563994624 00000100:00100000:0.0:1787826425.003397:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1256 00000100:00100000:0.0:1787826425.003417:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eea2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55727:x1874670563994624:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:0.0:1787826425.003504:0:6522:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000405:0x1d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b8370e lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1744 expref: 44 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.003558:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b8371c lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.003711:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8369e lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1728 expref: 44 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.003719:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b8371c lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.003750:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8369e lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1728 expref: 44 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.003762:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8369e lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1728 expref: 44 pid: 6520 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826425.003778:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fdfc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585289472:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826425.004134:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f67e180 going to sleep for 11 seconds 00000100:00080000:3.0:1787826425.004356:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787826425.007051:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fdfc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585289472:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826425.007078:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b8371c lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826425.007692:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826425.009162:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563994752 00000100:00100000:3.0:1787826425.009172:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563994752 00010000:00010000:3.0:1787826425.009220:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8369e lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1728 expref: 45 pid: 6520 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826425.009263:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1304 00000100:00100000:3.0:1787826425.009273:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01dfed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+45:2403:x1874670563994752:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826425.009287:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826425.009294:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8369e lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1728 expref: 45 pid: 6520 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826425.009323:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8369e lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1728 expref: 45 pid: 6520 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826425.009348:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b8369e lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1728 expref: 45 pid: 6520 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826425.009365:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826425.009371:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b8371c lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826425.009381:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b8371c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826425.009389:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b8371c lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826425.009413:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826425.009463:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01dfed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:2403:x1874670563994752:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 191us (1773us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826425.009493:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1304 00010000:00010000:1.0:1787826425.010015:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b8371c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.010025:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b8371c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.010187:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b8371c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.010196:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b8371c lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.010203:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b8371c lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.010209:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165ea00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826425.010214:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b8371c lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.010221:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b8371c lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.010231:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826425.010234:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787826425.010239:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b8371c lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.010245:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b8371c lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.010256:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826425.010259:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787826425.010265:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834600/0x22153cd396b8370e lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1744 expref: 43 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826425.010380:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eea2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55727:x1874670563994624:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 6973us (7163us total) trans 8589935234 rc -22/-22 00000100:00100000:1.0:1787826425.010389:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1256 00000100:00100000:1.0:1787826425.018380:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826425.018791:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563994880 00000100:00100000:3.0:1787826425.018801:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563994880 00000100:00100000:3.0:1787826425.018874:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4029 00000100:00100000:3.0:1787826425.019023:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01dfcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55727:x1874670563994880:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826425.019048:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826425.019068:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b83723 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab174b expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826425.019191:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b83723 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab174b expref: 44 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826425.019205:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b83723 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab174b expref: 44 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826425.019221:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826425.019224:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826425.019227:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401800, rc 0) 00000100:00100000:3.0:1787826425.019295:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01dfcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55727:x1874670563994880:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 270us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826425.019303:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4029 00000100:00100000:3.0:1787826425.022641:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826425.022819:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563995136 00000100:00100000:2.0:1787826425.022887:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563995136 00000100:00100000:2.0:1787826425.023062:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4030 00000100:00100000:2.0:1787826425.023073:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06307840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55727:x1874670563995136:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826425.023091:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826425.023112:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8372a lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1752 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.023581:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b83731 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x41:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.023600:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b83731 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.023612:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b83731 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826425.023621:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x41:0x0]: returning size 0 00010000:00010000:2.0:1787826425.023658:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8372a lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1752 expref: 47 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.023678:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b83731 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1752 expref: 46 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.023699:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x41:0x0].0x0 (ffff90cf39e67800) 00010000:00010000:2.0:1787826425.023702:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826425.023705:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834800, rc 0) 00000100:00100000:2.0:1787826425.023768:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06307840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+46:55727:x1874670563995136:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 698us (1140us total) trans 8589935235 rc 0/0 00000100:00100000:2.0:1787826425.023775:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4030 00000100:00100000:0.0:1787826425.035467:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826425.035584:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563995392 00000100:00100000:1.0:1787826425.035593:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563995392 00000100:00100000:1.0:1787826425.035651:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4031 00000100:00100000:1.0:1787826425.035661:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+46:55727:x1874670563995392:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826425.035682:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826425.035702:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b8373f lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1759 expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.035808:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b83746 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.035823:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b83746 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.035844:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b83746 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826425.035855:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:1.0:1787826425.035946:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b8373f lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1759 expref: 49 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.035969:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b83746 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1759 expref: 48 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.035978:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826425.035981:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787826425.035983:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46aa00, rc 0) 00000100:00100000:1.0:1787826425.036051:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55727:x1874670563995392:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 392us (593us total) trans 8589935236 rc 0/0 00000100:00100000:1.0:1787826425.036057:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4031 00000100:00100000:3.0:1787826425.044227:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826425.044558:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563995648 00000100:00100000:2.0:1787826425.044567:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563995648 00000100:00100000:2.0:1787826425.045170:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1257 00000100:00100000:2.0:1787826425.045181:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06306580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55727:x1874670563995648:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:2.0:1787826425.045258:0:14257:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000405:0x1d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b83746 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1759 expref: 48 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.045299:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83754 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.045312:0:14257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b83723 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab174b expref: 48 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.045320:0:14257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83754 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.045353:0:14257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b83723 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab174b expref: 48 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.045366:0:14257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b83723 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab174b expref: 48 pid: 8247 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826425.045380:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0300c3c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585289600:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826425.045512:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10abab40 going to sleep for 11 seconds 00000100:00100000:2.0:1787826425.049831:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0300c3c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585289600:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826425.049860:0:14257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83754 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826425.050421:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826425.051654:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563995776 00000100:00100000:2.0:1787826425.051664:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563995776 00010000:00010000:2.0:1787826425.051709:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b83723 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab174b expref: 49 pid: 8247 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826425.051754:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1305 00000100:00100000:2.0:1787826425.051763:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf181fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:2404:x1874670563995776:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826425.051778:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826425.051785:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b83723 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab174b expref: 49 pid: 8247 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.051797:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b83723 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab174b expref: 49 pid: 8247 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.051822:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401800/0x22153cd396b83723 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab174b expref: 49 pid: 8247 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.051838:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826425.051844:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83754 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.051855:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83754 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.051863:0:10340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83754 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.051898:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826425.051925:0:14257:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83754 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826425.051935:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83754 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826425.051966:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b8375b lrc: 3/0,1 mode: --/EX res: [0x200000405:0x41:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826425.051976:0:14257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b83731 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1752 expref: 48 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826425.051989:0:14257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b8375b lrc: 4/0,1 mode: --/EX res: [0x200000405:0x41:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826425.052019:0:14257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b83731 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1752 expref: 48 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826425.052031:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf181fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:2404:x1874670563995776:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 266us (1609us total) trans 0 rc 0/0 00010000:00010000:3.0:1787826425.052034:0:14257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b83731 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1752 expref: 48 pid: 16564 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826425.052047:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1305 00000100:00100000:3.0:1787826425.052054:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce063061c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585289728:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826425.052128:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3900 going to sleep for 11 seconds 00000100:00100000:3.0:1787826425.055137:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce063061c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585289728:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826425.055162:0:14257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b8375b lrc: 3/0,1 mode: --/EX res: [0x200000405:0x41:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826425.055520:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826425.055657:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563995904 00000100:00100000:1.0:1787826425.055663:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563995904 00010000:00010000:1.0:1787826425.055699:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b83731 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1752 expref: 48 pid: 16564 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826425.055729:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1306 00000100:00100000:1.0:1787826425.055738:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:2403:x1874670563995904:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826425.055751:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826425.055758:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b83731 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1752 expref: 48 pid: 16564 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.055770:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b83731 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1752 expref: 48 pid: 16564 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.055790:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b83731 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1752 expref: 48 pid: 16564 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.055811:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x41:0x0].0x0 (ffff90cf39e67800) 00010000:00010000:1.0:1787826425.055816:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b8375b lrc: 3/0,1 mode: --/EX res: [0x200000405:0x41:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.055824:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b8375b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x41:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.055832:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b8375b lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x41:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.055864:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826425.055916:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+47:2403:x1874670563995904:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 178us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826425.055923:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1306 00010000:00010000:2.0:1787826425.055974:0:14257:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b8375b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x41:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.055982:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b8375b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x41:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826425.056280:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0300c3c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585289856:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1787826425.056325:0:14257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826425.056356:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf079b4480 going to sleep for 11 seconds 00000100:00100000:1.0:1787826425.056407:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585289856 00000100:00100000:1.0:1787826425.056412:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585289856 00000100:00080000:3.0:1787826425.056461:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826425.056503:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1499 00000100:00100000:1.0:1787826425.056512:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:14257:x1874670585289856:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1787826425.056594:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:14257:x1874670585289856:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 84us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826425.056601:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1499 00000100:00100000:3.0:1787826425.056662:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0300c3c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585289856:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:3.0:1787826425.056706:0:14257:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589935237 00000001:00080000:3.0:1787826425.057125:0:14257:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589935238 00010000:00010000:3.0:1787826425.057152:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b8375b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x41:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826425.057160:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b8375b lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x41:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826425.057165:0:14257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b8375b lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x41:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826425.057175:0:14257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826425.057179:0:14257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b8375b lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x41:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826425.057185:0:14257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b8375b lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x41:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826425.057205:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x41:0x0].0x0 (ffff90cf39e67800) 00010000:00010000:3.0:1787826425.057208:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787826425.057211:0:14257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b8375b lrc: 2/0,0 mode: --/EX res: [0x200000405:0x41:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826425.057217:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b8375b lrc: 0/0,0 mode: --/EX res: [0x200000405:0x41:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826425.057235:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83754 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826425.057242:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83754 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826425.057248:0:14257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83754 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826425.057253:0:14257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826425.057255:0:14257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83754 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826425.057261:0:14257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83754 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826425.057271:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826425.057273:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787826425.057275:0:14257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83754 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826425.057280:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83754 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826425.057290:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826425.057292:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787826425.057298:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b83746 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1759 expref: 49 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826425.057425:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06306580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55727:x1874670563995648:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 12245us (13207us total) trans 8589935239 rc 0/0 00000100:00100000:3.0:1787826425.057434:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1257 00000020:00080000:3.0:1787826425.057438:0:14257:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1787826425.062766:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826425.066821:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563996032 00000100:00100000:2.0:1787826425.066834:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563996032 00000100:00100000:2.0:1787826425.066902:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4032 00000100:00100000:2.0:1787826425.066911:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55727:x1874670563996032:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826425.066933:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826425.066952:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b83762 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1760 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.067004:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b83762 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1760 expref: 49 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.067019:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b83762 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1760 expref: 49 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.067035:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826425.067037:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826425.067041:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835a00, rc 0) 00000100:00100000:2.0:1787826425.067101:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:55727:x1874670563996032:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 191us (4347us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826425.067107:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4032 00000100:00100000:0.0:1787826425.073369:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826425.073504:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563996288 00000100:00100000:1.0:1787826425.073514:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563996288 00000100:00100000:0.0:1787826425.073634:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1258 00000100:00100000:0.0:1787826425.073647:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:55727:x1874670563996288:12345-192.168.203.39@tcp:35:lfs.0 00000004:00080000:0.0:1787826425.073983:0:6522:0:(mdd_object.c:4014:mdd_close()) Object [0x200000405:0x41:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787826425.074050:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].32, 64 off10696 00000004:00080000:0.0:1787826425.074064:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1371085592254ns, next at 1372085588862ns, rc = 0 00000001:00080000:0.0:1787826425.074072:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589935240 00010000:00010000:0.0:1787826425.074196:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b83769 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x41:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.074211:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b83769 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x41:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.074222:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b83769 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x41:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.074231:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b83769 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x41:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.074237:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b83769 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x41:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.074244:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b83769 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x41:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.074326:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787826425.074431:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+51:55727:x1874670563996288:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 785us (1070us total) trans 8589935241 rc 0/0 00000100:00100000:0.0:1787826425.074439:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1258 00000020:00080000:0.0:1787826425.074444:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787826425.077633:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826425.077683:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563996544 00000100:00100000:3.0:1787826425.077694:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563996544 00000100:00100000:3.0:1787826425.077766:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1259 00000100:00100000:3.0:1787826425.077776:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01dffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+51:55727:x1874670563996544:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:3.0:1787826425.078247:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01dffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+52:55727:x1874670563996544:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 470us (621us total) trans 8589935242 rc 0/0 00000100:00100000:3.0:1787826425.078254:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1259 00010000:00010000:2.0:1787826425.079110:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826425.079127:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b83769 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x41:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.079138:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165ea00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826425.079142:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b83769 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x41:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.079153:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b83769 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x41:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.079170:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x41:0x0].0x0 (ffff90ce036caa00) 00010000:00010000:2.0:1787826425.079172:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787826425.079177:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b83769 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x41:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.079184:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b83769 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x41:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.079201:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826425.079203:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826425.079204:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826425.115247:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826425.115657:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563996672 00000100:00100000:1.0:1787826425.115667:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563996672 00000100:00100000:1.0:1787826425.115730:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4033 00000100:00100000:1.0:1787826425.115739:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce063061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+52:55729:x1874670563996672:12345-192.168.203.39@tcp:101:getfattr.0 00010000:00010000:1.0:1787826425.115772:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826425.115794:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b83770 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1767 expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.115866:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b83777 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.115881:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b83777 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.115892:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b83777 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.115905:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b8377e lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.115912:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b8377e lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.115919:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b8377e lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.116001:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b83785 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.116010:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b83785 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.116017:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b83785 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826425.116055:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:1.0:1787826425.116060:0:8247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826425.116080:0:8247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b83785 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.116091:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b83785 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.116099:0:8247:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b83777 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.116106:0:8247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b83777 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.116112:0:8247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b83777 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.116130:0:8247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b83777 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.116136:0:8247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46ba00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826425.116140:0:8247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b83777 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.116148:0:8247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b83777 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.116159:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf3ab61900) 00010000:00010000:1.0:1787826425.116162:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826425.116166:0:8247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b83777 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.116172:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b83777 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.116191:0:8247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b8377e lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.116196:0:8247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b8377e lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.116202:0:8247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b8377e lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.116207:0:8247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46b000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826425.116210:0:8247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b8377e lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.116217:0:8247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b8377e lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.116223:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf3ab61d00) 00010000:00010000:1.0:1787826425.116226:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826425.116228:0:8247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b8377e lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.116235:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b8377e lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.116261:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b83770 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1767 expref: 54 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.116275:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b83785 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1767 expref: 53 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.116288:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826425.116290:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826425.116293:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46a400, rc 0) 00000100:00100000:1.0:1787826425.116358:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce063061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55729:x1874670563996672:12345-192.168.203.39@tcp:101:getfattr.0 Request processed in 620us (1120us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826425.116366:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4033 00000100:00100000:0.0:1787826425.135340:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826425.135509:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563996800 00000100:00100000:1.0:1787826425.135526:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563996800 00000100:00100000:1.0:1787826425.135586:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2259 00000100:00100000:1.0:1787826425.135595:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2402:x1874670563996800:12345-192.168.203.39@tcp:101:getfattr.0 00010000:00010000:1.0:1787826425.135611:0:8545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826425.135629:0:8545:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8fb1ffc/0x22153cd396b8378c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab176e expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826425.135678:0:8545:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01dff480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8545:1874670585289984:192.168.203.39@tcp:106: 00000100:00100000:1.0:1787826425.135748:0:8545:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf396cf180 going to sleep for 11 seconds 00000100:00080000:3.0:1787826425.136219:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826425.143182:0:8545:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01dff480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8545:1874670585289984:192.168.203.39@tcp:106: 00010000:00010000:1.0:1787826425.143220:0:8545:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a8fb1ffc/0x22153cd396b8378c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab176e expref: 13 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.143244:0:8545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8fb1ffc/0x22153cd396b8378c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab176e expref: 13 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.143261:0:8545:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46ac00, rc 0) 00000100:00100000:1.0:1787826425.143319:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2402:x1874670563996800:12345-192.168.203.39@tcp:101:getfattr.0 Request processed in 7724us (7987us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826425.143328:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2259 00010000:00010000:2.0:1787826425.155671:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826425.182780:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826425.184366:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563996928 00000100:00100000:0.0:1787826425.184378:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563996928 00000100:00100000:0.0:1787826425.184450:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4034 00000100:00100000:0.0:1787826425.184461:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55733:x1874670563996928:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:0.0:1787826425.184579:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b83793 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.184595:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b83793 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.184605:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b83793 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.184617:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b8379a lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.184624:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b8379a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.184631:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b8379a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.184977:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b837a1 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.184987:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b837a1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.184995:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b837a1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826425.185042:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:0.0:1787826425.185046:0:16564:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826425.185058:0:16564:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b837a1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.185069:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b83793 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.185075:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b83793 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.185081:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b83793 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.185087:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165e000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826425.185090:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b83793 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.185096:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b83793 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.185106:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90ce036cab00) 00010000:00010000:0.0:1787826425.185109:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826425.186487:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b83793 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.186504:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b83793 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.187362:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b8379a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.187375:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b8379a lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.187381:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b8379a lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.187388:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165e400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826425.187393:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b8379a lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.187400:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b8379a lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.187423:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90ce036ca600) 00010000:00010000:0.0:1787826425.187427:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826425.187431:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b8379a lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.187437:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b8379a lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.187452:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b837a1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.187458:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b837a1 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.187464:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b837a1 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.187468:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165f600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826425.188045:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b837a1 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.188054:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b837a1 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.188068:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826425.188071:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826425.188074:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b837a1 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.188082:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b837a1 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826425.188198:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55733:x1874670563996928:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 3734us (5423us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826425.188208:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4034 00000100:00100000:1.0:1787826425.241247:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826425.243356:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563997184 00000100:00100000:0.0:1787826425.243367:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563997184 00000100:00100000:0.0:1787826425.243437:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4035 00000100:00100000:0.0:1787826425.243447:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01dff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55735:x1874670563997184:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826425.243466:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826425.243511:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b837a8 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1775 expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.243620:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b837af lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.243635:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b837af lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.243646:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b837af lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826425.243656:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:0.0:1787826425.243748:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b837a8 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1775 expref: 56 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.243767:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b837af lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1775 expref: 55 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.243775:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826425.243779:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787826425.243783:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165e400, rc 0) 00000100:00100000:0.0:1787826425.243845:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01dff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+55:55735:x1874670563997184:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 400us (2607us total) trans 8589935243 rc 0/0 00000100:00100000:0.0:1787826425.243852:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4035 00000100:00100000:1.0:1787826425.249708:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826425.250000:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563997312 00000100:00100000:0.0:1787826425.250009:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563997312 00000100:00100000:0.0:1787826425.250063:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2260 00000100:00100000:0.0:1787826425.250072:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01dfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563997312:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826425.250089:0:30696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826425.250105:0:30696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a27ec96/0x22153cd396b837bd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab177c expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826425.250174:0:30696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03976d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:30696:1874670585290112:192.168.203.39@tcp:106: 00000100:00100000:1.0:1787826425.252750:0:30696:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f67e840 going to sleep for 11 seconds 00000100:00100000:1.0:1787826425.264624:0:30696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03976d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:30696:1874670585290112:192.168.203.39@tcp:106: 00010000:00010000:1.0:1787826425.264666:0:30696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009a27ec96/0x22153cd396b837bd lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab177c expref: 13 pid: 30696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.264692:0:30696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a27ec96/0x22153cd396b837bd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab177c expref: 13 pid: 30696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.264705:0:30696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165f600, rc 0) 00000100:00100000:1.0:1787826425.264817:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01dfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563997312:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 14744us (15117us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826425.264826:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2260 00000100:00100000:3.0:1787826425.270801:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826425.271545:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563997568 00000100:00100000:0.0:1787826425.271555:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563997568 00000100:00100000:0.0:1787826425.271617:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4036 00000100:00100000:0.0:1787826425.271626:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06305e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+55:55735:x1874670563997568:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826425.271648:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826425.271668:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b837c4 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1783 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.271774:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b837cb lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.271790:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b83785 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1767 expref: 56 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.271799:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b837cb lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.271830:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b83785 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1767 expref: 56 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.271843:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b83785 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1767 expref: 56 pid: 8247 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826425.271855:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03977840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1874670585290240:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826425.272034:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f67e180 going to sleep for 11 seconds 00000100:00100000:2.0:1787826425.280712:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03977840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1874670585290240:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826425.280744:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b837cb lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826425.283768:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826425.283873:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563997696 00000100:00100000:2.0:1787826425.283883:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563997696 00010000:00010000:2.0:1787826425.283921:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b83785 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1767 expref: 57 pid: 8247 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826425.283957:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1307 00000100:00100000:2.0:1787826425.283965:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06305a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+57:2403:x1874670563997696:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826425.283978:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826425.283984:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b83785 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1767 expref: 57 pid: 8247 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.283996:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b83785 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1767 expref: 57 pid: 8247 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.284015:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b83785 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1767 expref: 57 pid: 8247 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.284040:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826425.284051:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b837cb lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.284061:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b837cb lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.284068:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b837cb lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.284099:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826425.284166:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06305a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+56:2403:x1874670563997696:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 201us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826425.284174:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1307 00010000:00010000:0.0:1787826425.284555:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b837cb lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.284565:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b837cb lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826425.284586:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:0.0:1787826425.284700:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b837c4 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1783 expref: 57 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.284723:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b837cb lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1783 expref: 56 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.284730:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826425.284733:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787826425.284735:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165f400, rc 0) 00000100:00100000:0.0:1787826425.284762:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06305e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+56:55735:x1874670563997568:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 13137us (13969us total) trans 8589935244 rc 0/0 00000100:00100000:0.0:1787826425.284768:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4036 00000100:00100000:0.0:1787826425.290802:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826425.290894:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563997952 00000100:00100000:1.0:1787826425.290903:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563997952 00000100:00100000:1.0:1787826425.290966:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4037 00000100:00100000:1.0:1787826425.290977:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03977840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+56:55735:x1874670563997952:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826425.291000:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826425.291022:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b837d9 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab178a expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.291543:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b837e0 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.291558:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b837e0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.291569:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b837e0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826425.291578:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x42:0x0]: returning size 0 00010000:00010000:1.0:1787826425.291622:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b837d9 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab178a expref: 59 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.291644:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b837e0 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab178a expref: 58 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.291653:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x42:0x0].0x0 (ffff90cf3ab61d00) 00010000:00010000:1.0:1787826425.291656:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826425.291659:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46b200, rc 0) 00000100:00100000:1.0:1787826425.291722:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03977840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:55735:x1874670563997952:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 746us (929us total) trans 8589935245 rc 0/0 00000100:00100000:1.0:1787826425.291730:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4037 00000100:00100000:1.0:1787826425.298624:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826425.299634:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563998208 00000100:00100000:0.0:1787826425.299644:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563998208 00000100:00100000:0.0:1787826425.299774:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4038 00000100:00100000:0.0:1787826425.299784:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01dff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:55735:x1874670563998208:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826425.299808:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826425.299829:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b837ee lrc: 2/0,0 mode: --/CR res: [0x200000405:0x42:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1791 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.299941:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b837f5 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x42:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.299956:0:16564:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b837e0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab178a expref: 59 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.299964:0:16564:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b837f5 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x42:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.299998:0:16564:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b837e0 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab178a expref: 59 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.300011:0:16564:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b837e0 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab178a expref: 59 pid: 8247 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826425.300024:0:16564:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03976d00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:16564:1874670585290368:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826425.300704:0:16564:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f67e180 going to sleep for 11 seconds 00000100:00100000:0.0:1787826425.304683:0:16564:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03976d00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:16564:1874670585290368:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826425.304714:0:16564:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b837f5 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x42:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826425.305156:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826425.305307:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563998336 00000100:00100000:3.0:1787826425.305314:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563998336 00010000:00010000:3.0:1787826425.305350:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b837e0 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab178a expref: 60 pid: 8247 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826425.305387:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1308 00000100:00100000:3.0:1787826425.305397:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01dfe580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:2403:x1874670563998336:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826425.305411:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826425.305428:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b837e0 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab178a expref: 60 pid: 8247 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826425.305441:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b837e0 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab178a expref: 60 pid: 8247 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826425.305465:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b837e0 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab178a expref: 60 pid: 8247 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826425.305521:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x42:0x0].0x0 (ffff90cf3ab61d00) 00010000:00010000:3.0:1787826425.305527:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b837f5 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x42:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826425.305536:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b837f5 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x42:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826425.305544:0:10340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b837f5 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x42:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826425.305563:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826425.305617:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01dfe580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:2403:x1874670563998336:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 220us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826425.305624:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1308 00010000:00010000:0.0:1787826425.305944:0:16564:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b837f5 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x42:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.305953:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b837f5 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x42:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826425.305974:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x42:0x0]: returning size 0 00000004:00080000:0.0:1787826425.306148:0:16564:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x10e:0x0], index 0: 0 00010000:00010000:0.0:1787826425.306257:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b837f5 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x42:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.306265:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b837f5 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x42:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.306272:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b837f5 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x42:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.306281:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165ec00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826425.306285:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b837f5 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x42:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.306300:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b837f5 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x42:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.306311:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x42:0x0].0x0 (ffff90cf3ab61d00) 00010000:00010000:0.0:1787826425.306313:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826425.306317:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b837f5 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x42:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.306322:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b837f5 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x42:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.306363:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b837ee lrc: 1/0,0 mode: --/CR res: [0x200000405:0x42:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1791 expref: 59 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.306372:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x42:0x0].0x0 (ffff90cf3ab61d00) 00010000:00010000:0.0:1787826425.306374:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787826425.306377:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b837ee lrc: 0/0,0 mode: --/CR res: [0x200000405:0x42:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1791 expref: 59 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.306390:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165fa00, rc 0) 00000100:00100000:0.0:1787826425.306441:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01dff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:55735:x1874670563998208:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 6658us (7826us total) trans 8589935246 rc 301/301 00000100:00100000:0.0:1787826425.306448:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4038 00000100:00100000:1.0:1787826425.313105:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826425.313462:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563998592 00000100:00100000:2.0:1787826425.314443:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563998592 00000100:00100000:2.0:1787826425.314703:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1260 00000100:00100000:2.0:1787826425.314714:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01dfcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:55735:x1874670563998592:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:2.0:1787826425.315773:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01dfcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55735:x1874670563998592:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 1058us (2674us total) trans 8589935247 rc 0/0 00000100:00100000:2.0:1787826425.315785:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1260 00000100:00100000:3.0:1787826425.319907:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826425.319995:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563998720 00000100:00100000:0.0:1787826425.320005:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563998720 00000100:00100000:0.0:1787826425.320077:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4039 00000100:00100000:0.0:1787826425.320087:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06306d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55735:x1874670563998720:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826425.320111:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826425.320143:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b83803 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1798 expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.320253:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b8380a lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.320268:0:9966:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b837cb lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1783 expref: 60 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.320278:0:9966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b8380a lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.320325:0:9966:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b837cb lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1783 expref: 60 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.320339:0:9966:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b837cb lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1783 expref: 60 pid: 6520 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826425.320354:0:9966:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03976d00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9966:1874670585290496:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826425.320446:0:9966:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f67e840 going to sleep for 11 seconds 00000100:00100000:3.0:1787826425.325408:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826425.325639:0:9966:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03976d00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9966:1874670585290496:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826425.325667:0:9966:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b8380a lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826425.325969:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563998848 00000100:00100000:1.0:1787826425.325976:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563998848 00010000:00010000:1.0:1787826425.326016:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b837cb lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1783 expref: 61 pid: 6520 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826425.326067:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1309 00000100:00100000:1.0:1787826425.326077:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce063052c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+61:2404:x1874670563998848:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826425.326095:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826425.326102:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b837cb lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1783 expref: 61 pid: 6520 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.326123:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b837cb lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1783 expref: 61 pid: 6520 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.326148:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b837cb lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1783 expref: 61 pid: 6520 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.326165:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826425.326170:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b8380a lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.326180:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b8380a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.326188:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b8380a lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.326575:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826425.326626:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce063052c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:2404:x1874670563998848:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 549us (1228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826425.326634:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1309 00010000:00010000:0.0:1787826425.328160:0:9966:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b8380a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.328173:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b8380a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826425.328336:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:1.0:1787826425.328341:0:9966:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826425.328360:0:9966:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b8380a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.328396:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b83803 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1798 expref: 60 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.328413:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b8380a lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1798 expref: 59 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.328431:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826425.328434:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826425.328437:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165f600, rc 0) 00000100:00100000:1.0:1787826425.328515:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06306d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55735:x1874670563998720:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 8429us (8615us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826425.328523:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4039 00000100:00100000:3.0:1787826425.332282:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826425.332575:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563998976 00000100:00100000:1.0:1787826425.332584:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563998976 00000100:00100000:1.0:1787826425.332644:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2261 00000100:00100000:1.0:1787826425.332654:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06304000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2402:x1874670563998976:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826425.332673:0:30695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826425.332692:0:30695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bacf1a1a/0x22153cd396b83811 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab179f expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826425.332751:0:30695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01dfc780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:30695:1874670585290624:192.168.203.39@tcp:106: 00000100:00100000:1.0:1787826425.332981:0:30695:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce02742d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787826425.336617:0:30695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01dfc780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:30695:1874670585290624:192.168.203.39@tcp:106: 00010000:00010000:1.0:1787826425.336651:0:30695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bacf1a1a/0x22153cd396b83811 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab179f expref: 13 pid: 30695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.336680:0:30695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bacf1a1a/0x22153cd396b83811 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab179f expref: 13 pid: 30695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.336692:0:30695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46b200, rc 0) 00000100:00100000:1.0:1787826425.336749:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06304000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2402:x1874670563998976:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 4097us (4478us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826425.336758:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2261 00000100:00100000:0.0:1787826425.341085:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826425.341165:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563999104 00000100:00100000:2.0:1787826425.341174:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563999104 00000100:00100000:2.0:1787826425.341241:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4040 00000100:00100000:2.0:1787826425.341252:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03976d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55735:x1874670563999104:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826425.341273:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826425.341307:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b83818 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab17a6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.341370:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b8381f lrc: 3/1,0 mode: --/PR res: [0x200000405:0x42:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.341383:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b8381f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x42:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.341393:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b8381f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x42:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826425.341432:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x42:0x0]: returning size 0 00000004:00200000:2.0:1787826425.341437:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826425.341454:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b8381f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x42:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.341523:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b83818 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17a6 expref: 61 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.341538:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b8381f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x42:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17a6 expref: 60 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.341550:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x42:0x0].0x0 (ffff90cf39e67a00) 00010000:00010000:2.0:1787826425.341553:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787826425.341556:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835800, rc 0) 00000100:00100000:2.0:1787826425.341609:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03976d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:55735:x1874670563999104:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 359us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826425.341615:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4040 00000100:00100000:0.0:1787826425.347165:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826425.347263:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563999232 00000100:00100000:1.0:1787826425.347271:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563999232 00000100:00100000:1.0:1787826425.347339:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2262 00000100:00100000:1.0:1787826425.347348:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136d4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2404:x1874670563999232:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826425.347365:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826425.347382:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bacf1a1a/0x22153cd396b83826 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x10e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab17ad expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826425.347407:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826425.347433:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10e:0x0].0x0 since=1371s v=(0 0) 00010000:00010000:1.0:1787826425.347438:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826425.347447:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bacf1a1a/0x22153cd396b83826 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17ad expref: 10 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.347464:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bacf1a1a/0x22153cd396b83826 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17ad expref: 10 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.347512:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46b200, rc 0) 00000100:00100000:1.0:1787826425.347559:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136d4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670563999232:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 212us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826425.347566:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2262 00000100:00080000:3.0:1787826425.348466:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787826425.353930:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826425.354092:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563999488 00000100:00100000:2.0:1787826425.354102:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563999488 00000100:00100000:2.0:1787826425.354172:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4041 00000100:00100000:2.0:1787826425.354181:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06304b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:55735:x1874670563999488:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826425.354201:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826425.354231:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b8382d lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab17b4 expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.354345:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83834 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.354360:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83834 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.354371:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83834 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826425.354383:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:2.0:1787826425.354519:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b8382d lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17b4 expref: 63 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.354545:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83834 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17b4 expref: 62 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.354554:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826425.354556:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787826425.354560:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835c00, rc 0) 00000100:00100000:2.0:1787826425.354618:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06304b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+62:55735:x1874670563999488:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 438us (697us total) trans 8589935248 rc 0/0 00000100:00100000:2.0:1787826425.354627:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4041 00000100:00100000:0.0:1787826425.359531:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826425.359656:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563999616 00000100:00100000:2.0:1787826425.359665:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563999616 00000100:00100000:2.0:1787826425.359718:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2263 00000100:00100000:2.0:1787826425.359726:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136d70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563999616:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826425.359742:0:28853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826425.359758:0:28853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c800962/0x22153cd396b83842 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab17bb expref: -99 pid: 28853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826425.359810:0:28853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0300c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28853:1874670585290752:192.168.203.39@tcp:106: 00000100:00100000:2.0:1787826425.359984:0:28853:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f5e79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826425.362815:0:28853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0300c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28853:1874670585290752:192.168.203.39@tcp:106: 00010000:00010000:2.0:1787826425.362869:0:28853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008c800962/0x22153cd396b83842 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17bb expref: 13 pid: 28853 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.362895:0:28853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c800962/0x22153cd396b83842 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17bb expref: 13 pid: 28853 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.362909:0:28853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834800, rc 0) 00000100:00100000:2.0:1787826425.362960:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136d70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563999616:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 3234us (3438us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826425.362969:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2263 00000100:00100000:3.0:1787826425.367605:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826425.367700:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563999744 00000100:00100000:0.0:1787826425.367709:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563999744 00000100:00100000:0.0:1787826425.367771:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2264 00000100:00100000:0.0:1787826425.367781:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8af840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563999744:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826425.367799:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826425.367815:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a67399c/0x22153cd396b83849 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab17c2 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826425.368000:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf136d43c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1874670585290880:192.168.203.39@tcp:106: 00000100:00100000:0.0:1787826425.368080:0:8435:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f67e840 going to sleep for 11 seconds 00000100:00100000:1.0:1787826425.371572:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf136d43c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1874670585290880:192.168.203.39@tcp:106: 00010000:00010000:1.0:1787826425.371613:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005a67399c/0x22153cd396b83849 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17c2 expref: 13 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.371639:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a67399c/0x22153cd396b83849 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17c2 expref: 13 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.371654:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165fc00, rc 0) 00000100:00100000:1.0:1787826425.371716:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8af840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2404:x1874670563999744:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 3936us (4119us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826425.371725:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2264 00000100:00100000:3.0:1787826425.375806:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826425.375958:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670563999872 00000100:00100000:2.0:1787826425.375967:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670563999872 00000100:00100000:2.0:1787826425.376026:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2265 00000100:00100000:2.0:1787826425.376037:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670563999872:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:2.0:1787826425.376082:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008c800962/0x22153cd396b83850 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.376102:0:14864:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b8367b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab171a expref: 12 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.376124:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x10e:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787826425.376129:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787826425.376134:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c800962/0x22153cd396b83850 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.376171:0:14864:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b8367b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab171a expref: 12 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.376185:0:14864:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b8367b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab171a expref: 12 pid: 14864 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826425.376206:0:14864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0300c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14864:1874670585291008:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826425.376309:0:14864:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f5e79c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826425.380307:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826425.380415:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564000000 00000100:00100000:1.0:1787826425.380424:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564000000 00010000:00010000:1.0:1787826425.380463:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b8367b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab171a expref: 13 pid: 14864 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826425.380543:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1310 00000100:00100000:1.0:1787826425.380553:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8acf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2404:x1874670564000000:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826425.380569:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826425.380591:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b8367b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x10e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab171a expref: 13 pid: 14864 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.380605:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b8367b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x10e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab171a expref: 13 pid: 14864 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.380630:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826425.380635:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826425.380640:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008c800962/0x22153cd396b83850 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x10e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.380651:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c800962/0x22153cd396b83850 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x10e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.380673:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826425.380720:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8acf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2404:x1874670564000000:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 168us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826425.380728:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1310 00010000:00010000:2.0:1787826425.381653:0:14864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008398d30b/0x22153cd396b8367b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab171a expref: 12 pid: 14864 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826425.381670:0:14864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0300c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14864:1874670585291008:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826425.381690:0:14864:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008c800962/0x22153cd396b83850 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x10e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.381701:0:14864:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008c800962/0x22153cd396b83850 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x10e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.381709:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c800962/0x22153cd396b83850 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x10e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.381732:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008c800962/0x22153cd396b83850 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x10e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.381741:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c800962/0x22153cd396b83850 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x10e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.381748:0:14864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c800962/0x22153cd396b83850 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.381760:0:14864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834800 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826425.381764:0:14864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c800962/0x22153cd396b83850 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.381773:0:14864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c800962/0x22153cd396b83850 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x10e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.381788:0:14864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c800962/0x22153cd396b83850 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x10e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.381796:0:14864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c800962/0x22153cd396b83850 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x10e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826425.381933:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2403:x1874670563999872:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 5897us (6135us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826425.381941:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2265 00000100:00100000:1.0:1787826425.386377:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826425.386446:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564000128 00000100:00100000:2.0:1787826425.386455:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564000128 00000100:00100000:2.0:1787826425.386548:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2266 00000100:00100000:2.0:1787826425.386557:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01dfc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2402:x1874670564000128:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826425.386575:0:30694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826425.386594:0:30694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000382351a4/0x22153cd396b83857 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x10e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab17c9 expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787826425.386618:0:30694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10e:0x0] initial LVB size: 0, mtime: 0x6a9010ec, atime: 0x6a9010ec, ctime: 0x6a9010f9, blocks: 0x0 00010000:00010000:2.0:1787826425.386638:0:30694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10e:0x0].0x0 since=1371s v=(0 0) 00010000:00010000:2.0:1787826425.386642:0:30694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826425.386652:0:30694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000382351a4/0x22153cd396b83857 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17c9 expref: 12 pid: 30694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.386668:0:30694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000382351a4/0x22153cd396b83857 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17c9 expref: 12 pid: 30694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.386681:0:30694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834c00, rc 0) 00000100:00100000:2.0:1787826425.386728:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01dfc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2402:x1874670564000128:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 173us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826425.386736:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2266 00000100:00100000:0.0:1787826425.460665:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826425.460828:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564000256 00000100:00100000:2.0:1787826425.460837:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564000256 00000100:00100000:2.0:1787826425.460896:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4042 00000100:00100000:2.0:1787826425.460905:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+62:55735:x1874670564000256:12345-192.168.203.39@tcp:44:lfs.0 00000001:00080000:3.0:1787826425.464802:0:34481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935248 is committed 00000004:00080000:3.0:1787826425.464849:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 33 committed 00000020:00080000:3.0:1787826425.464923:0:34481:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90ce05b56d80 refcount 2 committed 0 result 0 batchid 4294969346 00000020:00080000:3.0:1787826425.464929:0:34481:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cf1f111400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90ce05b569c0 00010000:00010000:0.0:1787826425.465053:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8366d lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.465065:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8366d lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.465073:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8366d lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.465080:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826425.465099:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8366d lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.465108:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8366d lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.465134:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x40:0x0].0x0 (ffff90cf39e67e00) 00010000:00010000:0.0:1787826425.465137:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826425.465142:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8366d lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.465148:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b8366d lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.465176:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b83682 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.465184:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b83682 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.465190:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b83682 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.465195:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46a600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826425.465197:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b83682 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.465203:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b83682 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.465210:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826425.465213:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826425.465216:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b83682 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.465226:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b83682 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826425.465360:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf136d43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585291136:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787826425.465653:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826425.465757:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585291136 00000100:00100000:1.0:1787826425.465764:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585291136 00000100:00100000:1.0:1787826425.465822:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2267 00000100:00100000:1.0:1787826425.465831:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3644:x1874670585291136:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787826425.465856:0:8436:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:269 count 1 00010000:00010000:1.0:1787826425.465877:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003eb46645/0x22153cd396b8385e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.465899:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000421aa0a2/0x22153cd396b83689 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1721 expref: 9 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.465907:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x10d:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787826425.465912:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826425.465917:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003eb46645/0x22153cd396b8385e lrc: 4/0,1 mode: --/PW res: [0x280000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.465955:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000421aa0a2/0x22153cd396b83689 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1721 expref: 9 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.465971:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000421aa0a2/0x22153cd396b83689 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1721 expref: 9 pid: 8437 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826425.465981:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01dfde00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1874670585291264:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826425.466044:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce02742d80 going to sleep for 11 seconds 00000020:00080000:3.0:1787826425.466664:0:34481:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cf1f111600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90cf3a8ff800 00000020:00080000:3.0:1787826425.466694:0:34481:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969345 batchid updated 00000100:00080000:0.0:1787826425.467026:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:1.0:1787826425.467075:0:34512:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969346 committed batchid 4294969345 00000020:00080000:1.0:1787826425.467215:0:34512:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969345 00000100:00100000:2.0:1787826425.467646:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:55735:x1874670564000256:12345-192.168.203.39@tcp:44:lfs.0 Request processed in 6737us (6987us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826425.467658:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4042 00000100:00100000:1.0:1787826425.468775:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01dfde00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1874670585291264:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826425.468799:0:8436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003eb46645/0x22153cd396b8385e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826425.469779:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826425.469857:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826425.469913:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564000384 00000100:00100000:0.0:1787826425.469922:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564000384 00010000:00010000:0.0:1787826425.469970:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000421aa0a2/0x22153cd396b83689 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1721 expref: 10 pid: 8437 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826425.470007:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1311 00000100:00100000:0.0:1787826425.470015:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01dfde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670564000384:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826425.470028:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826425.470033:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000421aa0a2/0x22153cd396b83689 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x10d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1721 expref: 10 pid: 8437 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.470046:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000421aa0a2/0x22153cd396b83689 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1721 expref: 10 pid: 8437 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.470066:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000421aa0a2/0x22153cd396b83689 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1721 expref: 10 pid: 8437 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.470082:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826425.470098:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826425.470104:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003eb46645/0x22153cd396b8385e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.470122:0:10341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003eb46645/0x22153cd396b8385e lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x10d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.470158:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826425.470203:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01dfde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670564000384:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 188us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826425.470210:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1311 00010000:00010000:2.0:1787826425.470701:0:8436:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003eb46645/0x22153cd396b8385e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.470711:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003eb46645/0x22153cd396b8385e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.470721:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003eb46645/0x22153cd396b8385e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.470730:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003eb46645/0x22153cd396b8385e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.470755:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787826425.470966:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3644:x1874670585291136:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5135us (5314us total) trans 21474837027 rc 0/0 00000100:00100000:2.0:1787826425.470975:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2267 00000100:00100000:2.0:1787826425.470993:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564000512 00000100:00100000:2.0:1787826425.470997:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564000512 00000100:00100000:2.0:1787826425.471024:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2268 00000100:00100000:2.0:1787826425.471030:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01dfda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670564000512:12345-192.168.203.39@tcp:16:lfs.0 00000100:00100000:2.0:1787826425.471121:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01dfda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670564000512:12345-192.168.203.39@tcp:16:lfs.0 Request processed in 80us (1253us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826425.471128:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2268 00010000:00010000:1.0:1787826425.471603:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826425.471611:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003eb46645/0x22153cd396b8385e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.471622:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46ba00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:1.0:1787826425.471627:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003eb46645/0x22153cd396b8385e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.471637:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003eb46645/0x22153cd396b8385e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.471656:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003eb46645/0x22153cd396b8385e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.471665:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003eb46645/0x22153cd396b8385e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.471687:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826425.471689:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826425.471691:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787826425.476132:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf136d43c0/2, rc 0, transno 21474837027 00000100:00100000:0.0:1787826425.476147:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf136d43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585291136:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787826425.498291:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826425.498516:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564000640 00000100:00100000:1.0:1787826425.498526:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564000640 00000100:00100000:1.0:1787826425.498625:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2269 00000100:00100000:1.0:1787826425.498635:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c87c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670564000640:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:1.0:1787826425.498679:0:8545:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003eb46645/0x22153cd396b83865 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.498695:0:8545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826425.498701:0:8545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826425.498707:0:8545:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003eb46645/0x22153cd396b83865 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.498720:0:8545:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003eb46645/0x22153cd396b83865 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.498745:0:8545:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003eb46645/0x22153cd396b83865 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.498753:0:8545:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003eb46645/0x22153cd396b83865 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.498761:0:8545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003eb46645/0x22153cd396b83865 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.498768:0:8545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46ba00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:1.0:1787826425.498772:0:8545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003eb46645/0x22153cd396b83865 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.498781:0:8545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003eb46645/0x22153cd396b83865 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.498795:0:8545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003eb46645/0x22153cd396b83865 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.498803:0:8545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003eb46645/0x22153cd396b83865 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826425.499681:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c87c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670564000640:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 1041us (1454us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826425.499691:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2269 00000100:00100000:2.0:1787826425.512903:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826425.515529:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564000896 00000100:00100000:1.0:1787826425.515543:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564000896 00000100:00100000:3.0:1787826425.515790:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4043 00000100:00100000:3.0:1787826425.515803:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:55735:x1874670564000896:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:3.0:1787826425.515852:0:9966:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826425.515879:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b8381f lrc: 0/0,0 mode: --/PR res: [0x200000405:0x42:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17a6 expref: 33 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826425.515900:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x42:0x0].0x0 (ffff90cf39e67a00) 00010000:00010000:3.0:1787826425.515911:0:9966:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826425.515942:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b8386c lrc: 3/0,1 mode: --/PW res: [0x200000405:0x42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826425.515956:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b8386c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826425.515965:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b8386c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826425.516070:0:9966:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000073d44a83 reply state 0000000049e95cac transno 8589935249 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b8386c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826425.516081:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b8386c lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826425.516215:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x42:0x0].0x0 (ffff90cf2f6bd300) 00010000:00010000:3.0:1787826425.516218:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787826425.516220:0:9966:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787826425.516606:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:55735:x1874670564000896:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 804us (3711us total) trans 8589935249 rc 0/0 00000100:00100000:3.0:1787826425.516613:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4043 00000100:00100000:2.0:1787826425.522852:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826425.522933:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564001024 00000100:00100000:1.0:1787826425.522942:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564001024 00000100:00100000:1.0:1787826425.523005:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4044 00000100:00100000:1.0:1787826425.523016:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:55735:x1874670564001024:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826425.523040:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826425.523062:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b83873 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x42:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab17d0 expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.523142:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b83873 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x42:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17d0 expref: 35 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.523157:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b83873 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x42:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17d0 expref: 35 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.523175:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x42:0x0].0x0 (ffff90cf2f6bd300) 00010000:00010000:1.0:1787826425.523179:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826425.523183:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46a400, rc 0) 00000100:00100000:1.0:1787826425.523246:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:55735:x1874670564001024:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 233us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826425.523254:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4044 00000100:00100000:1.0:1787826425.526807:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826425.526896:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564001152 00000100:00100000:2.0:1787826425.526905:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564001152 00000100:00100000:2.0:1787826425.526966:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2270 00000100:00100000:2.0:1787826425.526976:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01dfed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:55735:x1874670564001152:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826425.526994:0:30696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826425.527010:0:30696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c6f0c33/0x22153cd396b8387a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab17d7 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.527042:0:30696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bacf1a1a/0x22153cd396b83826 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17ad expref: 10 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.527052:0:30696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826425.527056:0:30696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826425.527062:0:30696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c6f0c33/0x22153cd396b8387a lrc: 4/0,0 mode: --/PW res: [0x280000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17d7 expref: 10 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.527127:0:30696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bacf1a1a/0x22153cd396b83826 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17ad expref: 10 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.527141:0:30696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bacf1a1a/0x22153cd396b83826 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17ad expref: 10 pid: 8436 timeout: 1471 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826425.527156:0:30696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f936580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:30696:1874670585291392:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826425.527240:0:30696:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f5e73c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826425.547287:0:30696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f936580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:30696:1874670585291392:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826425.547328:0:30696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005c6f0c33/0x22153cd396b8387a lrc: 3/0,0 mode: --/PW res: [0x280000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17d7 expref: 10 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.547350:0:30696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834600, rc 0) 00000100:00100000:2.0:1787826425.547430:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01dfed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:55735:x1874670564001152:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 20455us (20631us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826425.547440:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2270 00000100:00100000:3.0:1787826425.548337:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826425.548919:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564001280 00000100:00100000:2.0:1787826425.548927:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564001280 00010000:00010000:2.0:1787826425.548964:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bacf1a1a/0x22153cd396b83826 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17ad expref: 10 pid: 8436 timeout: 1471 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826425.549012:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1312 00000100:00100000:2.0:1787826425.549022:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf181fc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670564001280:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826425.549038:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826425.549058:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bacf1a1a/0x22153cd396b83826 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x10e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17ad expref: 10 pid: 8436 timeout: 1471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.549073:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bacf1a1a/0x22153cd396b83826 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17ad expref: 10 pid: 8436 timeout: 1471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.549109:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bacf1a1a/0x22153cd396b83826 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x10e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17ad expref: 10 pid: 8436 timeout: 1471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.549135:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826425.549140:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826425.549147:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005c6f0c33/0x22153cd396b8387a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17d7 expref: 9 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.549158:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c6f0c33/0x22153cd396b8387a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17d7 expref: 9 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.549197:0:6505:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005c6f0c33/0x22153cd396b8387a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17d7 expref: 9 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826425.549218:0:6505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f936580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1874670585291520:192.168.203.39@tcp:105: 00000100:00100000:2.0:1787826425.549299:0:6505:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f5e73c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826425.561230:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826425.561346:0:6505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f936580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1874670585291520:192.168.203.39@tcp:105: 00010000:00010000:2.0:1787826425.561373:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826425.561437:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf181fc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670564001280:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 12415us (13102us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826425.561448:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1312 00000100:00100000:0.0:1787826425.568729:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564001408 00000100:00100000:0.0:1787826425.568744:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564001408 00000100:00100000:0.0:1787826425.568817:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2271 00000100:00100000:0.0:1787826425.568828:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8ade00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670564001408:12345-192.168.203.39@tcp:2:lfs.0 00002000:00010000:0.0:1787826425.568984:0:30694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x10e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787826425.568988:0:30694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x10e:0x0] updating lvb mtime from disk: 0 -> 1787826412 00002000:00010000:0.0:1787826425.568990:0:30694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x10e:0x0] updating lvb atime from disk: 0 -> 1787826412 00002000:00010000:0.0:1787826425.568992:0:30694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x10e:0x0] updating lvb ctime from disk: 0 -> 1787826426 00002000:00010000:0.0:1787826425.568994:0:30694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x10e:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1787826425.569075:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8ade00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670564001408:12345-192.168.203.39@tcp:2:lfs.0 Request processed in 248us (7854us total) trans 21474837028 rc 0/0 00000100:00100000:0.0:1787826425.569083:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2271 00000100:00100000:3.0:1787826425.579570:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826425.579887:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564001664 00000100:00100000:0.0:1787826425.579898:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564001664 00000100:00100000:0.0:1787826425.579960:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4045 00000100:00100000:0.0:1787826425.579971:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8afc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:55735:x1874670564001664:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:0.0:1787826425.580022:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826425.580049:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f600/0x22153cd396b8380a lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1798 expref: 35 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.580068:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826425.580073:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787826425.580132:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b83881 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.580147:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b83881 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.580157:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b83881 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787826425.580267:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000068c1119c reply state 0000000065256d5f transno 8589935250 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b83881 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.580279:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b83881 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.580285:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826425.580288:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787826425.580291:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787826425.580383:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8afc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55735:x1874670564001664:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 407us (816us total) trans 8589935250 rc 0/0 00000100:00100000:0.0:1787826425.580390:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4045 00000100:00100000:2.0:1787826425.586213:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826425.586524:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564001792 00000100:00100000:0.0:1787826425.586534:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564001792 00000100:00100000:0.0:1787826425.586593:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2272 00000100:00100000:0.0:1787826425.586603:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f936580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:55735:x1874670564001792:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826425.586620:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826425.586650:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a27ec96/0x22153cd396b83888 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab17de expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.586683:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000382351a4/0x22153cd396b83857 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17c9 expref: 13 pid: 30694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.586692:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826425.586696:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826425.586701:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a27ec96/0x22153cd396b83888 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17de expref: 13 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.586736:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000382351a4/0x22153cd396b83857 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17c9 expref: 13 pid: 30694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.586748:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000382351a4/0x22153cd396b83857 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17c9 expref: 13 pid: 30694 timeout: 1471 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826425.586776:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf41c86d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1874670585291648:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826425.586854:0:8437:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f67ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1787826425.591566:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf41c86d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1874670585291648:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826425.591607:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009a27ec96/0x22153cd396b83888 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17de expref: 13 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.591630:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165f600, rc 0) 00000100:00100000:0.0:1787826425.591760:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f936580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:55735:x1874670564001792:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 5158us (5556us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826425.591770:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2272 00000100:00100000:3.0:1787826425.597373:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826425.597641:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564001920 00000100:00100000:2.0:1787826425.597650:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564001920 00010000:00010000:2.0:1787826425.597693:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000382351a4/0x22153cd396b83857 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17c9 expref: 13 pid: 30694 timeout: 1471 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826425.597803:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1313 00000100:00100000:2.0:1787826425.597814:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8ac780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2403:x1874670564001920:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826425.597830:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826425.597850:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000382351a4/0x22153cd396b83857 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x10e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17c9 expref: 13 pid: 30694 timeout: 1471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.597863:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000382351a4/0x22153cd396b83857 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17c9 expref: 13 pid: 30694 timeout: 1471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.597884:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000382351a4/0x22153cd396b83857 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x10e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17c9 expref: 13 pid: 30694 timeout: 1471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.598664:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826425.598671:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826425.598681:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009a27ec96/0x22153cd396b83888 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17de expref: 12 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.598692:0:10340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a27ec96/0x22153cd396b83888 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17de expref: 12 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.598749:0:10340:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009a27ec96/0x22153cd396b83888 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17de expref: 12 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826425.598764:0:10340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f934f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10340:1874670585291776:192.168.203.39@tcp:105: 00000100:00100000:2.0:1787826425.598850:0:10340:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f5e7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826425.603981:0:10340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f934f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10340:1874670585291776:192.168.203.39@tcp:105: 00010000:00010000:0.0:1787826425.604014:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826425.604075:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8ac780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670564001920:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6263us (6712us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826425.604098:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1313 00000100:00100000:1.0:1787826425.606704:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826425.606838:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564002048 00000100:00100000:2.0:1787826425.606847:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564002048 00000100:00100000:2.0:1787826425.606906:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2273 00000100:00100000:2.0:1787826425.606917:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01dfe580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670564002048:12345-192.168.203.39@tcp:2:lfs.0 00002000:00010000:2.0:1787826425.608240:0:28853:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x10e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787826425.608247:0:28853:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x10e:0x0] updating lvb mtime from disk: 1787826412 -> 1787826412 00002000:00010000:2.0:1787826425.608250:0:28853:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x10e:0x0] updating lvb atime from disk: 1787826412 -> 1787826412 00002000:00010000:2.0:1787826425.608252:0:28853:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x10e:0x0] updating lvb ctime from disk: 1787826425 -> 1787826426 00002000:00010000:2.0:1787826425.608254:0:28853:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x10e:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1787826425.608326:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01dfe580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2403:x1874670564002048:12345-192.168.203.39@tcp:2:lfs.0 Request processed in 1407us (1628us total) trans 17179869687 rc 0/0 00000100:00100000:2.0:1787826425.608340:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2273 00000100:00100000:3.0:1787826425.611902:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826425.612046:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564002304 00000100:00100000:2.0:1787826425.612056:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564002304 00000100:00100000:2.0:1787826425.612653:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1261 00000100:00100000:2.0:1787826425.612666:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eea3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55735:x1874670564002304:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:2.0:1787826425.612744:0:14257:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000405:0x1d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83834 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17b4 expref: 36 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.612792:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b8388f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.612804:0:14257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b83762 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1760 expref: 36 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.612812:0:14257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b837af lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1775 expref: 36 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.612820:0:14257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b8388f lrc: 5/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.612852:0:14257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b837af lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1775 expref: 36 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.612865:0:14257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b837af lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1775 expref: 36 pid: 9966 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826425.612878:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f936940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585291904:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826425.612969:0:14257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b83762 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1760 expref: 36 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.612978:0:14257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b83762 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1760 expref: 36 pid: 6519 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826425.612987:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f9352c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585292032:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826425.613009:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f5e7480 going to sleep for 11 seconds 00000100:00100000:3.0:1787826425.616330:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826425.616952:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f936940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585291904:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826425.616966:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f9352c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585292032:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826425.616991:0:14257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b8388f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826425.617101:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826425.617255:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564002560 00000100:00100000:1.0:1787826425.617263:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564002560 00000100:00100000:1.0:1787826425.617542:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1262 00000100:00100000:1.0:1787826425.617553:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:49796:x1874670564002560:12345-192.168.203.39@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787826425.617750:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:49796:x1874670564002560:12345-192.168.203.39@tcp:35:ldlm_bl.0 Request processed in 199us (1427us total) trans 8589935251 rc 0/0 00000100:00100000:1.0:1787826425.619497:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1262 00000100:00100000:3.0:1787826425.620216:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826425.621009:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564002688 00000100:00100000:0.0:1787826425.621020:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564002688 00010000:00010000:0.0:1787826425.621057:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b83762 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1760 expref: 38 pid: 6519 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826425.621092:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564002816 00000100:00100000:0.0:1787826425.621095:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564002816 00010000:00010000:0.0:1787826425.621107:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b837af lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1775 expref: 39 pid: 9966 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826425.621145:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1314 00000100:00100000:0.0:1787826425.621155:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8acb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+39:2403:x1874670564002688:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826425.621170:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826425.621176:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b83762 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1760 expref: 39 pid: 6519 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.621193:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b83762 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1760 expref: 39 pid: 6519 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.621217:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b83762 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1760 expref: 39 pid: 6519 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.621233:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826425.621239:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b8388f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.621247:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b8388f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.621255:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826425.621429:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1315 00000100:00100000:3.0:1787826425.621438:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8af0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:2404:x1874670564002816:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826425.621449:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826425.621454:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b837af lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1775 expref: 38 pid: 9966 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826425.621464:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b837af lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1775 expref: 38 pid: 9966 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826425.621493:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b837af lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1775 expref: 38 pid: 9966 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826425.621505:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826425.621508:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b8388f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826425.621515:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b8388f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826425.621523:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b8388f lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826425.621545:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826425.621605:0:14257:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b8388f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.621613:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b8388f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.621635:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83896 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x42:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.621647:0:14257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b83873 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x42:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17d0 expref: 37 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.621654:0:14257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83896 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x42:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.621685:0:14257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b83873 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x42:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17d0 expref: 37 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.621697:0:14257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b83873 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x42:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17d0 expref: 37 pid: 8247 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826425.621710:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f9352c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585292160:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826425.621807:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8acb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:2403:x1874670564002688:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 653us (4705us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826425.621816:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1314 00000100:00100000:3.0:1787826425.623044:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8af0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:2404:x1874670564002816:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 1602us (2825us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826425.623055:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1315 00000100:00100000:2.0:1787826425.623242:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f5e7480 going to sleep for 11 seconds 00000100:00100000:2.0:1787826425.626839:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826425.627189:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564002944 00000100:00100000:3.0:1787826425.627198:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564002944 00010000:00010000:3.0:1787826425.627238:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b83873 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x42:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17d0 expref: 36 pid: 8247 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826425.627280:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1316 00000100:00100000:3.0:1787826425.627307:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f936940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:2403:x1874670564002944:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826425.627322:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826425.627329:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b83873 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x42:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17d0 expref: 36 pid: 8247 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826425.627342:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b83873 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x42:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17d0 expref: 36 pid: 8247 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826425.627364:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x42:0x0].0x0 (ffff90cf2f6bd300) 00010000:00010000:3.0:1787826425.627369:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83896 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x42:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826425.627378:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83896 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x42:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826425.627385:0:10340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83896 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x42:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826425.627403:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826425.627458:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f936940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:2403:x1874670564002944:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 161us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826425.627465:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1316 00010000:00010000:0.0:1787826425.629574:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a400/0x22153cd396b83873 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x42:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17d0 expref: 35 pid: 8247 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826425.629598:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f9352c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585292160:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826425.629621:0:14257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83896 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x42:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.629632:0:14257:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83896 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x42:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.629642:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83896 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x42:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826425.634144:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf41c86d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585292288:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1787826425.634213:0:14257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826425.634304:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf396cf180 going to sleep for 11 seconds 00000100:00100000:3.0:1787826425.634668:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585292288 00000100:00100000:3.0:1787826425.634676:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585292288 00000100:00100000:3.0:1787826425.634767:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1500 00000100:00100000:3.0:1787826425.634776:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:14257:x1874670585292288:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1787826425.634882:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:14257:x1874670585292288:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 108us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826425.634890:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1500 00000100:00100000:0.0:1787826425.634974:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf41c86d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585292288:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1787826425.635025:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf41c86d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585292416:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1787826425.635052:0:14257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826425.635259:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f67ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1787826425.635625:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585292416 00000100:00100000:1.0:1787826425.635631:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585292416 00000100:00100000:1.0:1787826425.635662:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1501 00000100:00100000:1.0:1787826425.635669:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9ae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:14257:x1874670585292416:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1787826425.635748:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9ae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:14257:x1874670585292416:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 80us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826425.635765:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1501 00000100:00100000:0.0:1787826425.635829:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf41c86d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585292416:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:0.0:1787826425.635976:0:14257:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589935252 00000100:00100000:0.0:1787826425.636037:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a9ac3c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585292544:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1787826425.636065:0:14257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826425.636087:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce05b56600 going to sleep for 11 seconds 00000100:00100000:1.0:1787826425.636243:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585292544 00000100:00100000:1.0:1787826425.636248:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585292544 00000100:00100000:1.0:1787826425.636268:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1502 00000100:00100000:1.0:1787826425.636274:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9af0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:14257:x1874670585292544:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1787826425.636413:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9af0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:14257:x1874670585292544:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 129us (338us total) trans 21474837029 rc 0/0 00000100:00100000:1.0:1787826425.636421:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1502 00000100:00100000:0.0:1787826425.636750:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a9ac3c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585292544:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:0.0:1787826425.636809:0:14257:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589935253 00010000:00010000:0.0:1787826425.636835:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83896 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x42:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.636845:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83896 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x42:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.636852:0:14257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83896 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x42:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.636862:0:14257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826425.636867:0:14257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83896 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x42:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.636874:0:14257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83896 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x42:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.636891:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x42:0x0].0x0 (ffff90cf2f6bd300) 00010000:00010000:0.0:1787826425.636894:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787826425.636916:0:14257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83896 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x42:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.636923:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83896 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x42:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.637159:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b8388f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.637167:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b8388f lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.637174:0:14257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b8388f lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.637179:0:14257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826425.637182:0:14257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b8388f lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.637188:0:14257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b8388f lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.637201:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826425.637204:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787826425.637207:0:14257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b8388f lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.637212:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b8388f lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.637224:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826425.637226:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787826425.637232:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83834 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17b4 expref: 37 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826425.637452:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eea3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55735:x1874670564002304:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 24788us (25558us total) trans 8589935254 rc 0/0 00000100:00100000:0.0:1787826425.637462:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1261 00000020:00080000:0.0:1787826425.637466:0:14257:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1787826425.641185:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826425.641279:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564003072 00000100:00100000:0.0:1787826425.641289:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564003072 00000100:00100000:0.0:1787826425.641615:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4046 00000100:00100000:0.0:1787826425.641626:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f934780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55735:x1874670564003072:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826425.641651:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826425.641674:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b8389d lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab17e5 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.641727:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b8389d lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17e5 expref: 37 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.641747:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b8389d lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17e5 expref: 37 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.641765:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826425.641768:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826425.641772:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165e000, rc 0) 00000100:00100000:0.0:1787826425.641829:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f934780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:55735:x1874670564003072:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 205us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826425.641836:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4046 00000100:00100000:1.0:1787826425.645577:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826425.645744:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564003328 00000100:00100000:3.0:1787826425.645754:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564003328 00000100:00100000:3.0:1787826425.645801:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1263 00000100:00100000:3.0:1787826425.645811:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01dfde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:55735:x1874670564003328:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:3.0:1787826425.646222:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01dfde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:55735:x1874670564003328:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 411us (651us total) trans 8589935255 rc 0/0 00000100:00100000:3.0:1787826425.646231:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1263 00000100:00100000:1.0:1787826425.649180:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826425.649261:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564003584 00000100:00100000:0.0:1787826425.649270:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564003584 00000100:00100000:2.0:1787826425.649928:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1264 00000100:00100000:2.0:1787826425.649942:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01dffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:55735:x1874670564003584:12345-192.168.203.39@tcp:35:lfs.0 00000004:00080000:2.0:1787826425.650128:0:6522:0:(mdd_object.c:4014:mdd_close()) Object [0x200000405:0x42:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:2.0:1787826425.650206:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b838a4 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x42:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.650223:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b838a4 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.650234:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b838a4 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.650243:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b838a4 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.650250:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b838a4 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.650261:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b838a4 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.650439:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787826425.651908:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01dffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+39:55735:x1874670564003584:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 1964us (2730us total) trans 8589935256 rc 0/0 00000100:00100000:2.0:1787826425.651919:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1264 00010000:00010000:3.0:1787826425.660553:0:7460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826425.660569:0:7460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b838a4 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826425.660580:0:7460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834a00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826425.660585:0:7460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b838a4 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826425.660594:0:7460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b838a4 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826425.660613:0:7460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x42:0x0].0x0 (ffff90cf2f6bd300) 00010000:00010000:3.0:1787826425.660616:0:7460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787826425.660621:0:7460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b838a4 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826425.660627:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b838a4 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826425.660645:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826425.660647:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826425.660648:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826425.687241:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826425.687397:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564003712 00000100:00100000:3.0:1787826425.687418:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564003712 00000100:00100000:3.0:1787826425.687518:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4047 00000100:00100000:3.0:1787826425.687530:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01dfcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+39:55737:x1874670564003712:12345-192.168.203.39@tcp:101:getfattr.0 00010000:00010000:3.0:1787826425.687553:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826425.687576:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b838ab lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab17ec expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.687874:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b838b2 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.687890:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b838b2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.687901:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b838b2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.687916:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b838b9 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.687924:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b838b9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.687930:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b838b9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.688014:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b838c0 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.688025:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b838c0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.688037:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b838c0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826425.688076:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:2.0:1787826425.688080:0:9966:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826425.688099:0:9966:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b838c0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.688121:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b838c0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.688130:0:9966:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b838b2 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.688138:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b838b2 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.688143:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b838b2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.688150:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b838b2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.688155:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826425.688159:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b838b2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.688166:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b838b2 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.688179:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf2f6bd000) 00010000:00010000:2.0:1787826425.688182:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826425.688187:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b838b2 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.688192:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b838b2 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.688207:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b838b9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.688213:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b838b9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.688219:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b838b9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.688224:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826425.688226:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b838b9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.688232:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b838b9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.688240:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf39e67600) 00010000:00010000:2.0:1787826425.688243:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826425.688246:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b838b9 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.688252:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834800/0x22153cd396b838b9 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.688661:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400c00/0x22153cd396b838ab lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17ec expref: 41 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.688692:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b838c0 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17ec expref: 40 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.688700:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826425.688703:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826425.688706:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834a00, rc 0) 00000100:00100000:2.0:1787826425.688784:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01dfcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55737:x1874670564003712:12345-192.168.203.39@tcp:101:getfattr.0 Request processed in 1257us (1551us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826425.688792:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4047 00000100:00100000:2.0:1787826425.732571:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826425.732717:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564003840 00000100:00100000:1.0:1787826425.732726:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564003840 00000100:00100000:1.0:1787826425.732800:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4048 00000100:00100000:1.0:1787826425.732811:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f934b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55741:x1874670564003840:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:1.0:1787826425.732886:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b838c7 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.732903:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b838c7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.732914:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b838c7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.732927:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b838ce lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.732933:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b838ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.732940:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b838ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.733013:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b838d5 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.733022:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b838d5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.733028:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b838d5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826425.733068:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:1.0:1787826425.733073:0:32404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826425.733085:0:32404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b838d5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.733098:0:32404:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b838c7 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.733105:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b838c7 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.733122:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b838c7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.733129:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b838c7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.733135:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46b200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826425.733139:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b838c7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.733147:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b838c7 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.733158:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf04f8b600) 00010000:00010000:1.0:1787826425.733162:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826425.733166:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b838c7 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.733173:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b838c7 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.733192:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b838ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.733198:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b838ce lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.733204:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b838ce lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.733210:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46ba00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826425.733212:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b838ce lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.733218:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b838ce lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.733227:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf04f8b400) 00010000:00010000:1.0:1787826425.733229:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826425.733232:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b838ce lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.733237:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b838ce lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.733249:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b838d5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.733255:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b838d5 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.733260:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b838d5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.733265:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46bc00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826425.733268:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b838d5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.733278:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b838d5 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.733285:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826425.733286:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826425.733290:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b838d5 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.733294:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b838d5 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826425.733372:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f934b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55741:x1874670564003840:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 562us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826425.733380:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4048 00000100:00100000:1.0:1787826425.770662:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826425.771422:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564004096 00000100:00100000:0.0:1787826425.771433:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564004096 00000100:00100000:0.0:1787826425.771713:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4049 00000100:00100000:0.0:1787826425.771724:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf07965a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55743:x1874670564004096:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826425.771743:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826425.771781:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b838dc lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab17f3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.771890:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b838e3 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.771905:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b838e3 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.771916:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b838e3 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826425.771931:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:0.0:1787826425.772038:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b838dc lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17f3 expref: 43 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.772059:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b838e3 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17f3 expref: 42 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.772068:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826425.772070:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787826425.772074:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165e400, rc 0) 00000100:00100000:0.0:1787826425.772145:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf07965a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+42:55743:x1874670564004096:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 424us (1491us total) trans 8589935257 rc 0/0 00000100:00100000:0.0:1787826425.772153:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4049 00000100:00100000:1.0:1787826425.779864:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826425.779946:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564004352 00000100:00100000:0.0:1787826425.779956:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564004352 00000100:00100000:0.0:1787826425.780013:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4050 00000100:00100000:0.0:1787826425.780023:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf079643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+42:55743:x1874670564004352:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826425.780047:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826425.780068:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b838f1 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab17fa expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.780184:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b838f8 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.780199:0:16564:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b838c0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17ec expref: 43 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.780213:0:16564:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b838f8 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.780247:0:16564:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b838c0 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17ec expref: 43 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.780260:0:16564:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b838c0 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17ec expref: 43 pid: 9966 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826425.780272:0:16564:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf41c86d00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:16564:1874670585292672:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826425.780637:0:16564:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce02742d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787826425.784577:0:16564:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf41c86d00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:16564:1874670585292672:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826425.784602:0:16564:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b838f8 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826425.784659:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826425.784980:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564004480 00000100:00100000:0.0:1787826425.784987:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564004480 00010000:00010000:0.0:1787826425.785021:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b838c0 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17ec expref: 44 pid: 9966 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826425.785123:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1317 00000100:00100000:0.0:1787826425.785133:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f936d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:2404:x1874670564004480:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826425.785147:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826425.785154:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b838c0 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17ec expref: 44 pid: 9966 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.785172:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b838c0 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17ec expref: 44 pid: 9966 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.785194:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b838c0 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17ec expref: 44 pid: 9966 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.785211:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826425.785215:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b838f8 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.785224:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b838f8 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.785231:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b838f8 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.785260:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826425.785329:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f936d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:2404:x1874670564004480:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 197us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826425.785337:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1317 00010000:00010000:2.0:1787826425.785393:0:16564:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b838f8 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.785400:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b838f8 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826425.785424:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:2.0:1787826425.785576:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b838f1 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17fa expref: 44 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.785591:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b838f8 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17fa expref: 43 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.785600:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826425.785603:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787826425.785605:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165fa00, rc 0) 00000100:00100000:2.0:1787826425.785635:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf079643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55743:x1874670564004352:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 5614us (5780us total) trans 8589935258 rc 0/0 00000100:00100000:2.0:1787826425.785642:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4050 00000100:00100000:3.0:1787826425.788421:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826425.788602:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564004608 00000100:00100000:1.0:1787826425.788612:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564004608 00000100:00100000:1.0:1787826425.788675:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1265 00000100:00100000:1.0:1787826425.788683:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55743:x1874670564004608:12345-192.168.203.39@tcp:33:lfs.0 00000100:00100000:1.0:1787826425.788967:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55743:x1874670564004608:12345-192.168.203.39@tcp:33:lfs.0 Request processed in 283us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826425.788975:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1265 00000100:00100000:3.0:1787826425.790883:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826425.791014:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564004864 00000100:00100000:1.0:1787826425.791022:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564004864 00000100:00100000:1.0:1787826425.791128:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1266 00000100:00100000:1.0:1787826425.791139:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8ae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55743:x1874670564004864:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:1.0:1787826425.791349:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8ae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55743:x1874670564004864:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 211us (474us total) trans 8589935259 rc 0/0 00000100:00100000:1.0:1787826425.791357:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1266 00000100:00100000:0.0:1787826425.794419:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826425.794702:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564005120 00000100:00100000:2.0:1787826425.794712:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564005120 00000100:00100000:2.0:1787826425.794810:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4051 00000100:00100000:2.0:1787826425.794821:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf41c86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55743:x1874670564005120:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826425.794843:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826425.794846:0:9966:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:2.0:1787826425.794873:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b838f8 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17fa expref: 44 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.794894:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b838e3 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17f3 expref: 43 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.794904:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826425.794910:0:9966:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826425.794923:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b83906 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1801 expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.795018:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8390d lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.795031:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8390d lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.795041:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8390d lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826425.795057:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:2.0:1787826425.795162:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b83906 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1801 expref: 45 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.795176:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8390d lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1801 expref: 44 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.795183:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826425.795186:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787826425.795188:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835c00, rc 0) 00000100:00100000:2.0:1787826425.795247:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf41c86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55743:x1874670564005120:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 427us (836us total) trans 8589935260 rc 0/0 00000100:00100000:2.0:1787826425.795254:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4051 00000100:00100000:3.0:1787826425.798584:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826425.798745:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564005376 00000100:00100000:1.0:1787826425.798755:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564005376 00000100:00100000:1.0:1787826425.798814:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1267 00000100:00100000:1.0:1787826425.798824:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eea0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55743:x1874670564005376:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:1.0:1787826425.798893:0:6521:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000405:0x1d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8390d lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1801 expref: 44 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.798931:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b8391b lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.798945:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b8389d lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17e5 expref: 44 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.798953:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b8391b lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.798985:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b8389d lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17e5 expref: 44 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.799000:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b8389d lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17e5 expref: 44 pid: 16564 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826425.799014:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0373cb40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1874670585292800:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826425.799150:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf087aca80 going to sleep for 11 seconds 00000100:00100000:1.0:1787826425.802194:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0373cb40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1874670585292800:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826425.802225:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b8391b lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826425.804837:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826425.804938:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564005504 00000100:00100000:0.0:1787826425.804949:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564005504 00010000:00010000:0.0:1787826425.804988:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b8389d lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17e5 expref: 45 pid: 16564 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826425.805030:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1318 00000100:00100000:0.0:1787826425.805040:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8acf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+45:2403:x1874670564005504:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826425.805056:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826425.805063:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b8389d lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17e5 expref: 45 pid: 16564 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.805077:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b8389d lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17e5 expref: 45 pid: 16564 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.805100:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b8389d lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17e5 expref: 45 pid: 16564 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.805125:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826425.805131:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b8391b lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.805140:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b8391b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.805148:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b8391b lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.805182:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826425.805238:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8acf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:2403:x1874670564005504:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 199us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826425.805246:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1318 00010000:00010000:1.0:1787826425.805322:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b8391b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.805330:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b8391b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.805531:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b8391b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.805539:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b8391b lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.805545:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b8391b lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.805550:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46bc00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826425.805554:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b8391b lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.805560:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b8391b lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.805569:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826425.805572:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787826425.805575:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b8391b lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.805581:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b8391b lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.805592:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826425.805594:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787826425.805598:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b8390d lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1801 expref: 43 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826425.805694:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eea0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55743:x1874670564005376:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 6872us (7119us total) trans 8589935261 rc -22/-22 00000100:00100000:1.0:1787826425.805702:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1267 00000100:00100000:1.0:1787826425.812466:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826425.812725:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564005632 00000100:00100000:2.0:1787826425.812735:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564005632 00000100:00100000:2.0:1787826425.812795:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4052 00000100:00100000:2.0:1787826425.812806:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55743:x1874670564005632:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826425.812829:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826425.812849:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b83922 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1808 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.812906:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b83922 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1808 expref: 44 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.812921:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b83922 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1808 expref: 44 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.812946:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826425.812949:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826425.812954:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834c00, rc 0) 00000100:00100000:2.0:1787826425.813016:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55743:x1874670564005632:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 211us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826425.813023:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4052 00000100:00100000:2.0:1787826425.817900:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826425.817976:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564005888 00000100:00100000:0.0:1787826425.817986:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564005888 00000100:00100000:0.0:1787826425.818042:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4053 00000100:00100000:0.0:1787826425.818052:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f935680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55743:x1874670564005888:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826425.818074:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826425.818097:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b83929 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab180f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.818595:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b83930 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.818608:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b83930 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.818618:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b83930 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826425.818627:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x43:0x0]: returning size 0 00010000:00010000:0.0:1787826425.818666:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b83929 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab180f expref: 47 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.818684:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b83930 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab180f expref: 46 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.818693:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x43:0x0].0x0 (ffff90ce036cab00) 00010000:00010000:0.0:1787826425.818695:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826425.818698:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165fc00, rc 0) 00000100:00100000:0.0:1787826425.818761:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f935680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+46:55743:x1874670564005888:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 710us (870us total) trans 8589935262 rc 0/0 00000100:00100000:0.0:1787826425.818768:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4053 00000100:00100000:3.0:1787826425.823135:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826425.823231:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564006144 00000100:00100000:2.0:1787826425.823240:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564006144 00000100:00100000:2.0:1787826425.823307:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4054 00000100:00100000:2.0:1787826425.823319:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+46:55743:x1874670564006144:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826425.823342:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826425.823362:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b8393e lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1816 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.823461:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b83945 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.823519:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b83945 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.823534:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b83945 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826425.823545:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:2.0:1787826425.823643:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b8393e lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1816 expref: 49 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.823666:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b83945 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1816 expref: 48 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.823674:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826425.823676:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787826425.823680:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835a00, rc 0) 00000100:00100000:2.0:1787826425.823737:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55743:x1874670564006144:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 422us (611us total) trans 8589935263 rc 0/0 00000100:00100000:2.0:1787826425.823745:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4054 00000100:00100000:3.0:1787826425.827523:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826425.827672:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564006400 00000100:00100000:1.0:1787826425.827682:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564006400 00000100:00100000:1.0:1787826425.827738:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1268 00000100:00100000:1.0:1787826425.827749:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55743:x1874670564006400:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:1.0:1787826425.827841:0:14257:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000405:0x1d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b83945 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1816 expref: 48 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.827882:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b83953 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.827895:0:14257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b83922 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1808 expref: 48 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.827905:0:14257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b83953 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.827937:0:14257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b83922 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1808 expref: 48 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.827956:0:14257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b83922 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1808 expref: 48 pid: 6518 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826425.827970:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0373d680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585292928:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826425.828052:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf1e87f780 going to sleep for 11 seconds 00000100:00100000:0.0:1787826425.832051:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826425.832200:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564006528 00000100:00100000:2.0:1787826425.832211:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564006528 00010000:00010000:2.0:1787826425.832251:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b83922 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1808 expref: 49 pid: 6518 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826425.832422:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1319 00000100:00100000:3.0:1787826425.832434:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf181fd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:2403:x1874670564006528:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826425.832449:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826425.832456:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b83922 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1808 expref: 49 pid: 6518 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826425.832516:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b83922 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1808 expref: 49 pid: 6518 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826425.832545:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826425.832550:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b83953 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826425.832559:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b83953 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826425.832567:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b83953 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826425.832584:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826425.832635:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf181fd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:2403:x1874670564006528:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 204us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826425.832642:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1319 00010000:00010000:1.0:1787826425.833322:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b83922 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1808 expref: 48 pid: 6518 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826425.833341:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0373d680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585292928:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826425.833364:0:14257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b83953 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.833373:0:14257:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b83953 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.833379:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b83953 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.833401:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b8395a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.833411:0:14257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b83930 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab180f expref: 47 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.833419:0:14257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b8395a lrc: 4/0,1 mode: --/EX res: [0x200000405:0x43:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.833444:0:14257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b83930 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab180f expref: 47 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.833458:0:14257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b83930 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab180f expref: 47 pid: 6519 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826425.833514:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0373d680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585293056:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826425.833581:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf1e87f780 going to sleep for 11 seconds 00000100:00100000:1.0:1787826425.837907:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0373d680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585293056:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826425.837937:0:14257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b8395a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x43:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826425.839978:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826425.840064:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564006656 00000100:00100000:1.0:1787826425.840073:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564006656 00010000:00010000:1.0:1787826425.840121:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b83930 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab180f expref: 48 pid: 6519 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826425.840161:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1320 00000100:00100000:1.0:1787826425.840170:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:2401:x1874670564006656:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826425.840185:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826425.840192:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b83930 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab180f expref: 48 pid: 6519 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.840205:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b83930 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab180f expref: 48 pid: 6519 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.840228:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b83930 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab180f expref: 48 pid: 6519 timeout: 1471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.840250:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x43:0x0].0x0 (ffff90ce036cab00) 00010000:00010000:1.0:1787826425.840255:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b8395a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x43:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.840264:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b8395a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x43:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.840272:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b8395a lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x43:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.840405:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826425.840456:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+47:2401:x1874670564006656:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 287us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826425.840463:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1320 00010000:00010000:2.0:1787826425.843442:0:14257:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b8395a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x43:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.843457:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b8395a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x43:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826425.845050:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f9361c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585293184:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1787826425.845131:0:14257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826425.845168:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f5e7900 going to sleep for 11 seconds 00000100:00100000:1.0:1787826425.845737:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585293184 00000100:00100000:1.0:1787826425.845746:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585293184 00000100:00100000:1.0:1787826425.845809:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1503 00000100:00100000:1.0:1787826425.845818:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f937480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:14257:x1874670585293184:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1787826425.845905:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f937480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:14257:x1874670585293184:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 89us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826425.845913:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1503 00000100:00100000:2.0:1787826425.846070:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f9361c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585293184:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:2.0:1787826425.846139:0:14257:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589935264 00000001:00080000:2.0:1787826425.846201:0:14257:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589935265 00010000:00010000:2.0:1787826425.846224:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b8395a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x43:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.846234:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b8395a lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x43:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.846241:0:14257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b8395a lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x43:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.846247:0:14257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46ba00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826425.846251:0:14257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b8395a lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x43:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.846258:0:14257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b8395a lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x43:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.846273:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x43:0x0].0x0 (ffff90ce036cab00) 00010000:00010000:2.0:1787826425.846276:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787826425.846281:0:14257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b8395a lrc: 2/0,0 mode: --/EX res: [0x200000405:0x43:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.846304:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b8395a lrc: 0/0,0 mode: --/EX res: [0x200000405:0x43:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.846324:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b83953 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.846330:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b83953 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.846335:0:14257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b83953 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.846344:0:14257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46bc00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826425.846347:0:14257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b83953 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.846353:0:14257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b83953 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.846361:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826425.846363:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787826425.846366:0:14257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b83953 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.846372:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46bc00/0x22153cd396b83953 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.846383:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826425.846385:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787826425.846392:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b83945 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1816 expref: 49 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826425.846579:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55743:x1874670564006400:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 18726us (19002us total) trans 8589935266 rc 0/0 00000100:00100000:2.0:1787826425.846587:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1268 00000020:00080000:2.0:1787826425.846591:0:14257:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1787826425.849690:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826425.849784:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564006784 00000100:00100000:2.0:1787826425.849794:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564006784 00000100:00100000:2.0:1787826425.849854:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4055 00000100:00100000:2.0:1787826425.849864:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecaed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55743:x1874670564006784:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826425.849889:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826425.849910:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83961 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab181d expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.849967:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83961 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab181d expref: 49 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.849982:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83961 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab181d expref: 49 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.850000:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826425.850003:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826425.850008:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835800, rc 0) 00000100:00100000:2.0:1787826425.850066:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecaed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:55743:x1874670564006784:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 203us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826425.850073:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4055 00000100:00100000:0.0:1787826425.854373:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826425.854463:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564007040 00000100:00100000:1.0:1787826425.854518:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564007040 00000100:00100000:1.0:1787826425.854570:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1269 00000100:00100000:1.0:1787826425.854580:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecafc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:55743:x1874670564007040:12345-192.168.203.39@tcp:35:lfs.0 00000004:00080000:1.0:1787826425.854880:0:6521:0:(mdd_object.c:4014:mdd_close()) Object [0x200000405:0x43:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787826425.854943:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].33, 64 off10784 00000004:00080000:1.0:1787826425.854955:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1371866482987ns, next at 1372866480857ns, rc = 0 00000001:00080000:1.0:1787826425.854962:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589935267 00010000:00010000:1.0:1787826425.854999:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b83968 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.855014:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b83968 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x43:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.855025:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b83968 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x43:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.855033:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b83968 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x43:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.855040:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b83968 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x43:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.855045:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b83968 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x43:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.855074:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787826425.855158:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecafc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+51:55743:x1874670564007040:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 578us (795us total) trans 8589935268 rc 0/0 00000100:00100000:1.0:1787826425.855166:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1269 00000020:00080000:1.0:1787826425.855170:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787826425.855686:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826425.855695:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b83968 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x43:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826425.855703:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46b200 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826425.855707:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b83968 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x43:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826425.855716:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b83968 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x43:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826425.855731:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x43:0x0].0x0 (ffff90cf04f8b400) 00010000:00010000:3.0:1787826425.855734:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787826425.855739:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b83968 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x43:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826425.855751:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b83968 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x43:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826425.855780:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826425.855782:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826425.855784:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826425.858422:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826425.859241:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564007296 00000100:00100000:2.0:1787826425.859250:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564007296 00000100:00100000:2.0:1787826425.859585:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1270 00000100:00100000:2.0:1787826425.859595:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+51:55743:x1874670564007296:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:2.0:1787826425.860009:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+52:55743:x1874670564007296:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 413us (1593us total) trans 8589935269 rc 0/0 00000100:00100000:2.0:1787826425.860017:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1270 00000100:00100000:0.0:1787826425.886209:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826425.887617:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564007424 00000100:00100000:2.0:1787826425.887631:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564007424 00000100:00100000:0.0:1787826425.888032:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4056 00000100:00100000:0.0:1787826425.888045:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+52:55745:x1874670564007424:12345-192.168.203.39@tcp:101:getfattr.0 00010000:00010000:0.0:1787826425.888071:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826425.888094:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b8396f lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1824 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.888168:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b83976 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.888182:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b83976 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.888192:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b83976 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.888204:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b8397d lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.888210:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b8397d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.888217:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b8397d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.888973:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b83984 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.888986:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b83984 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.888999:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b83984 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826425.889041:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:0.0:1787826425.889045:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826425.889063:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b83984 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.889074:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b83984 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.889082:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b83976 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.889089:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b83976 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.889096:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b83976 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.889103:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b83976 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.889117:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165e600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826425.889121:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b83976 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.889128:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b83976 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.889139:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90ce036ca600) 00010000:00010000:0.0:1787826425.889142:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826425.889147:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b83976 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.889153:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b83976 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.889165:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b8397d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.889171:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b8397d lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.889175:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b8397d lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.889180:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165e000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826425.889182:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b8397d lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.889187:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b8397d lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.889193:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90ce036cad00) 00010000:00010000:0.0:1787826425.889195:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826425.889198:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b8397d lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.889203:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b8397d lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.889232:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b8396f lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1824 expref: 54 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.889253:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b83984 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1824 expref: 53 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.889260:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826425.889262:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826425.889265:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165ea00, rc 0) 00000100:00100000:0.0:1787826425.890020:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55745:x1874670564007424:12345-192.168.203.39@tcp:101:getfattr.0 Request processed in 1973us (3816us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826425.890029:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4056 00000100:00100000:0.0:1787826425.897558:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826425.897637:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564007552 00000100:00100000:1.0:1787826425.897646:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564007552 00000100:00100000:1.0:1787826425.897707:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2274 00000100:00100000:1.0:1787826425.897718:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecacf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670564007552:12345-192.168.203.39@tcp:101:getfattr.0 00010000:00010000:1.0:1787826425.897734:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826425.897752:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a5fe178/0x22153cd396b8398b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab182b expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826425.897828:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0373d680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1874670585293312:192.168.203.39@tcp:106: 00000100:00100000:1.0:1787826425.897911:0:8435:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf1e87f240 going to sleep for 11 seconds 00000100:00100000:1.0:1787826425.903009:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0373d680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1874670585293312:192.168.203.39@tcp:106: 00010000:00010000:1.0:1787826425.903049:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001a5fe178/0x22153cd396b8398b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab182b expref: 11 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.903075:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a5fe178/0x22153cd396b8398b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab182b expref: 11 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.903088:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46a600, rc 0) 00000100:00100000:1.0:1787826425.903165:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecacf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670564007552:12345-192.168.203.39@tcp:101:getfattr.0 Request processed in 5448us (5616us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826425.903174:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2274 00000100:00100000:0.0:1787826425.946722:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826425.946861:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564007680 00000100:00100000:1.0:1787826425.946872:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564007680 00000100:00100000:1.0:1787826425.946934:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4057 00000100:00100000:1.0:1787826425.946944:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55749:x1874670564007680:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:1.0:1787826425.947019:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b83992 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.947035:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b83992 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.947047:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b83992 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.947064:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b83999 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.947070:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b83999 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.947077:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b83999 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.947155:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b839a0 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.947165:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b839a0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.947170:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b839a0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826425.947207:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:1.0:1787826425.947212:0:8247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826425.947224:0:8247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b839a0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.947239:0:8247:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b83992 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.947245:0:8247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b83992 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.947252:0:8247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b83992 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.947263:0:8247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b83992 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.947269:0:8247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46a600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826425.947273:0:8247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b83992 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.947401:0:8247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b83992 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.947417:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf04f8b600) 00010000:00010000:1.0:1787826425.947420:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826425.947425:0:8247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b83992 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.947432:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b83992 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.947449:0:8247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b83999 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.947455:0:8247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b83999 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.947461:0:8247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b83999 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.947467:0:8247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46b000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826425.947590:0:8247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b83999 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.947601:0:8247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b83999 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.947610:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf04f8bb00) 00010000:00010000:1.0:1787826425.947613:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826425.947615:0:8247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b83999 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.947621:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b83999 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.947632:0:8247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b839a0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.947637:0:8247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b839a0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.947643:0:8247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b839a0 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.947648:0:8247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46b200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826425.947651:0:8247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b839a0 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.947656:0:8247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b839a0 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.947663:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826425.947665:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826425.947668:0:8247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b839a0 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.947676:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b839a0 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826425.948632:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55749:x1874670564007680:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 813us (1042us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826425.948644:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4057 00000100:00100000:0.0:1787826425.971334:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826425.971458:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564007936 00000100:00100000:1.0:1787826425.971467:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564007936 00000100:00100000:1.0:1787826425.971608:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4058 00000100:00100000:1.0:1787826425.971616:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f877480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55751:x1874670564007936:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826425.971633:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826425.971650:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b839a7 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1832 expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.971736:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b839ae lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.971747:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b839ae lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.972117:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b839ae lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826425.972133:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:1.0:1787826425.972235:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b839a7 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1832 expref: 56 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.972254:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b839ae lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1832 expref: 55 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.972263:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826425.972266:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787826425.972269:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46b000, rc 0) 00000100:00100000:1.0:1787826425.972342:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f877480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+55:55751:x1874670564007936:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 725us (1016us total) trans 8589935270 rc 0/0 00000100:00100000:1.0:1787826425.972349:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4058 00000100:00100000:3.0:1787826425.975592:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826425.975654:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564008064 00000100:00100000:0.0:1787826425.975664:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564008064 00000100:00100000:0.0:1787826425.975750:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2275 00000100:00100000:0.0:1787826425.975769:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8acb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670564008064:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826425.975787:0:14864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826425.975806:0:14864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e32bc9b1/0x22153cd396b839bc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1839 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826425.975872:0:14864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f874780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14864:1874670585293440:192.168.203.39@tcp:106: 00000100:00100000:0.0:1787826425.975969:0:14864:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f67e840 going to sleep for 11 seconds 00000100:00100000:2.0:1787826425.984041:0:14864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f874780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14864:1874670585293440:192.168.203.39@tcp:106: 00010000:00010000:2.0:1787826425.984083:0:14864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e32bc9b1/0x22153cd396b839bc lrc: 1/0,0 mode: --/PR res: [0x280000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1839 expref: 11 pid: 14864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.984117:0:14864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e32bc9b1/0x22153cd396b839bc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1839 expref: 11 pid: 14864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826425.984131:0:14864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165e000, rc 0) 00000100:00100000:2.0:1787826425.984188:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8acb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670564008064:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 8430us (8601us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826425.984197:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2275 00000100:00100000:2.0:1787826425.991175:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826425.991271:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564008320 00000100:00100000:1.0:1787826425.991280:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564008320 00000100:00100000:1.0:1787826425.991530:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4059 00000100:00100000:1.0:1787826425.991541:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f9361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+55:55751:x1874670564008320:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826425.991565:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826425.991586:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b839c3 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1840 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.991695:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b839ca lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.991710:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b83984 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1824 expref: 56 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.991719:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b839ca lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.991753:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b83984 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1824 expref: 56 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.991780:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b83984 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1824 expref: 56 pid: 6520 timeout: 1472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826425.991794:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0373d680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1874670585293568:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826425.991868:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf1e87fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787826425.995122:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826425.995159:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0373d680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1874670585293568:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826425.995189:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b839ca lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826425.995248:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564008448 00000100:00100000:0.0:1787826425.995256:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564008448 00010000:00010000:0.0:1787826425.995302:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b83984 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1824 expref: 57 pid: 6520 timeout: 1472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826425.995336:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1321 00000100:00100000:0.0:1787826425.995344:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8af0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+57:2403:x1874670564008448:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826425.995359:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826425.995367:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b83984 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1824 expref: 57 pid: 6520 timeout: 1472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.995447:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b83984 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1824 expref: 57 pid: 6520 timeout: 1472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.995556:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b83984 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1824 expref: 57 pid: 6520 timeout: 1472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.995573:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826425.995578:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b839ca lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.995587:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b839ca lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.995595:0:10340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b839ca lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826425.995616:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826425.995671:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8af0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+56:2403:x1874670564008448:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 327us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826425.995679:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1321 00010000:00010000:1.0:1787826425.996012:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b839ca lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.996019:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b839ca lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826425.996040:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:1.0:1787826425.996997:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b839c3 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1840 expref: 57 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.997018:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b839ca lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1840 expref: 56 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826425.997027:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826425.997030:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787826425.997032:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46a600, rc 0) 00000100:00100000:1.0:1787826425.997125:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f9361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+56:55751:x1874670564008320:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 5586us (5960us total) trans 8589935271 rc 0/0 00000100:00100000:1.0:1787826425.997133:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4059 00000100:00100000:3.0:1787826426.001681:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826426.001960:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564008704 00000100:00100000:0.0:1787826426.001970:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564008704 00000100:00100000:0.0:1787826426.002090:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4060 00000100:00100000:0.0:1787826426.002100:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8acf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+56:55751:x1874670564008704:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826426.002137:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826426.002159:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b839d8 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1847 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.003101:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b839df lrc: 3/1,0 mode: --/PR res: [0x200000405:0x44:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.003128:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b839df lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.003139:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b839df lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826426.003150:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x44:0x0]: returning size 0 00010000:00010000:0.0:1787826426.003207:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165f400/0x22153cd396b839d8 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1847 expref: 59 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.003231:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b839df lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1847 expref: 58 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.003239:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x44:0x0].0x0 (ffff90ce036cad00) 00010000:00010000:0.0:1787826426.003242:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826426.003245:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165ec00, rc 0) 00000100:00100000:0.0:1787826426.003428:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8acf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:55751:x1874670564008704:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1328us (1962us total) trans 8589935272 rc 0/0 00000100:00100000:0.0:1787826426.003436:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4060 00000100:00100000:0.0:1787826426.016839:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826426.016894:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564008960 00000100:00100000:3.0:1787826426.016903:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564008960 00000100:00100000:3.0:1787826426.016969:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4061 00000100:00100000:3.0:1787826426.016979:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:55751:x1874670564008960:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826426.017001:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826426.017021:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b839ed lrc: 2/0,0 mode: --/CR res: [0x200000405:0x44:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab184e expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826426.017174:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b839f4 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x44:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826426.017189:0:8247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b839df lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1847 expref: 59 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826426.017198:0:8247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b839f4 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x44:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826426.017229:0:8247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b839df lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1847 expref: 59 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826426.017243:0:8247:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b839df lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1847 expref: 59 pid: 6520 timeout: 1472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826426.017256:0:8247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a8ae940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8247:1874670585293696:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826426.017330:0:8247:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3780 going to sleep for 11 seconds 00000100:00100000:2.0:1787826426.021793:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826426.021845:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564009088 00000100:00100000:0.0:1787826426.021855:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564009088 00010000:00010000:0.0:1787826426.021899:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b839df lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1847 expref: 60 pid: 6520 timeout: 1472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826426.021920:0:8247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a8ae940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8247:1874670585293696:192.168.203.39@tcp:104: 00010000:00010000:3.0:1787826426.021944:0:8247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b839f4 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x44:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826426.021997:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1322 00000100:00100000:0.0:1787826426.022008:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f937c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:2403:x1874670564009088:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826426.022025:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826426.022032:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b839df lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1847 expref: 60 pid: 6520 timeout: 1472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.022044:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b839df lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1847 expref: 60 pid: 6520 timeout: 1472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.022067:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b839df lrc: 0/0,0 mode: --/PR res: [0x200000405:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1847 expref: 60 pid: 6520 timeout: 1472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.022096:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x44:0x0].0x0 (ffff90ce036cad00) 00010000:00010000:0.0:1787826426.022102:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b839f4 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x44:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.022122:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b839f4 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x44:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.022130:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b839f4 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x44:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.022162:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826426.022278:0:8247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b839f4 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x44:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826426.022300:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b839f4 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x44:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826426.022319:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x44:0x0]: returning size 0 00000100:00100000:0.0:1787826426.022720:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f937c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:2403:x1874670564009088:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 711us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826426.022729:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1322 00000004:00080000:3.0:1787826426.022809:0:8247:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x10f:0x0], index 1: 0 00010000:00010000:3.0:1787826426.022918:0:8247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b839f4 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x44:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826426.022926:0:8247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b839f4 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x44:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826426.022933:0:8247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b839f4 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x44:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826426.022939:0:8247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826426.022942:0:8247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b839f4 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x44:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826426.022951:0:8247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b839f4 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x44:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826426.022963:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x44:0x0].0x0 (ffff90ce036cad00) 00010000:00010000:3.0:1787826426.022965:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787826426.022969:0:8247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b839f4 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x44:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826426.022975:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b839f4 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x44:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826426.023018:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b839ed lrc: 1/0,0 mode: --/CR res: [0x200000405:0x44:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab184e expref: 59 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826426.023027:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x44:0x0].0x0 (ffff90ce036cad00) 00010000:00010000:3.0:1787826426.023029:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787826426.023033:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b839ed lrc: 0/0,0 mode: --/CR res: [0x200000405:0x44:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab184e expref: 59 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826426.023047:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401200, rc 0) 00000100:00100000:3.0:1787826426.023080:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:55751:x1874670564008960:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 6102us (6250us total) trans 8589935273 rc 301/301 00000100:00100000:3.0:1787826426.023100:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4061 00000100:00100000:1.0:1787826426.027839:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826426.027959:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564009344 00000100:00100000:2.0:1787826426.027968:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564009344 00000100:00100000:2.0:1787826426.028055:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1271 00000100:00100000:2.0:1787826426.028067:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+58:55751:x1874670564009344:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:2.0:1787826426.028830:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55751:x1874670564009344:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 762us (998us total) trans 8589935274 rc 0/0 00000100:00100000:2.0:1787826426.028839:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1271 00000100:00100000:2.0:1787826426.035814:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826426.035907:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564009472 00000100:00100000:1.0:1787826426.035916:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564009472 00000100:00100000:1.0:1787826426.035974:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4062 00000100:00100000:1.0:1787826426.035984:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f9370c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55751:x1874670564009472:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826426.036007:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826426.036026:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b83a02 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1855 expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.036120:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b83a09 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.036135:0:32404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b839ca lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1840 expref: 60 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.036144:0:32404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b83a09 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.036174:0:32404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b839ca lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1840 expref: 60 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.036186:0:32404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b839ca lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1840 expref: 60 pid: 6518 timeout: 1472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826426.036199:0:32404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0373c780 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:32404:1874670585293824:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826426.036278:0:32404:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf1e87f840 going to sleep for 11 seconds 00000100:00100000:1.0:1787826426.040985:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826426.041060:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564009600 00000100:00100000:0.0:1787826426.041068:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564009600 00010000:00010000:0.0:1787826426.041115:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b839ca lrc: 5/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1840 expref: 61 pid: 6518 timeout: 1472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826426.041157:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1323 00000100:00100000:0.0:1787826426.041166:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+61:2403:x1874670564009600:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826426.041180:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826426.041187:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b839ca lrc: 5/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1840 expref: 61 pid: 6518 timeout: 1472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.041200:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b839ca lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1840 expref: 61 pid: 6518 timeout: 1472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.041222:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826426.041228:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b83a09 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.041238:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b83a09 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.041246:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b83a09 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.041264:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826426.041333:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+61:2403:x1874670564009600:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 168us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826426.041341:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1323 00010000:00010000:2.0:1787826426.043212:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b839ca lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1840 expref: 60 pid: 6518 timeout: 1472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826426.043238:0:32404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0373c780 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:32404:1874670585293824:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826426.043264:0:32404:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b83a09 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.043276:0:32404:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b83a09 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.043687:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b83a09 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826426.043743:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:2.0:1787826426.043749:0:32404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826426.043785:0:32404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b83a09 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.043821:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b200/0x22153cd396b83a02 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1855 expref: 60 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.043837:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b83a09 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1855 expref: 59 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.043845:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826426.043848:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826426.043851:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46ba00, rc 0) 00000100:00100000:2.0:1787826426.043920:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f9370c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55751:x1874670564009472:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 7937us (8116us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826426.043928:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4062 00000100:00100000:1.0:1787826426.048412:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826426.048544:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564009728 00000100:00100000:2.0:1787826426.048552:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564009728 00000100:00100000:2.0:1787826426.048596:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2276 00000100:00100000:2.0:1787826426.048604:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670564009728:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826426.048620:0:30694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826426.048640:0:30694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000382351a4/0x22153cd396b83a10 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab185c expref: -99 pid: 30694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826426.048699:0:30694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f936940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:30694:1874670585293952:192.168.203.39@tcp:106: 00000100:00100000:2.0:1787826426.048785:0:30694:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf013703c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826426.052157:0:30694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f936940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:30694:1874670585293952:192.168.203.39@tcp:106: 00010000:00010000:2.0:1787826426.052195:0:30694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000382351a4/0x22153cd396b83a10 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab185c expref: 11 pid: 30694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.052219:0:30694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000382351a4/0x22153cd396b83a10 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab185c expref: 11 pid: 30694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.052232:0:30694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834c00, rc 0) 00000100:00100000:2.0:1787826426.052309:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670564009728:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 3704us (3914us total) trans 0 rc 301/301 00000100:00100000:2.0:1787826426.052319:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2276 00000100:00100000:3.0:1787826426.056389:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826426.056848:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564009856 00000100:00100000:1.0:1787826426.056859:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564009856 00000100:00100000:1.0:1787826426.056956:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4063 00000100:00100000:1.0:1787826426.056967:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a8ae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+59:55751:x1874670564009856:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826426.056987:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826426.057009:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b83a17 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x44:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1863 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.057080:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b83a1e lrc: 3/1,0 mode: --/PR res: [0x200000405:0x44:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.057093:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b83a1e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x44:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.057104:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b83a1e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x44:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826426.057155:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x44:0x0]: returning size 0 00000004:00200000:1.0:1787826426.057159:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826426.057176:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b83a1e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x44:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.057203:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b83a17 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x44:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1863 expref: 61 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.057219:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b83a1e lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x44:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1863 expref: 60 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.057228:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x44:0x0].0x0 (ffff90cf04f8bb00) 00010000:00010000:1.0:1787826426.057231:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787826426.057234:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46aa00, rc 0) 00000100:00100000:1.0:1787826426.057309:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a8ae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:55751:x1874670564009856:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 344us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826426.057317:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4063 00000100:00100000:1.0:1787826426.060879:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826426.061047:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564009984 00000100:00100000:2.0:1787826426.061057:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564009984 00000100:00100000:2.0:1787826426.061124:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2277 00000100:00100000:2.0:1787826426.061134:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0373c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2404:x1874670564009984:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826426.061150:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826426.061170:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000382351a4/0x22153cd396b83a25 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x10f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab186a expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787826426.061197:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787826426.061216:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10f:0x0].0x0 since=1372s v=(0 0) 00010000:00010000:2.0:1787826426.061222:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826426.061232:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000382351a4/0x22153cd396b83a25 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab186a expref: 14 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.061250:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000382351a4/0x22153cd396b83a25 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab186a expref: 14 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.061264:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834c00, rc 0) 00000100:00100000:2.0:1787826426.061841:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0373c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670564009984:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 707us (968us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826426.061849:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2277 00000100:00100000:3.0:1787826426.066066:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826426.066170:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564010240 00000100:00100000:0.0:1787826426.066180:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564010240 00000100:00100000:0.0:1787826426.066244:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4064 00000100:00100000:0.0:1787826426.066254:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136ced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+60:55751:x1874670564010240:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826426.066273:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826426.066306:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b83a2c lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1871 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.066425:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b83a33 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.066440:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b83a33 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.066451:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b83a33 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826426.066464:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:0.0:1787826426.066715:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ec00/0x22153cd396b83a2c lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1871 expref: 63 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.066734:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b83a33 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1871 expref: 62 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.066744:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826426.066747:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787826426.066750:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165ea00, rc 0) 00000100:00100000:0.0:1787826426.066800:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136ced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+62:55751:x1874670564010240:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 548us (742us total) trans 8589935275 rc 0/0 00000100:00100000:0.0:1787826426.066808:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4064 00000100:00100000:3.0:1787826426.072045:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826426.072135:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564010368 00000100:00100000:1.0:1787826426.072144:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564010368 00000100:00100000:1.0:1787826426.072238:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2278 00000100:00100000:1.0:1787826426.072249:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136ce580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670564010368:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826426.072268:0:30398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826426.072285:0:30398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000816b8b1f/0x22153cd396b83a41 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1878 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826426.072356:0:30398:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01dfde00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:30398:1874670585294080:192.168.203.39@tcp:106: 00000100:00100000:1.0:1787826426.072452:0:30398:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf1e87f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826426.075903:0:30398:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01dfde00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:30398:1874670585294080:192.168.203.39@tcp:106: 00010000:00010000:3.0:1787826426.075944:0:30398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000816b8b1f/0x22153cd396b83a41 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1878 expref: 11 pid: 30398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826426.075968:0:30398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000816b8b1f/0x22153cd396b83a41 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1878 expref: 11 pid: 30398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826426.075981:0:30398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46ae00, rc 0) 00000100:00100000:3.0:1787826426.076074:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136ce580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670564010368:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 3826us (4037us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826426.076083:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2278 00000100:00100000:3.0:1787826426.082817:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826426.085792:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564010496 00000100:00100000:1.0:1787826426.085808:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564010496 00000100:00100000:1.0:1787826426.085934:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2279 00000100:00100000:1.0:1787826426.085945:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136cde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670564010496:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826426.085963:0:8545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826426.085983:0:8545:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000951304c9/0x22153cd396b83a48 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab187f expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826426.086042:0:8545:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01dffc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8545:1874670585294208:192.168.203.39@tcp:106: 00000100:00100000:1.0:1787826426.086155:0:8545:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf1e87f180 going to sleep for 11 seconds 00000100:00100000:3.0:1787826426.096362:0:8545:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01dffc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8545:1874670585294208:192.168.203.39@tcp:106: 00010000:00010000:3.0:1787826426.096422:0:8545:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000951304c9/0x22153cd396b83a48 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab187f expref: 11 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826426.096449:0:8545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000951304c9/0x22153cd396b83a48 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab187f expref: 11 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826426.096463:0:8545:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46b400, rc 0) 00000100:00100000:3.0:1787826426.096801:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136cde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670564010496:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 10857us (13994us total) trans 0 rc 301/301 00000100:00100000:3.0:1787826426.096811:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2279 00000100:00100000:2.0:1787826426.101582:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826426.101746:0:30696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564010624 00000100:00100000:1.0:1787826426.101756:0:30696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564010624 00000100:00100000:1.0:1787826426.101812:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2280 00000100:00100000:1.0:1787826426.101822:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f936940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670564010624:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:1.0:1787826426.101866:0:30696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000065f23c08/0x22153cd396b83a4f lrc: 3/1,0 mode: --/PR res: [0x280000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.101886:0:30696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005c6f0c33/0x22153cd396b8387a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17d7 expref: 10 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.101894:0:30696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x10e:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787826426.101898:0:30696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826426.101903:0:30696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065f23c08/0x22153cd396b83a4f lrc: 4/1,0 mode: --/PR res: [0x280000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.101937:0:30696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005c6f0c33/0x22153cd396b8387a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17d7 expref: 10 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.101951:0:30696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005c6f0c33/0x22153cd396b8387a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17d7 expref: 10 pid: 30696 timeout: 1472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826426.101965:0:30696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01dffc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:30696:1874670585294336:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826426.102039:0:30696:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf1e87f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826426.106828:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826426.107571:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564010752 00000100:00100000:0.0:1787826426.107582:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564010752 00010000:00010000:0.0:1787826426.107624:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005c6f0c33/0x22153cd396b8387a lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17d7 expref: 11 pid: 30696 timeout: 1472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826426.107715:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1324 00000100:00100000:0.0:1787826426.107726:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01dfde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2403:x1874670564010752:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826426.107742:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826426.107764:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005c6f0c33/0x22153cd396b8387a lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x10e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17d7 expref: 11 pid: 30696 timeout: 1472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.107778:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005c6f0c33/0x22153cd396b8387a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x10e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17d7 expref: 11 pid: 30696 timeout: 1472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.107806:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826426.107811:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826426.107817:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065f23c08/0x22153cd396b83a4f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x10e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.107826:0:10340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065f23c08/0x22153cd396b83a4f lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x10e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.107846:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826426.107913:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01dfde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2403:x1874670564010752:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 188us (1095us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826426.107921:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1324 00010000:00010000:2.0:1787826426.108010:0:30696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c6f0c33/0x22153cd396b8387a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17d7 expref: 10 pid: 30696 timeout: 1472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826426.108025:0:30696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01dffc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:30696:1874670585294336:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826426.108045:0:30696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065f23c08/0x22153cd396b83a4f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x10e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.108056:0:30696:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065f23c08/0x22153cd396b83a4f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x10e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.108068:0:30696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065f23c08/0x22153cd396b83a4f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x10e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.108087:0:30696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000065f23c08/0x22153cd396b83a4f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x10e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.108096:0:30696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065f23c08/0x22153cd396b83a4f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x10e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.108104:0:30696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065f23c08/0x22153cd396b83a4f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.108120:0:30696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46a800 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:2.0:1787826426.108124:0:30696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065f23c08/0x22153cd396b83a4f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.108132:0:30696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065f23c08/0x22153cd396b83a4f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x10e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.108144:0:30696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065f23c08/0x22153cd396b83a4f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x10e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.108151:0:30696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065f23c08/0x22153cd396b83a4f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x10e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826426.108196:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f936940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670564010624:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 6376us (6625us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826426.108204:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2280 00000100:00100000:2.0:1787826426.113163:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826426.114599:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564010880 00000100:00100000:1.0:1787826426.114612:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564010880 00000100:00100000:1.0:1787826426.114681:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2281 00000100:00100000:1.0:1787826426.114691:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f936d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2403:x1874670564010880:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826426.114709:0:30695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826426.114731:0:30695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000381c17db/0x22153cd396b83a56 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x10e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1886 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826426.114756:0:30695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10e:0x0] initial LVB size: 0, mtime: 0x6a9010ec, atime: 0x6a9010ec, ctime: 0x6a9010fa, blocks: 0x0 00010000:00010000:1.0:1787826426.114775:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10e:0x0].0x0 since=1372s v=(0 0) 00010000:00010000:1.0:1787826426.114780:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826426.114789:0:30695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000381c17db/0x22153cd396b83a56 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1886 expref: 10 pid: 30695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.114806:0:30695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000381c17db/0x22153cd396b83a56 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1886 expref: 10 pid: 30695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.114819:0:30695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46a400, rc 0) 00000100:00100000:1.0:1787826426.115712:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f936d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670564010880:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1014us (2552us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826426.115721:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2281 00010000:00010000:2.0:1787826426.182417:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826426.200060:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826426.204806:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564011008 00000100:00100000:0.0:1787826426.204820:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564011008 00000100:00100000:0.0:1787826426.204899:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4065 00000100:00100000:0.0:1787826426.204909:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+62:55751:x1874670564011008:12345-192.168.203.39@tcp:44:lfs.0 00000001:00080000:3.0:1787826426.207547:0:34481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935275 is committed 00000004:00080000:3.0:1787826426.207578:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 33 committed 00000020:00080000:3.0:1787826426.207611:0:34481:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90ce02706840 refcount 2 committed 0 result 0 batchid 4294969347 00000020:00080000:3.0:1787826426.207616:0:34481:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cf18034b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90cf396cf180 00000020:00080000:3.0:1787826426.207620:0:34481:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cf18034e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90ce04f57000 00000020:00080000:3.0:1787826426.207632:0:34481:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969346 batchid updated 00000020:00080000:0.0:1787826426.207724:0:34512:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969347 committed batchid 4294969346 00000020:00080000:0.0:1787826426.207784:0:34512:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969346 00000100:00100000:0.0:1787826426.207923:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:55751:x1874670564011008:12345-192.168.203.39@tcp:44:lfs.0 Request processed in 3011us (7868us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826426.207933:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4065 00000100:00100000:3.0:1787826426.208904:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787826426.208923:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01dffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585294464:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787826426.208981:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826426.209133:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585294464 00000100:00100000:1.0:1787826426.209141:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585294464 00000100:00100000:1.0:1787826426.209193:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2282 00000100:00100000:1.0:1787826426.209202:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136ce940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3644:x1874670585294464:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787826426.209226:0:8437:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:270 count 1 00010000:00010000:1.0:1787826426.209250:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bacf1a1a/0x22153cd396b83a5d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.209272:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009a27ec96/0x22153cd396b83888 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17de expref: 13 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.209282:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x10e:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787826426.209286:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787826426.209291:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bacf1a1a/0x22153cd396b83a5d lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.209319:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009a27ec96/0x22153cd396b83888 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17de expref: 13 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.209334:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009a27ec96/0x22153cd396b83888 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17de expref: 13 pid: 8437 timeout: 1472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826426.209345:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f80b0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1874670585294592:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826426.209404:0:8437:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf1e87fa80 going to sleep for 11 seconds 00010000:00010000:2.0:1787826426.210171:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b8386c lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.210184:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b8386c lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.210191:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b8386c lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.210198:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826426.210203:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b8386c lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.210211:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b8386c lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.210228:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x42:0x0].0x0 (ffff90cf2f6bd300) 00010000:00010000:2.0:1787826426.210231:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826426.210236:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b8386c lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.210242:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400400/0x22153cd396b8386c lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.210270:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b83881 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.210277:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b83881 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.210282:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b83881 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.210299:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165fe00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826426.210303:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b83881 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.210309:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b83881 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.210315:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826426.210318:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826426.210321:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b83881 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.210326:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fe00/0x22153cd396b83881 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826426.213896:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826426.213986:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826426.214241:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f80b0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1874670585294592:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826426.214268:0:8437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bacf1a1a/0x22153cd396b83a5d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826426.214534:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564011264 00000100:00100000:2.0:1787826426.214541:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564011264 00000100:00100000:2.0:1787826426.214599:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2283 00000100:00100000:2.0:1787826426.214608:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136ccf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670564011264:12345-192.168.203.39@tcp:16:lfs.0 00000100:00100000:2.0:1787826426.214717:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136ccf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670564011264:12345-192.168.203.39@tcp:16:lfs.0 Request processed in 109us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826426.214725:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2283 00000100:00100000:0.0:1787826426.214950:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564011136 00000100:00100000:0.0:1787826426.214954:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564011136 00010000:00010000:0.0:1787826426.214978:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009a27ec96/0x22153cd396b83888 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17de expref: 14 pid: 8437 timeout: 1472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826426.215011:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1325 00000100:00100000:0.0:1787826426.215018:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136cfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670564011136:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826426.215028:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826426.215034:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009a27ec96/0x22153cd396b83888 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x10e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17de expref: 14 pid: 8437 timeout: 1472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.215045:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009a27ec96/0x22153cd396b83888 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17de expref: 14 pid: 8437 timeout: 1472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.215072:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a27ec96/0x22153cd396b83888 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab17de expref: 14 pid: 8437 timeout: 1472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.215089:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826426.215094:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787826426.215098:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bacf1a1a/0x22153cd396b83a5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.215117:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bacf1a1a/0x22153cd396b83a5d lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.215145:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826426.215176:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136cfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2404:x1874670564011136:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 157us (1288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826426.215184:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1325 00010000:00010000:2.0:1787826426.215981:0:8437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bacf1a1a/0x22153cd396b83a5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.215995:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bacf1a1a/0x22153cd396b83a5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.216005:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bacf1a1a/0x22153cd396b83a5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.216019:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bacf1a1a/0x22153cd396b83a5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.216045:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787826426.216232:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136ce940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:3644:x1874670585294464:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7029us (7248us total) trans 17179869688 rc 0/0 00000100:00100000:2.0:1787826426.216241:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2282 00010000:00010000:1.0:1787826426.216242:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826426.216251:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bacf1a1a/0x22153cd396b83a5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.216262:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46b200 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:1.0:1787826426.216267:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bacf1a1a/0x22153cd396b83a5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.216282:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bacf1a1a/0x22153cd396b83a5d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.216298:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bacf1a1a/0x22153cd396b83a5d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.216305:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bacf1a1a/0x22153cd396b83a5d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.216323:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826426.216325:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826426.216326:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787826426.216387:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90ce01dffc00/2, rc 0, transno 17179869688 00000100:00100000:3.0:1787826426.216394:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01dffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585294464:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787826426.234816:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826426.234912:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564011392 00000100:00100000:0.0:1787826426.234922:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564011392 00000100:00100000:0.0:1787826426.234977:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2284 00000100:00100000:0.0:1787826426.234988:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670564011392:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:0.0:1787826426.235032:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009a27ec96/0x22153cd396b83a64 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.235049:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826426.235053:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826426.235060:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a27ec96/0x22153cd396b83a64 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.235074:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a27ec96/0x22153cd396b83a64 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.235101:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009a27ec96/0x22153cd396b83a64 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.235120:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a27ec96/0x22153cd396b83a64 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.235129:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a27ec96/0x22153cd396b83a64 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.235136:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165f600 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:0.0:1787826426.235140:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a27ec96/0x22153cd396b83a64 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.235149:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a27ec96/0x22153cd396b83a64 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.235164:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a27ec96/0x22153cd396b83a64 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.235177:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a27ec96/0x22153cd396b83a64 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826426.235262:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2404:x1874670564011392:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 275us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826426.235270:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2284 00000100:00100000:1.0:1787826426.241568:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826426.241700:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564011648 00000100:00100000:2.0:1787826426.241710:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564011648 00000100:00100000:2.0:1787826426.241779:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4066 00000100:00100000:2.0:1787826426.241788:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f80b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:55751:x1874670564011648:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:2.0:1787826426.241843:0:32404:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826426.241872:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46aa00/0x22153cd396b83a1e lrc: 0/0,0 mode: --/PR res: [0x200000405:0x44:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1863 expref: 33 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.241890:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x44:0x0].0x0 (ffff90cf04f8bb00) 00010000:00010000:2.0:1787826426.241900:0:32404:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826426.241935:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b83a6b lrc: 3/0,1 mode: --/PW res: [0x200000405:0x44:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.241959:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b83a6b lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.241969:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b83a6b lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826426.242082:0:32404:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000a6b9ce0 reply state 00000000de962061 transno 8589935276 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b83a6b lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.242093:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b83a6b lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.242099:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x44:0x0].0x0 (ffff90cf39e67b00) 00010000:00010000:2.0:1787826426.242102:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826426.242105:0:32404:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826426.242221:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f80b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:55751:x1874670564011648:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 433us (661us total) trans 8589935276 rc 0/0 00000100:00100000:2.0:1787826426.242957:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4066 00000100:00100000:1.0:1787826426.246885:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826426.247069:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564011776 00000100:00100000:2.0:1787826426.247079:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564011776 00000100:00100000:2.0:1787826426.247148:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4067 00000100:00100000:2.0:1787826426.247158:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f80ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:55751:x1874670564011776:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826426.247183:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826426.247203:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b83a72 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x44:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab188d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.247266:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b83a72 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x44:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab188d expref: 35 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.247292:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b83a72 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x44:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab188d expref: 35 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.247310:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x44:0x0].0x0 (ffff90cf39e67b00) 00010000:00010000:2.0:1787826426.247313:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826426.247316:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834a00, rc 0) 00000100:00100000:2.0:1787826426.247367:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f80ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:55751:x1874670564011776:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 211us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826426.247374:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4067 00000100:00100000:3.0:1787826426.251526:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826426.251629:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564011904 00000100:00100000:2.0:1787826426.251638:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564011904 00000100:00100000:2.0:1787826426.251699:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2285 00000100:00100000:2.0:1787826426.251709:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf13669e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:55751:x1874670564011904:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826426.251725:0:14864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826426.251743:0:14864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c800962/0x22153cd396b83a79 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x10f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1894 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.251776:0:14864:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000382351a4/0x22153cd396b83a25 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x10f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab186a expref: 14 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.251786:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826426.251790:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826426.251795:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c800962/0x22153cd396b83a79 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x10f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1894 expref: 14 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.251828:0:14864:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000382351a4/0x22153cd396b83a25 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x10f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab186a expref: 14 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.251842:0:14864:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000382351a4/0x22153cd396b83a25 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x10f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab186a expref: 14 pid: 8436 timeout: 1472 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826426.251856:0:14864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f9352c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14864:1874670585294720:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826426.251934:0:14864:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f5e76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787826426.260732:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826426.265079:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564012032 00000100:00100000:3.0:1787826426.265093:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564012032 00010000:00010000:3.0:1787826426.265160:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000382351a4/0x22153cd396b83a25 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x10f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab186a expref: 15 pid: 8436 timeout: 1472 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826426.265208:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1326 00000100:00100000:3.0:1787826426.265217:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf181fd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+15:2403:x1874670564012032:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826426.265233:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826426.265255:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000382351a4/0x22153cd396b83a25 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x10f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab186a expref: 15 pid: 8436 timeout: 1472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826426.265268:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000382351a4/0x22153cd396b83a25 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x10f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab186a expref: 15 pid: 8436 timeout: 1472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826426.265311:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826426.265316:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787826426.265323:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008c800962/0x22153cd396b83a79 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1894 expref: 15 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826426.265333:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c800962/0x22153cd396b83a79 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x10f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1894 expref: 15 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826426.265374:0:6503:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008c800962/0x22153cd396b83a79 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x10f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1894 expref: 15 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826426.265388:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf1366b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6503:1874670585294848:192.168.203.39@tcp:105: 00000100:00100000:3.0:1787826426.265516:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3180 going to sleep for 11 seconds 00010000:00010000:2.0:1787826426.265618:0:14864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000382351a4/0x22153cd396b83a25 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x10f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab186a expref: 15 pid: 8436 timeout: 1472 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826426.265632:0:14864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f9352c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14864:1874670585294720:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826426.265653:0:14864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008c800962/0x22153cd396b83a79 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x10f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1894 expref: 14 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.265662:0:14864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834800, rc 0) 00000100:00100000:2.0:1787826426.265692:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf13669e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:55751:x1874670564011904:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 13985us (14175us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826426.265700:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2285 00000100:00100000:3.0:1787826426.273775:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826426.273827:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf1366b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6503:1874670585294848:192.168.203.39@tcp:105: 00010000:00010000:1.0:1787826426.273853:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826426.273907:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf181fd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2403:x1874670564012032:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 8691us (13184us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826426.273919:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1326 00000100:00100000:2.0:1787826426.273932:0:30694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564012160 00000100:00100000:2.0:1787826426.273938:0:30694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564012160 00000100:00100000:2.0:1787826426.273991:0:30694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2286 00000100:00100000:2.0:1787826426.274001:0:30694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1366bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+13:2403:x1874670564012160:12345-192.168.203.39@tcp:2:lfs.0 00002000:00010000:2.0:1787826426.274159:0:30694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x10f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787826426.274163:0:30694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x10f:0x0] updating lvb mtime from disk: 0 -> 1787826412 00002000:00010000:2.0:1787826426.274166:0:30694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x10f:0x0] updating lvb atime from disk: 0 -> 1787826412 00002000:00010000:2.0:1787826426.274168:0:30694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x10f:0x0] updating lvb ctime from disk: 0 -> 1787826426 00002000:00010000:2.0:1787826426.274171:0:30694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x10f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1787826426.274196:0:30694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1366bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2403:x1874670564012160:12345-192.168.203.39@tcp:2:lfs.0 Request processed in 197us (431us total) trans 17179869689 rc 0/0 00000100:00100000:2.0:1787826426.274202:0:30694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2286 00000100:00100000:0.0:1787826426.285688:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826426.285800:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564012416 00000100:00100000:2.0:1787826426.285809:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564012416 00000100:00100000:2.0:1787826426.285870:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4068 00000100:00100000:2.0:1787826426.285880:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f875e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:55751:x1874670564012416:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:2.0:1787826426.285934:0:9966:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826426.285961:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ba00/0x22153cd396b83a09 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1855 expref: 35 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.285982:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826426.285987:0:9966:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826426.286209:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b83a80 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.286224:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b83a80 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.286234:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b83a80 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826426.286575:0:9966:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dc0486c2 reply state 00000000a6d2b0f6 transno 8589935277 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b83a80 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.286589:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b83a80 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.286596:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826426.286598:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826426.286601:0:9966:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826426.286695:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f875e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55751:x1874670564012416:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 816us (1016us total) trans 8589935277 rc 0/0 00000100:00100000:2.0:1787826426.286704:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4068 00000100:00100000:3.0:1787826426.292574:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826426.292632:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564012544 00000100:00100000:2.0:1787826426.292641:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564012544 00000100:00100000:2.0:1787826426.292707:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2287 00000100:00100000:2.0:1787826426.292718:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf13668780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:55751:x1874670564012544:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826426.292735:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826426.292918:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c6f0c33/0x22153cd396b83a87 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab189b expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.292954:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000381c17db/0x22153cd396b83a56 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1886 expref: 11 pid: 30695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.292963:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826426.292968:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787826426.292974:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c6f0c33/0x22153cd396b83a87 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab189b expref: 11 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.293005:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000381c17db/0x22153cd396b83a56 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1886 expref: 11 pid: 30695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.293019:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000381c17db/0x22153cd396b83a56 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1886 expref: 11 pid: 30695 timeout: 1472 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826426.293045:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f9352c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1874670585294976:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826426.293184:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f5e7480 going to sleep for 11 seconds 00000100:00100000:1.0:1787826426.296755:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826426.296852:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564012672 00000100:00100000:0.0:1787826426.296861:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564012672 00010000:00010000:0.0:1787826426.296902:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000381c17db/0x22153cd396b83a56 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1886 expref: 12 pid: 30695 timeout: 1472 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826426.296948:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1327 00000100:00100000:0.0:1787826426.296957:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f808b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+12:2403:x1874670564012672:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826426.296972:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826426.296992:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000381c17db/0x22153cd396b83a56 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x10e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1886 expref: 12 pid: 30695 timeout: 1472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.297006:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000381c17db/0x22153cd396b83a56 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x10e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1886 expref: 12 pid: 30695 timeout: 1472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.297187:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826426.297192:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787826426.297200:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005c6f0c33/0x22153cd396b83a87 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab189b expref: 12 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.297212:0:10340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c6f0c33/0x22153cd396b83a87 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x10e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab189b expref: 12 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.297250:0:10340:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005c6f0c33/0x22153cd396b83a87 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x10e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab189b expref: 12 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826426.297264:0:10340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f8761c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10340:1874670585295104:192.168.203.39@tcp:105: 00010000:00010000:2.0:1787826426.297467:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000381c17db/0x22153cd396b83a56 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x10e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1886 expref: 12 pid: 30695 timeout: 1472 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826426.297762:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f9352c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1874670585294976:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826426.297789:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005c6f0c33/0x22153cd396b83a87 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab189b expref: 11 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.297801:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834600, rc 0) 00000100:00100000:2.0:1787826426.297851:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf13668780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:55751:x1874670564012544:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 5135us (5284us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826426.297859:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2287 00000100:00100000:0.0:1787826426.298195:0:10340:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce01ef9e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787826426.302757:0:10340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f8761c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10340:1874670585295104:192.168.203.39@tcp:105: 00010000:00010000:3.0:1787826426.302785:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826426.302843:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f808b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670564012672:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5887us (6096us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826426.302855:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1327 00000100:00100000:3.0:1787826426.304301:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826426.304726:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564012800 00000100:00100000:2.0:1787826426.304735:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564012800 00000100:00100000:2.0:1787826426.304799:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2288 00000100:00100000:2.0:1787826426.304810:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf13668f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+10:2403:x1874670564012800:12345-192.168.203.39@tcp:2:lfs.0 00002000:00010000:2.0:1787826426.304957:0:28853:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x10e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787826426.304961:0:28853:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x10e:0x0] updating lvb mtime from disk: 1787826412 -> 1787826412 00002000:00010000:2.0:1787826426.304964:0:28853:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x10e:0x0] updating lvb atime from disk: 1787826412 -> 1787826412 00002000:00010000:2.0:1787826426.304967:0:28853:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x10e:0x0] updating lvb ctime from disk: 1787826426 -> 1787826426 00002000:00010000:2.0:1787826426.304969:0:28853:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x10e:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1787826426.305020:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf13668f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2403:x1874670564012800:12345-192.168.203.39@tcp:2:lfs.0 Request processed in 212us (737us total) trans 21474837030 rc 0/0 00000100:00100000:2.0:1787826426.305029:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2288 00000100:00100000:1.0:1787826426.308697:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826426.308794:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564013056 00000100:00100000:2.0:1787826426.308803:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564013056 00000100:00100000:2.0:1787826426.308858:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1272 00000100:00100000:2.0:1787826426.308867:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eea2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55751:x1874670564013056:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:2.0:1787826426.308941:0:14257:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000405:0x1d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b83a33 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1871 expref: 36 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.308989:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83a8e lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.309001:0:14257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83961 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab181d expref: 36 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.309008:0:14257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b839ae lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1832 expref: 36 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.309016:0:14257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83a8e lrc: 5/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.309046:0:14257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b839ae lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1832 expref: 36 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.309059:0:14257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b839ae lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1832 expref: 36 pid: 32404 timeout: 1472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826426.309073:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f9352c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585295232:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826426.309174:0:14257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83961 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab181d expref: 36 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.309184:0:14257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83961 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab181d expref: 36 pid: 9966 timeout: 1472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826426.309193:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f934f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585295360:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826426.309221:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f5e7480 going to sleep for 11 seconds 00000100:00100000:2.0:1787826426.312832:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f9352c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585295232:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826426.312850:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f934f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585295360:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826426.312876:0:14257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83a8e lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826426.317447:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826426.317579:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564013312 00000100:00100000:2.0:1787826426.317589:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564013312 00000100:00100000:2.0:1787826426.317651:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1273 00000100:00100000:2.0:1787826426.317660:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f80a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:42221:x1874670564013312:12345-192.168.203.39@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787826426.320737:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f80a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:42221:x1874670564013312:12345-192.168.203.39@tcp:35:ldlm_bl.0 Request processed in 3066us (3288us total) trans 8589935278 rc 0/0 00000100:00100000:2.0:1787826426.320752:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1273 00000100:00100000:1.0:1787826426.321073:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826426.321598:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564013440 00000100:00100000:0.0:1787826426.321608:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564013440 00010000:00010000:0.0:1787826426.321649:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83961 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab181d expref: 38 pid: 9966 timeout: 1472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826426.321694:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1328 00000100:00100000:0.0:1787826426.321704:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f80b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:2403:x1874670564013440:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826426.321718:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826426.321724:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83961 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab181d expref: 38 pid: 9966 timeout: 1472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.321736:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83961 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab181d expref: 38 pid: 9966 timeout: 1472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.321760:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83961 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab181d expref: 38 pid: 9966 timeout: 1472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.321778:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826426.321783:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83a8e lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.321792:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83a8e lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.321805:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826426.321851:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f80b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:2403:x1874670564013440:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 149us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826426.321860:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1328 00000100:00100000:0.0:1787826426.324250:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826426.324435:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564013568 00000100:00100000:1.0:1787826426.324445:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564013568 00010000:00010000:1.0:1787826426.324511:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b839ae lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1832 expref: 37 pid: 32404 timeout: 1472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826426.324544:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1329 00000100:00100000:1.0:1787826426.324554:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8770c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:2403:x1874670564013568:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826426.324568:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826426.324575:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b839ae lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1832 expref: 37 pid: 32404 timeout: 1472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.324587:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b839ae lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1832 expref: 37 pid: 32404 timeout: 1472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.324611:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b839ae lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1832 expref: 37 pid: 32404 timeout: 1472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.324628:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826426.324634:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83a8e lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.324643:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83a8e lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.324651:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83a8e lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.324677:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826426.324716:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8770c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:2403:x1874670564013568:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 164us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826426.324728:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1329 00010000:00010000:1.0:1787826426.324753:0:14257:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83a8e lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.324761:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83a8e lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.324782:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b83a95 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x44:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.324793:0:14257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b83a72 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x44:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab188d expref: 35 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.324800:0:14257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b83a95 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x44:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.324829:0:14257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b83a72 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x44:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab188d expref: 35 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.324842:0:14257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b83a72 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x44:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab188d expref: 35 pid: 6518 timeout: 1472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826426.324856:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f8092c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585295488:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826426.324908:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf1e87fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787826426.328463:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f8092c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585295488:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826426.328524:0:14257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b83a95 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x44:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826426.329238:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826426.329579:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564013696 00000100:00100000:0.0:1787826426.329587:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564013696 00010000:00010000:0.0:1787826426.329626:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b83a72 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x44:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab188d expref: 36 pid: 6518 timeout: 1472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826426.329656:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1330 00000100:00100000:0.0:1787826426.329665:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f80b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:2403:x1874670564013696:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826426.329679:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826426.329685:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b83a72 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x44:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab188d expref: 36 pid: 6518 timeout: 1472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.329698:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b83a72 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x44:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab188d expref: 36 pid: 6518 timeout: 1472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.329719:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b83a72 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x44:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab188d expref: 36 pid: 6518 timeout: 1472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.329735:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x44:0x0].0x0 (ffff90cf39e67b00) 00010000:00010000:0.0:1787826426.329741:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b83a95 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x44:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.329749:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b83a95 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x44:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.329756:0:10340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b83a95 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x44:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.329790:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826426.329850:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f80b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:2403:x1874670564013696:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 185us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826426.329858:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1330 00010000:00010000:1.0:1787826426.330000:0:14257:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b83a95 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x44:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.330009:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b83a95 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x44:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826426.330316:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f808f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585295616:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1787826426.330366:0:14257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826426.330402:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf1e87f600 going to sleep for 11 seconds 00000100:00100000:0.0:1787826426.331025:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585295616 00000100:00100000:0.0:1787826426.331032:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585295616 00000100:00100000:0.0:1787826426.331081:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1504 00000100:00100000:0.0:1787826426.331089:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f809680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:14257:x1874670585295616:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1787826426.331189:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f809680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:14257:x1874670585295616:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 101us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826426.331196:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1504 00000100:00100000:2.0:1787826426.331323:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f808f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585295616:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1787826426.331378:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f934f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585295744:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1787826426.331409:0:14257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826426.331434:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2f5e7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787826426.331502:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585295744 00000100:00100000:3.0:1787826426.331506:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585295744 00000100:00100000:3.0:1787826426.331535:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1505 00000100:00100000:3.0:1787826426.331542:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f9352c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:14257:x1874670585295744:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1787826426.331610:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f9352c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:14257:x1874670585295744:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 68us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826426.331616:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1505 00000100:00100000:2.0:1787826426.332017:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f934f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585295744:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:2.0:1787826426.332158:0:14257:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589935279 00000100:00100000:2.0:1787826426.332218:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f934f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585295872:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1787826426.332250:0:14257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826426.332274:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce05b56600 going to sleep for 11 seconds 00000100:00100000:1.0:1787826426.332344:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585295872 00000100:00100000:1.0:1787826426.332350:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585295872 00000100:00100000:1.0:1787826426.332390:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1506 00000100:00100000:1.0:1787826426.332397:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f937c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+10:14257:x1874670585295872:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1787826426.332537:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f937c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+11:14257:x1874670585295872:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 139us (285us total) trans 17179869690 rc 0/0 00000100:00100000:1.0:1787826426.332544:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1506 00000100:00100000:2.0:1787826426.332710:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f934f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14257:1874670585295872:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:2.0:1787826426.332761:0:14257:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589935280 00010000:00010000:2.0:1787826426.332784:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b83a95 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x44:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.332794:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b83a95 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x44:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.332802:0:14257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b83a95 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x44:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.332808:0:14257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46ac00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826426.332812:0:14257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b83a95 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x44:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.332820:0:14257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b83a95 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x44:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.332835:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x44:0x0].0x0 (ffff90cf39e67b00) 00010000:00010000:2.0:1787826426.332838:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787826426.332843:0:14257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b83a95 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x44:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.332849:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ac00/0x22153cd396b83a95 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x44:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.332865:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83a8e lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.332870:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83a8e lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.332875:0:14257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83a8e lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.332880:0:14257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826426.332882:0:14257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83a8e lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.332887:0:14257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83a8e lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.332894:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826426.332897:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787826426.332899:0:14257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83a8e lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.332904:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83a8e lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.332915:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826426.332918:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787826426.332923:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ea00/0x22153cd396b83a33 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1871 expref: 37 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826426.333042:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eea2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55751:x1874670564013056:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 24176us (24353us total) trans 8589935281 rc 0/0 00000100:00100000:2.0:1787826426.333051:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1272 00000020:00080000:2.0:1787826426.333055:0:14257:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1787826426.336125:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826426.336183:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564013824 00000100:00100000:1.0:1787826426.336192:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564013824 00000100:00100000:1.0:1787826426.336245:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4069 00000100:00100000:1.0:1787826426.336254:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1366a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+36:55751:x1874670564013824:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826426.336276:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826426.336307:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b83a9c lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab18a2 expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.336356:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b83a9c lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18a2 expref: 37 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.336370:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b83a9c lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18a2 expref: 37 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.336386:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826426.336389:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826426.336393:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46a600, rc 0) 00000100:00100000:1.0:1787826426.336622:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1366a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:55751:x1874670564013824:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 367us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826426.336629:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4069 00000100:00100000:3.0:1787826426.340301:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826426.340441:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564014080 00000100:00100000:1.0:1787826426.340451:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564014080 00000100:00100000:1.0:1787826426.340531:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1274 00000100:00100000:1.0:1787826426.340541:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1366a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+37:55751:x1874670564014080:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:1.0:1787826426.340743:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1366a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:55751:x1874670564014080:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 204us (464us total) trans 8589935282 rc 0/0 00000100:00100000:1.0:1787826426.340751:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1274 00000100:00100000:0.0:1787826426.344076:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826426.344161:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564014336 00000100:00100000:2.0:1787826426.344172:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564014336 00000100:00100000:2.0:1787826426.344229:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1275 00000100:00100000:2.0:1787826426.344238:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f876580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:55751:x1874670564014336:12345-192.168.203.39@tcp:35:lfs.0 00000004:00080000:2.0:1787826426.344426:0:14257:0:(mdd_object.c:4014:mdd_close()) Object [0x200000405:0x44:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:2.0:1787826426.344534:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83aa3 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x44:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.344550:0:14257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83aa3 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.344561:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83aa3 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.344570:0:14257:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83aa3 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.344576:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83aa3 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.344582:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83aa3 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.344605:0:14257:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787826426.344689:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f876580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+39:55751:x1874670564014336:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 451us (621us total) trans 8589935283 rc 0/0 00000100:00100000:2.0:1787826426.344697:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1275 00010000:00010000:3.0:1787826426.345173:0:7460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826426.345181:0:7460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83aa3 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826426.345190:0:7460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835c00 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826426.345194:0:7460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83aa3 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826426.345203:0:7460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83aa3 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826426.345217:0:7460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x44:0x0].0x0 (ffff90cf39e67b00) 00010000:00010000:3.0:1787826426.345221:0:7460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787826426.345226:0:7460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83aa3 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826426.345233:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83aa3 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826426.345247:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826426.345249:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826426.345251:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826426.368378:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826426.368590:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564014464 00000100:00100000:2.0:1787826426.368599:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564014464 00000100:00100000:2.0:1787826426.368660:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4070 00000100:00100000:2.0:1787826426.368670:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1366b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+39:55753:x1874670564014464:12345-192.168.203.39@tcp:101:getfattr.0 00010000:00010000:2.0:1787826426.368695:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826426.368721:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b83aaa lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab18a9 expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.368788:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83ab1 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.368801:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83ab1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.368812:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83ab1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.368825:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83ab8 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.368833:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83ab8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.368839:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83ab8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.368908:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b83abf lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.368916:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b83abf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.368922:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b83abf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826426.368962:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:2.0:1787826426.368966:0:32404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826426.368984:0:32404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b83abf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.368995:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b83abf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.369004:0:32404:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83ab1 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.369012:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83ab1 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.369019:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83ab1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.369027:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83ab1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.369033:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826426.369037:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83ab1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.369044:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83ab1 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.369055:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf39e67100) 00010000:00010000:2.0:1787826426.369058:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826426.369062:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83ab1 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.369068:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83ab1 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.369081:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83ab8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.369088:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83ab8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.369094:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83ab8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.369098:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826426.369101:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83ab8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.369118:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83ab8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.369125:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf39e67a00) 00010000:00010000:2.0:1787826426.369128:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826426.369130:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83ab8 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.369136:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83ab8 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.369166:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b83aaa lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18a9 expref: 41 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.369181:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b83abf lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18a9 expref: 40 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.369188:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826426.369190:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826426.369193:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834a00, rc 0) 00000100:00100000:2.0:1787826426.369242:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1366b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55753:x1874670564014464:12345-192.168.203.39@tcp:101:getfattr.0 Request processed in 572us (873us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826426.369248:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4070 00000100:00100000:0.0:1787826426.425354:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826426.425468:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564014592 00000100:00100000:2.0:1787826426.425509:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564014592 00000100:00100000:2.0:1787826426.425559:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4071 00000100:00100000:2.0:1787826426.425568:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55757:x1874670564014592:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:2.0:1787826426.425653:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b83ac6 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.425671:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b83ac6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.425681:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b83ac6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.425693:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83acd lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.425699:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83acd lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.425705:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83acd lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.425773:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83ad4 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.425782:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83ad4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.425794:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83ad4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826426.425831:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:2.0:1787826426.425836:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826426.425849:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83ad4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.425863:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b83ac6 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.425869:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b83ac6 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.425876:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b83ac6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.425887:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b83ac6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.425894:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826426.425898:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b83ac6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.425905:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b83ac6 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.425917:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf39e67100) 00010000:00010000:2.0:1787826426.425920:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826426.425925:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b83ac6 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.425936:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b83ac6 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.425956:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83acd lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.425962:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83acd lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.425968:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83acd lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.425972:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826426.425975:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83acd lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.425981:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83acd lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.425989:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf39e67a00) 00010000:00010000:2.0:1787826426.425992:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826426.425994:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83acd lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.426000:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83acd lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.426012:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83ad4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.426018:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83ad4 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.426024:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83ad4 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.426029:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826426.426031:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83ad4 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.426037:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83ad4 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.426044:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826426.426047:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826426.426050:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83ad4 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.426055:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83ad4 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826426.426143:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55757:x1874670564014592:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 576us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826426.426151:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4071 00000100:00100000:0.0:1787826426.456256:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826426.456921:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564014848 00000100:00100000:2.0:1787826426.456932:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564014848 00000100:00100000:2.0:1787826426.456999:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4072 00000100:00100000:2.0:1787826426.457009:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f874780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:55759:x1874670564014848:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826426.457037:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826426.457060:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83adb lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab18b0 expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.457180:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83ae2 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.457196:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83ae2 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.457210:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83ae2 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826426.457221:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:2.0:1787826426.457335:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83adb lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18b0 expref: 43 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.457357:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83ae2 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18b0 expref: 42 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.457366:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826426.457369:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787826426.457372:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835c00, rc 0) 00000100:00100000:2.0:1787826426.457440:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f874780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+42:55759:x1874670564014848:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 432us (1195us total) trans 8589935284 rc 0/0 00000100:00100000:2.0:1787826426.457448:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4072 00000100:00100000:3.0:1787826426.471776:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826426.471994:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564015104 00000100:00100000:1.0:1787826426.472004:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564015104 00000100:00100000:1.0:1787826426.472070:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4073 00000100:00100000:1.0:1787826426.472080:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+42:55759:x1874670564015104:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826426.472122:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826426.472143:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b83af0 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab18b7 expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.472255:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b83af7 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.472269:0:8247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b83abf lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18a9 expref: 43 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.472278:0:8247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b83af7 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.472317:0:8247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b83abf lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18a9 expref: 43 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.472331:0:8247:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b83abf lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18a9 expref: 43 pid: 32404 timeout: 1472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826426.472345:0:8247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f808f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8247:1874670585296000:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826426.472429:0:8247:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf1e87f900 going to sleep for 11 seconds 00000100:00100000:3.0:1787826426.475801:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826426.476336:0:8247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f808f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8247:1874670585296000:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826426.476365:0:8247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b83af7 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826426.476428:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564015232 00000100:00100000:0.0:1787826426.476434:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564015232 00010000:00010000:0.0:1787826426.476468:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b83abf lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18a9 expref: 44 pid: 32404 timeout: 1472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826426.476534:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1331 00000100:00100000:0.0:1787826426.476543:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab152c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:2404:x1874670564015232:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826426.476559:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826426.476566:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b83abf lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18a9 expref: 44 pid: 32404 timeout: 1472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.476576:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b83abf lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18a9 expref: 44 pid: 32404 timeout: 1472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.476597:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b83abf lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18a9 expref: 44 pid: 32404 timeout: 1472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.476611:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826426.476616:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b83af7 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.476624:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b83af7 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.476631:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b83af7 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.476789:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826426.476851:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab152c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:2404:x1874670564015232:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 309us (1058us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826426.476858:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1331 00010000:00010000:2.0:1787826426.478765:0:8247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b83af7 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.478780:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b83af7 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826426.478805:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:2.0:1787826426.479125:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b83af0 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18b7 expref: 44 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.479147:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b83af7 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18b7 expref: 43 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.479155:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826426.479158:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787826426.479162:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46a800, rc 0) 00000100:00100000:2.0:1787826426.479267:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55759:x1874670564015104:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 7188us (7509us total) trans 8589935285 rc 0/0 00000100:00100000:2.0:1787826426.479276:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4073 00000100:00100000:3.0:1787826426.482724:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826426.482797:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564015360 00000100:00100000:2.0:1787826426.482805:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564015360 00000100:00100000:2.0:1787826426.482857:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1276 00000100:00100000:2.0:1787826426.482874:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab14780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55759:x1874670564015360:12345-192.168.203.39@tcp:33:lfs.0 00000100:00100000:2.0:1787826426.483018:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab14780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55759:x1874670564015360:12345-192.168.203.39@tcp:33:lfs.0 Request processed in 152us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826426.483031:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1276 00000100:00100000:0.0:1787826426.489204:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826426.489526:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564015616 00000100:00100000:1.0:1787826426.489536:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564015616 00000100:00100000:1.0:1787826426.489595:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1277 00000100:00100000:1.0:1787826426.489606:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0557b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55759:x1874670564015616:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:1.0:1787826426.489832:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0557b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55759:x1874670564015616:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 227us (636us total) trans 8589935286 rc 0/0 00000100:00100000:1.0:1787826426.489840:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1277 00000100:00100000:3.0:1787826426.493432:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826426.493797:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564015872 00000100:00100000:1.0:1787826426.493807:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564015872 00000100:00100000:1.0:1787826426.493867:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4074 00000100:00100000:1.0:1787826426.493876:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab15e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55759:x1874670564015872:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826426.493898:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826426.493901:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:1.0:1787826426.493928:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b83af7 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18b7 expref: 44 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.493949:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83ae2 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18b0 expref: 43 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.493958:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826426.493963:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787826426.493975:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b83b05 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab18be expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.494234:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b83b0c lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.494247:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b83b0c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.494257:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b83b0c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826426.494269:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:1.0:1787826426.494531:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b83b05 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18be expref: 45 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.494546:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b83b0c lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18be expref: 44 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.494553:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826426.494556:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787826426.494559:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46ae00, rc 0) 00000100:00100000:1.0:1787826426.494617:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab15e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55759:x1874670564015872:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 741us (1194us total) trans 8589935287 rc 0/0 00000100:00100000:1.0:1787826426.494625:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4074 00000100:00100000:3.0:1787826426.500941:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826426.501036:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564016128 00000100:00100000:1.0:1787826426.501046:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564016128 00000100:00100000:1.0:1787826426.501113:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1278 00000100:00100000:1.0:1787826426.501124:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eea0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55759:x1874670564016128:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:1.0:1787826426.501195:0:14257:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000405:0x1d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b83b0c lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18be expref: 44 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.501235:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b83b1a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.501248:0:14257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b83a9c lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18a2 expref: 44 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.501256:0:14257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b83b1a lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.501303:0:14257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b83a9c lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18a2 expref: 44 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.501316:0:14257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b83a9c lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18a2 expref: 44 pid: 8247 timeout: 1472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826426.501329:0:14257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f808f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585296128:192.168.203.39@tcp:104: 00000100:00100000:1.0:1787826426.501414:0:14257:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf1e87f900 going to sleep for 11 seconds 00000100:00100000:3.0:1787826426.505536:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826426.505651:0:14257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f808f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14257:1874670585296128:192.168.203.39@tcp:104: 00010000:00010000:1.0:1787826426.505678:0:14257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b83b1a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826426.505875:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564016256 00000100:00100000:2.0:1787826426.505887:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564016256 00010000:00010000:2.0:1787826426.505920:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b83a9c lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18a2 expref: 45 pid: 8247 timeout: 1472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826426.505956:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1332 00000100:00100000:2.0:1787826426.505964:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab161c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+45:2404:x1874670564016256:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826426.505978:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826426.505985:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b83a9c lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18a2 expref: 45 pid: 8247 timeout: 1472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.505997:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b83a9c lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18a2 expref: 45 pid: 8247 timeout: 1472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.506019:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b83a9c lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18a2 expref: 45 pid: 8247 timeout: 1472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.506034:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826426.506038:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b83b1a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.506048:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b83b1a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.506056:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b83b1a lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.506080:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826426.506140:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab161c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:2404:x1874670564016256:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 175us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826426.506148:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1332 00010000:00010000:1.0:1787826426.506200:0:14257:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b83b1a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.506208:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b83b1a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.506359:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b83b1a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.506367:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b83b1a lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.506374:0:14257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b83b1a lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.506380:0:14257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46a800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826426.506384:0:14257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b83b1a lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.506392:0:14257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b83b1a lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.506401:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826426.506404:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787826426.506407:0:14257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b83b1a lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.506414:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a800/0x22153cd396b83b1a lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.506423:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826426.506426:0:14257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787826426.506431:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b83b0c lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18be expref: 43 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826426.506564:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eea0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55759:x1874670564016128:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 5442us (5633us total) trans 8589935288 rc -22/-22 00000100:00100000:1.0:1787826426.506573:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1278 00000100:00100000:2.0:1787826426.511190:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826426.511320:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564016384 00000100:00100000:0.0:1787826426.511329:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564016384 00000100:00100000:0.0:1787826426.511381:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4075 00000100:00100000:0.0:1787826426.511390:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:55759:x1874670564016384:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826426.511410:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826426.511429:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b83b21 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab18c5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.511516:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b83b21 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18c5 expref: 44 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.511530:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b83b21 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18c5 expref: 44 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.511548:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:0.0:1787826426.511551:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826426.511555:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165e400, rc 0) 00000100:00100000:0.0:1787826426.511597:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55759:x1874670564016384:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 208us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826426.511604:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4075 00000100:00100000:3.0:1787826426.516389:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826426.516661:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564016640 00000100:00100000:0.0:1787826426.516670:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564016640 00000100:00100000:0.0:1787826426.516733:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4076 00000100:00100000:0.0:1787826426.516743:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab15680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+44:55759:x1874670564016640:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826426.516769:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826426.516790:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b83b28 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab18cc expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.517194:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b83b2f lrc: 3/1,0 mode: --/PR res: [0x200000405:0x45:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.517212:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b83b2f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.517223:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b83b2f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826426.517234:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x45:0x0]: returning size 0 00010000:00010000:0.0:1787826426.517273:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165ee00/0x22153cd396b83b28 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18cc expref: 47 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.517305:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b83b2f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18cc expref: 46 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826426.517313:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x45:0x0].0x0 (ffff90ce036cae00) 00010000:00010000:0.0:1787826426.517316:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787826426.517319:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165fa00, rc 0) 00000100:00100000:0.0:1787826426.517369:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab15680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+46:55759:x1874670564016640:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 628us (990us total) trans 8589935289 rc 0/0 00000100:00100000:0.0:1787826426.517377:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4076 00000100:00100000:3.0:1787826426.521584:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826426.521751:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564016896 00000100:00100000:2.0:1787826426.521761:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564016896 00000100:00100000:2.0:1787826426.521823:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4077 00000100:00100000:2.0:1787826426.521833:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab15a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+46:55759:x1874670564016896:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826426.521856:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826426.521874:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b83b3d lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab18d3 expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.521960:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83b44 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.521973:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83b44 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.521984:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83b44 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826426.522000:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00010000:00010000:2.0:1787826426.522211:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b83b3d lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18d3 expref: 49 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.522230:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83b44 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18d3 expref: 48 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.522238:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826426.522241:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787826426.522244:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835800, rc 0) 00000100:00100000:2.0:1787826426.522568:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab15a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55759:x1874670564016896:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 735us (992us total) trans 8589935290 rc 0/0 00000100:00100000:2.0:1787826426.522576:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4077 00000100:00100000:3.0:1787826426.525740:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826426.525902:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564017152 00000100:00100000:2.0:1787826426.525911:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564017152 00000100:00100000:2.0:1787826426.526000:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1279 00000100:00100000:2.0:1787826426.526012:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55759:x1874670564017152:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:2.0:1787826426.526087:0:6522:0:(mdt_open.c:2315:mdt_close_handle_layouts()) ### [0x200000405:0x1d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83b44 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18d3 expref: 48 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.526138:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83b52 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.526151:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b83b21 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18c5 expref: 48 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.526160:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83b52 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.526189:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b83b21 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18c5 expref: 48 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.526202:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b83b21 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18c5 expref: 48 pid: 6519 timeout: 1472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826426.526216:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fdcb40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585296256:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826426.526304:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2069f480 going to sleep for 11 seconds 00000100:00100000:2.0:1787826426.533998:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fdcb40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585296256:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826426.534028:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83b52 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826426.535902:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826426.536100:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564017280 00000100:00100000:2.0:1787826426.536119:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564017280 00010000:00010000:2.0:1787826426.536160:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b83b21 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18c5 expref: 49 pid: 6519 timeout: 1472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826426.536212:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1333 00000100:00100000:2.0:1787826426.536222:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf181ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:2404:x1874670564017280:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826426.536237:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826426.536245:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b83b21 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18c5 expref: 49 pid: 6519 timeout: 1472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.536258:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b83b21 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18c5 expref: 49 pid: 6519 timeout: 1472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.536280:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e400/0x22153cd396b83b21 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18c5 expref: 49 pid: 6519 timeout: 1472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.536297:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826426.536302:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83b52 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.536322:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83b52 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.536330:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83b52 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.536361:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826426.536420:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf181ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:2404:x1874670564017280:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 200us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826426.536428:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1333 00010000:00010000:3.0:1787826426.536463:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83b52 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826426.536495:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83b52 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826426.536516:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b83b59 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x45:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826426.536528:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b83b2f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18cc expref: 47 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826426.536535:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b83b59 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x45:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826426.536564:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b83b2f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18cc expref: 47 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826426.536576:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b83b2f lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18cc expref: 47 pid: 16564 timeout: 1472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826426.536595:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab17c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585296384:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826426.536644:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3780 going to sleep for 11 seconds 00000100:00100000:3.0:1787826426.543728:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826426.543799:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564017408 00000100:00100000:1.0:1787826426.543807:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564017408 00000100:00100000:2.0:1787826426.543951:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab17c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1874670585296384:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826426.543977:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b83b59 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x45:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.544041:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b83b2f lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18cc expref: 48 pid: 16564 timeout: 1472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826426.544079:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1334 00000100:00100000:1.0:1787826426.544088:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:2403:x1874670564017408:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826426.544194:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826426.544202:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b83b2f lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18cc expref: 48 pid: 16564 timeout: 1472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.544214:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b83b2f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18cc expref: 48 pid: 16564 timeout: 1472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.544235:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b83b2f lrc: 0/0,0 mode: --/PR res: [0x200000405:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18cc expref: 48 pid: 16564 timeout: 1472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.544250:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x45:0x0].0x0 (ffff90ce036cae00) 00010000:00010000:1.0:1787826426.544255:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b83b59 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x45:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.544263:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b83b59 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x45:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.544271:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b83b59 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x45:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.544295:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826426.544356:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b83b59 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x45:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.544364:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b83b59 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x45:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826426.544677:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fdcb40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1874670585296512:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787826426.544715:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:2403:x1874670564017408:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 627us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826426.544722:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826426.544723:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1334 00000100:00100000:2.0:1787826426.544754:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf09f7d480 going to sleep for 11 seconds 00000100:00100000:0.0:1787826426.544938:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585296512 00000100:00100000:0.0:1787826426.544944:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585296512 00000100:00100000:0.0:1787826426.544984:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1507 00000100:00100000:0.0:1787826426.544992:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06306580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+11:6522:x1874670585296512:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787826426.545125:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06306580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+11:6522:x1874670585296512:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 134us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826426.545132:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1507 00000100:00100000:2.0:1787826426.546666:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fdcb40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1874670585296512:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787826426.546739:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589935291 00000001:00080000:2.0:1787826426.547040:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589935292 00010000:00010000:2.0:1787826426.547062:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b83b59 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x45:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.547071:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b83b59 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x45:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.547077:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b83b59 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x45:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.547083:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826426.547086:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b83b59 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x45:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.547093:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b83b59 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x45:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.547127:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x45:0x0].0x0 (ffff90ce036cae00) 00010000:00010000:2.0:1787826426.547130:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787826426.547135:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b83b59 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x45:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.547141:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400800/0x22153cd396b83b59 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x45:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.547163:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83b52 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.547169:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83b52 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.547175:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83b52 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.547179:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826426.547182:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83b52 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.547187:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83b52 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.547194:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826426.547196:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787826426.547199:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83b52 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.547203:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83b52 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.547219:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826426.547221:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787826426.547227:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83b44 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18d3 expref: 49 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826426.547465:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55759:x1874670564017152:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 21454us (21731us total) trans 8589935293 rc 0/0 00000100:00100000:2.0:1787826426.547500:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1279 00000020:00080000:2.0:1787826426.547506:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1787826426.550795:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826426.550891:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564017536 00000100:00100000:1.0:1787826426.550901:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564017536 00000100:00100000:1.0:1787826426.551011:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4078 00000100:00100000:1.0:1787826426.551025:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab17840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:55759:x1874670564017536:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826426.551048:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826426.551068:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b83b60 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab18da expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.551133:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b83b60 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18da expref: 49 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.551150:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b400/0x22153cd396b83b60 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18da expref: 49 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.551169:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826426.551172:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787826426.551177:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46b400, rc 0) 00000100:00100000:1.0:1787826426.551266:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab17840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:55759:x1874670564017536:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 244us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826426.551273:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4078 00000100:00100000:1.0:1787826426.554245:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826426.554685:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564017792 00000100:00100000:2.0:1787826426.554694:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564017792 00000100:00100000:2.0:1787826426.554783:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1280 00000100:00100000:2.0:1787826426.554794:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f80a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+49:55759:x1874670564017792:12345-192.168.203.39@tcp:35:lfs.0 00000004:00080000:2.0:1787826426.555144:0:14257:0:(mdd_object.c:4014:mdd_close()) Object [0x200000405:0x45:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787826426.555203:0:14257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].33, 64 off10760 00000004:00080000:2.0:1787826426.555214:0:14257:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1372566741903ns, next at 1373566739081ns, rc = 0 00000001:00080000:2.0:1787826426.555220:0:14257:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589935294 00010000:00010000:2.0:1787826426.555256:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83b67 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x45:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.555271:0:14257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83b67 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.555529:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83b67 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.555541:0:14257:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83b67 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.555552:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83b67 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.555559:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83b67 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.555613:0:14257:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787826426.555851:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f80a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+51:55759:x1874670564017792:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 1057us (1614us total) trans 8589935295 rc 0/0 00000100:00100000:2.0:1787826426.555860:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1280 00000020:00080000:2.0:1787826426.555865:0:14257:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787826426.555912:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787826426.555919:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83b67 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826426.555931:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835800 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:3.0:1787826426.555935:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83b67 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826426.555953:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83b67 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826426.556037:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x45:0x0].0x0 (ffff90cf39e67a00) 00010000:00010000:3.0:1787826426.556041:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787826426.556045:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83b67 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826426.556050:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835800/0x22153cd396b83b67 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826426.556067:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826426.556069:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787826426.556070:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826426.558662:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826426.559079:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564018048 00000100:00100000:2.0:1787826426.559090:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564018048 00000100:00100000:2.0:1787826426.559155:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1281 00000100:00100000:2.0:1787826426.559165:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+51:55759:x1874670564018048:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:2.0:1787826426.560169:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+52:55759:x1874670564018048:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 1001us (1510us total) trans 8589935296 rc 0/0 00000100:00100000:2.0:1787826426.560180:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1281 00000100:00100000:0.0:1787826426.593676:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826426.593800:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564018176 00000100:00100000:2.0:1787826426.593811:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564018176 00000100:00100000:2.0:1787826426.593877:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4079 00000100:00100000:2.0:1787826426.593888:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0557b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+52:55761:x1874670564018176:12345-192.168.203.39@tcp:101:getfattr.0 00010000:00010000:2.0:1787826426.593914:0:9966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826426.593937:0:9966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83b6e lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab18e1 expref: -99 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.594004:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b83b75 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.594019:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b83b75 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.594029:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b83b75 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.594042:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83b7c lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.594049:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83b7c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.594056:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83b7c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.594140:0:9966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b83b83 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.594149:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b83b83 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.594156:0:9966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b83b83 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826426.594195:0:9966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:2.0:1787826426.594200:0:9966:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787826426.594219:0:9966:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b83b83 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.594231:0:9966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b83b83 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.594245:0:9966:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b83b75 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.594250:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b83b75 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.594256:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b83b75 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.594263:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b83b75 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.594269:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835a00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826426.594273:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b83b75 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.595503:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b83b75 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.595527:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf39e67100) 00010000:00010000:2.0:1787826426.595531:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826426.595536:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b83b75 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.595543:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835a00/0x22153cd396b83b75 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.595561:0:9966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83b7c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.595568:0:9966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83b7c lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.595576:0:9966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83b7c lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.595581:0:9966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a835c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826426.595585:0:9966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83b7c lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.595591:0:9966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83b7c lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.595598:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf39e67e00) 00010000:00010000:2.0:1787826426.595601:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826426.595603:0:9966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83b7c lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.595609:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835c00/0x22153cd396b83b7c lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.595650:0:9966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a835000/0x22153cd396b83b6e lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18e1 expref: 54 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.595668:0:9966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834a00/0x22153cd396b83b83 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18e1 expref: 53 pid: 9966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826426.595676:0:9966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:2.0:1787826426.595678:0:9966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826426.595680:0:9966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834a00, rc 0) 00000100:00100000:2.0:1787826426.595762:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0557b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55761:x1874670564018176:12345-192.168.203.39@tcp:101:getfattr.0 Request processed in 1875us (2095us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826426.595774:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4079 00000100:00100000:1.0:1787826426.608114:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826426.608268:0:8545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564018304 00000100:00100000:3.0:1787826426.608286:0:8545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564018304 00000100:00100000:3.0:1787826426.608350:0:8545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2289 00000100:00100000:3.0:1787826426.608360:0:8545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f808f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2402:x1874670564018304:12345-192.168.203.39@tcp:101:getfattr.0 00010000:00010000:3.0:1787826426.608379:0:8545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826426.608397:0:8545:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d747c98/0x22153cd396b83b8a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x10f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab18e8 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826426.608454:0:8545:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab16580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8545:1874670585296640:192.168.203.39@tcp:106: 00000100:00100000:3.0:1787826426.608578:0:8545:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf068e3180 going to sleep for 11 seconds 00000100:00100000:1.0:1787826426.616138:0:8545:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab16580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8545:1874670585296640:192.168.203.39@tcp:106: 00010000:00010000:1.0:1787826426.616179:0:8545:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004d747c98/0x22153cd396b83b8a lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x10f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18e8 expref: 15 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.616204:0:8545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d747c98/0x22153cd396b83b8a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x10f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18e8 expref: 15 pid: 8545 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.616216:0:8545:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401200, rc 0) 00000100:00100000:1.0:1787826426.616293:0:8545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f808f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2402:x1874670564018304:12345-192.168.203.39@tcp:101:getfattr.0 Request processed in 7934us (8198us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826426.616301:0:8545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2289 00000100:00100000:0.0:1787826426.652305:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826426.652412:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564018432 00000100:00100000:1.0:1787826426.652423:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564018432 00000100:00100000:1.0:1787826426.652532:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4080 00000100:00100000:1.0:1787826426.652543:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05579a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55765:x1874670564018432:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:1.0:1787826426.652619:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b83b91 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.652636:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b83b91 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.652653:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b83b91 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.652666:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b83b98 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.652673:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b83b98 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.652680:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b83b98 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.652766:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b83b9f lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.652775:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b83b9f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.652782:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b83b9f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826426.652817:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000405:0x1d:0x0]: returning size 0 00000004:00200000:1.0:1787826426.652822:0:32404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787826426.652834:0:32404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b83b9f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.652847:0:32404:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b83b91 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.652855:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b83b91 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.652865:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b83b91 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.652871:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b83b91 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.652876:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46ae00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826426.652880:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b83b91 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.652887:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b83b91 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.652898:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff90cf04f8b300) 00010000:00010000:1.0:1787826426.652901:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826426.652905:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b83b91 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.652911:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46ae00/0x22153cd396b83b91 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.652942:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b83b98 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.652949:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b83b98 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.652954:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b83b98 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.652958:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46a600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826426.652961:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b83b98 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.652966:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b83b98 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.652972:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff90cf04f8b200) 00010000:00010000:1.0:1787826426.652974:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826426.652977:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b83b98 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.652982:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46a600/0x22153cd396b83b98 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.652992:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b83b9f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.652998:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b83b9f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.653004:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b83b9f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.653008:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46b000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826426.653011:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b83b9f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.653016:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b83b9f lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.653023:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:1.0:1787826426.653026:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826426.653029:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b83b9f lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826426.653034:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f46b000/0x22153cd396b83b9f lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826426.653119:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05579a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:55765:x1874670564018432:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 577us (822us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826426.653127:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4080 00010000:00010000:2.0:1787826427.203859:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787826428.165142:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab16580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585296896:0@lo:400:kworker.0 00000100:00100000:3.0:1787826428.165203:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826428.165240:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab14780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874670585297408:0@lo:400:kworker.0 00000100:00100000:3.0:1787826428.165261:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826428.165280:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf361e6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585297920:0@lo:400:kworker.0 00000100:00100000:3.0:1787826428.165296:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826428.165315:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1787826428.165320:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab14f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e3c550b8-2c3c-46c3-ad36-671c284167ea:3647:1874670585296768:0@lo:400:kworker.0 00000100:00100000:3.0:1787826428.165344:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826428.165362:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585297280:0@lo:400:kworker.0 00000100:00100000:3.0:1787826428.165382:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826428.165413:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf361e5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1874670585297792:0@lo:400:kworker.0 00000100:00100000:3.0:1787826428.165446:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826428.165463:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf361e61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874670585298304:0@lo:400:kworker.0 00000100:00100000:3.0:1787826428.167894:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826428.167979:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab17c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874670585297024:0@lo:400:kworker.0 00000100:00100000:3.0:1787826428.168017:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826428.168041:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf361e6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874670585297536:0@lo:400:kworker.0 00000100:00100000:3.0:1787826428.168061:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826428.168079:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf361e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585298048:0@lo:400:kworker.0 00000100:00100000:3.0:1787826428.168113:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826428.168140:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787826428.168146:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585297152:0@lo:400:kworker.0 00000100:00100000:3.0:1787826428.168173:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826428.168192:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf361e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1874670585297664:0@lo:400:kworker.0 00000100:00100000:3.0:1787826428.168212:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826428.168229:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf361e43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585298176:0@lo:400:kworker.0 00000100:00100000:3.0:1787826428.168248:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826428.168285:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585296896 00000100:00100000:3.0:1787826428.168293:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585296896 00000100:00100000:3.0:1787826428.168337:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585297920 00000100:00100000:3.0:1787826428.168341:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585297920 00000100:00100000:3.0:1787826428.168356:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1508 00000100:00100000:3.0:1787826428.168363:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3647:x1874670585296896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826428.169690:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3647:x1874670585296896:12345-0@lo:400:kworker.0 Request processed in 1323us (4482us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826428.169701:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1508 00000100:00100000:3.0:1787826428.169732:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1509 00000100:00100000:3.0:1787826428.169742:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874670585297920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826428.169779:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874670585297920:12345-0@lo:400:kworker.0 Request processed in 41us (4481us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826428.169788:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1509 00000100:00100000:3.0:1787826428.169816:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585297408 00000100:00100000:3.0:1787826428.169822:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585297408 00000100:00100000:3.0:1787826428.169863:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585297792 00000100:00100000:3.0:1787826428.169867:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585297792 00000100:00100000:3.0:1787826428.169880:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585298304 00000100:00100000:3.0:1787826428.169883:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585298304 00000100:00100000:3.0:1787826428.169893:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585297024 00000100:00100000:3.0:1787826428.169896:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585297024 00000100:00100000:3.0:1787826428.169905:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585297536 00000100:00100000:3.0:1787826428.169907:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585297536 00000100:00100000:3.0:1787826428.169918:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585297664 00000100:00100000:3.0:1787826428.169920:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585297664 00000100:00100000:3.0:1787826428.169935:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1597 00000100:00100000:3.0:1787826428.169941:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874670585297408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826428.169972:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874670585297408:12345-0@lo:400:kworker.0 Request processed in 32us (4710us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826428.169978:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1597 00000100:00100000:3.0:1787826428.169989:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1598 00000100:00100000:3.0:1787826428.169995:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874670585297792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826428.170021:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874670585297792:12345-0@lo:400:kworker.0 Request processed in 26us (4575us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826428.170027:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1598 00000100:00100000:3.0:1787826428.170037:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1599 00000100:00100000:3.0:1787826428.170043:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874670585298304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826428.170069:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874670585298304:12345-0@lo:400:kworker.0 Request processed in 27us (2182us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826428.170075:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1599 00000100:00100000:3.0:1787826428.170087:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1600 00000100:00100000:3.0:1787826428.170105:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874670585297024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826428.170138:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874670585297024:12345-0@lo:400:kworker.0 Request processed in 46us (2120us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826428.170144:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1600 00000100:00100000:3.0:1787826428.170155:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1601 00000100:00100000:3.0:1787826428.170161:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874670585297536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826428.170188:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874670585297536:12345-0@lo:400:kworker.0 Request processed in 28us (2126us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826428.170194:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1601 00000100:00100000:3.0:1787826428.170206:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1602 00000100:00100000:3.0:1787826428.170212:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874670585297664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826428.170238:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874670585297664:12345-0@lo:400:kworker.0 Request processed in 27us (2024us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826428.170244:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1602 00000100:00100000:3.0:1787826428.170269:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585297280 00000100:00100000:3.0:1787826428.170273:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585297280 00000100:00100000:3.0:1787826428.171142:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585298048 00000100:00100000:3.0:1787826428.171148:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585298048 00000100:00100000:3.0:1787826428.171179:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585297152 00000100:00100000:3.0:1787826428.171181:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585297152 00000100:00100000:3.0:1787826428.171198:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585298176 00000100:00100000:3.0:1787826428.171201:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585298176 00000100:00100000:3.0:1787826428.171223:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 942 00000100:00100000:3.0:1787826428.171231:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf361e4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3647:x1874670585297280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826428.171275:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf361e4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3647:x1874670585297280:12345-0@lo:400:kworker.0 Request processed in 46us (5892us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826428.171285:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 942 00000100:00100000:3.0:1787826428.171300:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 943 00000100:00100000:3.0:1787826428.171307:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa86d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3644:x1874670585298048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826428.171343:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa86d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3644:x1874670585298048:12345-0@lo:400:kworker.0 Request processed in 38us (3229us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826428.171349:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 943 00000100:00100000:3.0:1787826428.171365:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 944 00000100:00100000:3.0:1787826428.171374:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa84780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3644:x1874670585297152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826428.171428:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa84780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3644:x1874670585297152:12345-0@lo:400:kworker.0 Request processed in 56us (3252us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826428.171434:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 944 00000100:00100000:3.0:1787826428.171447:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 945 00000100:00100000:3.0:1787826428.171453:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa87840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+11:3644:x1874670585298176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787826428.171574:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa87840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+11:3644:x1874670585298176:12345-0@lo:400:kworker.0 Request processed in 121us (3323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826428.171580:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 945 00000100:00080000:3.0:1787826428.171612:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787826428.171617:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787826428.171619:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787826428.171622:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787826428.171687:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585297152:0@lo:400:kworker.0 00000100:00100000:3.0:1787826428.171700:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf361e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1874670585297664:0@lo:400:kworker.0 00000100:00100000:3.0:1787826428.171711:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf361e43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585298176:0@lo:400:kworker.0 00000100:00100000:3.0:1787826428.171722:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab17c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874670585297024:0@lo:400:kworker.0 00000100:00100000:3.0:1787826428.171734:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf361e6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874670585297536:0@lo:400:kworker.0 00000100:00100000:3.0:1787826428.171744:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf361e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585298048:0@lo:400:kworker.0 00000100:00100000:3.0:1787826428.171799:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585297280:0@lo:400:kworker.0 00000100:00100000:3.0:1787826428.171811:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf361e5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1874670585297792:0@lo:400:kworker.0 00000100:00100000:3.0:1787826428.171823:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf361e61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874670585298304:0@lo:400:kworker.0 00000100:00100000:3.0:1787826428.171835:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab16580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585296896:0@lo:400:kworker.0 00000100:00100000:3.0:1787826428.171846:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab14780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874670585297408:0@lo:400:kworker.0 00000100:00100000:3.0:1787826428.171858:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf361e6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585297920:0@lo:400:kworker.0 00000100:00100000:1.0:1787826428.177197:0:34488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585296768 00000100:00100000:1.0:1787826428.177212:0:34488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585296768 00000100:00100000:1.0:1787826428.177268:0:34488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787826428.177278:0:34488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf2f426050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3c550b8-2c3c-46c3-ad36-671c284167ea+24:3647:x1874670585296768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826428.177370:0:34488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf2f426050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3c550b8-2c3c-46c3-ad36-671c284167ea+24:3647:x1874670585296768:12345-0@lo:400:kworker.0 Request processed in 93us (12023us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826428.177377:0:34488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787826428.177484:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787826428.177636:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f808b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585298432:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787826428.177682:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826428.177724:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585298432 00000100:00100000:1.0:1787826428.177729:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585298432 00000100:00100000:1.0:1787826428.177760:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1510 00000100:00100000:1.0:1787826428.177768:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f80b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874670585298432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787826428.177795:0:7796:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446182912 avail 1299943424 00000100:00100000:1.0:1787826428.177832:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f80b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874670585298432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 65us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826428.177839:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1510 00000100:00100000:1.0:1787826428.177875:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f808b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585298432:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787826428.177908:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab14f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e3c550b8-2c3c-46c3-ad36-671c284167ea:3647:1874670585296768:0@lo:400:kworker.0 00000100:00100000:1.0:1787826428.177963:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787826428.177970:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f808b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585298560:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787826428.177993:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826428.178016:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585298560 00000100:00100000:1.0:1787826428.178019:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585298560 00000100:00100000:1.0:1787826428.178041:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1511 00000100:00100000:1.0:1787826428.178046:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f80b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3645:x1874670585298560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787826428.178066:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445871616 avail 1299632128 00000100:00100000:1.0:1787826428.178108:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f80b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3645:x1874670585298560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 62us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826428.178115:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1511 00000100:00100000:1.0:1787826428.178142:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f808b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585298560:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787826428.230140:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787826428.678353:0:34501:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1374689878627ns, next at 1375689876065ns, rc = 0 00000100:00100000:1.0:1787826428.678415:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3f808b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585298688:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826428.678501:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826428.678553:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf1366a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585298816:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826428.678578:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826428.678613:0:25628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585298688 00000100:00100000:1.0:1787826428.678620:0:25628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585298688 00000100:00100000:1.0:1787826428.678661:0:25628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585298816 00000100:00100000:1.0:1787826428.678664:0:25628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585298816 00000100:00100000:1.0:1787826428.678685:0:25628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 790 00000100:00100000:1.0:1787826428.678694:0:25628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f8770c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+11:3645:x1874670585298688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787826428.678724:0:25628:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 160009024 pending 0 free 3920248832 avail 3688726528 00000100:00100000:1.0:1787826428.678782:0:25628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f8770c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+11:3645:x1874670585298688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826428.678790:0:25628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 790 00000100:00100000:1.0:1787826428.678808:0:25628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 791 00000100:00100000:1.0:1787826428.678814:0:25628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f876580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3646:x1874670585298816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787826428.678827:0:25628:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 186235712 pending 0 free 3919187968 avail 3687665664 00000100:00100000:1.0:1787826428.678856:0:25628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f876580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3646:x1874670585298816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826428.678862:0:25628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 791 00000100:00100000:1.0:1787826428.678908:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf1366a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585298816:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826428.678939:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3f808b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585298688:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826428.680989:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aa85e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585298944:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826428.682694:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826428.685266:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787826428.685287:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce06305a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585299072:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787826428.685347:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826428.692295:0:25628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585298944 00000100:00100000:3.0:1787826428.692307:0:25628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585298944 00000100:00100000:3.0:1787826428.692362:0:25628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585299072 00000100:00100000:3.0:1787826428.692365:0:25628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585299072 00000100:00100000:3.0:1787826428.692387:0:25628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 792 00000100:00100000:3.0:1787826428.692396:0:25628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f808b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874670585298944:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787826428.692624:0:25628:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 186235712 pending 0 free 3919187968 avail 3687665664 00000100:00100000:3.0:1787826428.692707:0:25628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f808b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874670585298944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 312us (10017us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826428.692931:0:25628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 792 00000100:00100000:3.0:1787826428.692965:0:25628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 793 00000100:00100000:3.0:1787826428.692973:0:25628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce063052c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874670585299072:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787826428.692991:0:25628:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 160009024 pending 0 free 3920248832 avail 3688726528 00000100:00100000:3.0:1787826428.693050:0:25628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce063052c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874670585299072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (7701us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826428.693059:0:25628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 793 00000100:00100000:3.0:1787826428.693325:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aa85e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585298944:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787826428.693392:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce06305a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585299072:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787826429.081212:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826429.081254:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826429.081349:0:34485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564018560 00000100:00100000:2.0:1787826429.081359:0:34485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564018560 00000100:00100000:0.0:1787826429.081511:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826429.081544:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826429.081591:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564019072 00000100:00100000:1.0:1787826429.081595:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564019072 00000100:00100000:1.0:1787826429.081669:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 946 00000100:00100000:1.0:1787826429.081678:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05578b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670564019072:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1787826429.081754:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05578b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+14:2404:x1874670564019072:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 77us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826429.081762:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 946 00000100:00080000:1.0:1787826429.081917:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787826429.082156:0:34485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 106 00000100:00100000:2.0:1787826429.082165:0:34485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0346ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:307626ff-a376-4faf-93e0-9f55b723d964+10:2404:x1874670564018560:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1787826429.082200:0:34485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0346ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:307626ff-a376-4faf-93e0-9f55b723d964+10:2404:x1874670564018560:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 38us (997us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826429.082207:0:34485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 106 00000100:00100000:0.0:1787826429.085875:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826429.086014:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564018944 00000100:00100000:1.0:1787826429.086024:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564018944 00000100:00100000:1.0:1787826429.086109:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 947 00000100:00100000:1.0:1787826429.086119:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0557bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2404:x1874670564018944:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1787826429.086186:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0557bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+11:2404:x1874670564018944:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 69us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826429.086194:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 947 00000100:00100000:3.0:1787826429.086786:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564018816 00000100:00100000:3.0:1787826429.086793:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564018816 00000100:00080000:0.0:1787826429.086867:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787826429.086871:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787826429.089890:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564018688 00000100:00100000:2.0:1787826429.089903:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564018688 00000100:00100000:2.0:1787826429.090054:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1603 00000100:00100000:2.0:1787826429.090066:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0557a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:2404:x1874670564018816:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1787826429.090158:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0557a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:2404:x1874670564018816:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 95us (8902us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826429.090165:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1603 00000100:00100000:2.0:1787826429.090187:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1604 00000100:00100000:2.0:1787826429.090194:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce055783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:2404:x1874670564018688:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1787826429.090220:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce055783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+53:2404:x1874670564018688:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 27us (8675us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826429.090226:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1604 00000100:00080000:0.0:1787826429.090596:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1787826429.195558:0:27651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179869690 is committed 00000001:00080000:0.0:1787826429.195573:0:27651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179869689 is committed 00010000:00010000:3.0:1787826429.251862:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787826429.702206:0:26205:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474837030 is committed 00000001:00080000:0.0:1787826429.702220:0:26205:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474837029 is committed 00010000:00010000:3.0:1787826430.275797:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826431.299844:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787826431.752850:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 35 committed 00000001:00080000:0.0:1787826431.752889:0:34481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935296 is committed 00000004:00080000:0.0:1787826431.752898:0:34481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 34 committed 00000020:00080000:0.0:1787826431.752927:0:34481:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90cf2f5e7900 refcount 2 committed 0 result 0 batchid 4294969348 00000020:00080000:0.0:1787826431.752933:0:34481:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cf1f111400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90cf013703c0 00000020:00080000:0.0:1787826431.752936:0:34481:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cf1f111200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90ce0372ba00 00000020:00080000:0.0:1787826431.752951:0:34481:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969347 batchid updated 00000020:00080000:0.0:1787826431.752965:0:34512:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969348 committed batchid 4294969347 00000020:00080000:0.0:1787826431.753026:0:34512:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969347 00010000:00010000:3.0:1787826431.753063:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b83a6b lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826431.753084:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b83a6b lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826431.753092:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b83a6b lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826431.753098:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826431.753102:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b83a6b lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826431.753110:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b83a6b lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826431.753129:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x44:0x0].0x0 (ffff90cf39e67b00) 00010000:00010000:3.0:1787826431.753133:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826431.753137:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b83a6b lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826431.753143:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834400/0x22153cd396b83a6b lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826431.753170:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b83a80 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826431.753177:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b83a80 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826431.753179:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1787826431.753182:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b83a80 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826431.753187:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826431.753190:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b83a80 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826431.753195:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b83a80 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826431.753196:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf1366a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585299200:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1787826431.753202:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d:0x0].0x0 (ffff90cf39656c00) 00010000:00010000:3.0:1787826431.753205:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826431.753207:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b83a80 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826431.753212:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf3a834c00/0x22153cd396b83a80 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9966 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826431.753261:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826431.753380:0:30695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585299200 00000100:00100000:3.0:1787826431.753387:0:30695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585299200 00000100:00100000:3.0:1787826431.753448:0:30695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2290 00000100:00100000:3.0:1787826431.753457:0:30695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1ecafc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3644:x1874670585299200:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787826431.753507:0:30695:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:270 count 1 00010000:00010000:3.0:1787826431.753530:0:30695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d612c5b/0x22153cd396b83ba6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826431.753549:0:30695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005c6f0c33/0x22153cd396b83a87 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab189b expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826431.753558:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x10e:0x0].0x0 since=5s v=(0 0) 00010000:00010000:3.0:1787826431.753563:0:30695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826431.753567:0:30695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d612c5b/0x22153cd396b83ba6 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826431.753595:0:30695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005c6f0c33/0x22153cd396b83a87 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab189b expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826431.753609:0:30695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005c6f0c33/0x22153cd396b83a87 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab189b expref: 6 pid: 8436 timeout: 1477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826431.753621:0:30695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aa84b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:30695:1874670585299328:192.168.203.39@tcp:104: 00000100:00100000:3.0:1787826431.753675:0:30695:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2068e6c0 going to sleep for 11 seconds 00000100:00080000:1.0:1787826431.755206:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826431.758145:0:30695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aa84b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:30695:1874670585299328:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826431.758174:0:30695:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006d612c5b/0x22153cd396b83ba6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826431.765401:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826431.769103:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564019200 00000100:00100000:3.0:1787826431.769116:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564019200 00010000:00010000:3.0:1787826431.769178:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005c6f0c33/0x22153cd396b83a87 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab189b expref: 7 pid: 8436 timeout: 1477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826431.769231:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1335 00000100:00100000:3.0:1787826431.769240:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06305a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2403:x1874670564019200:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787826431.769256:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787826431.769262:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005c6f0c33/0x22153cd396b83a87 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x10e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab189b expref: 7 pid: 8436 timeout: 1477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826431.769275:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005c6f0c33/0x22153cd396b83a87 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab189b expref: 7 pid: 8436 timeout: 1477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826431.769297:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c6f0c33/0x22153cd396b83a87 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab189b expref: 7 pid: 8436 timeout: 1477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826431.769313:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826431.769318:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787826431.769323:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006d612c5b/0x22153cd396b83ba6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826431.769334:0:10340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d612c5b/0x22153cd396b83ba6 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x10e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826431.769372:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787826431.769429:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06305a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+6:2403:x1874670564019200:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 189us (4034us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826431.769437:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1335 00010000:00010000:3.0:1787826431.769468:0:30695:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006d612c5b/0x22153cd396b83ba6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826431.769494:0:30695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d612c5b/0x22153cd396b83ba6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826431.769508:0:30695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d612c5b/0x22153cd396b83ba6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826431.769516:0:30695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d612c5b/0x22153cd396b83ba6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826431.772978:0:30695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787826431.773974:0:30695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1ecafc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3644:x1874670585299200:12345-0@lo:6:osp-syn-0-0.0 Request processed in 20513us (20707us total) trans 21474837031 rc 0/0 00000100:00100000:3.0:1787826431.773986:0:30695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2290 00000100:00080000:1.0:1787826431.775498:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787826431.775584:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826431.775594:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d612c5b/0x22153cd396b83ba6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826431.775609:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400000 already unused, calling callback (ffffffffc0cdf420) 00010000:00010000:1.0:1787826431.775614:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d612c5b/0x22153cd396b83ba6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826431.775625:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d612c5b/0x22153cd396b83ba6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826431.775646:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d612c5b/0x22153cd396b83ba6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826431.775653:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d612c5b/0x22153cd396b83ba6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826431.775680:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826431.775682:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826431.775684:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826431.777917:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474837029 gen 2 00000004:00080000:2.0:1787826431.777927:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf3f809a40, transno 21474837023 00000004:00080000:2.0:1787826431.777943:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837025 committed transno 21474837029 00000004:00080000:2.0:1787826431.777961:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf136d43c0, transno 21474837027 00000004:00080000:2.0:1787826431.777966:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474837029 committed transno 21474837029 00000100:00100000:2.0:1787826431.777988:0:3644:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff90cf1366a580 x1874670585299200/t21474837031(21474837031) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787826447 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1787826431.778002:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cf1366a580/2, rc 0, transno 21474837031 00000100:00100000:2.0:1787826431.778007:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf1366a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874670585299200:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1787826432.324212:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787826433.186203:0:36508:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 61a: mirror extend and migrate preserve timestamps ========================================================== 06:27:12 (1787826432) 00000100:00100000:1.0:1787826433.284616:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf1ecad2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585299456:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787826433.284685:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826433.284746:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585299456 00000100:00100000:1.0:1787826433.284752:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585299456 00000100:00100000:1.0:1787826433.284796:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1512 00000100:00100000:1.0:1787826433.284805:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3f809a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874670585299456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787826433.284837:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446182912 avail 1299943424 00000100:00100000:1.0:1787826433.284883:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3f809a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874670585299456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826433.284890:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1512 00000100:00100000:1.0:1787826433.285071:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf136d43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e3c550b8-2c3c-46c3-ad36-671c284167ea:3647:1874670585299584:0@lo:400:kworker.0 00000100:00100000:1.0:1787826433.285105:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826433.285132:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0373d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585300096:0@lo:400:kworker.0 00000100:00100000:1.0:1787826433.285159:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826433.285178:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3fb97840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1874670585300608:0@lo:400:kworker.0 00000100:00100000:1.0:1787826433.285203:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826433.285225:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787826433.285231:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a8af0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585299968:0@lo:400:kworker.0 00000100:00100000:1.0:1787826433.285257:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826433.285275:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf136cfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1874670585300480:0@lo:400:kworker.0 00000100:00100000:1.0:1787826433.285297:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826433.285329:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03a18780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874670585300992:0@lo:400:kworker.0 00000100:00100000:1.0:1787826433.285353:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826433.285381:0:34488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585299584 00000100:00100000:1.0:1787826433.285385:0:34488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585299584 00000100:00100000:1.0:1787826433.285415:0:34488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787826433.285422:0:34488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0346bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3c550b8-2c3c-46c3-ad36-671c284167ea+24:3647:x1874670585299584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826433.285455:0:34488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0346bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3c550b8-2c3c-46c3-ad36-671c284167ea+24:3647:x1874670585299584:12345-0@lo:400:kworker.0 Request processed in 34us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826433.285461:0:34488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787826433.285508:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585300096 00000100:00100000:1.0:1787826433.285512:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585300096 00000100:00100000:1.0:1787826433.285543:0:28853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585299968 00000100:00100000:1.0:1787826433.285546:0:28853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585299968 00000100:00100000:1.0:1787826433.285568:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 948 00000100:00100000:1.0:1787826433.285574:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf2f790c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3647:x1874670585300096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826433.285604:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf2f790c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3647:x1874670585300096:12345-0@lo:400:kworker.0 Request processed in 31us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826433.285610:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 948 00000100:00100000:1.0:1787826433.285736:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 949 00000100:00100000:1.0:1787826433.285743:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a1ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3647:x1874670585299968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826433.285770:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a1ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3647:x1874670585299968:12345-0@lo:400:kworker.0 Request processed in 28us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826433.285775:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 949 00000100:00100000:1.0:1787826433.285793:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585300608 00000100:00100000:1.0:1787826433.285796:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585300608 00000100:00100000:1.0:1787826433.285822:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585300480 00000100:00100000:1.0:1787826433.285824:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585300480 00000100:00100000:1.0:1787826433.285843:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585300992 00000100:00100000:1.0:1787826433.285846:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585300992 00000100:00100000:1.0:1787826433.285864:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1605 00000100:00100000:1.0:1787826433.285870:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a19e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874670585300608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826433.285901:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a19e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874670585300608:12345-0@lo:400:kworker.0 Request processed in 31us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826433.285906:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1605 00000100:00100000:1.0:1787826433.285917:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1606 00000100:00100000:1.0:1787826433.285922:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a1a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874670585300480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826433.285947:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a1a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874670585300480:12345-0@lo:400:kworker.0 Request processed in 26us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826433.285953:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1606 00000100:00100000:1.0:1787826433.285963:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1607 00000100:00100000:1.0:1787826433.285969:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a18f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874670585300992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787826433.285996:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a18f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874670585300992:12345-0@lo:400:kworker.0 Request processed in 27us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826433.286001:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1607 00000100:00080000:1.0:1787826433.286032:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787826433.286036:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787826433.286039:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787826433.286040:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787826433.286101:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf1ecad2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585299456:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787826433.286135:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a8af0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585299968:0@lo:400:kworker.0 00000100:00100000:1.0:1787826433.286145:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf136cfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1874670585300480:0@lo:400:kworker.0 00000100:00100000:1.0:1787826433.286155:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03a18780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874670585300992:0@lo:400:kworker.0 00000100:00100000:1.0:1787826433.286163:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf136d43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e3c550b8-2c3c-46c3-ad36-671c284167ea:3647:1874670585299584:0@lo:400:kworker.0 00000100:00100000:1.0:1787826433.286171:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0373d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874670585300096:0@lo:400:kworker.0 00000100:00100000:1.0:1787826433.286179:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3fb97840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1874670585300608:0@lo:400:kworker.0 00000100:00100000:0.0:1787826433.286452:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a8ac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874670585299840:0@lo:400:kworker.0 00000100:00100000:0.0:1787826433.286502:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826433.286524:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01dfde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1874670585300352:0@lo:400:kworker.0 00000100:00100000:0.0:1787826433.286544:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826433.286559:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3fb96d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585300864:0@lo:400:kworker.0 00000100:00100000:0.0:1787826433.286578:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826433.286597:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787826433.286603:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3a8aed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585299712:0@lo:400:kworker.0 00000100:00100000:0.0:1787826433.286625:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826433.286642:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0373da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874670585300224:0@lo:400:kworker.0 00000100:00100000:0.0:1787826433.286662:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826433.286679:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3fb970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585300736:0@lo:400:kworker.0 00000100:00100000:0.0:1787826433.286699:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826433.286725:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585299840 00000100:00100000:0.0:1787826433.286729:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585299840 00000100:00100000:0.0:1787826433.286753:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585300352 00000100:00100000:0.0:1787826433.286755:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585300352 00000100:00100000:0.0:1787826433.286774:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585300224 00000100:00100000:0.0:1787826433.286776:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585300224 00000100:00100000:0.0:1787826433.286791:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1608 00000100:00100000:0.0:1787826433.286797:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0557ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874670585299840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826433.286828:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0557ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874670585299840:12345-0@lo:400:kworker.0 Request processed in 31us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826433.286834:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1608 00000100:00100000:0.0:1787826433.286846:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1609 00000100:00100000:0.0:1787826433.286851:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0557b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874670585300352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826433.286872:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0557b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874670585300352:12345-0@lo:400:kworker.0 Request processed in 22us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826433.286878:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1609 00000100:00100000:0.0:1787826433.286887:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1610 00000100:00100000:0.0:1787826433.286892:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05578b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874670585300224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826433.286928:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05578b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874670585300224:12345-0@lo:400:kworker.0 Request processed in 35us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826433.286933:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1610 00000100:00100000:0.0:1787826433.286948:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585300864 00000100:00100000:0.0:1787826433.286951:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585300864 00000100:00100000:0.0:1787826433.286970:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585300736 00000100:00100000:0.0:1787826433.286973:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585300736 00000100:00100000:0.0:1787826433.286987:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 950 00000100:00100000:0.0:1787826433.286993:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05578000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874670585300864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826433.287021:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05578000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874670585300864:12345-0@lo:400:kworker.0 Request processed in 28us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826433.287027:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 950 00000100:00100000:0.0:1787826433.287037:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 951 00000100:00100000:0.0:1787826433.287044:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0557bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1874670585300736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826433.287081:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0557bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1874670585300736:12345-0@lo:400:kworker.0 Request processed in 38us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826433.287087:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 951 00000100:00100000:0.0:1787826433.287103:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585299712 00000100:00100000:0.0:1787826433.287106:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585299712 00000100:00100000:0.0:1787826433.287129:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1513 00000100:00100000:0.0:1787826433.287135:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0557a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3645:x1874670585299712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787826433.287166:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0557a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3645:x1874670585299712:12345-0@lo:400:kworker.0 Request processed in 31us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826433.287174:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1513 00000100:00080000:0.0:1787826433.287207:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787826433.287210:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787826433.287213:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787826433.287215:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787826433.287224:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787826433.287232:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce05579e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585301120:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826433.287258:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826433.287284:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585301120 00000100:00100000:0.0:1787826433.287288:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585301120 00000100:00100000:0.0:1787826433.287325:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1514 00000100:00100000:0.0:1787826433.287332:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0557a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3646:x1874670585301120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787826433.287355:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445871616 avail 1299632128 00000100:00100000:0.0:1787826433.287389:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0557a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3646:x1874670585301120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 58us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826433.287395:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1514 00000100:00100000:0.0:1787826433.287432:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce05579e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874670585301120:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787826433.287455:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a8aed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585299712:0@lo:400:kworker.0 00000100:00100000:0.0:1787826433.287465:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0373da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874670585300224:0@lo:400:kworker.0 00000100:00100000:0.0:1787826433.287495:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3fb970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585300736:0@lo:400:kworker.0 00000100:00100000:0.0:1787826433.287505:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3a8ac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874670585299840:0@lo:400:kworker.0 00000100:00100000:0.0:1787826433.287513:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01dfde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1874670585300352:0@lo:400:kworker.0 00000100:00100000:0.0:1787826433.287520:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869690 gen 2 00000004:00080000:0.0:1787826433.287524:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce01fdda40, transno 17179869680 00000004:00080000:0.0:1787826433.287536:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869682 committed transno 17179869690 00000004:00080000:0.0:1787826433.287551:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cf07966940, transno 17179869684 00000004:00080000:0.0:1787826433.287554:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869686 committed transno 17179869690 00000004:00080000:0.0:1787826433.287564:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90ce01dffc00, transno 17179869688 00000004:00080000:0.0:1787826433.287567:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869690 committed transno 17179869690 00000100:00100000:0.0:1787826433.287579:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3fb96d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874670585300864:0@lo:400:kworker.0 00000004:00080000:0.0:1787826433.287697:0:34502:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 3 done 00010000:00010000:3.0:1787826433.349113:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826433.795660:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03975e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585301248:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826433.795699:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787826433.795716:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03a1a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585301504:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787826433.795734:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826433.795763:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787826433.795769:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce03a18780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585301376:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787826433.795775:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826433.795806:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826433.795878:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787826433.795889:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce05579e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585301632:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787826433.795919:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826433.798344:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585301248 00000100:00100000:2.0:1787826433.798344:0:25628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585301504 00000100:00100000:2.0:1787826433.798357:0:25628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585301504 00000100:00100000:3.0:1787826433.798411:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585301376 00000100:00100000:3.0:1787826433.798417:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585301376 00000100:00100000:3.0:1787826433.798452:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585301632 00000100:00100000:3.0:1787826433.798455:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585301632 00000100:00100000:3.0:1787826433.798492:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 794 00000100:00100000:3.0:1787826433.798502:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a1bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1874670585301504:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787826433.798532:0:25628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 795 00002000:00000024:3.0:1787826433.798535:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 186235712 pending 0 free 3919187968 avail 3687665664 00000100:00100000:2.0:1787826433.798544:0:25628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874670585301376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787826433.798559:0:25628:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 186235712 pending 0 free 3919187968 avail 3687665664 00000100:00100000:3.0:1787826433.798602:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a1bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1874670585301504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (2833us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826433.798610:0:25628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874670585301376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (2804us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826433.798612:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 794 00000100:00100000:2.0:1787826433.798622:0:25628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 795 00000100:00100000:3.0:1787826433.798639:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 796 00000100:00100000:3.0:1787826433.798648:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05579680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874670585301632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787826433.798667:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 160009024 pending 0 free 3920248832 avail 3688726528 00000100:00100000:2.0:1787826433.798681:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03a18780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585301376:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787826433.798707:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05579680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874670585301632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (2787us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826433.798714:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 796 00000100:00100000:2.0:1787826433.799611:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce05579e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874670585301632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787826433.801087:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585301248 00000100:00100000:1.0:1787826433.801142:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 797 00000100:00100000:1.0:1787826433.801151:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3a9ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874670585301248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787826433.801170:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 160009024 pending 0 free 3920248832 avail 3688726528 00000100:00100000:1.0:1787826433.801240:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3a9ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874670585301248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (5506us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826433.801248:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 797 00000100:00100000:3.0:1787826433.801277:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03975e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874670585301248:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787826433.801297:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce03a1a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874670585301504:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787826434.192613:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826434.192661:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826434.192698:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826434.192729:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826434.192757:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826434.192786:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564019456 00000100:00100000:1.0:1787826434.192794:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564019456 00000100:00100000:1.0:1787826434.192849:0:9966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564019584 00000100:00100000:1.0:1787826434.192853:0:9966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564019584 00000100:00100000:1.0:1787826434.192877:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1611 00000100:00100000:1.0:1787826434.192886:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a1a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:2402:x1874670564019456:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1787826434.192959:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a1a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:2402:x1874670564019456:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 74us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826434.192966:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1611 00000100:00100000:1.0:1787826434.192984:0:9966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1612 00000100:00100000:1.0:1787826434.192991:0:9966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a1b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:2402:x1874670564019584:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1787826434.193001:0:34485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564019328 00000100:00100000:0.0:1787826434.193007:0:34485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564019328 00000100:00100000:1.0:1787826434.193019:0:9966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a1b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:2402:x1874670564019584:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 28us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826434.193027:0:9966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1612 00000100:00100000:0.0:1787826434.193046:0:34485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 108 00000100:00080000:1.0:1787826434.193047:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787826434.193065:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787826434.193071:0:34485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce027e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:307626ff-a376-4faf-93e0-9f55b723d964+10:2402:x1874670564019328:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1787826434.193106:0:34485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce027e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:307626ff-a376-4faf-93e0-9f55b723d964+10:2402:x1874670564019328:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 38us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826434.193114:0:34485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 108 00000100:00100000:3.0:1787826434.193304:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564019712 00000100:00100000:3.0:1787826434.193309:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564019712 00000100:00100000:3.0:1787826434.193352:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564019840 00000100:00100000:3.0:1787826434.193356:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564019840 00000100:00100000:0.0:1787826434.193395:0:28853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 952 00000100:00100000:0.0:1787826434.193406:0:28853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a1a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+6:2402:x1874670564019712:12345-192.168.203.39@tcp:400:kworker.0 00000100:00080000:1.0:1787826434.193412:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787826434.193417:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787826434.193457:0:28853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a1a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+6:2402:x1874670564019712:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 53us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826434.193465:0:28853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 952 00000100:00100000:2.0:1787826434.193937:0:30696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 953 00000100:00100000:2.0:1787826434.193948:0:30696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a19680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2402:x1874670564019840:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1787826434.194028:0:30696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a19680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+9:2402:x1874670564019840:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 83us (1269us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826434.194034:0:30696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 953 00010000:00010000:2.0:1787826434.371768:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787826434.503198:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826434.503284:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826434.503653:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564019968 00000100:00100000:0.0:1787826434.503663:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564019968 00000100:00100000:0.0:1787826434.503728:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564020224 00000100:00100000:0.0:1787826434.503732:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564020224 00000100:00100000:0.0:1787826434.503759:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4081 00000100:00100000:0.0:1787826434.503769:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a19a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+28:2401:x1874670564019968:12345-192.168.203.39@tcp:41:mkdir.0 00000004:00000024:0.0:1787826434.503816:0:16564:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446182912 avail 1299943424 00000100:00100000:0.0:1787826434.503878:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a19a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+28:2401:x1874670564019968:12345-192.168.203.39@tcp:41:mkdir.0 Request processed in 109us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826434.503887:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4081 00000100:00100000:0.0:1787826434.503904:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4082 00000100:00100000:0.0:1787826434.503911:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce03a18780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+27:56416:x1874670564020224:12345-192.168.203.39@tcp:36:mkdir.0 00000100:00100000:0.0:1787826434.503989:0:16564:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce055792c0 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:16564:1874670585301760:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1787826434.504041:0:16564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826434.504077:0:16564:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2068ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826434.504111:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585301760 00000100:00100000:0.0:1787826434.504114:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585301760 00000100:00100000:0.0:1787826434.504142:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1515 00000100:00100000:0.0:1787826434.504148:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05578780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:16564:x1874670585301760:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1787826434.504205:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05578780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:16564:x1874670585301760:12345-0@lo:1000:mdt00_005.0 Request processed in 56us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826434.504211:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1515 00000100:00100000:0.0:1787826434.504247:0:16564:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce055792c0 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:16564:1874670585301760:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1787826434.504300:0:16564:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce055792c0 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:16564:1874670585301888:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1787826434.504323:0:16564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826434.504337:0:16564:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3ab7ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826434.504350:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585301888 00000100:00100000:0.0:1787826434.504353:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585301888 00000100:00100000:0.0:1787826434.504374:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1516 00000100:00100000:0.0:1787826434.504381:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05578f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:16564:x1874670585301888:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1787826434.504444:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05578f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:16564:x1874670585301888:12345-0@lo:1000:mdt00_005.0 Request processed in 63us (120us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787826434.504451:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1516 00000100:00100000:0.0:1787826434.504494:0:16564:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce055792c0 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:16564:1874670585301888:0@lo:1000:mdt00_005.0 00010000:00010000:0.0:1787826434.504536:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff90cf0165ea00/0x22153cd396b83bad lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826434.504546:0:16564:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff90cf0165ea00/0x22153cd396b83bad lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826434.504554:0:16564:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff90cf0165ea00/0x22153cd396b83bad lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826434.504565:0:16564:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce055792c0 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:16564:1874670585302016:0@lo:101:mdt00_005.0 00000100:00100000:0.0:1787826434.504589:0:16564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826434.504602:0:16564:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf07972300 going to sleep for 11 seconds 00000100:00100000:0.0:1787826434.504613:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585302016 00000100:00100000:0.0:1787826434.504616:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585302016 00000100:00100000:0.0:1787826434.504638:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1517 00000100:00100000:0.0:1787826434.504644:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0557b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:16564:x1874670585302016:12345-0@lo:101:mdt00_005.0 00010000:00010000:0.0:1787826434.504652:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826434.504665:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b83bb4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x22153cd396b83bad expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826434.504688:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067c00/0x22153cd396b812d3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab09de expref: 29 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826434.504702:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b83bb4 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x22153cd396b83bad expref: 8 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826434.504725:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067c00/0x22153cd396b812d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab09de expref: 29 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826434.504737:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067c00/0x22153cd396b812d3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab09de expref: 29 pid: 6518 timeout: 1480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826434.504748:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce05579e00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:6524:1874670585302144:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826434.504787:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce02706840 going to sleep for 11 seconds 00000100:00100000:2.0:1787826434.508111:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce05579e00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:6524:1874670585302144:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826434.508143:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b83bb4 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x22153cd396b83bad expref: 8 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826434.508154:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ce01f45300) 00010000:00010000:2.0:1787826434.508158:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826434.508162:0:6524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b83bb4 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x22153cd396b83bad expref: 8 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826434.508172:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165e600, rc 0) 00000100:00100000:2.0:1787826434.508269:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0557b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:16564:x1874670585302016:12345-0@lo:101:mdt00_005.0 Request processed in 3623us (3678us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826434.508277:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1517 00000100:00100000:3.0:1787826434.509573:0:16564:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce055792c0 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:16564:1874670585302016:0@lo:101:mdt00_005.0 00010000:00010000:3.0:1787826434.509595:0:16564:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff90cf0165ea00/0x22153cd396b83bad lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x22153cd396b83bb4 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.509606:0:16564:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff90cf0165ea00/0x22153cd396b83bad lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x22153cd396b83bb4 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826434.511179:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826434.511459:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564020352 00000100:00100000:2.0:1787826434.511468:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564020352 00010000:00010000:2.0:1787826434.511863:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067c00/0x22153cd396b812d3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab09de expref: 30 pid: 6518 timeout: 1480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826434.511998:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1336 00000100:00100000:2.0:1787826434.512009:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb96d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:2404:x1874670564020352:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787826434.512025:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826434.512033:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067c00/0x22153cd396b812d3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab09de expref: 30 pid: 6518 timeout: 1480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826434.512046:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067c00/0x22153cd396b812d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab09de expref: 30 pid: 6518 timeout: 1480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826434.512076:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90ce0a067c00/0x22153cd396b812d3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab09de expref: 30 pid: 6518 timeout: 1480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826434.512091:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ce01f45300) 00010000:00010000:2.0:1787826434.512097:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b83bb4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x22153cd396b83bad expref: 7 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826434.512108:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b83bb4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x22153cd396b83bad expref: 7 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826434.512117:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b83bb4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x22153cd396b83bad expref: 7 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826434.512148:0:10341:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b83bb4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x22153cd396b83bad expref: 7 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826434.512162:0:10341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fdde00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:10341:1874670585302272:0@lo:105: 00000100:00100000:2.0:1787826434.512203:0:10341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826434.512273:0:10341:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf395f3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787826434.512373:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585302272 00000100:00100000:3.0:1787826434.512378:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585302272 00000100:00100000:3.0:1787826434.512432:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787826434.512439:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:10341:x1874670585302272:12345-0@lo:105: 00010000:00010000:3.0:1787826434.512457:0:6501:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff90cf0165ea00/0x22153cd396b83bad lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x22153cd396b83bb4 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.512467:0:6501:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff90cf0165ea00/0x22153cd396b83bad lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x22153cd396b83bb4 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.512507:0:6501:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff90cf0165ea00/0x22153cd396b83bad lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x22153cd396b83bb4 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.512516:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff90cf0165ea00/0x22153cd396b83bad lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x22153cd396b83bb4 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.512522:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff90cf0165ea00/0x22153cd396b83bad lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x22153cd396b83bb4 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.512529:0:6501:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff90cf0165ea00/0x22153cd396b83bad lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x22153cd396b83bb4 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.512545:0:6501:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff90cf0165ea00) 00000100:00100000:3.0:1787826434.512587:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:10341:x1874670585302272:12345-0@lo:105: Request processed in 148us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826434.512594:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00010000:1.0:1787826434.512649:0:16564:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff90cf0165ea00/0x22153cd396b83bad lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x22153cd396b83bb4 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.512658:0:16564:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff90cf0165ea00/0x22153cd396b83bad lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x22153cd396b83bb4 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787826434.512681:0:16564:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1787826434.512716:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff90cf2f46ac00/0x22153cd396b83bbb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.512722:0:16564:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff90cf2f46ac00/0x22153cd396b83bbb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.512735:0:16564:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff90cf2f46ac00/0x22153cd396b83bbb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826434.512751:0:16564:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3fb970c0 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:16564:1874670585302400:0@lo:101:mdt00_005.0 00000100:00100000:1.0:1787826434.512779:0:16564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826434.512797:0:16564:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce05b569c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826434.512827:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585302400 00000100:00100000:0.0:1787826434.512833:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585302400 00000100:00100000:0.0:1787826434.512871:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1518 00000100:00100000:0.0:1787826434.512878:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:16564:x1874670585302400:12345-0@lo:101:mdt00_005.0 00010000:00010000:0.0:1787826434.512892:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826434.512917:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b83bc2 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x22153cd396b83bbb expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826434.512937:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b83bc2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x22153cd396b83bbb expref: 9 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826434.512949:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b83bc2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x22153cd396b83bbb expref: 9 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826434.512956:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x159f6f8a (ffff90cf0c7dac00) 00010000:00010000:0.0:1787826434.512960:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787826434.512963:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165e000, rc 0) 00000100:00100000:0.0:1787826434.513004:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:16564:x1874670585302400:12345-0@lo:101:mdt00_005.0 Request processed in 127us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826434.513011:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1518 00000100:00100000:1.0:1787826434.513041:0:16564:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3fb970c0 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:16564:1874670585302400:0@lo:101:mdt00_005.0 00010000:00010000:1.0:1787826434.513064:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff90cf2f46ac00/0x22153cd396b83bbb lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x22153cd396b83bc2 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.513072:0:16564:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff90cf2f46ac00/0x22153cd396b83bbb lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x22153cd396b83bc2 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787826434.513082:0:16564:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:1.0:1787826434.513110:0:16564:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3fb970c0 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:16564:1874670585302528:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1787826434.513136:0:16564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826434.513156:0:16564:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce05b56f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826434.513175:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585302528 00000100:00100000:0.0:1787826434.513181:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585302528 00000100:00100000:0.0:1787826434.513216:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1519 00000100:00100000:0.0:1787826434.513224:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:16564:x1874670585302528:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1787826434.513282:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:16564:x1874670585302528:12345-0@lo:1000:mdt00_005.0 Request processed in 58us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826434.513289:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1519 00000100:00100000:1.0:1787826434.513324:0:16564:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3fb970c0 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:16564:1874670585302528:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1787826434.513363:0:16564:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0300d2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:16564:1874670585302656:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1787826434.513386:0:16564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826434.513408:0:16564:0:(client.c:2715:ptlrpc_set_wait()) set ffff90ce05b56f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826434.513559:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585302656 00000100:00100000:0.0:1787826434.513564:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585302656 00000100:00100000:0.0:1787826434.513598:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1520 00000100:00100000:0.0:1787826434.513607:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:16564:x1874670585302656:12345-0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1787826434.513622:0:10341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fdde00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:10341:1874670585302272:0@lo:105: 00010000:00010000:1.0:1787826434.513634:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826434.513676:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb96d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+29:2404:x1874670564020352:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 1668us (2501us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826434.513689:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1336 00000100:00100000:0.0:1787826434.513696:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:16564:x1874670585302656:12345-0@lo:1000:mdt00_005.0 Request processed in 90us (308us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787826434.513704:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1520 00000100:00100000:0.0:1787826434.513730:0:16564:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0300d2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:16564:1874670585302656:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1787826434.513982:0:16564:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce055792c0 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:16564:1874670585302784:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1787826434.514009:0:16564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787826434.514030:0:16564:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf3ab7ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826434.514101:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585302784 00000100:00100000:1.0:1787826434.514106:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585302784 00000100:00100000:1.0:1787826434.514145:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1521 00000100:00100000:1.0:1787826434.514152:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce05579e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:16564:x1874670585302784:12345-0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1787826434.514397:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce05579e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:16564:x1874670585302784:12345-0@lo:1000:mdt00_005.0 Request processed in 245us (385us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787826434.514404:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1521 00000100:00100000:2.0:1787826434.514604:0:16564:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce055792c0 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:16564:1874670585302784:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1787826434.514655:0:16564:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fdcb40 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:16564:1874670585302912:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1787826434.514681:0:16564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826434.514856:0:16564:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf395f3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787826434.514949:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585302912 00000100:00100000:0.0:1787826434.514954:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585302912 00000100:00100000:0.0:1787826434.514988:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1522 00000100:00100000:0.0:1787826434.514994:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fdde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:16564:x1874670585302912:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1787826434.515326:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fdde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:16564:x1874670585302912:12345-0@lo:1000:mdt00_005.0 Request processed in 331us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826434.515333:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1522 00000100:00100000:2.0:1787826434.515380:0:16564:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fdcb40 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:16564:1874670585302912:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1787826434.515525:0:16564:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fdcb40 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:16564:1874670585303040:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1787826434.515550:0:16564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826434.515575:0:16564:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf395f3b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787826434.515916:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585303040 00000100:00100000:3.0:1787826434.515922:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585303040 00000100:00100000:3.0:1787826434.515957:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1523 00000100:00100000:3.0:1787826434.515964:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce01fde1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:16564:x1874670585303040:12345-0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1787826434.516186:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce01fde1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:16564:x1874670585303040:12345-0@lo:1000:mdt00_005.0 Request processed in 222us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826434.516193:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1523 00000100:00100000:2.0:1787826434.516242:0:16564:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fdcb40 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:16564:1874670585303040:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1787826434.516341:0:16564:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce01fdcb40 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:16564:1874670585303168:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1787826434.516369:0:16564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826434.516616:0:16564:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf395f3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787826434.516947:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585303168 00000100:00100000:0.0:1787826434.516953:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585303168 00000100:00100000:0.0:1787826434.517032:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1524 00000100:00100000:0.0:1787826434.517041:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:16564:x1874670585303168:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1787826434.517130:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:16564:x1874670585303168:12345-0@lo:1000:mdt00_005.0 Request processed in 90us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826434.517137:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1524 00000100:00100000:3.0:1787826434.517186:0:16564:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce01fdcb40 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:16564:1874670585303168:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1787826434.517240:0:16564:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aa87480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:16564:1874670585303296:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1787826434.517278:0:16564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826434.518218:0:16564:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf07972300 going to sleep for 11 seconds 00000100:00100000:2.0:1787826434.518271:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585303296 00000100:00100000:2.0:1787826434.518276:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585303296 00000100:00100000:2.0:1787826434.518305:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1525 00000100:00100000:2.0:1787826434.518312:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa85a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:16564:x1874670585303296:12345-0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1787826434.518375:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa85a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:16564:x1874670585303296:12345-0@lo:1000:mdt00_005.0 Request processed in 63us (1096us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826434.518383:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1525 00000100:00100000:2.0:1787826434.518546:0:16564:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aa87480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:16564:1874670585303296:0@lo:1000:mdt00_005.0 00000040:00080000:2.0:1787826434.519030:0:16564:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].20, 992 off53648 00000040:00080000:2.0:1787826434.519093:0:16564:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x2:0x0].17, 1144 off54936 00000004:00080000:2.0:1787826434.519099:0:16564:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff90cf395f3240 with version 36 00000004:00080000:2.0:1787826434.519114:0:7464:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff90cf076a8cc0 version 36 rpc_version 36 00000020:00100000:2.0:1787826434.519134:0:7464:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787826434.519141:0:7464:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff90cf3ab90780 x1874670585303552/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2424/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787826434.519156:0:7464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab90780 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7464:1874670585303552:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787826434.519188:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826434.519202:0:7464:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf395f3a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787826434.519213:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585303552 00000100:00100000:2.0:1787826434.519217:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585303552 00000100:00100000:2.0:1787826434.519237:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1526 00000100:00100000:2.0:1787826434.519243:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab92d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:7464:x1874670585303552:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787826434.519524:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab92d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:7464:x1874670585303552:12345-0@lo:1000:osp_up0-1.0 Request processed in 280us (334us total) trans 8589935297 rc 0/0 00000100:00100000:2.0:1787826434.519532:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1526 00000100:00100000:2.0:1787826434.519572:0:7464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab90780 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7464:1874670585303552:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1787826434.519622:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46a400/0x22153cd396b83bc9 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.519637:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46a400/0x22153cd396b83bc9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.519648:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46a400/0x22153cd396b83bc9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826434.519665:0:16564:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002cb40598 reply state 000000007e2840c5 transno 4294967719 ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46a400/0x22153cd396b83bc9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.519675:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46a400/0x22153cd396b83bc9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.519682:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x13:0x0].0x0 (ffff90cf3ab61200) 00010000:00010000:1.0:1787826434.519685:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826434.519688:0:16564:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787826434.519694:0:16564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0x13:0x0]: returning size 4096 00000004:00080000:1.0:1787826434.519702:0:16564:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1787826434.519717:0:16564:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff90cf0165ea00/0x22153cd396b83bad lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x22153cd396b83bb4 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.519731:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff90cf0165ea00/0x22153cd396b83bad lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x22153cd396b83bb4 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.519739:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff90cf0165ea00/0x22153cd396b83bad lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x22153cd396b83bb4 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.519766:0:16564:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1787826434.519771:0:16564:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1787826434.519776:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff90cf2f46ac00/0x22153cd396b83bbb lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x22153cd396b83bc2 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.519783:0:16564:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff90cf2f46ac00/0x22153cd396b83bbb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x22153cd396b83bc2 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826434.519847:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce03a18780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+29:56416:x1874670564020224:12345-192.168.203.39@tcp:36:mkdir.0 Request processed in 15934us (16561us total) trans 4294967719 rc 0/0 00000100:00100000:1.0:1787826434.519854:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4082 00010000:00010000:2.0:1787826434.519898:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787826434.519904:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff90cf0165ea00/0x22153cd396b83bad lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x22153cd396b83bb4 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826434.519912:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165ea00 already unused, calling callback (ffffffffc18ffee0) 00010000:00010000:2.0:1787826434.519917:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff90cf0165ea00/0x22153cd396b83bad lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x22153cd396b83bb4 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826434.519925:0:6507:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff90cf0165ea00/0x22153cd396b83bad lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x22153cd396b83bb4 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826434.519950:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff90cf0165ea00/0x22153cd396b83bad lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x22153cd396b83bb4 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826434.519957:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787826434.519985:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff90cf0165ea00/0x22153cd396b83bad lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x22153cd396b83bb4 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826434.519993:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff90cf0165ea00/0x22153cd396b83bad lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x22153cd396b83bb4 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826434.520003:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826434.520005:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787826434.520007:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787826434.520013:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787826434.520022:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585303680:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787826434.520061:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826434.520089:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585303680 00000100:00100000:2.0:1787826434.520093:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585303680 00000100:00100000:2.0:1787826434.520120:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1787826434.520127:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab91a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+10:3645:x1874670585303680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787826434.520137:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826434.520153:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e600/0x22153cd396b83bb4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x22153cd396b83bad expref: 10 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826434.520164:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ce01f45300) 00010000:00010000:2.0:1787826434.520168:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787826434.520193:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab91a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+9:3645:x1874670585303680:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826434.520199:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1787826434.520733:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585303680:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787826434.532159:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826434.532341:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564020480 00000100:00100000:0.0:1787826434.532350:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564020480 00000100:00100000:0.0:1787826434.532403:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4083 00000100:00100000:0.0:1787826434.532412:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf07966940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+29:56417:x1874670564020480:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826434.532431:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826434.532450:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b83bd0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab18ef expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826434.532542:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b83bd7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826434.532557:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b83bd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826434.532569:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b83bd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826434.532608:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787826434.532613:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826434.532632:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b83bd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826434.532659:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fc00/0x22153cd396b83bd0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18ef expref: 31 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826434.532675:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165fa00/0x22153cd396b83bd7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18ef expref: 30 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826434.532684:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ce01f45300) 00010000:00010000:0.0:1787826434.532687:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787826434.532690:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165fa00, rc 0) 00000100:00100000:0.0:1787826434.532749:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf07966940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:56417:x1874670564020480:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 337us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826434.532758:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4083 00000100:00100000:1.0:1787826434.536600:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826434.536649:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564020608 00000100:00100000:3.0:1787826434.536660:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564020608 00000100:00100000:3.0:1787826434.537324:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4084 00000100:00100000:3.0:1787826434.537339:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf07966d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:56417:x1874670564020608:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826434.537358:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826434.537378:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b83bde lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab18f6 expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.537439:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b83be5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.537453:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b83be5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.537465:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b83be5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.537508:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b83bec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.537518:0:8247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b83bc2 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x22153cd396b83bbb expref: 8 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.537527:0:8247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b83bec lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.537556:0:8247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b83bc2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x22153cd396b83bbb expref: 8 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826434.537571:0:8247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aa84000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8247:1874670585303808:0@lo:104: 00000100:00100000:3.0:1787826434.537617:0:8247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826434.537662:0:8247:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf10a139c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787826434.539397:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585303808 00000100:00100000:0.0:1787826434.539406:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585303808 00000100:00100000:0.0:1787826434.539728:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787826434.539739:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:8247:x1874670585303808:12345-0@lo:104: 00010000:00010000:0.0:1787826434.540152:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff90cf2f46ac00/0x22153cd396b83bbb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x22153cd396b83bc2 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826434.540261:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787826434.540268:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:8247:x1874670585303808:12345-0@lo:104: Request processed in 531us (2650us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826434.540276:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00010000:00010000:1.0:1787826434.540336:0:7460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787826434.540344:0:7460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff90cf2f46ac00/0x22153cd396b83bbb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x22153cd396b83bc2 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.540353:0:7460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46ac00 already unused, calling callback (ffffffffc18ffee0) 00010000:00010000:1.0:1787826434.540358:0:7460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff90cf2f46ac00/0x22153cd396b83bbb lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x22153cd396b83bc2 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826434.540373:0:7460:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff90cf2f46ac00/0x22153cd396b83bbb lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x22153cd396b83bc2 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.540404:0:7460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff90cf2f46ac00/0x22153cd396b83bbb lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x22153cd396b83bc2 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.540411:0:7460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787826434.540446:0:7460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff90cf2f46ac00/0x22153cd396b83bbb lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x22153cd396b83bc2 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.540455:0:7460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff90cf2f46ac00/0x22153cd396b83bbb lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x22153cd396b83bc2 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.540489:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826434.540491:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787826434.540493:0:7460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787826434.540853:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf07964780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585303936:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787826434.540895:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787826434.540917:0:8247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aa84000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8247:1874670585303808:0@lo:104: 00010000:00010000:3.0:1787826434.540950:0:8247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b83bec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826434.540961:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585303936 00000100:00100000:0.0:1787826434.540967:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585303936 00010000:00010000:0.0:1787826434.540988:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b83bc2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x22153cd396b83bbb expref: 9 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826434.541023:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1337 00000100:00100000:0.0:1787826434.541031:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce055792c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+9:3645:x1874670585303936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787826434.541042:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:1.0:1787826434.543556:0:34481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935297 is committed 00000020:00080000:1.0:1787826434.543571:0:34481:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969348 batchid updated 00000020:00080000:3.0:1787826434.543602:0:34512:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969348 00000020:00080000:3.0:1787826434.543613:0:34512:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969348 00010000:00010000:1.0:1787826434.543652:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf0165e000/0x22153cd396b83bc2 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x22153cd396b83bbb expref: 8 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.543667:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x159f6f8a (ffff90cf0c7dac00) 00010000:00010000:1.0:1787826434.543672:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b83bec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.543681:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b83bec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.543692:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b83bec lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.543721:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787826434.543747:0:8247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b83bec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.543755:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b83bec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826434.543781:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce055792c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+7:3645:x1874670585303936:12345-0@lo:103:ldlm_bl.0 Request processed in 2751us (2886us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826434.543789:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1337 00000100:00100000:1.0:1787826434.543837:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf07964780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874670585303936:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787826434.543865:0:8247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aa84000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8247:1874670585304064:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787826434.543906:0:8247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787826434.543922:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585304064 00000100:00100000:3.0:1787826434.543925:0:8247:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf078ff240 going to sleep for 11 seconds 00000100:00100000:2.0:1787826434.543928:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585304064 00000100:00100000:2.0:1787826434.544759:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1527 00000100:00100000:2.0:1787826434.544769:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa86580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8247:x1874670585304064:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787826434.544848:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa86580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8247:x1874670585304064:12345-0@lo:1000:mdt00_003.0 Request processed in 81us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826434.544855:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1527 00000100:00100000:3.0:1787826434.545232:0:8247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aa84000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8247:1874670585304064:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1787826434.545285:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b83bf3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.545299:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b83bf3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x13:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.545311:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b83bf3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x13:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787826434.545333:0:8247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b83bf3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x13:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.545347:0:8247:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b83be5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.545355:0:8247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b83be5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.545360:0:8247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b83be5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.545366:0:8247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b83be5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.545372:0:8247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826434.545376:0:8247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b83be5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.545383:0:8247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b83be5 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.545394:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90ce01f45300) 00010000:00010000:3.0:1787826434.545397:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826434.545401:0:8247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b83be5 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.545408:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401400/0x22153cd396b83be5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.545420:0:8247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b83bec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.545427:0:8247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b83bec lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.545433:0:8247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b83bec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.545438:0:8247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826434.545441:0:8247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b83bec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.545446:0:8247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b83bec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.545454:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x159f6f8a (ffff90cf0c7dac00) 00010000:00010000:3.0:1787826434.545456:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826434.545460:0:8247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b83bec lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.545465:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f400000/0x22153cd396b83bec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.546570:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401e00/0x22153cd396b83bde lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18f6 expref: 32 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.546589:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cf2f401200/0x22153cd396b83bf3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x13:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18f6 expref: 31 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.546596:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x13:0x0].0x0 (ffff90cf06894700) 00010000:00010000:3.0:1787826434.546599:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787826434.546602:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f401200, rc 0) 00000100:00100000:3.0:1787826434.546659:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf07966d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+31:56417:x1874670564020608:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 9324us (10067us total) trans 0 rc 0/0 00000100:00100000:3.0:1787826434.546667:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4084 00000100:00100000:1.0:1787826434.550122:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826434.550182:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564020736 00000100:00100000:2.0:1787826434.550191:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564020736 00000100:00100000:2.0:1787826434.550254:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4085 00000100:00100000:2.0:1787826434.550276:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf07964780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+29:56417:x1874670564020736:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826434.550300:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826434.550332:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b83bfa lrc: 2/0,0 mode: --/CR res: [0x240000404:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab18fd expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826434.550961:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835c00/0x22153cd396b83c01 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826434.550976:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835c00/0x22153cd396b83c01 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x13:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826434.550988:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835c00/0x22153cd396b83c01 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x13:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826434.551045:0:32404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0x13:0x0]: returning size 4096 00000004:00200000:2.0:1787826434.551059:0:32404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1787826434.551099:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b83bfa lrc: 0/0,0 mode: --/CR res: [0x240000404:0x13:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18fd expref: 31 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826434.551115:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835c00/0x22153cd396b83c01 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x13:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18fd expref: 30 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826434.551129:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x13:0x0].0x0 (ffff90cf3ab61200) 00010000:00010000:2.0:1787826434.551133:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:2.0:1787826434.551137:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835c00, rc 0) 00000100:00100000:2.0:1787826434.551195:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf07964780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:56417:x1874670564020736:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 932us (1080us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826434.551203:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4085 00000100:00100000:3.0:1787826434.555063:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826434.555190:0:16564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564020864 00000100:00100000:1.0:1787826434.555199:0:16564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564020864 00000100:00100000:1.0:1787826434.555253:0:16564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4086 00000100:00100000:1.0:1787826434.555265:0:16564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:56417:x1874670564020864:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826434.555285:0:16564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826434.555306:0:16564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46ba00/0x22153cd396b83c08 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1904 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.555370:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46ac00/0x22153cd396b83c0f lrc: 3/1,0 mode: --/CR res: [0x240000404:0x13:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.555385:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46ac00/0x22153cd396b83c0f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.555397:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46ac00/0x22153cd396b83c0f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.555413:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46bc00/0x22153cd396b83c16 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x13:0x0].0xd5143738 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.555436:0:16564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46bc00/0x22153cd396b83c16 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x13:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.555443:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46bc00/0x22153cd396b83c16 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x13:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.555514:0:16564:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46ac00/0x22153cd396b83c0f lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.555521:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46ac00/0x22153cd396b83c0f lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.555527:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46ac00/0x22153cd396b83c0f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.555534:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46ac00/0x22153cd396b83c0f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.555540:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46ac00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826434.555545:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46ac00/0x22153cd396b83c0f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.555552:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46ac00/0x22153cd396b83c0f lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.555564:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x13:0x0].0x0 (ffff90cf3ab61200) 00010000:00010000:1.0:1787826434.555568:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826434.555572:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46ac00/0x22153cd396b83c0f lrc: 3/0,0 mode: --/CR res: [0x240000404:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.555579:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46ac00/0x22153cd396b83c0f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.555590:0:16564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46bc00/0x22153cd396b83c16 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x13:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.555596:0:16564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46bc00/0x22153cd396b83c16 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x13:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.555602:0:16564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46bc00/0x22153cd396b83c16 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x13:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.555607:0:16564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46bc00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826434.555609:0:16564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46bc00/0x22153cd396b83c16 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x13:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.555616:0:16564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46bc00/0x22153cd396b83c16 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x13:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.555625:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x13:0x0].0xd5143738 (ffff90cf04f8b900) 00010000:00010000:1.0:1787826434.555627:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826434.555631:0:16564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46bc00/0x22153cd396b83c16 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x13:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.555637:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46bc00/0x22153cd396b83c16 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x13:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16564 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.555669:0:16564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46ba00/0x22153cd396b83c08 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1904 expref: 31 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.555680:0:16564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x13:0x0].0x0 (ffff90cf3ab61200) 00010000:00010000:1.0:1787826434.555682:0:16564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826434.555687:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46ba00/0x22153cd396b83c08 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1904 expref: 31 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.555697:0:16564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46ba00, rc 0) 00000100:00100000:1.0:1787826434.555756:0:16564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:56417:x1874670564020864:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 494us (712us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826434.555764:0:16564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4086 00000100:00100000:1.0:1787826434.560704:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826434.561489:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564021120 00000100:00100000:3.0:1787826434.561618:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564021120 00000100:00100000:3.0:1787826434.561748:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4087 00000100:00100000:3.0:1787826434.561758:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+30:56417:x1874670564021120:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1787826434.561777:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826434.561796:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b83c1d lrc: 2/0,0 mode: --/CW res: [0x240000404:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab190b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.562080:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400000/0x22153cd396b83c24 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x13:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.562095:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400000/0x22153cd396b83c24 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.562105:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400000/0x22153cd396b83c24 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.562121:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401400/0x22153cd396b83c2b lrc: 3/0,1 mode: --/PW res: [0x240000404:0x13:0x0].0xd5143738 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.562128:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401400/0x22153cd396b83c2b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x13:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.562134:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401400/0x22153cd396b83c2b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x13:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787826434.562288:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3aa86d00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6519:1874670585304192:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787826434.562357:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787826434.563171:0:7796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670585304192 00000100:00100000:1.0:1787826434.563179:0:7796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670585304192 00000100:00100000:3.0:1787826434.563185:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf078fff00 going to sleep for 11 seconds 00000100:00100000:1.0:1787826434.563224:0:7796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1528 00000100:00100000:1.0:1787826434.563233:0:7796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:6519:x1874670585304192:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787826434.563657:0:7796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:6519:x1874670585304192:12345-0@lo:1000:mdt00_001.0 Request processed in 424us (1299us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826434.563665:0:7796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1528 00000100:00100000:2.0:1787826434.567583:0:6519:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 8589935297 gen 2 00000004:00080000:2.0:1787826434.567595:0:6519:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589935297 committed transno 8589935297 00000100:00100000:2.0:1787826434.567620:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3aa86d00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6519:1874670585304192:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1787826434.568001:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b83c32 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826434.568018:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b83c32 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826434.568029:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b83c32 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787826434.568042:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0x14:0x0]: returning size 0 00010000:00010000:2.0:1787826434.568080:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400000/0x22153cd396b83c24 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826434.568088:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400000/0x22153cd396b83c24 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826434.568094:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400000/0x22153cd396b83c24 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826434.568101:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400000/0x22153cd396b83c24 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826434.568108:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400000 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:2.0:1787826434.568112:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400000/0x22153cd396b83c24 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826434.568119:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400000/0x22153cd396b83c24 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826434.568131:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x13:0x0].0x0 (ffff90cf3ab61200) 00010000:00010000:2.0:1787826434.568134:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787826434.568139:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400000/0x22153cd396b83c24 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826434.568145:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400000/0x22153cd396b83c24 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787826434.568170:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bc3ea1fd reply state 000000006310eff8 transno 4294967720 ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401400/0x22153cd396b83c2b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x13:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826434.568185:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401400/0x22153cd396b83c2b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x13:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826434.568191:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x13:0x0].0xd5143738 (ffff90cf06894b00) 00010000:00010000:2.0:1787826434.568194:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826434.568197:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787826434.568231:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401e00/0x22153cd396b83c1d lrc: 0/0,0 mode: --/CW res: [0x240000404:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab190b expref: 33 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826434.568246:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b83c32 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab190b expref: 32 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826434.568259:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x14:0x0].0x0 (ffff90cf39e67100) 00010000:00010000:2.0:1787826434.568261:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787826434.568264:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835000, rc 0) 00000100:00100000:2.0:1787826434.568325:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:56417:x1874670564021120:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 6569us (7628us total) trans 4294967720 rc 0/0 00000100:00100000:2.0:1787826434.568335:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4087 00000100:00100000:0.0:1787826434.573890:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826434.573939:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564021376 00000100:00100000:0.0:1787826434.573948:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564021376 00000100:00100000:0.0:1787826434.574006:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4088 00000100:00100000:0.0:1787826434.574019:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0300d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:56417:x1874670564021376:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1787826434.574043:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826434.574073:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf0165e400/0x22153cd396b83c40 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1912 expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826434.574175:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf0165ee00/0x22153cd396b83c47 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826434.574190:0:8247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b83c32 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab190b expref: 34 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826434.574198:0:8247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf0165ee00/0x22153cd396b83c47 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826434.574233:0:8247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b83c32 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab190b expref: 34 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826434.574248:0:8247:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b83c32 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab190b expref: 34 pid: 6519 timeout: 1480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826434.574261:0:8247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90ce0b4330c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8247:1874670585304320:192.168.203.39@tcp:104: 00000100:00100000:0.0:1787826434.574328:0:8247:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf2068ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1787826434.576980:0:8247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90ce0b4330c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8247:1874670585304320:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826434.577006:0:8247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff90cf0165ee00/0x22153cd396b83c47 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826434.577821:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826434.577876:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564021504 00000100:00100000:1.0:1787826434.577883:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564021504 00010000:00010000:1.0:1787826434.577914:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b83c32 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab190b expref: 35 pid: 6519 timeout: 1480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826434.577955:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1338 00000100:00100000:1.0:1787826434.577966:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b4330c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:2403:x1874670564021504:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826434.577979:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826434.577987:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b83c32 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab190b expref: 35 pid: 6519 timeout: 1480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.578002:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b83c32 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab190b expref: 35 pid: 6519 timeout: 1480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.578024:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b83c32 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab190b expref: 35 pid: 6519 timeout: 1480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.578038:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x14:0x0].0x0 (ffff90cf39e67100) 00010000:00010000:1.0:1787826434.578043:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff90cf0165ee00/0x22153cd396b83c47 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.578061:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf0165ee00/0x22153cd396b83c47 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.578069:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf0165ee00/0x22153cd396b83c47 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.578122:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826434.578174:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b4330c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:2403:x1874670564021504:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 210us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826434.578182:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1338 00010000:00010000:0.0:1787826434.578273:0:8247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff90cf0165ee00/0x22153cd396b83c47 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826434.578281:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf0165ee00/0x22153cd396b83c47 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826434.578298:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0x14:0x0]: returning size 0 00000004:00080000:0.0:1787826434.578840:0:8247:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x28:0x0], index 0: 0 00010000:00010000:0.0:1787826434.578943:0:8247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf0165ee00/0x22153cd396b83c47 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826434.578951:0:8247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf0165ee00/0x22153cd396b83c47 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826434.578958:0:8247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf0165ee00/0x22153cd396b83c47 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826434.578964:0:8247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf0165ee00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826434.578969:0:8247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf0165ee00/0x22153cd396b83c47 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826434.578976:0:8247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf0165ee00/0x22153cd396b83c47 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826434.578988:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x14:0x0].0x0 (ffff90cf39e67100) 00010000:00010000:0.0:1787826434.578991:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826434.578996:0:8247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf0165ee00/0x22153cd396b83c47 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826434.579002:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf0165ee00/0x22153cd396b83c47 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826434.579067:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf0165e400/0x22153cd396b83c40 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x13:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1912 expref: 34 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826434.579079:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x13:0x0].0x0 (ffff90cf3ab61200) 00010000:00010000:0.0:1787826434.579081:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787826434.579085:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf0165e400/0x22153cd396b83c40 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x13:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1912 expref: 34 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826434.579097:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165e400, rc 0) 00000100:00100000:0.0:1787826434.579240:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0300d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:56417:x1874670564021376:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 5223us (5356us total) trans 4294967721 rc 301/301 00000100:00100000:0.0:1787826434.579248:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4088 00000100:00100000:0.0:1787826434.585227:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826434.585630:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564021760 00000100:00100000:3.0:1787826434.585640:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564021760 00000100:00100000:3.0:1787826434.585776:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1282 00000100:00100000:3.0:1787826434.585787:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b431680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+33:56417:x1874670564021760:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:3.0:1787826434.586083:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b431680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:56417:x1874670564021760:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 297us (862us total) trans 4294967722 rc 0/0 00000100:00100000:3.0:1787826434.586092:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1282 00000100:00100000:1.0:1787826434.594248:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826434.594382:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564022016 00000100:00100000:2.0:1787826434.594392:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564022016 00000100:00100000:2.0:1787826434.594455:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1283 00000100:00100000:2.0:1787826434.594465:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf1eea3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+34:56417:x1874670564022016:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:2.0:1787826434.594670:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf1eea3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:56417:x1874670564022016:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 207us (430us total) trans 4294967723 rc 0/0 00000100:00100000:2.0:1787826434.594676:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1283 00000100:00100000:2.0:1787826434.612487:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826434.612577:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564022144 00000100:00100000:1.0:1787826434.612597:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564022144 00000100:00100000:1.0:1787826434.612672:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4089 00000100:00100000:1.0:1787826434.612682:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab90780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:56418:x1874670564022144:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826434.612706:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826434.612734:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46ac00/0x22153cd396b83c55 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1919 expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.612819:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46aa00/0x22153cd396b83c5c lrc: 3/1,0 mode: --/CR res: [0x240000404:0x13:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.612832:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46aa00/0x22153cd396b83c5c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.612842:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46aa00/0x22153cd396b83c5c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.612856:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46b200/0x22153cd396b83c63 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x13:0x0].0x363df604 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.612862:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46b200/0x22153cd396b83c63 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x13:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.612869:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46b200/0x22153cd396b83c63 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x13:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.613116:0:32404:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46aa00/0x22153cd396b83c5c lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.613123:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46aa00/0x22153cd396b83c5c lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.613129:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46aa00/0x22153cd396b83c5c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.613136:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46aa00/0x22153cd396b83c5c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.613144:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46aa00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826434.613150:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46aa00/0x22153cd396b83c5c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.613158:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46aa00/0x22153cd396b83c5c lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.613174:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x13:0x0].0x0 (ffff90cf3ab61200) 00010000:00010000:1.0:1787826434.613177:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826434.613182:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46aa00/0x22153cd396b83c5c lrc: 3/0,0 mode: --/CR res: [0x240000404:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.613190:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46aa00/0x22153cd396b83c5c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.613209:0:32404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46b200/0x22153cd396b83c63 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x13:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.613215:0:32404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46b200/0x22153cd396b83c63 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x13:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.613220:0:32404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46b200/0x22153cd396b83c63 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x13:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.613287:0:32404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46b200 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826434.613291:0:32404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46b200/0x22153cd396b83c63 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x13:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.613297:0:32404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46b200/0x22153cd396b83c63 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x13:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.613305:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x13:0x0].0x363df604 (ffff90cf04f8b900) 00010000:00010000:1.0:1787826434.613307:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826434.613310:0:32404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46b200/0x22153cd396b83c63 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x13:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.613316:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46b200/0x22153cd396b83c63 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x13:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.613351:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46ac00/0x22153cd396b83c55 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1919 expref: 36 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.613370:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x13:0x0].0x0 (ffff90cf3ab61200) 00010000:00010000:1.0:1787826434.613373:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826434.613376:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46ac00/0x22153cd396b83c55 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1919 expref: 36 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.613386:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46ac00, rc 0) 00000100:00100000:1.0:1787826434.613449:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab90780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:56418:x1874670564022144:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 768us (993us total) trans 0 rc 301/301 00000100:00100000:1.0:1787826434.613457:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4089 00000100:00100000:0.0:1787826434.617315:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826434.617387:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564022400 00000100:00100000:1.0:1787826434.617404:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564022400 00000100:00100000:1.0:1787826434.617495:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4090 00000100:00100000:1.0:1787826434.617507:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b430780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+35:56418:x1874670564022400:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1787826434.617525:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826434.617543:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46ae00/0x22153cd396b83c6a lrc: 2/0,0 mode: --/CW res: [0x240000404:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1920 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.617652:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46a600/0x22153cd396b83c71 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x13:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.617666:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46a600/0x22153cd396b83c71 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.617677:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46a600/0x22153cd396b83c71 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.617690:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46b000/0x22153cd396b83c78 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x13:0x0].0x363df604 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.617697:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46b000/0x22153cd396b83c78 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x13:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.617713:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46b000/0x22153cd396b83c78 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x13:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.618129:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46a800/0x22153cd396b83c7f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.618139:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46a800/0x22153cd396b83c7f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.618147:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46a800/0x22153cd396b83c7f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787826434.618156:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0x15:0x0]: returning size 0 00010000:00010000:1.0:1787826434.618175:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46a600/0x22153cd396b83c71 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.618182:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46a600/0x22153cd396b83c71 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.618188:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46a600/0x22153cd396b83c71 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.618193:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f46a600 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:1.0:1787826434.618197:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46a600/0x22153cd396b83c71 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.618208:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46a600/0x22153cd396b83c71 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.618219:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x13:0x0].0x0 (ffff90cf3ab61200) 00010000:00010000:1.0:1787826434.618222:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787826434.618226:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46a600/0x22153cd396b83c71 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.618232:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46a600/0x22153cd396b83c71 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787826434.618244:0:6518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000378d14f5 reply state 00000000dc7c27f2 transno 4294967724 ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46b000/0x22153cd396b83c78 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x13:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.618253:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46b000/0x22153cd396b83c78 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x13:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.618258:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x13:0x0].0x363df604 (ffff90cf04f8bd00) 00010000:00010000:1.0:1787826434.618260:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787826434.618263:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787826434.618287:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46ae00/0x22153cd396b83c6a lrc: 0/0,0 mode: --/CW res: [0x240000404:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1920 expref: 38 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.618300:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46a800/0x22153cd396b83c7f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1920 expref: 37 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.618307:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x15:0x0].0x0 (ffff90cf04f8b100) 00010000:00010000:1.0:1787826434.618310:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787826434.618312:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46a800, rc 0) 00000100:00100000:1.0:1787826434.618371:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b430780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:56418:x1874670564022400:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 867us (1071us total) trans 4294967724 rc 0/0 00000100:00100000:1.0:1787826434.618379:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4090 00000100:00100000:3.0:1787826434.621092:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826434.621338:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564022656 00000100:00100000:2.0:1787826434.621349:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564022656 00000100:00100000:2.0:1787826434.621791:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4091 00000100:00100000:2.0:1787826434.621805:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa87840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:56418:x1874670564022656:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1787826434.621888:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826434.621914:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834600/0x22153cd396b83c8d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1927 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826434.622059:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834400/0x22153cd396b83c94 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826434.622080:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46a800/0x22153cd396b83c7f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1920 expref: 39 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826434.622090:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834400/0x22153cd396b83c94 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826434.622129:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46a800/0x22153cd396b83c7f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1920 expref: 39 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826434.622144:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46a800/0x22153cd396b83c7f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1920 expref: 39 pid: 6518 timeout: 1480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826434.622159:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab921c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6519:1874670585304448:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826434.622308:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf395f3a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787826434.624309:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826434.624408:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab921c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6519:1874670585304448:192.168.203.39@tcp:104: 00010000:00010000:0.0:1787826434.624442:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834400/0x22153cd396b83c94 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826434.625147:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564022784 00000100:00100000:1.0:1787826434.625159:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564022784 00010000:00010000:1.0:1787826434.625201:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46a800/0x22153cd396b83c7f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1920 expref: 40 pid: 6518 timeout: 1480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826434.625240:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1339 00000100:00100000:1.0:1787826434.625248:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf181fe050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:2403:x1874670564022784:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787826434.625263:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787826434.625270:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46a800/0x22153cd396b83c7f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1920 expref: 40 pid: 6518 timeout: 1480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.625287:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46a800/0x22153cd396b83c7f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1920 expref: 40 pid: 6518 timeout: 1480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.625307:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46a800/0x22153cd396b83c7f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1920 expref: 40 pid: 6518 timeout: 1480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.625322:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x15:0x0].0x0 (ffff90cf04f8b100) 00010000:00010000:1.0:1787826434.625327:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834400/0x22153cd396b83c94 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.625335:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834400/0x22153cd396b83c94 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.625342:0:10340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834400/0x22153cd396b83c94 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.625363:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787826434.625415:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf181fe050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+39:2403:x1874670564022784:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 167us (1117us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826434.625423:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1339 00010000:00010000:0.0:1787826434.625563:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834400/0x22153cd396b83c94 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826434.625580:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834400/0x22153cd396b83c94 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826434.625598:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0x15:0x0]: returning size 0 00000004:00080000:0.0:1787826434.625761:0:6519:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x26:0x0], index 1: 0 00010000:00010000:0.0:1787826434.625870:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834400/0x22153cd396b83c94 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826434.625878:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834400/0x22153cd396b83c94 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826434.625884:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834400/0x22153cd396b83c94 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826434.625889:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf3a834400 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:0.0:1787826434.625893:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834400/0x22153cd396b83c94 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826434.625899:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834400/0x22153cd396b83c94 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826434.625908:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x15:0x0].0x0 (ffff90cf04f8b100) 00010000:00010000:0.0:1787826434.625911:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787826434.625914:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834400/0x22153cd396b83c94 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826434.625923:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834400/0x22153cd396b83c94 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826434.625975:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834600/0x22153cd396b83c8d lrc: 1/0,0 mode: --/CR res: [0x240000404:0x13:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1927 expref: 39 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826434.625984:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x13:0x0].0x0 (ffff90cf3ab61200) 00010000:00010000:0.0:1787826434.625986:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787826434.625990:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a834600/0x22153cd396b83c8d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x13:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1927 expref: 39 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826434.625998:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a834600, rc 0) 00000100:00100000:0.0:1787826434.626023:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa87840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:56418:x1874670564022656:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 4223us (4944us total) trans 4294967725 rc 301/301 00000100:00100000:0.0:1787826434.626029:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4091 00000100:00100000:2.0:1787826434.628818:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826434.628928:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564023040 00000100:00100000:3.0:1787826434.628939:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564023040 00000100:00100000:3.0:1787826434.629003:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1284 00000100:00100000:3.0:1787826434.629015:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3ab912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+38:56418:x1874670564023040:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:3.0:1787826434.629417:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3ab912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+39:56418:x1874670564023040:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 404us (611us total) trans 4294967726 rc 0/0 00000100:00100000:3.0:1787826434.629425:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1284 00000100:00100000:3.0:1787826434.631501:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826434.631578:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564023296 00000100:00100000:2.0:1787826434.631588:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564023296 00000100:00100000:2.0:1787826434.631648:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1285 00000100:00100000:2.0:1787826434.631659:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa85e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+39:56418:x1874670564023296:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:2.0:1787826434.632160:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa85e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:56418:x1874670564023296:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 502us (693us total) trans 4294967727 rc 0/0 00000100:00100000:2.0:1787826434.632170:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1285 00000100:00100000:0.0:1787826434.635229:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826434.635662:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564023552 00000100:00100000:3.0:1787826434.635671:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564023552 00000100:00100000:3.0:1787826434.635740:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4092 00000100:00100000:3.0:1787826434.635756:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b4303c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+40:56198:x1874670564023552:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:3.0:1787826434.635785:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787826434.635810:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400400/0x22153cd396b83ca2 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab192e expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.635980:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400c00/0x22153cd396b83ca9 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x13:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.635998:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400c00/0x22153cd396b83ca9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.636011:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400c00/0x22153cd396b83ca9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.636022:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b83cb0 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x13:0x0].0xd5143738 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.636029:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b83cb0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x13:0x0].0xd5143738 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.636035:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b83cb0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x13:0x0].0xd5143738 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.636114:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400200/0x22153cd396b83cb7 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.636122:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400200/0x22153cd396b83cb7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.636130:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400200/0x22153cd396b83cb7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787826434.636141:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0x14:0x0]: returning size 0 00010000:00010000:3.0:1787826434.636227:0:8247:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400c00/0x22153cd396b83ca9 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.636235:0:8247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400c00/0x22153cd396b83ca9 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.636242:0:8247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400c00/0x22153cd396b83ca9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.636248:0:8247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400c00/0x22153cd396b83ca9 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.636256:0:8247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f400c00 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826434.636261:0:8247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400c00/0x22153cd396b83ca9 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.636269:0:8247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400c00/0x22153cd396b83ca9 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.636282:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x13:0x0].0x0 (ffff90cf3ab61200) 00010000:00010000:3.0:1787826434.636286:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826434.636290:0:8247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400c00/0x22153cd396b83ca9 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.636297:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400c00/0x22153cd396b83ca9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.636313:0:8247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b83cb0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x13:0x0].0xd5143738 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.636318:0:8247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b83cb0 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x13:0x0].0xd5143738 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.636324:0:8247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b83cb0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x13:0x0].0xd5143738 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.636328:0:8247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cf2f401800 already unused, calling callback (ffffffffc18f34f0) 00010000:00010000:3.0:1787826434.636331:0:8247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b83cb0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x13:0x0].0xd5143738 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.636337:0:8247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b83cb0 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x13:0x0].0xd5143738 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.636359:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x13:0x0].0xd5143738 (ffff90cf06894b00) 00010000:00010000:3.0:1787826434.636362:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787826434.636371:0:8247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b83cb0 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x13:0x0].0xd5143738 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.636383:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f401800/0x22153cd396b83cb0 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x13:0x0].0xd5143738 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.636431:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400400/0x22153cd396b83ca2 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab192e expref: 43 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.636444:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400200/0x22153cd396b83cb7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab192e expref: 42 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787826434.636452:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x14:0x0].0x0 (ffff90cf06894400) 00010000:00010000:3.0:1787826434.636454:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787826434.636456:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f400200, rc 0) 00000100:00100000:3.0:1787826434.636587:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b4303c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+42:56198:x1874670564023552:12345-192.168.203.39@tcp:101:bash.0 Request processed in 837us (1367us total) trans 4294967728 rc 0/0 00000100:00100000:3.0:1787826434.636599:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4092 00000100:00100000:3.0:1787826434.638647:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826434.639085:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564023680 00000100:00100000:1.0:1787826434.639095:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564023680 00000100:00100000:1.0:1787826434.639161:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4093 00000100:00100000:1.0:1787826434.639172:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+42:56198:x1874670564023680:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:1.0:1787826434.639196:0:32404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826434.639217:0:32404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46ae00/0x22153cd396b83cc5 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1935 expref: -99 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.639268:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46a600/0x22153cd396b83ccc lrc: 3/1,0 mode: --/PR res: [0x240000404:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.639284:0:32404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46a600/0x22153cd396b83ccc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x14:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.639296:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46a600/0x22153cd396b83ccc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x14:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.639430:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46ae00/0x22153cd396b83cc5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x14:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1935 expref: 44 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.639449:0:32404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f46a600/0x22153cd396b83ccc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x14:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1935 expref: 43 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.639458:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x14:0x0].0x0 (ffff90cf06894400) 00010000:00010000:1.0:1787826434.639462:0:32404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787826434.639466:0:32404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46a600, rc 0) 00000100:00100000:1.0:1787826434.639566:0:32404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:56198:x1874670564023680:12345-192.168.203.39@tcp:101:bash.0 Request processed in 395us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826434.639574:0:32404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4093 00000100:00100000:1.0:1787826434.641919:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826434.642013:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564023936 00000100:00100000:2.0:1787826434.642023:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564023936 00000100:00100000:2.0:1787826434.642097:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4094 00000100:00100000:2.0:1787826434.642108:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce06305a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+43:56198:x1874670564023936:12345-192.168.203.39@tcp:36:bash.0 00010000:00010000:2.0:1787826434.642169:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826434.642199:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf2f400200/0x22153cd396b83cb7 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab192e expref: 43 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826434.642219:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x14:0x0].0x0 (ffff90cf06894400) 00010000:00010000:2.0:1787826434.642225:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826434.642675:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b83cd3 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826434.642691:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b83cd3 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826434.642703:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b83cd3 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787826434.642760:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967729 00000004:00010000:2.0:1787826434.642785:0:6518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e95d7000 reply state 00000000606571ab transno 4294967730 ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b83cd3 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826434.642799:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835000/0x22153cd396b83cd3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826434.642805:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x14:0x0].0x0 (ffff90cf06894400) 00010000:00010000:2.0:1787826434.642808:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787826434.642811:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787826434.643068:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce06305a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+45:56198:x1874670564023936:12345-192.168.203.39@tcp:36:bash.0 Request processed in 961us (1161us total) trans 4294967730 rc 0/0 00000100:00100000:2.0:1787826434.643076:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4094 00000020:00080000:2.0:1787826434.643081:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787826434.644628:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826434.644702:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564024064 00000100:00100000:2.0:1787826434.644711:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564024064 00000100:00100000:2.0:1787826434.644767:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4095 00000100:00100000:2.0:1787826434.644778:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b433840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+45:56198:x1874670564024064:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:2.0:1787826434.644802:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787826434.644821:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835a00/0x22153cd396b83cda lrc: 2/0,0 mode: --/CR res: [0x240000404:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab193c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826434.644896:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835a00/0x22153cd396b83cda lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x14:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab193c expref: 46 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826434.644912:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835a00/0x22153cd396b83cda lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x14:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab193c expref: 46 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826434.644941:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x14:0x0].0x0 (ffff90cf06894400) 00010000:00010000:2.0:1787826434.644950:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787826434.644954:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf3a835a00, rc 0) 00000100:00100000:2.0:1787826434.645005:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b433840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+46:56198:x1874670564024064:12345-192.168.203.39@tcp:101:bash.0 Request processed in 229us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787826434.645021:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4095 00000100:00100000:3.0:1787826434.647026:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1787826434.648165:0:30398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564024192 00000100:00100000:1.0:1787826434.648177:0:30398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564024192 00000100:00100000:1.0:1787826434.648348:0:30398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2291 00000100:00100000:1.0:1787826434.648359:0:30398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+6:56198:x1874670564024192:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:1.0:1787826434.648379:0:30398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787826434.648402:0:30398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bacf1a1a/0x22153cd396b83ce1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab1943 expref: -99 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787826434.649046:0:30398:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787826434.649083:0:30398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28:0x0].0x0 since=1380s v=(0 0) 00010000:00010000:1.0:1787826434.649089:0:30398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787826434.649102:0:30398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bacf1a1a/0x22153cd396b83ce1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1943 expref: 7 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.649121:0:30398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bacf1a1a/0x22153cd396b83ce1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab1943 expref: 7 pid: 30398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787826434.649136:0:30398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf2f46b200, rc 0) 00000100:00100000:1.0:1787826434.649398:0:30398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:56198:x1874670564024192:12345-192.168.203.39@tcp:101:bash.0 Request processed in 1039us (2378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787826434.649411:0:30398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2291 00000100:00100000:1.0:1787826434.651370:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826434.651538:0:25422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564024320 00000100:00100000:0.0:1787826434.651547:0:25422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564024320 00002000:00010000:0.0:1787826434.651593:0:25422:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/40 (0->18446744073709551615) 00002000:00100000:0.0:1787826434.651599:0:25422:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf3fb96d00 with x1874670564024320 ext(0->18446744073709551615) 00002000:00010000:0.0:1787826434.651612:0:25422:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf3fb96d00. 00000100:00100000:0.0:1787826434.651649:0:25422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 759 00000100:00100000:0.0:1787826434.651660:0:25422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3fb96d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+7:2404:x1874670564024320:12345-192.168.203.39@tcp:10:bash.0 00002000:00010000:0.0:1787826434.652101:0:25422:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x28:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787826434.652105:0:25422:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x28:0x0] updating lvb mtime from disk: 0 -> 1787826435 00002000:00010000:0.0:1787826434.652109:0:25422:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x28:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787826434.652111:0:25422:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x28:0x0] updating lvb ctime from disk: 0 -> 1787826435 00002000:00010000:0.0:1787826434.652114:0:25422:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x28:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1787826434.652269:0:25422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3fb96d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+8:2404:x1874670564024320:12345-192.168.203.39@tcp:10:bash.0 Request processed in 611us (907us total) trans 21474837032 rc 0/0 00000100:00100000:0.0:1787826434.652278:0:25422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 759 00002000:00010000:0.0:1787826434.652283:0:25422:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/40 (0->18446744073709551615) 00002000:00100000:0.0:1787826434.652286:0:25422:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cf3fb96d00 with x1874670564024320 ext(0->18446744073709551615) 00002000:00010000:0.0:1787826434.652291:0:25422:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cf3fb96d00. 00000100:00100000:0.0:1787826434.654733:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1787826434.654995:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564024576 00000100:00100000:3.0:1787826434.655006:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564024576 00000100:00100000:3.0:1787826434.655130:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1286 00000100:00100000:3.0:1787826434.655141:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce0b430b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+46:56198:x1874670564024576:12345-192.168.203.39@tcp:35:bash.0 00000100:00100000:3.0:1787826434.655619:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90ce0b430b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+47:56198:x1874670564024576:12345-192.168.203.39@tcp:35:bash.0 Request processed in 478us (895us total) trans 4294967731 rc 0/0 00000100:00100000:3.0:1787826434.655629:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1286 00000100:00100000:3.0:1787826434.679542:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826434.679707:0:8247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564024704 00000100:00100000:0.0:1787826434.679721:0:8247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564024704 00000100:00100000:0.0:1787826434.679817:0:8247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4096 00000100:00100000:0.0:1787826434.679829:0:8247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf3aa86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+47:56419:x1874670564024704:12345-192.168.203.39@tcp:101:chown.0 00010000:00010000:0.0:1787826434.679862:0:8247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787826434.679892:0:8247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf0165fc00/0x22153cd396b83ce8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8e7c99ee62ab194a expref: -99 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826434.680060:0:8247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf0165e000/0x22153cd396b83cef lrc: 3/1,0 mode: --/PR res: [0x240000404:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826434.680078:0:8247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf0165e000/0x22153cd396b83cef lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x13:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826434.680093:0:8247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf0165e000/0x22153cd396b83cef lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x13:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787826434.680155:0:8247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000404:0x13:0x0]: returning size 4096 00000004:00200000:0.0:1787826434.680160:0:8247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787826434.680226:0:8247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff90cf0165e000/0x22153cd396b83cef lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x13:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8247 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826434.680261:0:8247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf0165fc00/0x22153cd396b83ce8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab194a expref: 49 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826434.680288:0:8247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf0165e000/0x22153cd396b83cef lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x13:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab194a expref: 48 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826434.680300:0:8247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x13:0x0].0x0 (ffff90cf3ab61200) 00010000:00010000:0.0:1787826434.680303:0:8247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787826434.680307:0:8247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cf0165e000, rc 0) 00000100:00100000:0.0:1787826434.680765:0:8247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf3aa86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:56419:x1874670564024704:12345-192.168.203.39@tcp:101:chown.0 Request processed in 560us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826434.680775:0:8247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4096 00000100:00100000:1.0:1787826434.686116:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1787826434.686219:0:32404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564024960 00000100:00100000:2.0:1787826434.686232:0:32404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564024960 00000100:00100000:2.0:1787826434.686362:0:32404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4097 00000100:00100000:2.0:1787826434.686376:0:32404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90ce055792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:56419:x1874670564024960:12345-192.168.203.39@tcp:36:chown.0 00010000:00010000:2.0:1787826434.686449:0:32404:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787826434.686722:0:32404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf0165e000/0x22153cd396b83cef lrc: 0/0,0 mode: --/PR res: [0x240000404:0x13:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab194a expref: 48 pid: 8247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826434.686751:0:32404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x13:0x0].0x0 (ffff90cf3ab61200) 00010000:00010000:2.0:1787826434.686812:0:32404:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787826434.686845:0:32404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835800/0x22153cd396b83cf6 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826434.686860:0:32404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835c00/0x22153cd396b83c01 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x13:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18fd expref: 47 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826434.686870:0:32404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835800/0x22153cd396b83cf6 lrc: 4/0,1 mode: --/PW res: [0x240000404:0x13:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826434.686976:0:32404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835c00/0x22153cd396b83c01 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x13:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18fd expref: 47 pid: 32404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826434.686992:0:32404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835c00/0x22153cd396b83c01 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x13:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18fd expref: 47 pid: 32404 timeout: 1480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787826434.687009:0:32404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90cf3ab91e00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001_UUID:32404:1874670585304576:192.168.203.39@tcp:104: 00000100:00100000:2.0:1787826434.687172:0:32404:0:(client.c:2715:ptlrpc_set_wait()) set ffff90cf395f3b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787826434.689839:0:32404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90cf3ab91e00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001_UUID:32404:1874670585304576:192.168.203.39@tcp:104: 00010000:00010000:2.0:1787826434.689877:0:32404:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835800/0x22153cd396b83cf6 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x13:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787826434.690131:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1787826434.690251:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874670564025088 00000100:00100000:0.0:1787826434.690260:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874670564025088 00010000:00010000:0.0:1787826434.690303:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835c00/0x22153cd396b83c01 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x13:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18fd expref: 48 pid: 32404 timeout: 1480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787826434.690345:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1340 00000100:00100000:0.0:1787826434.690357:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90cf136d43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+48:2403:x1874670564025088:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787826434.690373:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787826434.690381:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835c00/0x22153cd396b83c01 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x13:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18fd expref: 48 pid: 32404 timeout: 1480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826434.690397:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835c00/0x22153cd396b83c01 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x13:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18fd expref: 48 pid: 32404 timeout: 1480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826434.690430:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835c00/0x22153cd396b83c01 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x13:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x8e7c99ee62ab18fd expref: 48 pid: 32404 timeout: 1480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826434.690447:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x13:0x0].0x0 (ffff90cf3ab61200) 00010000:00010000:0.0:1787826434.690453:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835800/0x22153cd396b83cf6 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x13:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826434.690464:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835800/0x22153cd396b83cf6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x13:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826434.690944:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835800/0x22153cd396b83cf6 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x13:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787826434.690979:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787826434.691056:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90cf136d43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ed01c7-7b8c-4e06-9d82-a6b70e42014a+47:2403:x1874670564025088:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 693us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1787826434.691066:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1340 00010000:00010000:2.0:1787826434.691122:0:32404:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835800/0x22153cd396b83cf6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x13:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787826434.691130:0:32404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff90cf3a835800/0x22153cd396b83cf6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x13:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32404 initiator: MDT1 lru_score: 0 lru_type: 0 Debug log: 67478 lines, 67478 kept, 0 dropped, 0 bad.